[==========] Running 56 tests from 4 test suites.
[----------] Global test environment set-up.
[----------] 30 tests from SecurityITest
[ RUN ] SecurityITest.TestAuthorizationOnListTablets
Loading random data
Initializing database '/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790521920546562-17952-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 27 15:12:00 dist-test-slave-5s2t krb5kdc[17959](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 27 15:12:00 dist-test-slave-5s2t krb5kdc[17959](info): set up 2 sockets
Sep 27 15:12:00 dist-test-slave-5s2t krb5kdc[17959](info): commencing operation
krb5kdc: starting...
WARNING: Logging before InitGoogleLogging() is written to STDERR
W20260927 15:12:01.514810 17952 mini_kdc.cc:121] Time spent starting KDC: real 0.933s user 0.001s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790521920546562-17952-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790521920546562-17952-0/krb5kdc/test-user.keytab.
Sep 27 15:12:01 dist-test-slave-5s2t krb5kdc[17959](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790521921, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-27T15:12:01Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-27T15:12:01Z Disabled control of system clock
WARNING: no policy specified for kudu/127.17.136.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.136.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.136.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790521920546562-17952-0/krb5kdc/kudu_127.17.136.62.keytab.
Entry for principal kudu/127.17.136.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790521920546562-17952-0/krb5kdc/kudu_127.17.136.62.keytab.
I20260927 15:12:01.629871 17952 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu
/tmp/dist-test-taskiFOyeW/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790521920546562-17952-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790521920546562-17952-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790521920546562-17952-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790521920546562-17952-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.136.62:38989
--webserver_interface=127.17.136.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790521920546562-17952-0/krb5kdc/kudu_127.17.136.62.keytab
--principal=kudu/127.17.136.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.136.20:41479
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.136.62:38989
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790521920546562-17952-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790521920546562-17952-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790521920546562-17952-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260927 15:12:01.735062 17972 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260927 15:12:01.735352 17972 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260927 15:12:01.735390 17972 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260927 15:12:01.739269 17972 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260927 15:12:01.739315 17972 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260927 15:12:01.739333 17972 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260927 15:12:01.739347 17972 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260927 15:12:01.739362 17972 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260927 15:12:01.744335 17972 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.136.20:41479
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790521920546562-17952-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790521920546562-17952-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.17.136.62:38989
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790521920546562-17952-0/krb5kdc/kudu_127.17.136.62.keytab
--principal=kudu/127.17.136.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.136.62:38989
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790521920546562-17952-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.17.136.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17972
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790521920546562-17952-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 27 Sep 2026 14:27:13 UTC on ccycloud.quasar-psqrth.root.comops.site
build id 4676138
I20260927 15:12:01.745249 17972 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260927 15:12:01.746160 17972 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260927 15:12:01.754441 17977 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260927 15:12:01.754504 17978 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260927 15:12:01.754521 17972 server_base.cc:1034] running on GCE node
W20260927 15:12:01.754498 17980 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260927 15:12:01.755336 17972 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260927 15:12:01.756381 17972 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260927 15:12:01.757560 17972 hybrid_clock.cc:648] HybridClock initialized: now 1790521921757545 us; error 26 us; skew 500 ppm
Sep 27 15:12:01 dist-test-slave-5s2t krb5kdc[17959](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790521921, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.136.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260927 15:12:01.760245 17972 init.cc:377] Logged in from keytab as kudu/127.17.136.62@KRBTEST.COM (short username kudu)
I20260927 15:12:01.761092 17972 webserver.cc:460] Webserver started at http://127.17.136.62:41579/ using document root <none> and password file <none>
I20260927 15:12:01.761619 17972 fs_manager.cc:359] Metadata directory not provided
I20260927 15:12:01.761690 17972 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260927 15:12:01.761902 17972 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260927 15:12:01.764011 17972 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790521920546562-17952-0/minicluster-data/master-0/data/instance:
uuid: "6399a59db4ad483db9577b3f6368218b"
format_stamp: "Formatted at 2026-09-27 15:12:01 on dist-test-slave-5s2t"
server_key: "cc4a1d74c071d315f0cedfde6bb4d6c5"
server_key_iv: "97643340888b11e9497eeba9be6c9d07"
server_key_version: "encryptionkey@0"
I20260927 15:12:01.764583 17972 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790521920546562-17952-0/minicluster-data/master-0/wal/instance:
uuid: "6399a59db4ad483db9577b3f6368218b"
format_stamp: "Formatted at 2026-09-27 15:12:01 on dist-test-slave-5s2t"
server_key: "cc4a1d74c071d315f0cedfde6bb4d6c5"
server_key_iv: "97643340888b11e9497eeba9be6c9d07"
server_key_version: "encryptionkey@0"
I20260927 15:12:01.768325 17972 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.001s sys 0.003s
I20260927 15:12:01.770833 17987 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260927 15:12:01.772086 17972 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260927 15:12:01.772204 17972 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790521920546562-17952-0/minicluster-data/master-0/data,/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790521920546562-17952-0/minicluster-data/master-0/wal
uuid: "6399a59db4ad483db9577b3f6368218b"
format_stamp: "Formatted at 2026-09-27 15:12:01 on dist-test-slave-5s2t"
server_key: "cc4a1d74c071d315f0cedfde6bb4d6c5"
server_key_iv: "97643340888b11e9497eeba9be6c9d07"
server_key_version: "encryptionkey@0"
I20260927 15:12:01.772302 17972 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790521920546562-17952-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790521920546562-17952-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790521920546562-17952-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260927 15:12:01.802834 17972 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260927 15:12:01.806011 17972 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260927 15:12:01.806196 17972 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260927 15:12:01.813510 17972 rpc_server.cc:307] RPC server started. Bound to: 127.17.136.62:38989
I20260927 15:12:01.813515 18039 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.136.62:38989 every 8 connection(s)
I20260927 15:12:01.814441 17972 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790521920546562-17952-0/minicluster-data/master-0/data/info.pb
I20260927 15:12:01.816223 17952 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu as pid 17972
I20260927 15:12:01.816380 17952 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790521920546562-17952-0/minicluster-data/master-0/wal/instance
I20260927 15:12:01.817754 18040 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:12:01.817991 17952 external_mini_cluster.cc:1428] Setting key e660375eea5bf93fdae4f5f4419efcef
I20260927 15:12:01.823814 18040 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6399a59db4ad483db9577b3f6368218b: Bootstrap starting.
I20260927 15:12:01.825969 18040 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 6399a59db4ad483db9577b3f6368218b: Neither blocks nor log segments found. Creating new log.
I20260927 15:12:01.826807 18040 log.cc:824] T 00000000000000000000000000000000 P 6399a59db4ad483db9577b3f6368218b: Log is configured to *not* fsync() on all Append() calls
I20260927 15:12:01.828702 18040 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6399a59db4ad483db9577b3f6368218b: No bootstrap required, opened a new log
I20260927 15:12:01.832517 18040 raft_consensus.cc:348] T 00000000000000000000000000000000 P 6399a59db4ad483db9577b3f6368218b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6399a59db4ad483db9577b3f6368218b" member_type: VOTER last_known_addr { host: "127.17.136.62" port: 38989 } }
I20260927 15:12:01.832780 18040 raft_consensus.cc:374] T 00000000000000000000000000000000 P 6399a59db4ad483db9577b3f6368218b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:12:01.832839 18040 raft_consensus.cc:729] T 00000000000000000000000000000000 P 6399a59db4ad483db9577b3f6368218b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6399a59db4ad483db9577b3f6368218b, State: Initialized, Role: FOLLOWER
I20260927 15:12:01.833240 18040 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6399a59db4ad483db9577b3f6368218b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6399a59db4ad483db9577b3f6368218b" member_type: VOTER last_known_addr { host: "127.17.136.62" port: 38989 } }
I20260927 15:12:01.833353 18040 raft_consensus.cc:388] T 00000000000000000000000000000000 P 6399a59db4ad483db9577b3f6368218b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260927 15:12:01.833410 18040 raft_consensus.cc:482] T 00000000000000000000000000000000 P 6399a59db4ad483db9577b3f6368218b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260927 15:12:01.833500 18040 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 6399a59db4ad483db9577b3f6368218b [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:12:01.834376 18040 raft_consensus.cc:504] T 00000000000000000000000000000000 P 6399a59db4ad483db9577b3f6368218b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6399a59db4ad483db9577b3f6368218b" member_type: VOTER last_known_addr { host: "127.17.136.62" port: 38989 } }
I20260927 15:12:01.834676 18040 leader_election.cc:302] T 00000000000000000000000000000000 P 6399a59db4ad483db9577b3f6368218b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 6399a59db4ad483db9577b3f6368218b; no voters:
I20260927 15:12:01.834929 18040 leader_election.cc:288] T 00000000000000000000000000000000 P 6399a59db4ad483db9577b3f6368218b [CANDIDATE]: Term 1 election: Requested vote from peers
I20260927 15:12:01.835023 18045 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 6399a59db4ad483db9577b3f6368218b [term 1 FOLLOWER]: Leader election won for term 1
I20260927 15:12:01.835193 18045 raft_consensus.cc:686] T 00000000000000000000000000000000 P 6399a59db4ad483db9577b3f6368218b [term 1 LEADER]: Becoming Leader. State: Replica: 6399a59db4ad483db9577b3f6368218b, State: Running, Role: LEADER
I20260927 15:12:01.835500 18045 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6399a59db4ad483db9577b3f6368218b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6399a59db4ad483db9577b3f6368218b" member_type: VOTER last_known_addr { host: "127.17.136.62" port: 38989 } }
Sep 27 15:12:01 dist-test-slave-5s2t krb5kdc[17959](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790521921, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.136.62@KRBTEST.COM
I20260927 15:12:01.836172 18040 sys_catalog.cc:564] T 00000000000000000000000000000000 P 6399a59db4ad483db9577b3f6368218b [sys.catalog]: configured and running, proceeding with master startup.
I20260927 15:12:01.836963 18046 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6399a59db4ad483db9577b3f6368218b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "6399a59db4ad483db9577b3f6368218b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6399a59db4ad483db9577b3f6368218b" member_type: VOTER last_known_addr { host: "127.17.136.62" port: 38989 } } }
I20260927 15:12:01.837113 18046 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6399a59db4ad483db9577b3f6368218b [sys.catalog]: This master's current role is: LEADER
I20260927 15:12:01.837392 18047 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6399a59db4ad483db9577b3f6368218b [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6399a59db4ad483db9577b3f6368218b. Latest consensus state: current_term: 1 leader_uuid: "6399a59db4ad483db9577b3f6368218b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6399a59db4ad483db9577b3f6368218b" member_type: VOTER last_known_addr { host: "127.17.136.62" port: 38989 } } }
I20260927 15:12:01.837476 18047 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6399a59db4ad483db9577b3f6368218b [sys.catalog]: This master's current role is: LEADER
W20260927 15:12:01.840975 18060 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 6399a59db4ad483db9577b3f6368218b: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260927 15:12:01.841042 18060 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260927 15:12:01.841111 18054 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260927 15:12:01.841903 18054 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260927 15:12:01.842872 18042 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:01.821616 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55458 (local address 127.17.136.62:38989)
0927 15:12:01.822116 (+ 500us) server_negotiation.cc:206] Beginning negotiation
0927 15:12:01.822135 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0927 15:12:01.823157 (+ 1022us) server_negotiation.cc:407] Connection header received
0927 15:12:01.826366 (+ 3209us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:12:01.826388 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:12:01.826771 (+ 383us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:12:01.827133 (+ 362us) server_negotiation.cc:226] Negotiated authn=SASL
0927 15:12:01.829327 (+ 2194us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:01.830801 (+ 1474us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:01.832065 (+ 1264us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:01.832705 (+ 640us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:01.832857 (+ 152us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:01.837003 (+ 4146us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0927 15:12:01.837009 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0927 15:12:01.837024 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0927 15:12:01.837054 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0927 15:12:01.839166 (+ 2112us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:12:01.839809 (+ 643us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:12:01.839815 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:12:01.839820 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:12:01.839959 (+ 139us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:12:01.840379 (+ 420us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:12:01.840382 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:12:01.840384 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:12:01.840846 (+ 462us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0927 15:12:01.841041 (+ 195us) server_negotiation.cc:1035] Waiting for connection context
0927 15:12:01.841690 (+ 649us) server_negotiation.cc:299] Negotiation successful
0927 15:12:01.841965 (+ 275us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":337,"thread_start_us":159,"threads_started":1}
I20260927 15:12:01.847910 18054 catalog_manager.cc:1347] Generated new cluster ID: ac11defe872c41c681e66acdb1f4be1f
I20260927 15:12:01.847963 18054 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260927 15:12:01.863333 18054 catalog_manager.cc:1370] Generated new certificate authority record
I20260927 15:12:01.864650 18054 catalog_manager.cc:1504] Loading token signing keys...
I20260927 15:12:01.876473 18054 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 6399a59db4ad483db9577b3f6368218b: Generated new TSK 0
I20260927 15:12:01.877406 18054 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.17.136.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.136.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.136.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790521920546562-17952-0/krb5kdc/kudu_127.17.136.1.keytab.
Entry for principal kudu/127.17.136.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790521920546562-17952-0/krb5kdc/kudu_127.17.136.1.keytab.
I20260927 15:12:01.908180 17952 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu
/tmp/dist-test-taskiFOyeW/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790521920546562-17952-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790521920546562-17952-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790521920546562-17952-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790521920546562-17952-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.136.1:0
--local_ip_for_outbound_sockets=127.17.136.1
--webserver_interface=127.17.136.1
--webserver_port=0
--tserver_master_addrs=127.17.136.62:38989
--keytab_file=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790521920546562-17952-0/krb5kdc/kudu_127.17.136.1.keytab
--principal=kudu/127.17.136.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.136.20:41479
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790521920546562-17952-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790521920546562-17952-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790521920546562-17952-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260927 15:12:02.013341 18066 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260927 15:12:02.013587 18066 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260927 15:12:02.013629 18066 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260927 15:12:02.017529 18066 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260927 15:12:02.017587 18066 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260927 15:12:02.017644 18066 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.136.1
I20260927 15:12:02.022680 18066 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.136.20:41479
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790521920546562-17952-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790521920546562-17952-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790521920546562-17952-0/krb5kdc/kudu_127.17.136.1.keytab
--principal=kudu/127.17.136.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.136.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790521920546562-17952-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.17.136.1
--webserver_port=0
--tserver_master_addrs=127.17.136.62:38989
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18066
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.136.1
--log_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790521920546562-17952-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 27 Sep 2026 14:27:13 UTC on ccycloud.quasar-psqrth.root.comops.site
build id 4676138
I20260927 15:12:02.023639 18066 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260927 15:12:02.024546 18066 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260927 15:12:02.033433 18072 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260927 15:12:02.033447 18074 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260927 15:12:02.033514 18066 server_base.cc:1034] running on GCE node
W20260927 15:12:02.033669 18071 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260927 15:12:02.034058 18066 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260927 15:12:02.034633 18066 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260927 15:12:02.035780 18066 hybrid_clock.cc:648] HybridClock initialized: now 1790521922035761 us; error 29 us; skew 500 ppm
Sep 27 15:12:02 dist-test-slave-5s2t krb5kdc[17959](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790521922, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.136.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260927 15:12:02.038362 18066 init.cc:377] Logged in from keytab as kudu/127.17.136.1@KRBTEST.COM (short username kudu)
I20260927 15:12:02.039194 18066 webserver.cc:460] Webserver started at http://127.17.136.1:42801/ using document root <none> and password file <none>
I20260927 15:12:02.039723 18066 fs_manager.cc:359] Metadata directory not provided
I20260927 15:12:02.039788 18066 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260927 15:12:02.039985 18066 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260927 15:12:02.041965 18066 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790521920546562-17952-0/minicluster-data/ts-0/data/instance:
uuid: "c90e0ae536214bb4ba4bd5e30d629252"
format_stamp: "Formatted at 2026-09-27 15:12:02 on dist-test-slave-5s2t"
server_key: "ef68db5a4ae1c512da417dbd3d134fe6"
server_key_iv: "7bfda8c1a96ecdfb8446832789b561db"
server_key_version: "encryptionkey@0"
I20260927 15:12:02.042460 18066 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790521920546562-17952-0/minicluster-data/ts-0/wal/instance:
uuid: "c90e0ae536214bb4ba4bd5e30d629252"
format_stamp: "Formatted at 2026-09-27 15:12:02 on dist-test-slave-5s2t"
server_key: "ef68db5a4ae1c512da417dbd3d134fe6"
server_key_iv: "7bfda8c1a96ecdfb8446832789b561db"
server_key_version: "encryptionkey@0"
I20260927 15:12:02.046029 18066 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.004s
I20260927 15:12:02.048420 18081 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260927 15:12:02.049746 18066 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260927 15:12:02.049860 18066 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790521920546562-17952-0/minicluster-data/ts-0/data,/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790521920546562-17952-0/minicluster-data/ts-0/wal
uuid: "c90e0ae536214bb4ba4bd5e30d629252"
format_stamp: "Formatted at 2026-09-27 15:12:02 on dist-test-slave-5s2t"
server_key: "ef68db5a4ae1c512da417dbd3d134fe6"
server_key_iv: "7bfda8c1a96ecdfb8446832789b561db"
server_key_version: "encryptionkey@0"
I20260927 15:12:02.049973 18066 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790521920546562-17952-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790521920546562-17952-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790521920546562-17952-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260927 15:12:02.079741 18066 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260927 15:12:02.082671 18066 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260927 15:12:02.082846 18066 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260927 15:12:02.083469 18066 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260927 15:12:02.084290 18066 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260927 15:12:02.084335 18066 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260927 15:12:02.084386 18066 ts_tablet_manager.cc:610] Registered 0 tablets
I20260927 15:12:02.084414 18066 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260927 15:12:02.092518 18066 rpc_server.cc:307] RPC server started. Bound to: 127.17.136.1:35271
I20260927 15:12:02.092545 18194 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.136.1:35271 every 8 connection(s)
I20260927 15:12:02.093375 18066 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790521920546562-17952-0/minicluster-data/ts-0/data/info.pb
I20260927 15:12:02.093845 17952 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu as pid 18066
I20260927 15:12:02.093935 17952 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790521920546562-17952-0/minicluster-data/ts-0/wal/instance
I20260927 15:12:02.094197 17952 external_mini_cluster.cc:1428] Setting key c542f17060cbef38f06b5797173965cc
WARNING: no policy specified for kudu/127.17.136.2@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.136.2@KRBTEST.COM" created.
Sep 27 15:12:02 dist-test-slave-5s2t krb5kdc[17959](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790521922, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.136.1@KRBTEST.COM for kudu/127.17.136.62@KRBTEST.COM
I20260927 15:12:02.110132 18042 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:02.095065 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.136.1:35635 (local address 127.17.136.62:38989)
0927 15:12:02.095220 (+ 155us) server_negotiation.cc:206] Beginning negotiation
0927 15:12:02.095225 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0927 15:12:02.096584 (+ 1359us) server_negotiation.cc:407] Connection header received
0927 15:12:02.097614 (+ 1030us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:12:02.097617 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:12:02.097661 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:12:02.097724 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0927 15:12:02.099163 (+ 1439us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:02.099788 (+ 625us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:02.101412 (+ 1624us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:02.101645 (+ 233us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:02.101721 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:02.106567 (+ 4846us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0927 15:12:02.106571 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0927 15:12:02.106574 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0927 15:12:02.106603 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0927 15:12:02.107984 (+ 1381us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:12:02.108539 (+ 555us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:12:02.108541 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:12:02.108542 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:12:02.108613 (+ 71us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:12:02.108922 (+ 309us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:12:02.108923 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:12:02.108924 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:12:02.109119 (+ 195us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0927 15:12:02.109193 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0927 15:12:02.109839 (+ 646us) server_negotiation.cc:299] Negotiation successful
0927 15:12:02.110001 (+ 162us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260927 15:12:02.111268 18197 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:02.095720 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.62:38989 (local address 127.17.136.1:35635)
0927 15:12:02.096425 (+ 705us) negotiation.cc:107] Waiting for socket to connect
0927 15:12:02.096478 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0927 15:12:02.097392 (+ 914us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0927 15:12:02.097923 (+ 531us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0927 15:12:02.097932 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0927 15:12:02.098406 (+ 474us) client_negotiation.cc:189] Negotiated authn=SASL
0927 15:12:02.099025 (+ 619us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:12:02.099042 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:12:02.099906 (+ 864us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:12:02.099909 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:12:02.101293 (+ 1384us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:12:02.101303 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:12:02.101789 (+ 486us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:12:02.101793 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:12:02.101990 (+ 197us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:02.102604 (+ 614us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0927 15:12:02.102624 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0927 15:12:02.106394 (+ 3770us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0927 15:12:02.108115 (+ 1721us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0927 15:12:02.108122 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0927 15:12:02.108138 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0927 15:12:02.108455 (+ 317us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0927 15:12:02.108683 (+ 228us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0927 15:12:02.108686 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0927 15:12:02.108688 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0927 15:12:02.108850 (+ 162us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0927 15:12:02.109216 (+ 366us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0927 15:12:02.109223 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0927 15:12:02.109548 (+ 325us) client_negotiation.cc:769] Sending connection context
0927 15:12:02.109769 (+ 221us) client_negotiation.cc:240] Negotiation successful
0927 15:12:02.110141 (+ 372us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":491,"thread_start_us":107,"threads_started":1}
I20260927 15:12:02.112555 18195 heartbeater.cc:347] Connected to a master server at 127.17.136.62:38989
I20260927 15:12:02.112782 18195 heartbeater.cc:464] Registering TS with master...
I20260927 15:12:02.113273 18195 heartbeater.cc:511] Master 127.17.136.62:38989 requested a full tablet report, sending...
I20260927 15:12:02.114784 18004 ts_manager.cc:194] Registered new tserver with Master: c90e0ae536214bb4ba4bd5e30d629252 (127.17.136.1:35271)
I20260927 15:12:02.116025 18004 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.136.1@KRBTEST.COM'} at 127.17.136.1:35635
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.136.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790521920546562-17952-0/krb5kdc/kudu_127.17.136.2.keytab.
Entry for principal kudu/127.17.136.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790521920546562-17952-0/krb5kdc/kudu_127.17.136.2.keytab.
I20260927 15:12:02.122182 17952 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu
/tmp/dist-test-taskiFOyeW/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790521920546562-17952-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790521920546562-17952-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790521920546562-17952-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790521920546562-17952-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.136.2:0
--local_ip_for_outbound_sockets=127.17.136.2
--webserver_interface=127.17.136.2
--webserver_port=0
--tserver_master_addrs=127.17.136.62:38989
--keytab_file=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790521920546562-17952-0/krb5kdc/kudu_127.17.136.2.keytab
--principal=kudu/127.17.136.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.136.20:41479
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790521920546562-17952-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790521920546562-17952-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790521920546562-17952-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260927 15:12:02.226776 18200 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260927 15:12:02.227037 18200 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260927 15:12:02.227094 18200 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260927 15:12:02.231148 18200 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260927 15:12:02.231204 18200 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260927 15:12:02.231302 18200 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.136.2
I20260927 15:12:02.236411 18200 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.136.20:41479
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790521920546562-17952-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790521920546562-17952-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790521920546562-17952-0/krb5kdc/kudu_127.17.136.2.keytab
--principal=kudu/127.17.136.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.136.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790521920546562-17952-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.17.136.2
--webserver_port=0
--tserver_master_addrs=127.17.136.62:38989
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18200
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.136.2
--log_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790521920546562-17952-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 27 Sep 2026 14:27:13 UTC on ccycloud.quasar-psqrth.root.comops.site
build id 4676138
I20260927 15:12:02.237362 18200 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260927 15:12:02.238258 18200 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260927 15:12:02.247221 18205 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260927 15:12:02.247239 18208 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260927 15:12:02.247432 18200 server_base.cc:1034] running on GCE node
W20260927 15:12:02.247217 18206 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260927 15:12:02.247844 18200 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260927 15:12:02.248420 18200 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260927 15:12:02.249579 18200 hybrid_clock.cc:648] HybridClock initialized: now 1790521922249558 us; error 31 us; skew 500 ppm
Sep 27 15:12:02 dist-test-slave-5s2t krb5kdc[17959](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790521922, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.136.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260927 15:12:02.252128 18200 init.cc:377] Logged in from keytab as kudu/127.17.136.2@KRBTEST.COM (short username kudu)
I20260927 15:12:02.252929 18200 webserver.cc:460] Webserver started at http://127.17.136.2:45759/ using document root <none> and password file <none>
I20260927 15:12:02.253440 18200 fs_manager.cc:359] Metadata directory not provided
I20260927 15:12:02.253502 18200 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260927 15:12:02.253680 18200 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260927 15:12:02.255684 18200 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790521920546562-17952-0/minicluster-data/ts-1/data/instance:
uuid: "d97e8cf87826420083bde1279cbcec00"
format_stamp: "Formatted at 2026-09-27 15:12:02 on dist-test-slave-5s2t"
server_key: "bf7f108fe57b723e9a1611606f16a05a"
server_key_iv: "623ff0d07659f3e50781d33c81f12974"
server_key_version: "encryptionkey@0"
I20260927 15:12:02.256193 18200 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790521920546562-17952-0/minicluster-data/ts-1/wal/instance:
uuid: "d97e8cf87826420083bde1279cbcec00"
format_stamp: "Formatted at 2026-09-27 15:12:02 on dist-test-slave-5s2t"
server_key: "bf7f108fe57b723e9a1611606f16a05a"
server_key_iv: "623ff0d07659f3e50781d33c81f12974"
server_key_version: "encryptionkey@0"
I20260927 15:12:02.259653 18200 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.000s
I20260927 15:12:02.261840 18215 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260927 15:12:02.263291 18200 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260927 15:12:02.263398 18200 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790521920546562-17952-0/minicluster-data/ts-1/data,/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790521920546562-17952-0/minicluster-data/ts-1/wal
uuid: "d97e8cf87826420083bde1279cbcec00"
format_stamp: "Formatted at 2026-09-27 15:12:02 on dist-test-slave-5s2t"
server_key: "bf7f108fe57b723e9a1611606f16a05a"
server_key_iv: "623ff0d07659f3e50781d33c81f12974"
server_key_version: "encryptionkey@0"
I20260927 15:12:02.263484 18200 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790521920546562-17952-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790521920546562-17952-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790521920546562-17952-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260927 15:12:02.280894 18200 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260927 15:12:02.283527 18200 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260927 15:12:02.283692 18200 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260927 15:12:02.284260 18200 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260927 15:12:02.285075 18200 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260927 15:12:02.285123 18200 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260927 15:12:02.285175 18200 ts_tablet_manager.cc:610] Registered 0 tablets
I20260927 15:12:02.285199 18200 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260927 15:12:02.293345 18200 rpc_server.cc:307] RPC server started. Bound to: 127.17.136.2:41825
I20260927 15:12:02.293367 18328 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.136.2:41825 every 8 connection(s)
I20260927 15:12:02.294190 18200 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790521920546562-17952-0/minicluster-data/ts-1/data/info.pb
I20260927 15:12:02.297484 17952 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu as pid 18200
I20260927 15:12:02.297603 17952 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790521920546562-17952-0/minicluster-data/ts-1/wal/instance
I20260927 15:12:02.297830 17952 external_mini_cluster.cc:1428] Setting key 95553aa5cf515814b03c3b4a453c8a70
Sep 27 15:12:02 dist-test-slave-5s2t krb5kdc[17959](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790521922, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.136.2@KRBTEST.COM for kudu/127.17.136.62@KRBTEST.COM
WARNING: no policy specified for kudu/127.17.136.3@KRBTEST.COM; defaulting to no policy
I20260927 15:12:02.306748 18042 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:02.295890 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.136.2:56085 (local address 127.17.136.62:38989)
0927 15:12:02.296022 (+ 132us) server_negotiation.cc:206] Beginning negotiation
0927 15:12:02.296026 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0927 15:12:02.297078 (+ 1052us) server_negotiation.cc:407] Connection header received
0927 15:12:02.297970 (+ 892us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:12:02.297973 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:12:02.298028 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:12:02.298099 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0927 15:12:02.299241 (+ 1142us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:02.299773 (+ 532us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:02.300844 (+ 1071us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:02.301055 (+ 211us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:02.301143 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:02.303654 (+ 2511us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0927 15:12:02.303656 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0927 15:12:02.303658 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0927 15:12:02.303679 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0927 15:12:02.304953 (+ 1274us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:12:02.305397 (+ 444us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:12:02.305400 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:12:02.305402 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:12:02.305471 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:12:02.305764 (+ 293us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:12:02.305767 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:12:02.305769 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:12:02.305927 (+ 158us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0927 15:12:02.306007 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0927 15:12:02.306477 (+ 470us) server_negotiation.cc:299] Negotiation successful
0927 15:12:02.306591 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260927 15:12:02.307605 18331 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:02.296338 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.62:38989 (local address 127.17.136.2:56085)
0927 15:12:02.296940 (+ 602us) negotiation.cc:107] Waiting for socket to connect
0927 15:12:02.296978 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0927 15:12:02.297738 (+ 760us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0927 15:12:02.298291 (+ 553us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0927 15:12:02.298298 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0927 15:12:02.298636 (+ 338us) client_negotiation.cc:189] Negotiated authn=SASL
0927 15:12:02.299103 (+ 467us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:12:02.299116 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:12:02.299882 (+ 766us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:12:02.299885 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:12:02.300733 (+ 848us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:12:02.300741 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:12:02.301186 (+ 445us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:12:02.301190 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:12:02.301344 (+ 154us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:02.301888 (+ 544us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0927 15:12:02.301904 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0927 15:12:02.303505 (+ 1601us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0927 15:12:02.305054 (+ 1549us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0927 15:12:02.305060 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0927 15:12:02.305074 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0927 15:12:02.305309 (+ 235us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0927 15:12:02.305546 (+ 237us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0927 15:12:02.305549 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0927 15:12:02.305551 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0927 15:12:02.305682 (+ 131us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0927 15:12:02.306017 (+ 335us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0927 15:12:02.306023 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0927 15:12:02.306250 (+ 227us) client_negotiation.cc:769] Sending connection context
0927 15:12:02.306426 (+ 176us) client_negotiation.cc:240] Negotiation successful
0927 15:12:02.306731 (+ 305us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":424,"thread_start_us":109,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.136.3@KRBTEST.COM" created.
I20260927 15:12:02.308625 18329 heartbeater.cc:347] Connected to a master server at 127.17.136.62:38989
I20260927 15:12:02.308836 18329 heartbeater.cc:464] Registering TS with master...
I20260927 15:12:02.309383 18329 heartbeater.cc:511] Master 127.17.136.62:38989 requested a full tablet report, sending...
I20260927 15:12:02.310454 18004 ts_manager.cc:194] Registered new tserver with Master: d97e8cf87826420083bde1279cbcec00 (127.17.136.2:41825)
I20260927 15:12:02.311200 18004 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.136.2@KRBTEST.COM'} at 127.17.136.2:56085
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.136.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790521920546562-17952-0/krb5kdc/kudu_127.17.136.3.keytab.
Entry for principal kudu/127.17.136.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790521920546562-17952-0/krb5kdc/kudu_127.17.136.3.keytab.
I20260927 15:12:02.322225 17952 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu
/tmp/dist-test-taskiFOyeW/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790521920546562-17952-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790521920546562-17952-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790521920546562-17952-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790521920546562-17952-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.136.3:0
--local_ip_for_outbound_sockets=127.17.136.3
--webserver_interface=127.17.136.3
--webserver_port=0
--tserver_master_addrs=127.17.136.62:38989
--keytab_file=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790521920546562-17952-0/krb5kdc/kudu_127.17.136.3.keytab
--principal=kudu/127.17.136.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.136.20:41479
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790521920546562-17952-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790521920546562-17952-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790521920546562-17952-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260927 15:12:02.429333 18334 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260927 15:12:02.429593 18334 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260927 15:12:02.429637 18334 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260927 15:12:02.433620 18334 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260927 15:12:02.433671 18334 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260927 15:12:02.433730 18334 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.136.3
I20260927 15:12:02.438958 18334 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.136.20:41479
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790521920546562-17952-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790521920546562-17952-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790521920546562-17952-0/krb5kdc/kudu_127.17.136.3.keytab
--principal=kudu/127.17.136.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.136.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790521920546562-17952-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.17.136.3
--webserver_port=0
--tserver_master_addrs=127.17.136.62:38989
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18334
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.136.3
--log_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790521920546562-17952-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 27 Sep 2026 14:27:13 UTC on ccycloud.quasar-psqrth.root.comops.site
build id 4676138
I20260927 15:12:02.439996 18334 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260927 15:12:02.440971 18334 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260927 15:12:02.450273 18342 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260927 15:12:02.450286 18340 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260927 15:12:02.450289 18339 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260927 15:12:02.450335 18334 server_base.cc:1034] running on GCE node
I20260927 15:12:02.450901 18334 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260927 15:12:02.451530 18334 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260927 15:12:02.452694 18334 hybrid_clock.cc:648] HybridClock initialized: now 1790521922452683 us; error 37 us; skew 500 ppm
Sep 27 15:12:02 dist-test-slave-5s2t krb5kdc[17959](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790521922, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.136.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260927 15:12:02.455307 18334 init.cc:377] Logged in from keytab as kudu/127.17.136.3@KRBTEST.COM (short username kudu)
I20260927 15:12:02.456075 18334 webserver.cc:460] Webserver started at http://127.17.136.3:34227/ using document root <none> and password file <none>
I20260927 15:12:02.456566 18334 fs_manager.cc:359] Metadata directory not provided
I20260927 15:12:02.456619 18334 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260927 15:12:02.456777 18334 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260927 15:12:02.458684 18334 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790521920546562-17952-0/minicluster-data/ts-2/data/instance:
uuid: "d2a56510b583457fb577ed27f562dda5"
format_stamp: "Formatted at 2026-09-27 15:12:02 on dist-test-slave-5s2t"
server_key: "3c5803cb619c56d061584ef410c90157"
server_key_iv: "989ce02524b0e00f626e50d2f1c8505b"
server_key_version: "encryptionkey@0"
I20260927 15:12:02.459167 18334 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790521920546562-17952-0/minicluster-data/ts-2/wal/instance:
uuid: "d2a56510b583457fb577ed27f562dda5"
format_stamp: "Formatted at 2026-09-27 15:12:02 on dist-test-slave-5s2t"
server_key: "3c5803cb619c56d061584ef410c90157"
server_key_iv: "989ce02524b0e00f626e50d2f1c8505b"
server_key_version: "encryptionkey@0"
I20260927 15:12:02.462530 18334 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.000s
I20260927 15:12:02.464741 18349 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260927 15:12:02.465912 18334 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260927 15:12:02.466046 18334 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790521920546562-17952-0/minicluster-data/ts-2/data,/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790521920546562-17952-0/minicluster-data/ts-2/wal
uuid: "d2a56510b583457fb577ed27f562dda5"
format_stamp: "Formatted at 2026-09-27 15:12:02 on dist-test-slave-5s2t"
server_key: "3c5803cb619c56d061584ef410c90157"
server_key_iv: "989ce02524b0e00f626e50d2f1c8505b"
server_key_version: "encryptionkey@0"
I20260927 15:12:02.466137 18334 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790521920546562-17952-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790521920546562-17952-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790521920546562-17952-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260927 15:12:02.490393 18334 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260927 15:12:02.493249 18334 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260927 15:12:02.493397 18334 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260927 15:12:02.493921 18334 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260927 15:12:02.494678 18334 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260927 15:12:02.494721 18334 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260927 15:12:02.494758 18334 ts_tablet_manager.cc:610] Registered 0 tablets
I20260927 15:12:02.494777 18334 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260927 15:12:02.502840 18334 rpc_server.cc:307] RPC server started. Bound to: 127.17.136.3:44207
I20260927 15:12:02.502875 18462 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.136.3:44207 every 8 connection(s)
I20260927 15:12:02.503728 18334 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790521920546562-17952-0/minicluster-data/ts-2/data/info.pb
I20260927 15:12:02.507726 17952 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu as pid 18334
I20260927 15:12:02.507814 17952 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790521920546562-17952-0/minicluster-data/ts-2/wal/instance
I20260927 15:12:02.508024 17952 external_mini_cluster.cc:1428] Setting key 167229e14bb67cfa4b7264de3ae32b7d
Sep 27 15:12:02 dist-test-slave-5s2t krb5kdc[17959](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790521922, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.136.3@KRBTEST.COM for kudu/127.17.136.62@KRBTEST.COM
I20260927 15:12:02.516268 18042 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:02.505459 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.136.3:41129 (local address 127.17.136.62:38989)
0927 15:12:02.505592 (+ 133us) server_negotiation.cc:206] Beginning negotiation
0927 15:12:02.505596 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0927 15:12:02.506382 (+ 786us) server_negotiation.cc:407] Connection header received
0927 15:12:02.507666 (+ 1284us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:12:02.507670 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:12:02.507725 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:12:02.507795 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0927 15:12:02.508990 (+ 1195us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:02.509505 (+ 515us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:02.510575 (+ 1070us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:02.510785 (+ 210us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:02.510868 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:02.513157 (+ 2289us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0927 15:12:02.513160 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0927 15:12:02.513162 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0927 15:12:02.513186 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0927 15:12:02.514396 (+ 1210us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:12:02.514859 (+ 463us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:12:02.514862 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:12:02.514863 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:12:02.514942 (+ 79us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:12:02.515234 (+ 292us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:12:02.515237 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:12:02.515239 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:12:02.515447 (+ 208us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0927 15:12:02.515532 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0927 15:12:02.516005 (+ 473us) server_negotiation.cc:299] Negotiation successful
0927 15:12:02.516113 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260927 15:12:02.517022 18465 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:02.505830 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.62:38989 (local address 127.17.136.3:41129)
0927 15:12:02.506245 (+ 415us) negotiation.cc:107] Waiting for socket to connect
0927 15:12:02.506285 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0927 15:12:02.507450 (+ 1165us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0927 15:12:02.507968 (+ 518us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0927 15:12:02.507975 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0927 15:12:02.508314 (+ 339us) client_negotiation.cc:189] Negotiated authn=SASL
0927 15:12:02.508867 (+ 553us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:12:02.508882 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:12:02.509613 (+ 731us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:12:02.509617 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:12:02.510460 (+ 843us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:12:02.510469 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:12:02.510910 (+ 441us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:12:02.510914 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:12:02.511071 (+ 157us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:02.511577 (+ 506us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0927 15:12:02.511593 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0927 15:12:02.512981 (+ 1388us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0927 15:12:02.514507 (+ 1526us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0927 15:12:02.514513 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0927 15:12:02.514527 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0927 15:12:02.514767 (+ 240us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0927 15:12:02.515019 (+ 252us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0927 15:12:02.515022 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0927 15:12:02.515024 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0927 15:12:02.515150 (+ 126us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0927 15:12:02.515541 (+ 391us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0927 15:12:02.515547 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0927 15:12:02.515783 (+ 236us) client_negotiation.cc:769] Sending connection context
0927 15:12:02.515943 (+ 160us) client_negotiation.cc:240] Negotiation successful
0927 15:12:02.516247 (+ 304us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":241,"thread_start_us":109,"threads_started":1}
I20260927 15:12:02.518034 18463 heartbeater.cc:347] Connected to a master server at 127.17.136.62:38989
I20260927 15:12:02.518250 18463 heartbeater.cc:464] Registering TS with master...
I20260927 15:12:02.518707 18463 heartbeater.cc:511] Master 127.17.136.62:38989 requested a full tablet report, sending...
I20260927 15:12:02.519686 18004 ts_manager.cc:194] Registered new tserver with Master: d2a56510b583457fb577ed27f562dda5 (127.17.136.3:44207)
I20260927 15:12:02.520200 18004 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.136.3@KRBTEST.COM'} at 127.17.136.3:41129
I20260927 15:12:02.521785 17952 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Sep 27 15:12:02 dist-test-slave-5s2t krb5kdc[17959](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790521922, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Sep 27 15:12:02 dist-test-slave-5s2t krb5kdc[17959](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790521922, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.17.136.1@KRBTEST.COM
I20260927 15:12:02.547099 18470 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:02.537490 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47040 (local address 127.17.136.1:35271)
0927 15:12:02.537788 (+ 298us) server_negotiation.cc:206] Beginning negotiation
0927 15:12:02.537801 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0927 15:12:02.537831 (+ 30us) server_negotiation.cc:407] Connection header received
0927 15:12:02.537991 (+ 160us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:12:02.538000 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:12:02.538207 (+ 207us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:12:02.538347 (+ 140us) server_negotiation.cc:226] Negotiated authn=SASL
0927 15:12:02.539080 (+ 733us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:02.539984 (+ 904us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:02.540880 (+ 896us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:02.541271 (+ 391us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:02.541374 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:02.543836 (+ 2462us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0927 15:12:02.543844 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0927 15:12:02.543856 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0927 15:12:02.543882 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0927 15:12:02.545324 (+ 1442us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:12:02.545826 (+ 502us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:12:02.545831 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:12:02.545833 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:12:02.545911 (+ 78us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:12:02.546187 (+ 276us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:12:02.546190 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:12:02.546192 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:12:02.546411 (+ 219us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0927 15:12:02.546611 (+ 200us) server_negotiation.cc:1035] Waiting for connection context
0927 15:12:02.546804 (+ 193us) server_negotiation.cc:299] Negotiation successful
0927 15:12:02.546942 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":185,"thread_start_us":79,"threads_started":1}
W20260927 15:12:02.548039 18109 server_base.cc:1116] Unauthorized access attempt to method kudu.tserver.TabletServerService.ListTablets from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:47040
Sep 27 15:12:02 dist-test-slave-5s2t krb5kdc[17959](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790521922, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Sep 27 15:12:02 dist-test-slave-5s2t krb5kdc[17959](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790521922, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.136.1@KRBTEST.COM
I20260927 15:12:02.571163 18470 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:02.563669 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47042 (local address 127.17.136.1:35271)
0927 15:12:02.563774 (+ 105us) server_negotiation.cc:206] Beginning negotiation
0927 15:12:02.563777 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0927 15:12:02.563924 (+ 147us) server_negotiation.cc:407] Connection header received
0927 15:12:02.564028 (+ 104us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:12:02.564030 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:12:02.564068 (+ 38us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:12:02.564134 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0927 15:12:02.564763 (+ 629us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:02.565310 (+ 547us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:02.566089 (+ 779us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:02.566356 (+ 267us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:02.566440 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:02.568559 (+ 2119us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0927 15:12:02.568562 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0927 15:12:02.568564 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0927 15:12:02.568586 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0927 15:12:02.569882 (+ 1296us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:12:02.570209 (+ 327us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:12:02.570211 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:12:02.570213 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:12:02.570281 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:12:02.570494 (+ 213us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:12:02.570497 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:12:02.570499 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:12:02.570654 (+ 155us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0927 15:12:02.570749 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0927 15:12:02.570935 (+ 186us) server_negotiation.cc:299] Negotiation successful
0927 15:12:02.571045 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260927 15:12:02.572124 17952 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu with pid 18066
I20260927 15:12:02.577149 17952 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu with pid 18200
I20260927 15:12:02.581419 17952 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu with pid 18334
I20260927 15:12:02.585399 17952 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu with pid 17972
2026-09-27T15:12:02Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizationOnListTablets (2032 ms)
[ RUN ] SecurityITest.TestAuthorizationOnChecksum
Loading random data
Initializing database '/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790521920546562-17952-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 27 15:12:02 dist-test-slave-5s2t krb5kdc[18477](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 27 15:12:02 dist-test-slave-5s2t krb5kdc[18477](info): set up 2 sockets
Sep 27 15:12:02 dist-test-slave-5s2t krb5kdc[18477](info): commencing operation
krb5kdc: starting...
W20260927 15:12:03.526621 17952 mini_kdc.cc:121] Time spent starting KDC: real 0.921s user 0.003s sys 0.002s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790521920546562-17952-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790521920546562-17952-0/krb5kdc/test-user.keytab.
Sep 27 15:12:03 dist-test-slave-5s2t krb5kdc[18477](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790521923, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-27T15:12:03Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-27T15:12:03Z Disabled control of system clock
WARNING: no policy specified for kudu/127.17.136.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.136.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.136.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790521920546562-17952-0/krb5kdc/kudu_127.17.136.62.keytab.
Entry for principal kudu/127.17.136.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790521920546562-17952-0/krb5kdc/kudu_127.17.136.62.keytab.
I20260927 15:12:03.637342 17952 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu
/tmp/dist-test-taskiFOyeW/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790521920546562-17952-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790521920546562-17952-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790521920546562-17952-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790521920546562-17952-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.136.62:44459
--webserver_interface=127.17.136.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790521920546562-17952-0/krb5kdc/kudu_127.17.136.62.keytab
--principal=kudu/127.17.136.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.136.20:46305
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.136.62:44459
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790521920546562-17952-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790521920546562-17952-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790521920546562-17952-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260927 15:12:03.743173 18490 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260927 15:12:03.743453 18490 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260927 15:12:03.743508 18490 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260927 15:12:03.747386 18490 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260927 15:12:03.747437 18490 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260927 15:12:03.747460 18490 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260927 15:12:03.747480 18490 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260927 15:12:03.747499 18490 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260927 15:12:03.752573 18490 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.136.20:46305
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790521920546562-17952-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790521920546562-17952-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.17.136.62:44459
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790521920546562-17952-0/krb5kdc/kudu_127.17.136.62.keytab
--principal=kudu/127.17.136.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.136.62:44459
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790521920546562-17952-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.17.136.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18490
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790521920546562-17952-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 27 Sep 2026 14:27:13 UTC on ccycloud.quasar-psqrth.root.comops.site
build id 4676138
I20260927 15:12:03.753517 18490 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260927 15:12:03.754454 18490 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260927 15:12:03.762253 18496 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260927 15:12:03.762238 18498 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260927 15:12:03.762238 18495 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260927 15:12:03.762418 18490 server_base.cc:1034] running on GCE node
I20260927 15:12:03.763028 18490 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260927 15:12:03.764045 18490 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260927 15:12:03.765236 18490 hybrid_clock.cc:648] HybridClock initialized: now 1790521923765220 us; error 26 us; skew 500 ppm
Sep 27 15:12:03 dist-test-slave-5s2t krb5kdc[18477](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790521923, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.136.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260927 15:12:03.773665 18490 init.cc:377] Logged in from keytab as kudu/127.17.136.62@KRBTEST.COM (short username kudu)
I20260927 15:12:03.774521 18490 webserver.cc:460] Webserver started at http://127.17.136.62:39769/ using document root <none> and password file <none>
I20260927 15:12:03.775031 18490 fs_manager.cc:359] Metadata directory not provided
I20260927 15:12:03.775089 18490 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260927 15:12:03.775272 18490 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260927 15:12:03.777232 18490 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790521920546562-17952-0/minicluster-data/master-0/data/instance:
uuid: "3b1aa740351241c49b17036c78149435"
format_stamp: "Formatted at 2026-09-27 15:12:03 on dist-test-slave-5s2t"
server_key: "e4d22726571d2e7615f20c1bd36438e9"
server_key_iv: "c870bb8198ab6db985b4abb68be994d2"
server_key_version: "encryptionkey@0"
I20260927 15:12:03.777792 18490 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790521920546562-17952-0/minicluster-data/master-0/wal/instance:
uuid: "3b1aa740351241c49b17036c78149435"
format_stamp: "Formatted at 2026-09-27 15:12:03 on dist-test-slave-5s2t"
server_key: "e4d22726571d2e7615f20c1bd36438e9"
server_key_iv: "c870bb8198ab6db985b4abb68be994d2"
server_key_version: "encryptionkey@0"
I20260927 15:12:03.781267 18490 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260927 15:12:03.783540 18505 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260927 15:12:03.784739 18490 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260927 15:12:03.784847 18490 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790521920546562-17952-0/minicluster-data/master-0/data,/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790521920546562-17952-0/minicluster-data/master-0/wal
uuid: "3b1aa740351241c49b17036c78149435"
format_stamp: "Formatted at 2026-09-27 15:12:03 on dist-test-slave-5s2t"
server_key: "e4d22726571d2e7615f20c1bd36438e9"
server_key_iv: "c870bb8198ab6db985b4abb68be994d2"
server_key_version: "encryptionkey@0"
I20260927 15:12:03.784938 18490 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790521920546562-17952-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790521920546562-17952-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790521920546562-17952-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260927 15:12:03.799182 18490 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260927 15:12:03.802028 18490 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260927 15:12:03.802166 18490 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260927 15:12:03.808732 18490 rpc_server.cc:307] RPC server started. Bound to: 127.17.136.62:44459
I20260927 15:12:03.808777 18557 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.136.62:44459 every 8 connection(s)
I20260927 15:12:03.809600 18490 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790521920546562-17952-0/minicluster-data/master-0/data/info.pb
I20260927 15:12:03.812332 18558 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:12:03.812351 17952 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu as pid 18490
I20260927 15:12:03.812440 17952 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790521920546562-17952-0/minicluster-data/master-0/wal/instance
I20260927 15:12:03.812711 17952 external_mini_cluster.cc:1428] Setting key cef80d0c7d37045c3fd82631f94e12c3
I20260927 15:12:03.818988 18558 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3b1aa740351241c49b17036c78149435: Bootstrap starting.
I20260927 15:12:03.821225 18558 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3b1aa740351241c49b17036c78149435: Neither blocks nor log segments found. Creating new log.
I20260927 15:12:03.821894 18558 log.cc:824] T 00000000000000000000000000000000 P 3b1aa740351241c49b17036c78149435: Log is configured to *not* fsync() on all Append() calls
Sep 27 15:12:03 dist-test-slave-5s2t krb5kdc[18477](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790521923, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.136.62@KRBTEST.COM
I20260927 15:12:03.824209 18558 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3b1aa740351241c49b17036c78149435: No bootstrap required, opened a new log
I20260927 15:12:03.827366 18561 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:03.814058 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55776 (local address 127.17.136.62:44459)
0927 15:12:03.814586 (+ 528us) server_negotiation.cc:206] Beginning negotiation
0927 15:12:03.814606 (+ 20us) server_negotiation.cc:399] Waiting for connection header
0927 15:12:03.814650 (+ 44us) server_negotiation.cc:407] Connection header received
0927 15:12:03.815645 (+ 995us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:12:03.815670 (+ 25us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:12:03.816085 (+ 415us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:12:03.816458 (+ 373us) server_negotiation.cc:226] Negotiated authn=SASL
0927 15:12:03.817708 (+ 1250us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:03.818679 (+ 971us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:03.819591 (+ 912us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:03.820064 (+ 473us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:03.820207 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:03.822626 (+ 2419us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0927 15:12:03.822631 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0927 15:12:03.822648 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0927 15:12:03.822675 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0927 15:12:03.824484 (+ 1809us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:12:03.824887 (+ 403us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:12:03.824893 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:12:03.824898 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:12:03.825033 (+ 135us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:12:03.825253 (+ 220us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:12:03.825256 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:12:03.825258 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:12:03.825739 (+ 481us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0927 15:12:03.825932 (+ 193us) server_negotiation.cc:1035] Waiting for connection context
0927 15:12:03.826112 (+ 180us) server_negotiation.cc:299] Negotiation successful
0927 15:12:03.826417 (+ 305us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":347,"thread_start_us":123,"threads_started":1}
I20260927 15:12:03.828389 18558 raft_consensus.cc:348] T 00000000000000000000000000000000 P 3b1aa740351241c49b17036c78149435 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3b1aa740351241c49b17036c78149435" member_type: VOTER last_known_addr { host: "127.17.136.62" port: 44459 } }
I20260927 15:12:03.828647 18558 raft_consensus.cc:374] T 00000000000000000000000000000000 P 3b1aa740351241c49b17036c78149435 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:12:03.828702 18558 raft_consensus.cc:729] T 00000000000000000000000000000000 P 3b1aa740351241c49b17036c78149435 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3b1aa740351241c49b17036c78149435, State: Initialized, Role: FOLLOWER
I20260927 15:12:03.829144 18558 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3b1aa740351241c49b17036c78149435 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3b1aa740351241c49b17036c78149435" member_type: VOTER last_known_addr { host: "127.17.136.62" port: 44459 } }
I20260927 15:12:03.829290 18558 raft_consensus.cc:388] T 00000000000000000000000000000000 P 3b1aa740351241c49b17036c78149435 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260927 15:12:03.829355 18558 raft_consensus.cc:482] T 00000000000000000000000000000000 P 3b1aa740351241c49b17036c78149435 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260927 15:12:03.829449 18558 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3b1aa740351241c49b17036c78149435 [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:12:03.830274 18558 raft_consensus.cc:504] T 00000000000000000000000000000000 P 3b1aa740351241c49b17036c78149435 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3b1aa740351241c49b17036c78149435" member_type: VOTER last_known_addr { host: "127.17.136.62" port: 44459 } }
I20260927 15:12:03.830590 18558 leader_election.cc:302] T 00000000000000000000000000000000 P 3b1aa740351241c49b17036c78149435 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 3b1aa740351241c49b17036c78149435; no voters:
I20260927 15:12:03.830870 18558 leader_election.cc:288] T 00000000000000000000000000000000 P 3b1aa740351241c49b17036c78149435 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260927 15:12:03.830981 18563 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 3b1aa740351241c49b17036c78149435 [term 1 FOLLOWER]: Leader election won for term 1
I20260927 15:12:03.831184 18563 raft_consensus.cc:686] T 00000000000000000000000000000000 P 3b1aa740351241c49b17036c78149435 [term 1 LEADER]: Becoming Leader. State: Replica: 3b1aa740351241c49b17036c78149435, State: Running, Role: LEADER
I20260927 15:12:03.831517 18563 consensus_queue.cc:237] T 00000000000000000000000000000000 P 3b1aa740351241c49b17036c78149435 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3b1aa740351241c49b17036c78149435" member_type: VOTER last_known_addr { host: "127.17.136.62" port: 44459 } }
I20260927 15:12:03.831990 18558 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3b1aa740351241c49b17036c78149435 [sys.catalog]: configured and running, proceeding with master startup.
I20260927 15:12:03.832965 18565 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3b1aa740351241c49b17036c78149435 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3b1aa740351241c49b17036c78149435. Latest consensus state: current_term: 1 leader_uuid: "3b1aa740351241c49b17036c78149435" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3b1aa740351241c49b17036c78149435" member_type: VOTER last_known_addr { host: "127.17.136.62" port: 44459 } } }
I20260927 15:12:03.833082 18565 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3b1aa740351241c49b17036c78149435 [sys.catalog]: This master's current role is: LEADER
I20260927 15:12:03.833369 18564 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3b1aa740351241c49b17036c78149435 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "3b1aa740351241c49b17036c78149435" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3b1aa740351241c49b17036c78149435" member_type: VOTER last_known_addr { host: "127.17.136.62" port: 44459 } } }
I20260927 15:12:03.833532 18564 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3b1aa740351241c49b17036c78149435 [sys.catalog]: This master's current role is: LEADER
I20260927 15:12:03.833431 18572 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260927 15:12:03.836509 18572 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260927 15:12:03.841918 18572 catalog_manager.cc:1347] Generated new cluster ID: a0fe472d2f8f4e1d946cb4f605715798
I20260927 15:12:03.841981 18572 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260927 15:12:03.868664 18572 catalog_manager.cc:1370] Generated new certificate authority record
I20260927 15:12:03.869671 18572 catalog_manager.cc:1504] Loading token signing keys...
I20260927 15:12:03.873587 18572 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 3b1aa740351241c49b17036c78149435: Generated new TSK 0
I20260927 15:12:03.874208 18572 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.17.136.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.136.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.136.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790521920546562-17952-0/krb5kdc/kudu_127.17.136.1.keytab.
Entry for principal kudu/127.17.136.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790521920546562-17952-0/krb5kdc/kudu_127.17.136.1.keytab.
I20260927 15:12:03.901558 17952 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu
/tmp/dist-test-taskiFOyeW/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790521920546562-17952-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790521920546562-17952-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790521920546562-17952-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790521920546562-17952-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.136.1:0
--local_ip_for_outbound_sockets=127.17.136.1
--webserver_interface=127.17.136.1
--webserver_port=0
--tserver_master_addrs=127.17.136.62:44459
--keytab_file=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790521920546562-17952-0/krb5kdc/kudu_127.17.136.1.keytab
--principal=kudu/127.17.136.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.136.20:46305
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790521920546562-17952-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790521920546562-17952-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790521920546562-17952-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260927 15:12:04.006994 18584 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260927 15:12:04.007242 18584 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260927 15:12:04.007323 18584 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260927 15:12:04.011235 18584 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260927 15:12:04.011328 18584 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260927 15:12:04.011406 18584 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.136.1
I20260927 15:12:04.016582 18584 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.136.20:46305
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790521920546562-17952-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790521920546562-17952-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790521920546562-17952-0/krb5kdc/kudu_127.17.136.1.keytab
--principal=kudu/127.17.136.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.136.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790521920546562-17952-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.17.136.1
--webserver_port=0
--tserver_master_addrs=127.17.136.62:44459
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18584
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.136.1
--log_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790521920546562-17952-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 27 Sep 2026 14:27:13 UTC on ccycloud.quasar-psqrth.root.comops.site
build id 4676138
I20260927 15:12:04.017582 18584 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260927 15:12:04.018545 18584 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260927 15:12:04.027429 18589 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260927 15:12:04.027439 18590 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260927 15:12:04.027441 18592 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260927 15:12:04.027638 18584 server_base.cc:1034] running on GCE node
I20260927 15:12:04.028031 18584 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260927 15:12:04.028661 18584 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260927 15:12:04.029814 18584 hybrid_clock.cc:648] HybridClock initialized: now 1790521924029795 us; error 31 us; skew 500 ppm
Sep 27 15:12:04 dist-test-slave-5s2t krb5kdc[18477](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790521924, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.136.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260927 15:12:04.032480 18584 init.cc:377] Logged in from keytab as kudu/127.17.136.1@KRBTEST.COM (short username kudu)
I20260927 15:12:04.033334 18584 webserver.cc:460] Webserver started at http://127.17.136.1:35777/ using document root <none> and password file <none>
I20260927 15:12:04.033840 18584 fs_manager.cc:359] Metadata directory not provided
I20260927 15:12:04.033895 18584 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260927 15:12:04.034050 18584 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260927 15:12:04.036064 18584 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790521920546562-17952-0/minicluster-data/ts-0/data/instance:
uuid: "05a91e64a61d4538af8d7117bbe3274e"
format_stamp: "Formatted at 2026-09-27 15:12:04 on dist-test-slave-5s2t"
server_key: "5be3884d1de6b26d2f6daf65c31042a2"
server_key_iv: "d7b1257068814f0f4ac20dcb2c8f075f"
server_key_version: "encryptionkey@0"
I20260927 15:12:04.036589 18584 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790521920546562-17952-0/minicluster-data/ts-0/wal/instance:
uuid: "05a91e64a61d4538af8d7117bbe3274e"
format_stamp: "Formatted at 2026-09-27 15:12:04 on dist-test-slave-5s2t"
server_key: "5be3884d1de6b26d2f6daf65c31042a2"
server_key_iv: "d7b1257068814f0f4ac20dcb2c8f075f"
server_key_version: "encryptionkey@0"
I20260927 15:12:04.040134 18584 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260927 15:12:04.042455 18599 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260927 15:12:04.043675 18584 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260927 15:12:04.043776 18584 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790521920546562-17952-0/minicluster-data/ts-0/data,/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790521920546562-17952-0/minicluster-data/ts-0/wal
uuid: "05a91e64a61d4538af8d7117bbe3274e"
format_stamp: "Formatted at 2026-09-27 15:12:04 on dist-test-slave-5s2t"
server_key: "5be3884d1de6b26d2f6daf65c31042a2"
server_key_iv: "d7b1257068814f0f4ac20dcb2c8f075f"
server_key_version: "encryptionkey@0"
I20260927 15:12:04.043866 18584 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790521920546562-17952-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790521920546562-17952-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790521920546562-17952-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260927 15:12:04.067540 18584 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260927 15:12:04.070490 18584 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260927 15:12:04.070663 18584 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260927 15:12:04.071239 18584 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260927 15:12:04.072093 18584 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260927 15:12:04.072137 18584 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260927 15:12:04.072188 18584 ts_tablet_manager.cc:610] Registered 0 tablets
I20260927 15:12:04.072214 18584 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260927 15:12:04.080642 18584 rpc_server.cc:307] RPC server started. Bound to: 127.17.136.1:33363
I20260927 15:12:04.080675 18712 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.136.1:33363 every 8 connection(s)
I20260927 15:12:04.081489 18584 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790521920546562-17952-0/minicluster-data/ts-0/data/info.pb
I20260927 15:12:04.087471 17952 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu as pid 18584
I20260927 15:12:04.087566 17952 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790521920546562-17952-0/minicluster-data/ts-0/wal/instance
I20260927 15:12:04.087826 17952 external_mini_cluster.cc:1428] Setting key 71c9a26737cc98470547854fe93a6888
Sep 27 15:12:04 dist-test-slave-5s2t krb5kdc[18477](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790521924, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.136.1@KRBTEST.COM for kudu/127.17.136.62@KRBTEST.COM
I20260927 15:12:04.094548 18561 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:04.083199 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.136.1:41839 (local address 127.17.136.62:44459)
0927 15:12:04.083365 (+ 166us) server_negotiation.cc:206] Beginning negotiation
0927 15:12:04.083369 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0927 15:12:04.084173 (+ 804us) server_negotiation.cc:407] Connection header received
0927 15:12:04.085011 (+ 838us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:12:04.085014 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:12:04.085059 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:12:04.085130 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0927 15:12:04.086219 (+ 1089us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:04.086746 (+ 527us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:04.087963 (+ 1217us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:04.088265 (+ 302us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:04.088370 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:04.090851 (+ 2481us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0927 15:12:04.090854 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0927 15:12:04.090856 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0927 15:12:04.090880 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0927 15:12:04.092325 (+ 1445us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:12:04.092903 (+ 578us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:12:04.092906 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:12:04.092907 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:12:04.093001 (+ 94us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:12:04.093403 (+ 402us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:12:04.093407 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:12:04.093408 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:12:04.093602 (+ 194us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0927 15:12:04.093692 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0927 15:12:04.094304 (+ 612us) server_negotiation.cc:299] Negotiation successful
0927 15:12:04.094425 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
I20260927 15:12:04.095813 18715 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:04.083618 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.62:44459 (local address 127.17.136.1:41839)
0927 15:12:04.084027 (+ 409us) negotiation.cc:107] Waiting for socket to connect
0927 15:12:04.084068 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0927 15:12:04.084793 (+ 725us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0927 15:12:04.085276 (+ 483us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0927 15:12:04.085282 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0927 15:12:04.085626 (+ 344us) client_negotiation.cc:189] Negotiated authn=SASL
0927 15:12:04.086090 (+ 464us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:12:04.086103 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:12:04.086832 (+ 729us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:12:04.086834 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:12:04.087860 (+ 1026us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:12:04.087869 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:12:04.088406 (+ 537us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:12:04.088411 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:12:04.088546 (+ 135us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:04.089106 (+ 560us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0927 15:12:04.089127 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0927 15:12:04.090686 (+ 1559us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0927 15:12:04.092435 (+ 1749us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0927 15:12:04.092441 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0927 15:12:04.092458 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0927 15:12:04.092790 (+ 332us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0927 15:12:04.093097 (+ 307us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0927 15:12:04.093100 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0927 15:12:04.093102 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0927 15:12:04.093276 (+ 174us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0927 15:12:04.093711 (+ 435us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0927 15:12:04.093718 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0927 15:12:04.094039 (+ 321us) client_negotiation.cc:769] Sending connection context
0927 15:12:04.094272 (+ 233us) client_negotiation.cc:240] Negotiation successful
0927 15:12:04.094704 (+ 432us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":234,"thread_start_us":104,"threads_started":1}
WARNING: no policy specified for kudu/127.17.136.2@KRBTEST.COM; defaulting to no policy
I20260927 15:12:04.097033 18713 heartbeater.cc:347] Connected to a master server at 127.17.136.62:44459
I20260927 15:12:04.097254 18713 heartbeater.cc:464] Registering TS with master...
I20260927 15:12:04.097733 18713 heartbeater.cc:511] Master 127.17.136.62:44459 requested a full tablet report, sending...
I20260927 15:12:04.099169 18522 ts_manager.cc:194] Registered new tserver with Master: 05a91e64a61d4538af8d7117bbe3274e (127.17.136.1:33363)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.136.2@KRBTEST.COM" created.
I20260927 15:12:04.100596 18522 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.136.1@KRBTEST.COM'} at 127.17.136.1:41839
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.136.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790521920546562-17952-0/krb5kdc/kudu_127.17.136.2.keytab.
Entry for principal kudu/127.17.136.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790521920546562-17952-0/krb5kdc/kudu_127.17.136.2.keytab.
I20260927 15:12:04.113387 17952 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu
/tmp/dist-test-taskiFOyeW/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790521920546562-17952-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790521920546562-17952-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790521920546562-17952-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790521920546562-17952-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.136.2:0
--local_ip_for_outbound_sockets=127.17.136.2
--webserver_interface=127.17.136.2
--webserver_port=0
--tserver_master_addrs=127.17.136.62:44459
--keytab_file=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790521920546562-17952-0/krb5kdc/kudu_127.17.136.2.keytab
--principal=kudu/127.17.136.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.136.20:46305
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790521920546562-17952-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790521920546562-17952-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790521920546562-17952-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260927 15:12:04.217900 18718 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260927 15:12:04.218146 18718 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260927 15:12:04.218187 18718 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260927 15:12:04.222100 18718 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260927 15:12:04.222158 18718 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260927 15:12:04.222215 18718 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.136.2
I20260927 15:12:04.227326 18718 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.136.20:46305
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790521920546562-17952-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790521920546562-17952-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790521920546562-17952-0/krb5kdc/kudu_127.17.136.2.keytab
--principal=kudu/127.17.136.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.136.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790521920546562-17952-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.17.136.2
--webserver_port=0
--tserver_master_addrs=127.17.136.62:44459
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18718
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.136.2
--log_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790521920546562-17952-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 27 Sep 2026 14:27:13 UTC on ccycloud.quasar-psqrth.root.comops.site
build id 4676138
I20260927 15:12:04.228296 18718 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260927 15:12:04.229249 18718 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260927 15:12:04.238821 18724 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260927 15:12:04.238890 18726 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260927 15:12:04.238890 18723 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260927 15:12:04.239039 18718 server_base.cc:1034] running on GCE node
I20260927 15:12:04.239562 18718 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260927 15:12:04.240200 18718 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260927 15:12:04.241365 18718 hybrid_clock.cc:648] HybridClock initialized: now 1790521924241349 us; error 27 us; skew 500 ppm
Sep 27 15:12:04 dist-test-slave-5s2t krb5kdc[18477](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790521924, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.136.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260927 15:12:04.243933 18718 init.cc:377] Logged in from keytab as kudu/127.17.136.2@KRBTEST.COM (short username kudu)
I20260927 15:12:04.244724 18718 webserver.cc:460] Webserver started at http://127.17.136.2:35229/ using document root <none> and password file <none>
I20260927 15:12:04.245239 18718 fs_manager.cc:359] Metadata directory not provided
I20260927 15:12:04.245299 18718 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260927 15:12:04.245508 18718 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260927 15:12:04.247579 18718 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790521920546562-17952-0/minicluster-data/ts-1/data/instance:
uuid: "35d994fa4064447c8a30be7d936010dc"
format_stamp: "Formatted at 2026-09-27 15:12:04 on dist-test-slave-5s2t"
server_key: "e825b970760df878c06d8e59b51b93c6"
server_key_iv: "ad8950f71cbfaa55533ee02726d56e9f"
server_key_version: "encryptionkey@0"
I20260927 15:12:04.248096 18718 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790521920546562-17952-0/minicluster-data/ts-1/wal/instance:
uuid: "35d994fa4064447c8a30be7d936010dc"
format_stamp: "Formatted at 2026-09-27 15:12:04 on dist-test-slave-5s2t"
server_key: "e825b970760df878c06d8e59b51b93c6"
server_key_iv: "ad8950f71cbfaa55533ee02726d56e9f"
server_key_version: "encryptionkey@0"
I20260927 15:12:04.251588 18718 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.000s
I20260927 15:12:04.254041 18733 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260927 15:12:04.255319 18718 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260927 15:12:04.255432 18718 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790521920546562-17952-0/minicluster-data/ts-1/data,/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790521920546562-17952-0/minicluster-data/ts-1/wal
uuid: "35d994fa4064447c8a30be7d936010dc"
format_stamp: "Formatted at 2026-09-27 15:12:04 on dist-test-slave-5s2t"
server_key: "e825b970760df878c06d8e59b51b93c6"
server_key_iv: "ad8950f71cbfaa55533ee02726d56e9f"
server_key_version: "encryptionkey@0"
I20260927 15:12:04.255540 18718 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790521920546562-17952-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790521920546562-17952-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790521920546562-17952-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260927 15:12:04.274727 18718 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260927 15:12:04.277802 18718 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260927 15:12:04.277979 18718 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260927 15:12:04.278548 18718 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260927 15:12:04.279371 18718 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260927 15:12:04.279417 18718 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260927 15:12:04.279479 18718 ts_tablet_manager.cc:610] Registered 0 tablets
I20260927 15:12:04.279506 18718 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260927 15:12:04.288046 18718 rpc_server.cc:307] RPC server started. Bound to: 127.17.136.2:36933
I20260927 15:12:04.288080 18846 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.136.2:36933 every 8 connection(s)
I20260927 15:12:04.289044 18718 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790521920546562-17952-0/minicluster-data/ts-1/data/info.pb
Sep 27 15:12:04 dist-test-slave-5s2t krb5kdc[18477](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790521924, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.136.2@KRBTEST.COM for kudu/127.17.136.62@KRBTEST.COM
I20260927 15:12:04.298869 17952 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu as pid 18718
I20260927 15:12:04.299034 17952 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790521920546562-17952-0/minicluster-data/ts-1/wal/instance
I20260927 15:12:04.299335 17952 external_mini_cluster.cc:1428] Setting key c20f935a5c27d252ea47a4739f31b9ec
I20260927 15:12:04.301939 18561 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:04.290799 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.136.2:42443 (local address 127.17.136.62:44459)
0927 15:12:04.290958 (+ 159us) server_negotiation.cc:206] Beginning negotiation
0927 15:12:04.290963 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0927 15:12:04.291843 (+ 880us) server_negotiation.cc:407] Connection header received
0927 15:12:04.292729 (+ 886us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:12:04.292733 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:12:04.292781 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:12:04.292857 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0927 15:12:04.294014 (+ 1157us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:04.294561 (+ 547us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:04.295734 (+ 1173us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:04.295975 (+ 241us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:04.296064 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:04.298457 (+ 2393us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0927 15:12:04.298460 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0927 15:12:04.298462 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0927 15:12:04.298488 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0927 15:12:04.299936 (+ 1448us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:12:04.300397 (+ 461us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:12:04.300400 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:12:04.300402 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:12:04.300508 (+ 106us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:12:04.300888 (+ 380us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:12:04.300890 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:12:04.300891 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:12:04.301067 (+ 176us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0927 15:12:04.301137 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0927 15:12:04.301721 (+ 584us) server_negotiation.cc:299] Negotiation successful
0927 15:12:04.301822 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260927 15:12:04.302914 18849 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:04.291196 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.62:44459 (local address 127.17.136.2:42443)
0927 15:12:04.291689 (+ 493us) negotiation.cc:107] Waiting for socket to connect
0927 15:12:04.291732 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0927 15:12:04.292516 (+ 784us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0927 15:12:04.293011 (+ 495us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0927 15:12:04.293018 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0927 15:12:04.293364 (+ 346us) client_negotiation.cc:189] Negotiated authn=SASL
0927 15:12:04.293866 (+ 502us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:12:04.293880 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:12:04.294657 (+ 777us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:12:04.294660 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:12:04.295619 (+ 959us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:12:04.295628 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:12:04.296105 (+ 477us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:12:04.296108 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:12:04.296245 (+ 137us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:04.296798 (+ 553us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0927 15:12:04.296815 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0927 15:12:04.298268 (+ 1453us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0927 15:12:04.300050 (+ 1782us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0927 15:12:04.300054 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0927 15:12:04.300066 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0927 15:12:04.300303 (+ 237us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0927 15:12:04.300599 (+ 296us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0927 15:12:04.300601 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0927 15:12:04.300603 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0927 15:12:04.300787 (+ 184us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0927 15:12:04.301167 (+ 380us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0927 15:12:04.301173 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0927 15:12:04.301473 (+ 300us) client_negotiation.cc:769] Sending connection context
0927 15:12:04.301672 (+ 199us) client_negotiation.cc:240] Negotiation successful
0927 15:12:04.302017 (+ 345us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":294,"thread_start_us":106,"threads_started":1}
I20260927 15:12:04.303974 18847 heartbeater.cc:347] Connected to a master server at 127.17.136.62:44459
I20260927 15:12:04.304201 18847 heartbeater.cc:464] Registering TS with master...
I20260927 15:12:04.304663 18847 heartbeater.cc:511] Master 127.17.136.62:44459 requested a full tablet report, sending...
I20260927 15:12:04.305691 18522 ts_manager.cc:194] Registered new tserver with Master: 35d994fa4064447c8a30be7d936010dc (127.17.136.2:36933)
I20260927 15:12:04.306267 18522 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.136.2@KRBTEST.COM'} at 127.17.136.2:42443
WARNING: no policy specified for kudu/127.17.136.3@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.136.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.136.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790521920546562-17952-0/krb5kdc/kudu_127.17.136.3.keytab.
Entry for principal kudu/127.17.136.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790521920546562-17952-0/krb5kdc/kudu_127.17.136.3.keytab.
I20260927 15:12:04.325878 17952 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu
/tmp/dist-test-taskiFOyeW/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790521920546562-17952-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790521920546562-17952-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790521920546562-17952-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790521920546562-17952-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.136.3:0
--local_ip_for_outbound_sockets=127.17.136.3
--webserver_interface=127.17.136.3
--webserver_port=0
--tserver_master_addrs=127.17.136.62:44459
--keytab_file=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790521920546562-17952-0/krb5kdc/kudu_127.17.136.3.keytab
--principal=kudu/127.17.136.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.136.20:46305
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790521920546562-17952-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790521920546562-17952-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790521920546562-17952-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260927 15:12:04.435570 18852 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260927 15:12:04.435802 18852 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260927 15:12:04.435843 18852 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260927 15:12:04.439740 18852 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260927 15:12:04.439790 18852 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260927 15:12:04.439852 18852 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.136.3
I20260927 15:12:04.444913 18852 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.136.20:46305
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790521920546562-17952-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790521920546562-17952-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790521920546562-17952-0/krb5kdc/kudu_127.17.136.3.keytab
--principal=kudu/127.17.136.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.136.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790521920546562-17952-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.17.136.3
--webserver_port=0
--tserver_master_addrs=127.17.136.62:44459
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18852
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.136.3
--log_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790521920546562-17952-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 27 Sep 2026 14:27:13 UTC on ccycloud.quasar-psqrth.root.comops.site
build id 4676138
I20260927 15:12:04.445873 18852 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260927 15:12:04.446799 18852 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260927 15:12:04.455787 18857 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260927 15:12:04.455798 18860 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260927 15:12:04.455823 18858 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260927 15:12:04.455924 18852 server_base.cc:1034] running on GCE node
I20260927 15:12:04.456439 18852 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260927 15:12:04.457044 18852 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260927 15:12:04.458204 18852 hybrid_clock.cc:648] HybridClock initialized: now 1790521924458178 us; error 35 us; skew 500 ppm
Sep 27 15:12:04 dist-test-slave-5s2t krb5kdc[18477](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790521924, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.136.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260927 15:12:04.460817 18852 init.cc:377] Logged in from keytab as kudu/127.17.136.3@KRBTEST.COM (short username kudu)
I20260927 15:12:04.461680 18852 webserver.cc:460] Webserver started at http://127.17.136.3:41387/ using document root <none> and password file <none>
I20260927 15:12:04.462195 18852 fs_manager.cc:359] Metadata directory not provided
I20260927 15:12:04.462258 18852 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260927 15:12:04.462440 18852 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260927 15:12:04.464406 18852 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790521920546562-17952-0/minicluster-data/ts-2/data/instance:
uuid: "a75f63f3329f474b92fcb34553477ec0"
format_stamp: "Formatted at 2026-09-27 15:12:04 on dist-test-slave-5s2t"
server_key: "10746fba9b37d30e2c862dbb3dd01dcf"
server_key_iv: "89a21d9ec103f5b3a9c8e57b7070a5cc"
server_key_version: "encryptionkey@0"
I20260927 15:12:04.464898 18852 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790521920546562-17952-0/minicluster-data/ts-2/wal/instance:
uuid: "a75f63f3329f474b92fcb34553477ec0"
format_stamp: "Formatted at 2026-09-27 15:12:04 on dist-test-slave-5s2t"
server_key: "10746fba9b37d30e2c862dbb3dd01dcf"
server_key_iv: "89a21d9ec103f5b3a9c8e57b7070a5cc"
server_key_version: "encryptionkey@0"
I20260927 15:12:04.468310 18852 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.001s
I20260927 15:12:04.470625 18867 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260927 15:12:04.471849 18852 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260927 15:12:04.471966 18852 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790521920546562-17952-0/minicluster-data/ts-2/data,/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790521920546562-17952-0/minicluster-data/ts-2/wal
uuid: "a75f63f3329f474b92fcb34553477ec0"
format_stamp: "Formatted at 2026-09-27 15:12:04 on dist-test-slave-5s2t"
server_key: "10746fba9b37d30e2c862dbb3dd01dcf"
server_key_iv: "89a21d9ec103f5b3a9c8e57b7070a5cc"
server_key_version: "encryptionkey@0"
I20260927 15:12:04.472050 18852 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790521920546562-17952-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790521920546562-17952-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790521920546562-17952-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260927 15:12:04.485561 18852 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260927 15:12:04.488515 18852 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260927 15:12:04.488674 18852 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260927 15:12:04.489297 18852 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260927 15:12:04.490044 18852 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260927 15:12:04.490203 18852 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260927 15:12:04.490295 18852 ts_tablet_manager.cc:610] Registered 0 tablets
I20260927 15:12:04.490327 18852 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260927 15:12:04.498497 18852 rpc_server.cc:307] RPC server started. Bound to: 127.17.136.3:37565
I20260927 15:12:04.498533 18980 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.136.3:37565 every 8 connection(s)
I20260927 15:12:04.499366 18852 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790521920546562-17952-0/minicluster-data/ts-2/data/info.pb
I20260927 15:12:04.501907 17952 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu as pid 18852
I20260927 15:12:04.502041 17952 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790521920546562-17952-0/minicluster-data/ts-2/wal/instance
I20260927 15:12:04.502286 17952 external_mini_cluster.cc:1428] Setting key 3a5e4590b11df92406ac079117fa37e5
Sep 27 15:12:04 dist-test-slave-5s2t krb5kdc[18477](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790521924, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.136.3@KRBTEST.COM for kudu/127.17.136.62@KRBTEST.COM
I20260927 15:12:04.512017 18561 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:04.501153 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.136.3:34323 (local address 127.17.136.62:44459)
0927 15:12:04.501288 (+ 135us) server_negotiation.cc:206] Beginning negotiation
0927 15:12:04.501292 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0927 15:12:04.502131 (+ 839us) server_negotiation.cc:407] Connection header received
0927 15:12:04.503607 (+ 1476us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:12:04.503610 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:12:04.503662 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:12:04.503731 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0927 15:12:04.504916 (+ 1185us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:04.505444 (+ 528us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:04.506525 (+ 1081us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:04.506730 (+ 205us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:04.506811 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:04.509138 (+ 2327us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0927 15:12:04.509142 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0927 15:12:04.509144 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0927 15:12:04.509165 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0927 15:12:04.510236 (+ 1071us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:12:04.510659 (+ 423us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:12:04.510663 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:12:04.510665 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:12:04.510735 (+ 70us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:12:04.511026 (+ 291us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:12:04.511030 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:12:04.511031 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:12:04.511199 (+ 168us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0927 15:12:04.511298 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0927 15:12:04.511748 (+ 450us) server_negotiation.cc:299] Negotiation successful
0927 15:12:04.511861 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260927 15:12:04.512748 18983 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:04.501520 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.62:44459 (local address 127.17.136.3:34323)
0927 15:12:04.501979 (+ 459us) negotiation.cc:107] Waiting for socket to connect
0927 15:12:04.502038 (+ 59us) client_negotiation.cc:174] Beginning negotiation
0927 15:12:04.503417 (+ 1379us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0927 15:12:04.503914 (+ 497us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0927 15:12:04.503921 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0927 15:12:04.504332 (+ 411us) client_negotiation.cc:189] Negotiated authn=SASL
0927 15:12:04.504792 (+ 460us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:12:04.504805 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:12:04.505549 (+ 744us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:12:04.505553 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:12:04.506410 (+ 857us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:12:04.506419 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:12:04.506850 (+ 431us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:12:04.506854 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:12:04.507036 (+ 182us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:04.507547 (+ 511us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0927 15:12:04.507562 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0927 15:12:04.508969 (+ 1407us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0927 15:12:04.510331 (+ 1362us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0927 15:12:04.510336 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0927 15:12:04.510349 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0927 15:12:04.510574 (+ 225us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0927 15:12:04.510810 (+ 236us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0927 15:12:04.510813 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0927 15:12:04.510815 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0927 15:12:04.510940 (+ 125us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0927 15:12:04.511299 (+ 359us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0927 15:12:04.511305 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0927 15:12:04.511529 (+ 224us) client_negotiation.cc:769] Sending connection context
0927 15:12:04.511696 (+ 167us) client_negotiation.cc:240] Negotiation successful
0927 15:12:04.511985 (+ 289us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":266,"thread_start_us":108,"threads_started":1}
I20260927 15:12:04.513679 18981 heartbeater.cc:347] Connected to a master server at 127.17.136.62:44459
I20260927 15:12:04.513864 18981 heartbeater.cc:464] Registering TS with master...
I20260927 15:12:04.514271 18981 heartbeater.cc:511] Master 127.17.136.62:44459 requested a full tablet report, sending...
I20260927 15:12:04.515184 18522 ts_manager.cc:194] Registered new tserver with Master: a75f63f3329f474b92fcb34553477ec0 (127.17.136.3:37565)
I20260927 15:12:04.515815 17952 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260927 15:12:04.515826 18522 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.136.3@KRBTEST.COM'} at 127.17.136.3:34323
I20260927 15:12:04.525468 18561 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:04.518931 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55788 (local address 127.17.136.62:44459)
0927 15:12:04.519024 (+ 93us) server_negotiation.cc:206] Beginning negotiation
0927 15:12:04.519028 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0927 15:12:04.519173 (+ 145us) server_negotiation.cc:407] Connection header received
0927 15:12:04.519282 (+ 109us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:12:04.519284 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:12:04.519319 (+ 35us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:12:04.519382 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0927 15:12:04.519937 (+ 555us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:04.520466 (+ 529us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:04.521414 (+ 948us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:04.521626 (+ 212us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:04.521698 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:04.523040 (+ 1342us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0927 15:12:04.523043 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0927 15:12:04.523045 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0927 15:12:04.523066 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0927 15:12:04.524270 (+ 1204us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:12:04.524618 (+ 348us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:12:04.524620 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:12:04.524621 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:12:04.524691 (+ 70us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:12:04.524865 (+ 174us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:12:04.524867 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:12:04.524868 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:12:04.525046 (+ 178us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0927 15:12:04.525138 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0927 15:12:04.525279 (+ 141us) server_negotiation.cc:299] Negotiation successful
0927 15:12:04.525360 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260927 15:12:04.529525 18522 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:55788:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:12:04.532482 18522 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:12:04.545717 18992 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:04.540023 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.3:37565 (local address 127.0.0.1:58810)
0927 15:12:04.540382 (+ 359us) negotiation.cc:107] Waiting for socket to connect
0927 15:12:04.540441 (+ 59us) client_negotiation.cc:174] Beginning negotiation
0927 15:12:04.540581 (+ 140us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0927 15:12:04.541742 (+ 1161us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0927 15:12:04.541746 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0927 15:12:04.541765 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0927 15:12:04.541892 (+ 127us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:12:04.541898 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:12:04.543086 (+ 1188us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:12:04.543090 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:12:04.544408 (+ 1318us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:12:04.544419 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:12:04.545227 (+ 808us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:12:04.545230 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:12:04.545328 (+ 98us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:04.545362 (+ 34us) client_negotiation.cc:769] Sending connection context
0927 15:12:04.545462 (+ 100us) client_negotiation.cc:240] Negotiation successful
0927 15:12:04.545569 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":156,"mutex_wait_us":1,"thread_start_us":81,"threads_started":1}
I20260927 15:12:04.546033 18993 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:04.540152 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58810 (local address 127.17.136.3:37565)
0927 15:12:04.541257 (+ 1105us) server_negotiation.cc:206] Beginning negotiation
0927 15:12:04.541270 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0927 15:12:04.541294 (+ 24us) server_negotiation.cc:407] Connection header received
0927 15:12:04.541366 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:12:04.541372 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:12:04.541584 (+ 212us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:12:04.542033 (+ 449us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0927 15:12:04.542175 (+ 142us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:04.542966 (+ 791us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:04.544529 (+ 1563us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:04.545125 (+ 596us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:04.545217 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:04.545358 (+ 141us) server_negotiation.cc:1035] Waiting for connection context
0927 15:12:04.545789 (+ 431us) server_negotiation.cc:299] Negotiation successful
0927 15:12:04.545886 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1004,"thread_start_us":155,"threads_started":1}
I20260927 15:12:04.546238 18996 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:04.540790 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55938 (local address 127.17.136.2:36933)
0927 15:12:04.541257 (+ 467us) server_negotiation.cc:206] Beginning negotiation
0927 15:12:04.541269 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0927 15:12:04.541291 (+ 22us) server_negotiation.cc:407] Connection header received
0927 15:12:04.541370 (+ 79us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:12:04.541376 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:12:04.541548 (+ 172us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:12:04.541879 (+ 331us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0927 15:12:04.542153 (+ 274us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:04.543207 (+ 1054us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:04.544562 (+ 1355us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:04.545330 (+ 768us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:04.545467 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:04.545598 (+ 131us) server_negotiation.cc:1035] Waiting for connection context
0927 15:12:04.545998 (+ 400us) server_negotiation.cc:299] Negotiation successful
0927 15:12:04.546098 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":368,"thread_start_us":105,"threads_started":1}
I20260927 15:12:04.546238 18997 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:04.541107 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56516 (local address 127.17.136.1:33363)
0927 15:12:04.541679 (+ 572us) server_negotiation.cc:206] Beginning negotiation
0927 15:12:04.541692 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0927 15:12:04.541711 (+ 19us) server_negotiation.cc:407] Connection header received
0927 15:12:04.541775 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:12:04.541780 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:12:04.541939 (+ 159us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:12:04.542055 (+ 116us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0927 15:12:04.542425 (+ 370us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:04.543478 (+ 1053us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:04.544725 (+ 1247us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:04.545468 (+ 743us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:04.545552 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:04.545671 (+ 119us) server_negotiation.cc:1035] Waiting for connection context
0927 15:12:04.546020 (+ 349us) server_negotiation.cc:299] Negotiation successful
0927 15:12:04.546098 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":484,"thread_start_us":122,"threads_started":1}
I20260927 15:12:04.546458 18995 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:04.540719 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.1:33363 (local address 127.0.0.1:56516)
0927 15:12:04.540919 (+ 200us) negotiation.cc:107] Waiting for socket to connect
0927 15:12:04.540932 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0927 15:12:04.541010 (+ 78us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0927 15:12:04.542202 (+ 1192us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0927 15:12:04.542205 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0927 15:12:04.542221 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0927 15:12:04.542305 (+ 84us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:12:04.542310 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:12:04.543591 (+ 1281us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:12:04.543594 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:12:04.544605 (+ 1011us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:12:04.544615 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:12:04.545669 (+ 1054us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:12:04.545673 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:12:04.545773 (+ 100us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:04.545795 (+ 22us) client_negotiation.cc:769] Sending connection context
0927 15:12:04.545863 (+ 68us) client_negotiation.cc:240] Negotiation successful
0927 15:12:04.545927 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":151,"thread_start_us":85,"threads_started":1}
I20260927 15:12:04.545926 18994 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:04.540359 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.2:36933 (local address 127.0.0.1:55938)
0927 15:12:04.540586 (+ 227us) negotiation.cc:107] Waiting for socket to connect
0927 15:12:04.540597 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0927 15:12:04.540665 (+ 68us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0927 15:12:04.541704 (+ 1039us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0927 15:12:04.541710 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0927 15:12:04.541732 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0927 15:12:04.541930 (+ 198us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:12:04.541939 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:12:04.543353 (+ 1414us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:12:04.543356 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:12:04.544457 (+ 1101us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:12:04.544464 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:12:04.545471 (+ 1007us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:12:04.545474 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:12:04.545572 (+ 98us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:04.545592 (+ 20us) client_negotiation.cc:769] Sending connection context
0927 15:12:04.545661 (+ 69us) client_negotiation.cc:240] Negotiation successful
0927 15:12:04.545716 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":171,"mutex_wait_us":40,"thread_start_us":108,"threads_started":1}
I20260927 15:12:04.549005 18647 tablet_service.cc:1467] Processing CreateTablet for tablet d972c25d55ff498ca852c21a7fd8748f (DEFAULT_TABLE table=test-table [id=5e2c97cd66e24174a5c2d0f7815b18a4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:12:04.549082 18781 tablet_service.cc:1467] Processing CreateTablet for tablet d972c25d55ff498ca852c21a7fd8748f (DEFAULT_TABLE table=test-table [id=5e2c97cd66e24174a5c2d0f7815b18a4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:12:04.549901 18647 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d972c25d55ff498ca852c21a7fd8748f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:12:04.550046 18781 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d972c25d55ff498ca852c21a7fd8748f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:12:04.549707 18915 tablet_service.cc:1467] Processing CreateTablet for tablet d972c25d55ff498ca852c21a7fd8748f (DEFAULT_TABLE table=test-table [id=5e2c97cd66e24174a5c2d0f7815b18a4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:12:04.550545 18915 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d972c25d55ff498ca852c21a7fd8748f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:12:04.555564 18998 tablet_bootstrap.cc:492] T d972c25d55ff498ca852c21a7fd8748f P 05a91e64a61d4538af8d7117bbe3274e: Bootstrap starting.
I20260927 15:12:04.557135 18999 tablet_bootstrap.cc:492] T d972c25d55ff498ca852c21a7fd8748f P a75f63f3329f474b92fcb34553477ec0: Bootstrap starting.
I20260927 15:12:04.557135 19000 tablet_bootstrap.cc:492] T d972c25d55ff498ca852c21a7fd8748f P 35d994fa4064447c8a30be7d936010dc: Bootstrap starting.
I20260927 15:12:04.558243 18998 tablet_bootstrap.cc:654] T d972c25d55ff498ca852c21a7fd8748f P 05a91e64a61d4538af8d7117bbe3274e: Neither blocks nor log segments found. Creating new log.
I20260927 15:12:04.559152 18999 tablet_bootstrap.cc:654] T d972c25d55ff498ca852c21a7fd8748f P a75f63f3329f474b92fcb34553477ec0: Neither blocks nor log segments found. Creating new log.
I20260927 15:12:04.559231 18998 log.cc:824] T d972c25d55ff498ca852c21a7fd8748f P 05a91e64a61d4538af8d7117bbe3274e: Log is configured to *not* fsync() on all Append() calls
I20260927 15:12:04.559511 19000 tablet_bootstrap.cc:654] T d972c25d55ff498ca852c21a7fd8748f P 35d994fa4064447c8a30be7d936010dc: Neither blocks nor log segments found. Creating new log.
I20260927 15:12:04.560328 19000 log.cc:824] T d972c25d55ff498ca852c21a7fd8748f P 35d994fa4064447c8a30be7d936010dc: Log is configured to *not* fsync() on all Append() calls
I20260927 15:12:04.560384 18999 log.cc:824] T d972c25d55ff498ca852c21a7fd8748f P a75f63f3329f474b92fcb34553477ec0: Log is configured to *not* fsync() on all Append() calls
I20260927 15:12:04.562062 18998 tablet_bootstrap.cc:492] T d972c25d55ff498ca852c21a7fd8748f P 05a91e64a61d4538af8d7117bbe3274e: No bootstrap required, opened a new log
I20260927 15:12:04.562145 19000 tablet_bootstrap.cc:492] T d972c25d55ff498ca852c21a7fd8748f P 35d994fa4064447c8a30be7d936010dc: No bootstrap required, opened a new log
I20260927 15:12:04.562140 18999 tablet_bootstrap.cc:492] T d972c25d55ff498ca852c21a7fd8748f P a75f63f3329f474b92fcb34553477ec0: No bootstrap required, opened a new log
I20260927 15:12:04.562248 18998 ts_tablet_manager.cc:1397] T d972c25d55ff498ca852c21a7fd8748f P 05a91e64a61d4538af8d7117bbe3274e: Time spent bootstrapping tablet: real 0.007s user 0.000s sys 0.003s
I20260927 15:12:04.562312 19000 ts_tablet_manager.cc:1397] T d972c25d55ff498ca852c21a7fd8748f P 35d994fa4064447c8a30be7d936010dc: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s
I20260927 15:12:04.562312 18999 ts_tablet_manager.cc:1397] T d972c25d55ff498ca852c21a7fd8748f P a75f63f3329f474b92fcb34553477ec0: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s
I20260927 15:12:04.564980 18998 raft_consensus.cc:348] T d972c25d55ff498ca852c21a7fd8748f P 05a91e64a61d4538af8d7117bbe3274e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a75f63f3329f474b92fcb34553477ec0" member_type: VOTER last_known_addr { host: "127.17.136.3" port: 37565 } } peers { permanent_uuid: "05a91e64a61d4538af8d7117bbe3274e" member_type: VOTER last_known_addr { host: "127.17.136.1" port: 33363 } } peers { permanent_uuid: "35d994fa4064447c8a30be7d936010dc" member_type: VOTER last_known_addr { host: "127.17.136.2" port: 36933 } }
I20260927 15:12:04.565197 18998 raft_consensus.cc:374] T d972c25d55ff498ca852c21a7fd8748f P 05a91e64a61d4538af8d7117bbe3274e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:12:04.565266 18998 raft_consensus.cc:729] T d972c25d55ff498ca852c21a7fd8748f P 05a91e64a61d4538af8d7117bbe3274e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 05a91e64a61d4538af8d7117bbe3274e, State: Initialized, Role: FOLLOWER
I20260927 15:12:04.565663 18998 consensus_queue.cc:260] T d972c25d55ff498ca852c21a7fd8748f P 05a91e64a61d4538af8d7117bbe3274e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a75f63f3329f474b92fcb34553477ec0" member_type: VOTER last_known_addr { host: "127.17.136.3" port: 37565 } } peers { permanent_uuid: "05a91e64a61d4538af8d7117bbe3274e" member_type: VOTER last_known_addr { host: "127.17.136.1" port: 33363 } } peers { permanent_uuid: "35d994fa4064447c8a30be7d936010dc" member_type: VOTER last_known_addr { host: "127.17.136.2" port: 36933 } }
I20260927 15:12:04.565919 19000 raft_consensus.cc:348] T d972c25d55ff498ca852c21a7fd8748f P 35d994fa4064447c8a30be7d936010dc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a75f63f3329f474b92fcb34553477ec0" member_type: VOTER last_known_addr { host: "127.17.136.3" port: 37565 } } peers { permanent_uuid: "05a91e64a61d4538af8d7117bbe3274e" member_type: VOTER last_known_addr { host: "127.17.136.1" port: 33363 } } peers { permanent_uuid: "35d994fa4064447c8a30be7d936010dc" member_type: VOTER last_known_addr { host: "127.17.136.2" port: 36933 } }
I20260927 15:12:04.565936 18999 raft_consensus.cc:348] T d972c25d55ff498ca852c21a7fd8748f P a75f63f3329f474b92fcb34553477ec0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a75f63f3329f474b92fcb34553477ec0" member_type: VOTER last_known_addr { host: "127.17.136.3" port: 37565 } } peers { permanent_uuid: "05a91e64a61d4538af8d7117bbe3274e" member_type: VOTER last_known_addr { host: "127.17.136.1" port: 33363 } } peers { permanent_uuid: "35d994fa4064447c8a30be7d936010dc" member_type: VOTER last_known_addr { host: "127.17.136.2" port: 36933 } }
I20260927 15:12:04.566179 18999 raft_consensus.cc:374] T d972c25d55ff498ca852c21a7fd8748f P a75f63f3329f474b92fcb34553477ec0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:12:04.566238 19000 raft_consensus.cc:374] T d972c25d55ff498ca852c21a7fd8748f P 35d994fa4064447c8a30be7d936010dc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:12:04.566263 18713 heartbeater.cc:503] Master 127.17.136.62:44459 was elected leader, sending a full tablet report...
I20260927 15:12:04.566269 18999 raft_consensus.cc:729] T d972c25d55ff498ca852c21a7fd8748f P a75f63f3329f474b92fcb34553477ec0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a75f63f3329f474b92fcb34553477ec0, State: Initialized, Role: FOLLOWER
I20260927 15:12:04.566321 19000 raft_consensus.cc:729] T d972c25d55ff498ca852c21a7fd8748f P 35d994fa4064447c8a30be7d936010dc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35d994fa4064447c8a30be7d936010dc, State: Initialized, Role: FOLLOWER
I20260927 15:12:04.566605 18998 ts_tablet_manager.cc:1428] T d972c25d55ff498ca852c21a7fd8748f P 05a91e64a61d4538af8d7117bbe3274e: Time spent starting tablet: real 0.004s user 0.004s sys 0.001s
I20260927 15:12:04.566708 18999 consensus_queue.cc:260] T d972c25d55ff498ca852c21a7fd8748f P a75f63f3329f474b92fcb34553477ec0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a75f63f3329f474b92fcb34553477ec0" member_type: VOTER last_known_addr { host: "127.17.136.3" port: 37565 } } peers { permanent_uuid: "05a91e64a61d4538af8d7117bbe3274e" member_type: VOTER last_known_addr { host: "127.17.136.1" port: 33363 } } peers { permanent_uuid: "35d994fa4064447c8a30be7d936010dc" member_type: VOTER last_known_addr { host: "127.17.136.2" port: 36933 } }
I20260927 15:12:04.566708 19000 consensus_queue.cc:260] T d972c25d55ff498ca852c21a7fd8748f P 35d994fa4064447c8a30be7d936010dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a75f63f3329f474b92fcb34553477ec0" member_type: VOTER last_known_addr { host: "127.17.136.3" port: 37565 } } peers { permanent_uuid: "05a91e64a61d4538af8d7117bbe3274e" member_type: VOTER last_known_addr { host: "127.17.136.1" port: 33363 } } peers { permanent_uuid: "35d994fa4064447c8a30be7d936010dc" member_type: VOTER last_known_addr { host: "127.17.136.2" port: 36933 } }
I20260927 15:12:04.567507 18981 heartbeater.cc:503] Master 127.17.136.62:44459 was elected leader, sending a full tablet report...
I20260927 15:12:04.567613 19000 ts_tablet_manager.cc:1428] T d972c25d55ff498ca852c21a7fd8748f P 35d994fa4064447c8a30be7d936010dc: Time spent starting tablet: real 0.005s user 0.006s sys 0.000s
I20260927 15:12:04.567613 18999 ts_tablet_manager.cc:1428] T d972c25d55ff498ca852c21a7fd8748f P a75f63f3329f474b92fcb34553477ec0: Time spent starting tablet: real 0.005s user 0.006s sys 0.000s
I20260927 15:12:04.568043 18847 heartbeater.cc:503] Master 127.17.136.62:44459 was elected leader, sending a full tablet report...
W20260927 15:12:04.582532 18714 tablet.cc:2369] T d972c25d55ff498ca852c21a7fd8748f P 05a91e64a61d4538af8d7117bbe3274e: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260927 15:12:04.750412 18982 tablet.cc:2369] T d972c25d55ff498ca852c21a7fd8748f P a75f63f3329f474b92fcb34553477ec0: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260927 15:12:04.790180 18848 tablet.cc:2369] T d972c25d55ff498ca852c21a7fd8748f P 35d994fa4064447c8a30be7d936010dc: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260927 15:12:04.970052 19006 raft_consensus.cc:482] T d972c25d55ff498ca852c21a7fd8748f P a75f63f3329f474b92fcb34553477ec0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:12:04.970299 19006 raft_consensus.cc:504] T d972c25d55ff498ca852c21a7fd8748f P a75f63f3329f474b92fcb34553477ec0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a75f63f3329f474b92fcb34553477ec0" member_type: VOTER last_known_addr { host: "127.17.136.3" port: 37565 } } peers { permanent_uuid: "05a91e64a61d4538af8d7117bbe3274e" member_type: VOTER last_known_addr { host: "127.17.136.1" port: 33363 } } peers { permanent_uuid: "35d994fa4064447c8a30be7d936010dc" member_type: VOTER last_known_addr { host: "127.17.136.2" port: 36933 } }
I20260927 15:12:04.971534 19006 leader_election.cc:288] T d972c25d55ff498ca852c21a7fd8748f P a75f63f3329f474b92fcb34553477ec0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 05a91e64a61d4538af8d7117bbe3274e (127.17.136.1:33363), 35d994fa4064447c8a30be7d936010dc (127.17.136.2:36933)
I20260927 15:12:04.974778 19005 raft_consensus.cc:482] T d972c25d55ff498ca852c21a7fd8748f P 35d994fa4064447c8a30be7d936010dc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:12:04.975034 18983 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:04.971811 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.1:33363 (local address 127.17.136.3:51197)
0927 15:12:04.972002 (+ 191us) negotiation.cc:107] Waiting for socket to connect
0927 15:12:04.972019 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0927 15:12:04.972112 (+ 93us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0927 15:12:04.972341 (+ 229us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0927 15:12:04.972344 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0927 15:12:04.972359 (+ 15us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0927 15:12:04.972490 (+ 131us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:12:04.972495 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:12:04.973188 (+ 693us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:12:04.973191 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:12:04.974019 (+ 828us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:12:04.974028 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:12:04.974617 (+ 589us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:12:04.974620 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:12:04.974717 (+ 97us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:04.974739 (+ 22us) client_negotiation.cc:769] Sending connection context
0927 15:12:04.974805 (+ 66us) client_negotiation.cc:240] Negotiation successful
0927 15:12:04.974885 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":114,"mutex_wait_us":3}
I20260927 15:12:04.974977 19005 raft_consensus.cc:504] T d972c25d55ff498ca852c21a7fd8748f P 35d994fa4064447c8a30be7d936010dc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a75f63f3329f474b92fcb34553477ec0" member_type: VOTER last_known_addr { host: "127.17.136.3" port: 37565 } } peers { permanent_uuid: "05a91e64a61d4538af8d7117bbe3274e" member_type: VOTER last_known_addr { host: "127.17.136.1" port: 33363 } } peers { permanent_uuid: "35d994fa4064447c8a30be7d936010dc" member_type: VOTER last_known_addr { host: "127.17.136.2" port: 36933 } }
I20260927 15:12:04.975075 18997 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:04.971880 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.136.3:51197 (local address 127.17.136.1:33363)
0927 15:12:04.972052 (+ 172us) server_negotiation.cc:206] Beginning negotiation
0927 15:12:04.972056 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0927 15:12:04.972072 (+ 16us) server_negotiation.cc:407] Connection header received
0927 15:12:04.972218 (+ 146us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:12:04.972220 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:12:04.972262 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:12:04.972322 (+ 60us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0927 15:12:04.972586 (+ 264us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:04.973090 (+ 504us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:04.974130 (+ 1040us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:04.974501 (+ 371us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:04.974617 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:04.974671 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0927 15:12:04.974853 (+ 182us) server_negotiation.cc:299] Negotiation successful
0927 15:12:04.974931 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260927 15:12:04.975178 18996 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:04.971980 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.136.3:54227 (local address 127.17.136.2:36933)
0927 15:12:04.972099 (+ 119us) server_negotiation.cc:206] Beginning negotiation
0927 15:12:04.972104 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0927 15:12:04.972260 (+ 156us) server_negotiation.cc:407] Connection header received
0927 15:12:04.972394 (+ 134us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:12:04.972397 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:12:04.972439 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:12:04.972499 (+ 60us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0927 15:12:04.972739 (+ 240us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:04.973241 (+ 502us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:04.974222 (+ 981us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:04.974615 (+ 393us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:04.974717 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:04.974787 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0927 15:12:04.974981 (+ 194us) server_negotiation.cc:299] Negotiation successful
0927 15:12:04.975051 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260927 15:12:04.975509 19007 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:04.971829 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.2:36933 (local address 127.17.136.3:54227)
0927 15:12:04.972175 (+ 346us) negotiation.cc:107] Waiting for socket to connect
0927 15:12:04.972185 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0927 15:12:04.972288 (+ 103us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0927 15:12:04.972513 (+ 225us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0927 15:12:04.972516 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0927 15:12:04.972530 (+ 14us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0927 15:12:04.972646 (+ 116us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:12:04.972651 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:12:04.973337 (+ 686us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:12:04.973341 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:12:04.974119 (+ 778us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:12:04.974126 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:12:04.974750 (+ 624us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:12:04.974754 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:12:04.974855 (+ 101us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:04.974877 (+ 22us) client_negotiation.cc:769] Sending connection context
0927 15:12:04.975318 (+ 441us) client_negotiation.cc:240] Negotiation successful
0927 15:12:04.975386 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":290,"mutex_wait_us":1,"thread_start_us":81,"threads_started":1}
I20260927 15:12:04.975677 18667 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d972c25d55ff498ca852c21a7fd8748f" candidate_uuid: "a75f63f3329f474b92fcb34553477ec0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "05a91e64a61d4538af8d7117bbe3274e" is_pre_election: true
I20260927 15:12:04.976002 18667 raft_consensus.cc:2454] T d972c25d55ff498ca852c21a7fd8748f P 05a91e64a61d4538af8d7117bbe3274e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a75f63f3329f474b92fcb34553477ec0 in term 0.
I20260927 15:12:04.976181 18801 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d972c25d55ff498ca852c21a7fd8748f" candidate_uuid: "a75f63f3329f474b92fcb34553477ec0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35d994fa4064447c8a30be7d936010dc" is_pre_election: true
I20260927 15:12:04.976389 18801 raft_consensus.cc:2454] T d972c25d55ff498ca852c21a7fd8748f P 35d994fa4064447c8a30be7d936010dc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a75f63f3329f474b92fcb34553477ec0 in term 0.
I20260927 15:12:04.976472 18870 leader_election.cc:302] T d972c25d55ff498ca852c21a7fd8748f P a75f63f3329f474b92fcb34553477ec0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05a91e64a61d4538af8d7117bbe3274e, a75f63f3329f474b92fcb34553477ec0; no voters:
I20260927 15:12:04.976220 19005 leader_election.cc:288] T d972c25d55ff498ca852c21a7fd8748f P 35d994fa4064447c8a30be7d936010dc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a75f63f3329f474b92fcb34553477ec0 (127.17.136.3:37565), 05a91e64a61d4538af8d7117bbe3274e (127.17.136.1:33363)
I20260927 15:12:04.976982 19006 raft_consensus.cc:2781] T d972c25d55ff498ca852c21a7fd8748f P a75f63f3329f474b92fcb34553477ec0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 15:12:04.977073 19006 raft_consensus.cc:482] T d972c25d55ff498ca852c21a7fd8748f P a75f63f3329f474b92fcb34553477ec0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 15:12:04.977118 19006 raft_consensus.cc:3037] T d972c25d55ff498ca852c21a7fd8748f P a75f63f3329f474b92fcb34553477ec0 [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:12:04.978240 19006 raft_consensus.cc:504] T d972c25d55ff498ca852c21a7fd8748f P a75f63f3329f474b92fcb34553477ec0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a75f63f3329f474b92fcb34553477ec0" member_type: VOTER last_known_addr { host: "127.17.136.3" port: 37565 } } peers { permanent_uuid: "05a91e64a61d4538af8d7117bbe3274e" member_type: VOTER last_known_addr { host: "127.17.136.1" port: 33363 } } peers { permanent_uuid: "35d994fa4064447c8a30be7d936010dc" member_type: VOTER last_known_addr { host: "127.17.136.2" port: 36933 } }
I20260927 15:12:04.978561 19006 leader_election.cc:288] T d972c25d55ff498ca852c21a7fd8748f P a75f63f3329f474b92fcb34553477ec0 [CANDIDATE]: Term 1 election: Requested vote from peers 05a91e64a61d4538af8d7117bbe3274e (127.17.136.1:33363), 35d994fa4064447c8a30be7d936010dc (127.17.136.2:36933)
I20260927 15:12:04.978855 18801 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d972c25d55ff498ca852c21a7fd8748f" candidate_uuid: "a75f63f3329f474b92fcb34553477ec0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35d994fa4064447c8a30be7d936010dc"
I20260927 15:12:04.978961 18801 raft_consensus.cc:3037] T d972c25d55ff498ca852c21a7fd8748f P 35d994fa4064447c8a30be7d936010dc [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:12:04.979086 18667 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d972c25d55ff498ca852c21a7fd8748f" candidate_uuid: "a75f63f3329f474b92fcb34553477ec0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "05a91e64a61d4538af8d7117bbe3274e"
I20260927 15:12:04.979206 18667 raft_consensus.cc:3037] T d972c25d55ff498ca852c21a7fd8748f P 05a91e64a61d4538af8d7117bbe3274e [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:12:04.980202 18801 raft_consensus.cc:2454] T d972c25d55ff498ca852c21a7fd8748f P 35d994fa4064447c8a30be7d936010dc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a75f63f3329f474b92fcb34553477ec0 in term 1.
I20260927 15:12:04.980508 18868 leader_election.cc:302] T d972c25d55ff498ca852c21a7fd8748f P a75f63f3329f474b92fcb34553477ec0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35d994fa4064447c8a30be7d936010dc, a75f63f3329f474b92fcb34553477ec0; no voters:
I20260927 15:12:04.980675 19006 raft_consensus.cc:2781] T d972c25d55ff498ca852c21a7fd8748f P a75f63f3329f474b92fcb34553477ec0 [term 1 FOLLOWER]: Leader election won for term 1
I20260927 15:12:04.980710 18667 raft_consensus.cc:2454] T d972c25d55ff498ca852c21a7fd8748f P 05a91e64a61d4538af8d7117bbe3274e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a75f63f3329f474b92fcb34553477ec0 in term 1.
I20260927 15:12:04.980926 18993 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:04.976799 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.136.2:40553 (local address 127.17.136.3:37565)
0927 15:12:04.976912 (+ 113us) server_negotiation.cc:206] Beginning negotiation
0927 15:12:04.976916 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0927 15:12:04.977012 (+ 96us) server_negotiation.cc:407] Connection header received
0927 15:12:04.977198 (+ 186us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:12:04.977201 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:12:04.977240 (+ 39us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:12:04.977296 (+ 56us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0927 15:12:04.977538 (+ 242us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:04.978200 (+ 662us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:04.979700 (+ 1500us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:04.980262 (+ 562us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:04.980343 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:04.980403 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0927 15:12:04.980734 (+ 331us) server_negotiation.cc:299] Negotiation successful
0927 15:12:04.980798 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260927 15:12:04.980846 19006 raft_consensus.cc:686] T d972c25d55ff498ca852c21a7fd8748f P a75f63f3329f474b92fcb34553477ec0 [term 1 LEADER]: Becoming Leader. State: Replica: a75f63f3329f474b92fcb34553477ec0, State: Running, Role: LEADER
I20260927 15:12:04.981117 19008 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:04.976398 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.3:37565 (local address 127.17.136.2:40553)
0927 15:12:04.976943 (+ 545us) negotiation.cc:107] Waiting for socket to connect
0927 15:12:04.976956 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0927 15:12:04.977084 (+ 128us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0927 15:12:04.977312 (+ 228us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0927 15:12:04.977314 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0927 15:12:04.977329 (+ 15us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0927 15:12:04.977433 (+ 104us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:12:04.977439 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:12:04.978325 (+ 886us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:12:04.978328 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:12:04.979574 (+ 1246us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:12:04.979584 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:12:04.980483 (+ 899us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:12:04.980486 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:12:04.980580 (+ 94us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:04.980622 (+ 42us) client_negotiation.cc:769] Sending connection context
0927 15:12:04.980867 (+ 245us) client_negotiation.cc:240] Negotiation successful
0927 15:12:04.980937 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":483,"mutex_wait_us":39,"thread_start_us":97,"threads_started":1}
I20260927 15:12:04.981369 18997 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:04.976999 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.136.2:39649 (local address 127.17.136.1:33363)
0927 15:12:04.977091 (+ 92us) server_negotiation.cc:206] Beginning negotiation
0927 15:12:04.977095 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0927 15:12:04.977106 (+ 11us) server_negotiation.cc:407] Connection header received
0927 15:12:04.977390 (+ 284us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:12:04.977393 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:12:04.977431 (+ 38us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:12:04.977500 (+ 69us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0927 15:12:04.977751 (+ 251us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:04.978427 (+ 676us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:04.979963 (+ 1536us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:04.980535 (+ 572us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:04.980631 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:04.980684 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0927 15:12:04.981025 (+ 341us) server_negotiation.cc:299] Negotiation successful
0927 15:12:04.981100 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260927 15:12:04.981582 18935 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d972c25d55ff498ca852c21a7fd8748f" candidate_uuid: "35d994fa4064447c8a30be7d936010dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a75f63f3329f474b92fcb34553477ec0" is_pre_election: true
I20260927 15:12:04.981735 19009 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:04.976751 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.1:33363 (local address 127.17.136.2:39649)
0927 15:12:04.977025 (+ 274us) negotiation.cc:107] Waiting for socket to connect
0927 15:12:04.977038 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0927 15:12:04.977127 (+ 89us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0927 15:12:04.977531 (+ 404us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0927 15:12:04.977534 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0927 15:12:04.977551 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0927 15:12:04.977651 (+ 100us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:12:04.977656 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:12:04.978528 (+ 872us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:12:04.978531 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:12:04.979792 (+ 1261us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:12:04.979804 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:12:04.980788 (+ 984us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:12:04.980792 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:12:04.980880 (+ 88us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:04.980906 (+ 26us) client_negotiation.cc:769] Sending connection context
0927 15:12:04.981507 (+ 601us) client_negotiation.cc:240] Negotiation successful
0927 15:12:04.981588 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":219,"mutex_wait_us":22,"thread_start_us":59,"threads_started":1}
I20260927 15:12:04.981364 19006 consensus_queue.cc:237] T d972c25d55ff498ca852c21a7fd8748f P a75f63f3329f474b92fcb34553477ec0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a75f63f3329f474b92fcb34553477ec0" member_type: VOTER last_known_addr { host: "127.17.136.3" port: 37565 } } peers { permanent_uuid: "05a91e64a61d4538af8d7117bbe3274e" member_type: VOTER last_known_addr { host: "127.17.136.1" port: 33363 } } peers { permanent_uuid: "35d994fa4064447c8a30be7d936010dc" member_type: VOTER last_known_addr { host: "127.17.136.2" port: 36933 } }
I20260927 15:12:04.982263 18667 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d972c25d55ff498ca852c21a7fd8748f" candidate_uuid: "35d994fa4064447c8a30be7d936010dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "05a91e64a61d4538af8d7117bbe3274e" is_pre_election: true
I20260927 15:12:04.982441 18667 raft_consensus.cc:2379] T d972c25d55ff498ca852c21a7fd8748f P 05a91e64a61d4538af8d7117bbe3274e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35d994fa4064447c8a30be7d936010dc in current term 1: Already voted for candidate a75f63f3329f474b92fcb34553477ec0 in this term.
I20260927 15:12:04.982838 18736 leader_election.cc:302] T d972c25d55ff498ca852c21a7fd8748f P 35d994fa4064447c8a30be7d936010dc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35d994fa4064447c8a30be7d936010dc; no voters: 05a91e64a61d4538af8d7117bbe3274e, a75f63f3329f474b92fcb34553477ec0
I20260927 15:12:04.983076 19005 raft_consensus.cc:2726] T d972c25d55ff498ca852c21a7fd8748f P 35d994fa4064447c8a30be7d936010dc [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 15:12:04.985044 18520 catalog_manager.cc:5495] T d972c25d55ff498ca852c21a7fd8748f P a75f63f3329f474b92fcb34553477ec0 reported cstate change: term changed from 0 to 1, leader changed from <none> to a75f63f3329f474b92fcb34553477ec0 (127.17.136.3). New cstate: current_term: 1 leader_uuid: "a75f63f3329f474b92fcb34553477ec0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a75f63f3329f474b92fcb34553477ec0" member_type: VOTER last_known_addr { host: "127.17.136.3" port: 37565 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "05a91e64a61d4538af8d7117bbe3274e" member_type: VOTER last_known_addr { host: "127.17.136.1" port: 33363 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35d994fa4064447c8a30be7d936010dc" member_type: VOTER last_known_addr { host: "127.17.136.2" port: 36933 } health_report { overall_health: UNKNOWN } } }
Sep 27 15:12:05 dist-test-slave-5s2t krb5kdc[18477](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790521923, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.136.1@KRBTEST.COM
I20260927 15:12:05.106570 18997 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:05.097911 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56528 (local address 127.17.136.1:33363)
0927 15:12:05.098070 (+ 159us) server_negotiation.cc:206] Beginning negotiation
0927 15:12:05.098074 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0927 15:12:05.098165 (+ 91us) server_negotiation.cc:407] Connection header received
0927 15:12:05.098279 (+ 114us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:12:05.098282 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:12:05.098322 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:12:05.098382 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0927 15:12:05.099087 (+ 705us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:05.099655 (+ 568us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:05.100561 (+ 906us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:05.100766 (+ 205us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:05.100833 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:05.103340 (+ 2507us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0927 15:12:05.103352 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0927 15:12:05.103368 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0927 15:12:05.103394 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0927 15:12:05.104973 (+ 1579us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:12:05.105363 (+ 390us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:12:05.105369 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:12:05.105371 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:12:05.105467 (+ 96us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:12:05.105677 (+ 210us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:12:05.105679 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:12:05.105680 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:12:05.105978 (+ 298us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0927 15:12:05.106160 (+ 182us) server_negotiation.cc:1035] Waiting for connection context
0927 15:12:05.106274 (+ 114us) server_negotiation.cc:299] Negotiation successful
0927 15:12:05.106373 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":77}
Sep 27 15:12:05 dist-test-slave-5s2t krb5kdc[18477](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790521925, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Sep 27 15:12:05 dist-test-slave-5s2t krb5kdc[18477](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790521925, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.17.136.1@KRBTEST.COM
I20260927 15:12:05.132138 18997 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:05.124327 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56542 (local address 127.17.136.1:33363)
0927 15:12:05.124476 (+ 149us) server_negotiation.cc:206] Beginning negotiation
0927 15:12:05.124482 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0927 15:12:05.124621 (+ 139us) server_negotiation.cc:407] Connection header received
0927 15:12:05.124754 (+ 133us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:12:05.124757 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:12:05.124804 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:12:05.124879 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0927 15:12:05.125567 (+ 688us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:05.126071 (+ 504us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:05.126842 (+ 771us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:05.127058 (+ 216us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:05.127125 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:05.129385 (+ 2260us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0927 15:12:05.129388 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0927 15:12:05.129390 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0927 15:12:05.129414 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0927 15:12:05.130520 (+ 1106us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:12:05.130916 (+ 396us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:12:05.130919 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:12:05.130921 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:12:05.130991 (+ 70us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:12:05.131239 (+ 248us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:12:05.131242 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:12:05.131244 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:12:05.131441 (+ 197us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0927 15:12:05.131565 (+ 124us) server_negotiation.cc:1035] Waiting for connection context
0927 15:12:05.131864 (+ 299us) server_negotiation.cc:299] Negotiation successful
0927 15:12:05.131977 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
Sep 27 15:12:05 dist-test-slave-5s2t krb5kdc[18477](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790521925, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Sep 27 15:12:05 dist-test-slave-5s2t krb5kdc[18477](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790521925, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.136.1@KRBTEST.COM
I20260927 15:12:05.155901 18997 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:05.147918 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56548 (local address 127.17.136.1:33363)
0927 15:12:05.148079 (+ 161us) server_negotiation.cc:206] Beginning negotiation
0927 15:12:05.148084 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0927 15:12:05.148221 (+ 137us) server_negotiation.cc:407] Connection header received
0927 15:12:05.148353 (+ 132us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:12:05.148357 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:12:05.148401 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:12:05.148467 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0927 15:12:05.149108 (+ 641us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:05.149608 (+ 500us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:05.150414 (+ 806us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:05.150626 (+ 212us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:05.150710 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:05.153042 (+ 2332us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0927 15:12:05.153045 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0927 15:12:05.153048 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0927 15:12:05.153090 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0927 15:12:05.154391 (+ 1301us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:12:05.154777 (+ 386us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:12:05.154780 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:12:05.154782 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:12:05.154854 (+ 72us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:12:05.155092 (+ 238us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:12:05.155095 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:12:05.155097 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:12:05.155297 (+ 200us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0927 15:12:05.155408 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0927 15:12:05.155642 (+ 234us) server_negotiation.cc:299] Negotiation successful
0927 15:12:05.155747 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
W20260927 15:12:05.157251 18627 tablet_service.cc:2908] Rejecting scan request for tablet d972c25d55ff498ca852c21a7fd8748f: Uninitialized: clean time has not yet been initialized
I20260927 15:12:05.158996 17952 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu with pid 18584
I20260927 15:12:05.164156 17952 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu with pid 18718
I20260927 15:12:05.168591 17952 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu with pid 18852
I20260927 15:12:05.173350 17952 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu with pid 18490
2026-09-27T15:12:05Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizationOnChecksum (2588 ms)
[ RUN ] SecurityITest.SmokeTestAsAuthorizedUser
Loading random data
Initializing database '/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790521920546562-17952-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 27 15:12:05 dist-test-slave-5s2t krb5kdc[19024](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 27 15:12:05 dist-test-slave-5s2t krb5kdc[19024](info): set up 2 sockets
Sep 27 15:12:05 dist-test-slave-5s2t krb5kdc[19024](info): commencing operation
krb5kdc: starting...
W20260927 15:12:06.123008 17952 mini_kdc.cc:121] Time spent starting KDC: real 0.929s user 0.001s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790521920546562-17952-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790521920546562-17952-0/krb5kdc/test-user.keytab.
Sep 27 15:12:06 dist-test-slave-5s2t krb5kdc[19024](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790521926, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-27T15:12:06Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-27T15:12:06Z Disabled control of system clock
WARNING: no policy specified for kudu/127.17.136.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.136.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.136.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790521920546562-17952-0/krb5kdc/kudu_127.17.136.62.keytab.
Entry for principal kudu/127.17.136.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790521920546562-17952-0/krb5kdc/kudu_127.17.136.62.keytab.
I20260927 15:12:06.237902 17952 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu
/tmp/dist-test-taskiFOyeW/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790521920546562-17952-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790521920546562-17952-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790521920546562-17952-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790521920546562-17952-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.136.62:42991
--webserver_interface=127.17.136.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790521920546562-17952-0/krb5kdc/kudu_127.17.136.62.keytab
--principal=kudu/127.17.136.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.136.20:38247
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.136.62:42991
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790521920546562-17952-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790521920546562-17952-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790521920546562-17952-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260927 15:12:06.348492 19037 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260927 15:12:06.348753 19037 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260927 15:12:06.348795 19037 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260927 15:12:06.352846 19037 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260927 15:12:06.352908 19037 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260927 15:12:06.352924 19037 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260927 15:12:06.352942 19037 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260927 15:12:06.352972 19037 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260927 15:12:06.352999 19037 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260927 15:12:06.358289 19037 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.136.20:38247
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790521920546562-17952-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790521920546562-17952-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.17.136.62:42991
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790521920546562-17952-0/krb5kdc/kudu_127.17.136.62.keytab
--principal=kudu/127.17.136.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.136.62:42991
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790521920546562-17952-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.17.136.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19037
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790521920546562-17952-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 27 Sep 2026 14:27:13 UTC on ccycloud.quasar-psqrth.root.comops.site
build id 4676138
I20260927 15:12:06.359380 19037 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260927 15:12:06.360388 19037 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260927 15:12:06.368954 19045 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260927 15:12:06.368904 19042 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260927 15:12:06.369248 19037 server_base.cc:1034] running on GCE node
W20260927 15:12:06.368917 19043 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260927 15:12:06.369827 19037 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260927 15:12:06.370909 19037 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260927 15:12:06.372085 19037 hybrid_clock.cc:648] HybridClock initialized: now 1790521926372069 us; error 25 us; skew 500 ppm
Sep 27 15:12:06 dist-test-slave-5s2t krb5kdc[19024](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790521926, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.136.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260927 15:12:06.374833 19037 init.cc:377] Logged in from keytab as kudu/127.17.136.62@KRBTEST.COM (short username kudu)
I20260927 15:12:06.375831 19037 webserver.cc:460] Webserver started at http://127.17.136.62:32825/ using document root <none> and password file <none>
I20260927 15:12:06.376380 19037 fs_manager.cc:359] Metadata directory not provided
I20260927 15:12:06.376437 19037 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260927 15:12:06.376631 19037 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260927 15:12:06.378679 19037 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790521920546562-17952-0/minicluster-data/master-0/data/instance:
uuid: "b0f010545b374681bbbcbeb162563687"
format_stamp: "Formatted at 2026-09-27 15:12:06 on dist-test-slave-5s2t"
server_key: "7ff6ff0d78d3fc5989d573da189cf856"
server_key_iv: "498bb8d0484019b5a37059940d1b65a4"
server_key_version: "encryptionkey@0"
I20260927 15:12:06.379235 19037 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790521920546562-17952-0/minicluster-data/master-0/wal/instance:
uuid: "b0f010545b374681bbbcbeb162563687"
format_stamp: "Formatted at 2026-09-27 15:12:06 on dist-test-slave-5s2t"
server_key: "7ff6ff0d78d3fc5989d573da189cf856"
server_key_iv: "498bb8d0484019b5a37059940d1b65a4"
server_key_version: "encryptionkey@0"
I20260927 15:12:06.382961 19037 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.000s
I20260927 15:12:06.385401 19052 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260927 15:12:06.386628 19037 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260927 15:12:06.386729 19037 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790521920546562-17952-0/minicluster-data/master-0/data,/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790521920546562-17952-0/minicluster-data/master-0/wal
uuid: "b0f010545b374681bbbcbeb162563687"
format_stamp: "Formatted at 2026-09-27 15:12:06 on dist-test-slave-5s2t"
server_key: "7ff6ff0d78d3fc5989d573da189cf856"
server_key_iv: "498bb8d0484019b5a37059940d1b65a4"
server_key_version: "encryptionkey@0"
I20260927 15:12:06.386835 19037 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790521920546562-17952-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790521920546562-17952-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790521920546562-17952-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260927 15:12:06.401773 19037 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260927 15:12:06.404597 19037 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260927 15:12:06.404757 19037 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260927 15:12:06.412086 19037 rpc_server.cc:307] RPC server started. Bound to: 127.17.136.62:42991
I20260927 15:12:06.412190 19114 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.136.62:42991 every 8 connection(s)
I20260927 15:12:06.413117 19037 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790521920546562-17952-0/minicluster-data/master-0/data/info.pb
I20260927 15:12:06.413743 17952 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu as pid 19037
I20260927 15:12:06.413854 17952 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790521920546562-17952-0/minicluster-data/master-0/wal/instance
I20260927 15:12:06.414156 17952 external_mini_cluster.cc:1428] Setting key 55dcd52752f9d673a3ff59f032b6d27c
I20260927 15:12:06.416402 19115 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:12:06.422772 19115 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b0f010545b374681bbbcbeb162563687: Bootstrap starting.
Sep 27 15:12:06 dist-test-slave-5s2t krb5kdc[19024](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790521926, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.136.62@KRBTEST.COM
I20260927 15:12:06.425089 19115 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b0f010545b374681bbbcbeb162563687: Neither blocks nor log segments found. Creating new log.
I20260927 15:12:06.426131 19115 log.cc:824] T 00000000000000000000000000000000 P b0f010545b374681bbbcbeb162563687: Log is configured to *not* fsync() on all Append() calls
I20260927 15:12:06.428020 19115 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b0f010545b374681bbbcbeb162563687: No bootstrap required, opened a new log
I20260927 15:12:06.428182 19118 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:06.415576 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43688 (local address 127.17.136.62:42991)
0927 15:12:06.415967 (+ 391us) server_negotiation.cc:206] Beginning negotiation
0927 15:12:06.415989 (+ 22us) server_negotiation.cc:399] Waiting for connection header
0927 15:12:06.416024 (+ 35us) server_negotiation.cc:407] Connection header received
0927 15:12:06.416675 (+ 651us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:12:06.416694 (+ 19us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:12:06.417032 (+ 338us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:12:06.417313 (+ 281us) server_negotiation.cc:226] Negotiated authn=SASL
0927 15:12:06.418130 (+ 817us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:06.419123 (+ 993us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:06.420307 (+ 1184us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:06.420777 (+ 470us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:06.420889 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:06.423742 (+ 2853us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0927 15:12:06.423748 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0927 15:12:06.423761 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0927 15:12:06.423790 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0927 15:12:06.425499 (+ 1709us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:12:06.425906 (+ 407us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:12:06.425911 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:12:06.425915 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:12:06.426030 (+ 115us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:12:06.426308 (+ 278us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:12:06.426311 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:12:06.426312 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:12:06.426704 (+ 392us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0927 15:12:06.426871 (+ 167us) server_negotiation.cc:1035] Waiting for connection context
0927 15:12:06.427172 (+ 301us) server_negotiation.cc:299] Negotiation successful
0927 15:12:06.427454 (+ 282us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":252,"thread_start_us":101,"threads_started":1}
I20260927 15:12:06.430949 19115 raft_consensus.cc:348] T 00000000000000000000000000000000 P b0f010545b374681bbbcbeb162563687 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b0f010545b374681bbbcbeb162563687" member_type: VOTER last_known_addr { host: "127.17.136.62" port: 42991 } }
I20260927 15:12:06.431170 19115 raft_consensus.cc:374] T 00000000000000000000000000000000 P b0f010545b374681bbbcbeb162563687 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:12:06.431228 19115 raft_consensus.cc:729] T 00000000000000000000000000000000 P b0f010545b374681bbbcbeb162563687 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b0f010545b374681bbbcbeb162563687, State: Initialized, Role: FOLLOWER
I20260927 15:12:06.431631 19115 consensus_queue.cc:260] T 00000000000000000000000000000000 P b0f010545b374681bbbcbeb162563687 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b0f010545b374681bbbcbeb162563687" member_type: VOTER last_known_addr { host: "127.17.136.62" port: 42991 } }
I20260927 15:12:06.431767 19115 raft_consensus.cc:388] T 00000000000000000000000000000000 P b0f010545b374681bbbcbeb162563687 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260927 15:12:06.431829 19115 raft_consensus.cc:482] T 00000000000000000000000000000000 P b0f010545b374681bbbcbeb162563687 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260927 15:12:06.431926 19115 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b0f010545b374681bbbcbeb162563687 [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:12:06.432731 19115 raft_consensus.cc:504] T 00000000000000000000000000000000 P b0f010545b374681bbbcbeb162563687 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b0f010545b374681bbbcbeb162563687" member_type: VOTER last_known_addr { host: "127.17.136.62" port: 42991 } }
I20260927 15:12:06.433032 19115 leader_election.cc:302] T 00000000000000000000000000000000 P b0f010545b374681bbbcbeb162563687 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b0f010545b374681bbbcbeb162563687; no voters:
I20260927 15:12:06.433298 19115 leader_election.cc:288] T 00000000000000000000000000000000 P b0f010545b374681bbbcbeb162563687 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260927 15:12:06.433393 19120 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b0f010545b374681bbbcbeb162563687 [term 1 FOLLOWER]: Leader election won for term 1
I20260927 15:12:06.433604 19120 raft_consensus.cc:686] T 00000000000000000000000000000000 P b0f010545b374681bbbcbeb162563687 [term 1 LEADER]: Becoming Leader. State: Replica: b0f010545b374681bbbcbeb162563687, State: Running, Role: LEADER
I20260927 15:12:06.433916 19120 consensus_queue.cc:237] T 00000000000000000000000000000000 P b0f010545b374681bbbcbeb162563687 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b0f010545b374681bbbcbeb162563687" member_type: VOTER last_known_addr { host: "127.17.136.62" port: 42991 } }
I20260927 15:12:06.434396 19115 sys_catalog.cc:564] T 00000000000000000000000000000000 P b0f010545b374681bbbcbeb162563687 [sys.catalog]: configured and running, proceeding with master startup.
I20260927 15:12:06.435504 19121 sys_catalog.cc:455] T 00000000000000000000000000000000 P b0f010545b374681bbbcbeb162563687 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "b0f010545b374681bbbcbeb162563687" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b0f010545b374681bbbcbeb162563687" member_type: VOTER last_known_addr { host: "127.17.136.62" port: 42991 } } }
I20260927 15:12:06.435626 19121 sys_catalog.cc:458] T 00000000000000000000000000000000 P b0f010545b374681bbbcbeb162563687 [sys.catalog]: This master's current role is: LEADER
I20260927 15:12:06.435884 19122 sys_catalog.cc:455] T 00000000000000000000000000000000 P b0f010545b374681bbbcbeb162563687 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b0f010545b374681bbbcbeb162563687. Latest consensus state: current_term: 1 leader_uuid: "b0f010545b374681bbbcbeb162563687" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b0f010545b374681bbbcbeb162563687" member_type: VOTER last_known_addr { host: "127.17.136.62" port: 42991 } } }
I20260927 15:12:06.435971 19122 sys_catalog.cc:458] T 00000000000000000000000000000000 P b0f010545b374681bbbcbeb162563687 [sys.catalog]: This master's current role is: LEADER
W20260927 15:12:06.438634 19135 catalog_manager.cc:1558] T 00000000000000000000000000000000 P b0f010545b374681bbbcbeb162563687: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260927 15:12:06.438696 19135 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260927 15:12:06.438766 19129 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260927 15:12:06.439481 19129 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260927 15:12:06.444871 19129 catalog_manager.cc:1347] Generated new cluster ID: 3cd0605586714196b2be28a2561ceb6d
I20260927 15:12:06.444932 19129 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260927 15:12:06.461488 19129 catalog_manager.cc:1370] Generated new certificate authority record
I20260927 15:12:06.462728 19129 catalog_manager.cc:1504] Loading token signing keys...
I20260927 15:12:06.468928 19129 catalog_manager.cc:5868] T 00000000000000000000000000000000 P b0f010545b374681bbbcbeb162563687: Generated new TSK 0
I20260927 15:12:06.469715 19129 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.17.136.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.136.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.136.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790521920546562-17952-0/krb5kdc/kudu_127.17.136.1.keytab.
Entry for principal kudu/127.17.136.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790521920546562-17952-0/krb5kdc/kudu_127.17.136.1.keytab.
I20260927 15:12:06.501515 17952 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu
/tmp/dist-test-taskiFOyeW/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790521920546562-17952-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790521920546562-17952-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790521920546562-17952-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790521920546562-17952-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.136.1:0
--local_ip_for_outbound_sockets=127.17.136.1
--webserver_interface=127.17.136.1
--webserver_port=0
--tserver_master_addrs=127.17.136.62:42991
--keytab_file=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790521920546562-17952-0/krb5kdc/kudu_127.17.136.1.keytab
--principal=kudu/127.17.136.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.136.20:38247
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790521920546562-17952-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790521920546562-17952-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790521920546562-17952-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260927 15:12:06.605443 19141 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260927 15:12:06.605670 19141 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260927 15:12:06.605712 19141 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260927 15:12:06.609592 19141 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260927 15:12:06.609652 19141 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260927 15:12:06.609689 19141 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260927 15:12:06.609730 19141 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.136.1
I20260927 15:12:06.614979 19141 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.136.20:38247
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790521920546562-17952-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790521920546562-17952-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790521920546562-17952-0/krb5kdc/kudu_127.17.136.1.keytab
--principal=kudu/127.17.136.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.136.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790521920546562-17952-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.17.136.1
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.17.136.62:42991
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19141
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.136.1
--log_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790521920546562-17952-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 27 Sep 2026 14:27:13 UTC on ccycloud.quasar-psqrth.root.comops.site
build id 4676138
I20260927 15:12:06.616062 19141 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260927 15:12:06.617281 19141 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260927 15:12:06.626458 19147 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260927 15:12:06.626556 19141 server_base.cc:1034] running on GCE node
W20260927 15:12:06.626458 19149 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260927 15:12:06.626475 19146 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260927 15:12:06.627147 19141 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260927 15:12:06.627815 19141 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260927 15:12:06.628976 19141 hybrid_clock.cc:648] HybridClock initialized: now 1790521926628955 us; error 35 us; skew 500 ppm
Sep 27 15:12:06 dist-test-slave-5s2t krb5kdc[19024](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790521926, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.136.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260927 15:12:06.631580 19141 init.cc:377] Logged in from keytab as kudu/127.17.136.1@KRBTEST.COM (short username kudu)
I20260927 15:12:06.632359 19141 webserver.cc:460] Webserver started at http://127.17.136.1:45405/ using document root <none> and password file <none>
I20260927 15:12:06.632856 19141 fs_manager.cc:359] Metadata directory not provided
I20260927 15:12:06.632910 19141 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260927 15:12:06.633065 19141 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260927 15:12:06.635012 19141 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790521920546562-17952-0/minicluster-data/ts-0/data/instance:
uuid: "ee396b1c470f43f5a82199ea49511d5f"
format_stamp: "Formatted at 2026-09-27 15:12:06 on dist-test-slave-5s2t"
server_key: "3ff43b05d32829c4b1d0f9e4a08ef9c4"
server_key_iv: "3e86381227530024fd107db28345f40b"
server_key_version: "encryptionkey@0"
I20260927 15:12:06.635560 19141 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790521920546562-17952-0/minicluster-data/ts-0/wal/instance:
uuid: "ee396b1c470f43f5a82199ea49511d5f"
format_stamp: "Formatted at 2026-09-27 15:12:06 on dist-test-slave-5s2t"
server_key: "3ff43b05d32829c4b1d0f9e4a08ef9c4"
server_key_iv: "3e86381227530024fd107db28345f40b"
server_key_version: "encryptionkey@0"
I20260927 15:12:06.638958 19141 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.000s
I20260927 15:12:06.641229 19156 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260927 15:12:06.642351 19141 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260927 15:12:06.642441 19141 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790521920546562-17952-0/minicluster-data/ts-0/data,/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790521920546562-17952-0/minicluster-data/ts-0/wal
uuid: "ee396b1c470f43f5a82199ea49511d5f"
format_stamp: "Formatted at 2026-09-27 15:12:06 on dist-test-slave-5s2t"
server_key: "3ff43b05d32829c4b1d0f9e4a08ef9c4"
server_key_iv: "3e86381227530024fd107db28345f40b"
server_key_version: "encryptionkey@0"
I20260927 15:12:06.642531 19141 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790521920546562-17952-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790521920546562-17952-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790521920546562-17952-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260927 15:12:06.653613 19141 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260927 15:12:06.656284 19141 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260927 15:12:06.656471 19141 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260927 15:12:06.657862 19141 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260927 15:12:06.657914 19141 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260927 15:12:06.657963 19141 ts_tablet_manager.cc:610] Registered 0 tablets
I20260927 15:12:06.657997 19141 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Sep 27 15:12:06 dist-test-slave-5s2t krb5kdc[19024](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790521926, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.136.1@KRBTEST.COM for kudu/127.17.136.62@KRBTEST.COM
I20260927 15:12:06.668205 19141 rpc_server.cc:307] RPC server started. Bound to: 127.17.136.1:37499
I20260927 15:12:06.668262 19271 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.136.1:37499 every 8 connection(s)
I20260927 15:12:06.669183 19141 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790521920546562-17952-0/minicluster-data/ts-0/data/info.pb
I20260927 15:12:06.670383 19118 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:06.658563 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.136.1:40647 (local address 127.17.136.62:42991)
0927 15:12:06.658713 (+ 150us) server_negotiation.cc:206] Beginning negotiation
0927 15:12:06.658719 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0927 15:12:06.659968 (+ 1249us) server_negotiation.cc:407] Connection header received
0927 15:12:06.660990 (+ 1022us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:12:06.660994 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:12:06.661047 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:12:06.661125 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0927 15:12:06.662460 (+ 1335us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:06.663239 (+ 779us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:06.664439 (+ 1200us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:06.664676 (+ 237us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:06.664761 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:06.667090 (+ 2329us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0927 15:12:06.667093 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0927 15:12:06.667095 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0927 15:12:06.667116 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0927 15:12:06.668493 (+ 1377us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:12:06.668927 (+ 434us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:12:06.668931 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:12:06.668932 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:12:06.669006 (+ 74us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:12:06.669322 (+ 316us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:12:06.669325 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:12:06.669327 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:12:06.669490 (+ 163us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0927 15:12:06.669572 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0927 15:12:06.670147 (+ 575us) server_negotiation.cc:299] Negotiation successful
0927 15:12:06.670260 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260927 15:12:06.671130 19165 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:06.659331 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.62:42991 (local address 127.17.136.1:40647)
0927 15:12:06.659797 (+ 466us) negotiation.cc:107] Waiting for socket to connect
0927 15:12:06.659846 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0927 15:12:06.660798 (+ 952us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0927 15:12:06.661308 (+ 510us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0927 15:12:06.661318 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0927 15:12:06.661703 (+ 385us) client_negotiation.cc:189] Negotiated authn=SASL
0927 15:12:06.662329 (+ 626us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:12:06.662350 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:12:06.663369 (+ 1019us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:12:06.663373 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:12:06.664333 (+ 960us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:12:06.664342 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:12:06.664816 (+ 474us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:12:06.664820 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:12:06.664969 (+ 149us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:06.665497 (+ 528us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0927 15:12:06.665512 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0927 15:12:06.666942 (+ 1430us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0927 15:12:06.668596 (+ 1654us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0927 15:12:06.668602 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0927 15:12:06.668615 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0927 15:12:06.668842 (+ 227us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0927 15:12:06.669087 (+ 245us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0927 15:12:06.669090 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0927 15:12:06.669092 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0927 15:12:06.669222 (+ 130us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0927 15:12:06.669621 (+ 399us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0927 15:12:06.669627 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0927 15:12:06.669879 (+ 252us) client_negotiation.cc:769] Sending connection context
0927 15:12:06.670078 (+ 199us) client_negotiation.cc:240] Negotiation successful
0927 15:12:06.670352 (+ 274us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":241,"thread_start_us":108,"threads_started":1}
I20260927 15:12:06.672287 19272 heartbeater.cc:347] Connected to a master server at 127.17.136.62:42991
I20260927 15:12:06.672487 19272 heartbeater.cc:464] Registering TS with master...
I20260927 15:12:06.672935 19272 heartbeater.cc:511] Master 127.17.136.62:42991 requested a full tablet report, sending...
I20260927 15:12:06.674526 19068 ts_manager.cc:194] Registered new tserver with Master: ee396b1c470f43f5a82199ea49511d5f (127.17.136.1:37499)
I20260927 15:12:06.676023 19068 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.136.1@KRBTEST.COM'} at 127.17.136.1:40647
I20260927 15:12:06.677048 17952 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu as pid 19141
I20260927 15:12:06.677167 17952 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790521920546562-17952-0/minicluster-data/ts-0/wal/instance
I20260927 15:12:06.677480 17952 external_mini_cluster.cc:1428] Setting key 15de112ff90203ee9bfad3ce8aa4d3ee
I20260927 15:12:06.680907 19118 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:06.674566 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.136.1:49459 (local address 127.17.136.62:42991)
0927 15:12:06.674684 (+ 118us) server_negotiation.cc:206] Beginning negotiation
0927 15:12:06.674688 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0927 15:12:06.674745 (+ 57us) server_negotiation.cc:407] Connection header received
0927 15:12:06.674831 (+ 86us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:12:06.674834 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:12:06.674873 (+ 39us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:12:06.674962 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0927 15:12:06.675310 (+ 348us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:06.676065 (+ 755us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:06.676825 (+ 760us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:06.677044 (+ 219us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:06.677248 (+ 204us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:06.678147 (+ 899us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0927 15:12:06.678151 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0927 15:12:06.678153 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0927 15:12:06.678175 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0927 15:12:06.679500 (+ 1325us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:12:06.679855 (+ 355us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:12:06.679858 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:12:06.679860 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:12:06.679924 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:12:06.680195 (+ 271us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:12:06.680199 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:12:06.680201 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:12:06.680392 (+ 191us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0927 15:12:06.680485 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0927 15:12:06.680714 (+ 229us) server_negotiation.cc:299] Negotiation successful
0927 15:12:06.680800 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":4,"server-negotiator.queue_time_us":51}
I20260927 15:12:06.680963 19278 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:06.674433 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.62:42991 (local address 127.17.136.1:49459)
0927 15:12:06.674679 (+ 246us) negotiation.cc:107] Waiting for socket to connect
0927 15:12:06.674693 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0927 15:12:06.674770 (+ 77us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0927 15:12:06.674966 (+ 196us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0927 15:12:06.674968 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0927 15:12:06.675112 (+ 144us) client_negotiation.cc:189] Negotiated authn=SASL
0927 15:12:06.675196 (+ 84us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:12:06.675201 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:12:06.676182 (+ 981us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:12:06.676185 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:12:06.676725 (+ 540us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:12:06.676732 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:12:06.677147 (+ 415us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:12:06.677150 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:12:06.677235 (+ 85us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:06.677686 (+ 451us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0927 15:12:06.677696 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0927 15:12:06.678018 (+ 322us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0927 15:12:06.679604 (+ 1586us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0927 15:12:06.679607 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0927 15:12:06.679609 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0927 15:12:06.679775 (+ 166us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0927 15:12:06.679999 (+ 224us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0927 15:12:06.680001 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0927 15:12:06.680003 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0927 15:12:06.680085 (+ 82us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0927 15:12:06.680482 (+ 397us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0927 15:12:06.680485 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0927 15:12:06.680576 (+ 91us) client_negotiation.cc:769] Sending connection context
0927 15:12:06.680670 (+ 94us) client_negotiation.cc:240] Negotiation successful
0927 15:12:06.680788 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":171,"mutex_wait_us":21,"thread_start_us":89,"threads_started":1}
WARNING: no policy specified for kudu/127.17.136.2@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.136.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.136.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790521920546562-17952-0/krb5kdc/kudu_127.17.136.2.keytab.
Entry for principal kudu/127.17.136.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790521920546562-17952-0/krb5kdc/kudu_127.17.136.2.keytab.
I20260927 15:12:06.702848 17952 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu
/tmp/dist-test-taskiFOyeW/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790521920546562-17952-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790521920546562-17952-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790521920546562-17952-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790521920546562-17952-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.136.2:0
--local_ip_for_outbound_sockets=127.17.136.2
--webserver_interface=127.17.136.2
--webserver_port=0
--tserver_master_addrs=127.17.136.62:42991
--keytab_file=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790521920546562-17952-0/krb5kdc/kudu_127.17.136.2.keytab
--principal=kudu/127.17.136.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.136.20:38247
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790521920546562-17952-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790521920546562-17952-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790521920546562-17952-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260927 15:12:06.808054 19281 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260927 15:12:06.808295 19281 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260927 15:12:06.808336 19281 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260927 15:12:06.812234 19281 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260927 15:12:06.812284 19281 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260927 15:12:06.812321 19281 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260927 15:12:06.812356 19281 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.136.2
I20260927 15:12:06.817492 19281 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.136.20:38247
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790521920546562-17952-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790521920546562-17952-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790521920546562-17952-0/krb5kdc/kudu_127.17.136.2.keytab
--principal=kudu/127.17.136.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.136.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790521920546562-17952-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.17.136.2
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.17.136.62:42991
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19281
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.136.2
--log_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790521920546562-17952-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 27 Sep 2026 14:27:13 UTC on ccycloud.quasar-psqrth.root.comops.site
build id 4676138
I20260927 15:12:06.818449 19281 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260927 15:12:06.819379 19281 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260927 15:12:06.829262 19287 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260927 15:12:06.829275 19286 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260927 15:12:06.829275 19289 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260927 15:12:06.829438 19281 server_base.cc:1034] running on GCE node
I20260927 15:12:06.829842 19281 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260927 15:12:06.830435 19281 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260927 15:12:06.831581 19281 hybrid_clock.cc:648] HybridClock initialized: now 1790521926831564 us; error 33 us; skew 500 ppm
Sep 27 15:12:06 dist-test-slave-5s2t krb5kdc[19024](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790521926, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.136.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260927 15:12:06.834035 19281 init.cc:377] Logged in from keytab as kudu/127.17.136.2@KRBTEST.COM (short username kudu)
I20260927 15:12:06.834851 19281 webserver.cc:460] Webserver started at http://127.17.136.2:46659/ using document root <none> and password file <none>
I20260927 15:12:06.835390 19281 fs_manager.cc:359] Metadata directory not provided
I20260927 15:12:06.835456 19281 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260927 15:12:06.835642 19281 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260927 15:12:06.837574 19281 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790521920546562-17952-0/minicluster-data/ts-1/data/instance:
uuid: "470d26ed44b749b983f748436754bb95"
format_stamp: "Formatted at 2026-09-27 15:12:06 on dist-test-slave-5s2t"
server_key: "d44c3a723d224b54703ae1253a26afad"
server_key_iv: "3de728a0402a5f1efb4ee26f2a68b34c"
server_key_version: "encryptionkey@0"
I20260927 15:12:06.838119 19281 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790521920546562-17952-0/minicluster-data/ts-1/wal/instance:
uuid: "470d26ed44b749b983f748436754bb95"
format_stamp: "Formatted at 2026-09-27 15:12:06 on dist-test-slave-5s2t"
server_key: "d44c3a723d224b54703ae1253a26afad"
server_key_iv: "3de728a0402a5f1efb4ee26f2a68b34c"
server_key_version: "encryptionkey@0"
I20260927 15:12:06.841583 19281 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.004s
I20260927 15:12:06.843814 19296 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260927 15:12:06.844929 19281 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260927 15:12:06.845036 19281 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790521920546562-17952-0/minicluster-data/ts-1/data,/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790521920546562-17952-0/minicluster-data/ts-1/wal
uuid: "470d26ed44b749b983f748436754bb95"
format_stamp: "Formatted at 2026-09-27 15:12:06 on dist-test-slave-5s2t"
server_key: "d44c3a723d224b54703ae1253a26afad"
server_key_iv: "3de728a0402a5f1efb4ee26f2a68b34c"
server_key_version: "encryptionkey@0"
I20260927 15:12:06.845116 19281 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790521920546562-17952-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790521920546562-17952-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790521920546562-17952-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260927 15:12:06.861959 19281 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260927 15:12:06.864974 19281 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260927 15:12:06.865154 19281 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260927 15:12:06.866557 19281 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260927 15:12:06.866604 19281 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260927 15:12:06.866655 19281 ts_tablet_manager.cc:610] Registered 0 tablets
I20260927 15:12:06.866681 19281 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Sep 27 15:12:06 dist-test-slave-5s2t krb5kdc[19024](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790521926, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.136.2@KRBTEST.COM for kudu/127.17.136.62@KRBTEST.COM
I20260927 15:12:06.876626 19281 rpc_server.cc:307] RPC server started. Bound to: 127.17.136.2:42875
I20260927 15:12:06.877437 19281 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790521920546562-17952-0/minicluster-data/ts-1/data/info.pb
I20260927 15:12:06.878151 19411 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.136.2:42875 every 8 connection(s)
I20260927 15:12:06.878474 17952 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu as pid 19281
I20260927 15:12:06.878571 17952 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790521920546562-17952-0/minicluster-data/ts-1/wal/instance
I20260927 15:12:06.878862 17952 external_mini_cluster.cc:1428] Setting key fe6610581708617e5a10cb0f100c8587
I20260927 15:12:06.879074 19118 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:06.867326 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.136.2:38961 (local address 127.17.136.62:42991)
0927 15:12:06.867434 (+ 108us) server_negotiation.cc:206] Beginning negotiation
0927 15:12:06.867437 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0927 15:12:06.868499 (+ 1062us) server_negotiation.cc:407] Connection header received
0927 15:12:06.869599 (+ 1100us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:12:06.869603 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:12:06.869661 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:12:06.869731 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0927 15:12:06.870921 (+ 1190us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:06.871503 (+ 582us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:06.872614 (+ 1111us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:06.872875 (+ 261us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:06.872978 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:06.875713 (+ 2735us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0927 15:12:06.875716 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0927 15:12:06.875718 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0927 15:12:06.875741 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0927 15:12:06.877059 (+ 1318us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:12:06.877503 (+ 444us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:12:06.877506 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:12:06.877508 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:12:06.877598 (+ 90us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:12:06.877930 (+ 332us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:12:06.877933 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:12:06.877934 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:12:06.878159 (+ 225us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0927 15:12:06.878250 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0927 15:12:06.878797 (+ 547us) server_negotiation.cc:299] Negotiation successful
0927 15:12:06.878915 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260927 15:12:06.879933 19305 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:06.867876 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.62:42991 (local address 127.17.136.2:38961)
0927 15:12:06.868355 (+ 479us) negotiation.cc:107] Waiting for socket to connect
0927 15:12:06.868396 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0927 15:12:06.869291 (+ 895us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0927 15:12:06.869911 (+ 620us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0927 15:12:06.869920 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0927 15:12:06.870273 (+ 353us) client_negotiation.cc:189] Negotiated authn=SASL
0927 15:12:06.870789 (+ 516us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:12:06.870809 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:12:06.871609 (+ 800us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:12:06.871612 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:12:06.872478 (+ 866us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:12:06.872487 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:12:06.873033 (+ 546us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:12:06.873038 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:12:06.873255 (+ 217us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:06.873890 (+ 635us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0927 15:12:06.873907 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0927 15:12:06.875550 (+ 1643us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0927 15:12:06.877164 (+ 1614us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0927 15:12:06.877169 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0927 15:12:06.877184 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0927 15:12:06.877416 (+ 232us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0927 15:12:06.877678 (+ 262us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0927 15:12:06.877681 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0927 15:12:06.877683 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0927 15:12:06.877825 (+ 142us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0927 15:12:06.878318 (+ 493us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0927 15:12:06.878323 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0927 15:12:06.878549 (+ 226us) client_negotiation.cc:769] Sending connection context
0927 15:12:06.878732 (+ 183us) client_negotiation.cc:240] Negotiation successful
0927 15:12:06.878987 (+ 255us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":293,"thread_start_us":130,"threads_started":1}
I20260927 15:12:06.881057 19412 heartbeater.cc:347] Connected to a master server at 127.17.136.62:42991
I20260927 15:12:06.881188 19412 heartbeater.cc:464] Registering TS with master...
I20260927 15:12:06.881628 19412 heartbeater.cc:511] Master 127.17.136.62:42991 requested a full tablet report, sending...
I20260927 15:12:06.882534 19069 ts_manager.cc:194] Registered new tserver with Master: 470d26ed44b749b983f748436754bb95 (127.17.136.2:42875)
I20260927 15:12:06.883076 19069 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.136.2@KRBTEST.COM'} at 127.17.136.2:38961
WARNING: no policy specified for kudu/127.17.136.3@KRBTEST.COM; defaulting to no policy
I20260927 15:12:06.890326 19419 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:06.883186 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.62:42991 (local address 127.17.136.2:56391)
0927 15:12:06.883550 (+ 364us) negotiation.cc:107] Waiting for socket to connect
0927 15:12:06.883564 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0927 15:12:06.883655 (+ 91us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0927 15:12:06.883878 (+ 223us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0927 15:12:06.883881 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0927 15:12:06.884088 (+ 207us) client_negotiation.cc:189] Negotiated authn=SASL
0927 15:12:06.884202 (+ 114us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:12:06.884208 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:12:06.885216 (+ 1008us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:12:06.885219 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:12:06.885807 (+ 588us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:12:06.885816 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:12:06.886349 (+ 533us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:12:06.886352 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:12:06.886416 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:06.886889 (+ 473us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0927 15:12:06.886899 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0927 15:12:06.887179 (+ 280us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0927 15:12:06.888979 (+ 1800us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0927 15:12:06.888982 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0927 15:12:06.888983 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0927 15:12:06.889196 (+ 213us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0927 15:12:06.889463 (+ 267us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0927 15:12:06.889466 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0927 15:12:06.889467 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0927 15:12:06.889576 (+ 109us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0927 15:12:06.889915 (+ 339us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0927 15:12:06.889917 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0927 15:12:06.889997 (+ 80us) client_negotiation.cc:769] Sending connection context
0927 15:12:06.890073 (+ 76us) client_negotiation.cc:240] Negotiation successful
0927 15:12:06.890180 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":280,"thread_start_us":121,"threads_started":1}
I20260927 15:12:06.890347 19118 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:06.883309 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.136.2:56391 (local address 127.17.136.62:42991)
0927 15:12:06.883400 (+ 91us) server_negotiation.cc:206] Beginning negotiation
0927 15:12:06.883404 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0927 15:12:06.883639 (+ 235us) server_negotiation.cc:407] Connection header received
0927 15:12:06.883731 (+ 92us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:12:06.883734 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:12:06.883775 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:12:06.883847 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0927 15:12:06.884310 (+ 463us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:06.885082 (+ 772us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:06.885917 (+ 835us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:06.886253 (+ 336us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:06.886354 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:06.887326 (+ 972us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0927 15:12:06.887331 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0927 15:12:06.887334 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0927 15:12:06.887358 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0927 15:12:06.888835 (+ 1477us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:12:06.889295 (+ 460us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:12:06.889297 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:12:06.889298 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:12:06.889362 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:12:06.889652 (+ 290us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:12:06.889655 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:12:06.889656 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:12:06.889841 (+ 185us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0927 15:12:06.889910 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0927 15:12:06.890114 (+ 204us) server_negotiation.cc:299] Negotiation successful
0927 15:12:06.890237 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.136.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.136.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790521920546562-17952-0/krb5kdc/kudu_127.17.136.3.keytab.
Entry for principal kudu/127.17.136.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790521920546562-17952-0/krb5kdc/kudu_127.17.136.3.keytab.
I20260927 15:12:06.906067 17952 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu
/tmp/dist-test-taskiFOyeW/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790521920546562-17952-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790521920546562-17952-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790521920546562-17952-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790521920546562-17952-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.136.3:0
--local_ip_for_outbound_sockets=127.17.136.3
--webserver_interface=127.17.136.3
--webserver_port=0
--tserver_master_addrs=127.17.136.62:42991
--keytab_file=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790521920546562-17952-0/krb5kdc/kudu_127.17.136.3.keytab
--principal=kudu/127.17.136.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.136.20:38247
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790521920546562-17952-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790521920546562-17952-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790521920546562-17952-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260927 15:12:07.010394 19421 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260927 15:12:07.010630 19421 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260927 15:12:07.010673 19421 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260927 15:12:07.014665 19421 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260927 15:12:07.014727 19421 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260927 15:12:07.014770 19421 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260927 15:12:07.014809 19421 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.136.3
I20260927 15:12:07.020074 19421 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.136.20:38247
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790521920546562-17952-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790521920546562-17952-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790521920546562-17952-0/krb5kdc/kudu_127.17.136.3.keytab
--principal=kudu/127.17.136.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.136.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790521920546562-17952-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.17.136.3
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.17.136.62:42991
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19421
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.136.3
--log_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790521920546562-17952-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 27 Sep 2026 14:27:13 UTC on ccycloud.quasar-psqrth.root.comops.site
build id 4676138
I20260927 15:12:07.021102 19421 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260927 15:12:07.022089 19421 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260927 15:12:07.031204 19426 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260927 15:12:07.031373 19427 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260927 15:12:07.031450 19429 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260927 15:12:07.031546 19421 server_base.cc:1034] running on GCE node
I20260927 15:12:07.031940 19421 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260927 15:12:07.032538 19421 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260927 15:12:07.033691 19421 hybrid_clock.cc:648] HybridClock initialized: now 1790521927033666 us; error 43 us; skew 500 ppm
Sep 27 15:12:07 dist-test-slave-5s2t krb5kdc[19024](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790521927, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.136.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260927 15:12:07.036405 19421 init.cc:377] Logged in from keytab as kudu/127.17.136.3@KRBTEST.COM (short username kudu)
I20260927 15:12:07.037209 19421 webserver.cc:460] Webserver started at http://127.17.136.3:33403/ using document root <none> and password file <none>
I20260927 15:12:07.037714 19421 fs_manager.cc:359] Metadata directory not provided
I20260927 15:12:07.037773 19421 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260927 15:12:07.037956 19421 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260927 15:12:07.039965 19421 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790521920546562-17952-0/minicluster-data/ts-2/data/instance:
uuid: "6ccd1369ea5e4190a1587e169207b244"
format_stamp: "Formatted at 2026-09-27 15:12:07 on dist-test-slave-5s2t"
server_key: "f93860eb04e803022c7dc482f204c8f5"
server_key_iv: "0b3a610a1304305091a964ee34479fb4"
server_key_version: "encryptionkey@0"
I20260927 15:12:07.040477 19421 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790521920546562-17952-0/minicluster-data/ts-2/wal/instance:
uuid: "6ccd1369ea5e4190a1587e169207b244"
format_stamp: "Formatted at 2026-09-27 15:12:07 on dist-test-slave-5s2t"
server_key: "f93860eb04e803022c7dc482f204c8f5"
server_key_iv: "0b3a610a1304305091a964ee34479fb4"
server_key_version: "encryptionkey@0"
I20260927 15:12:07.044013 19421 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260927 15:12:07.046383 19436 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260927 15:12:07.047643 19421 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260927 15:12:07.047745 19421 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790521920546562-17952-0/minicluster-data/ts-2/data,/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790521920546562-17952-0/minicluster-data/ts-2/wal
uuid: "6ccd1369ea5e4190a1587e169207b244"
format_stamp: "Formatted at 2026-09-27 15:12:07 on dist-test-slave-5s2t"
server_key: "f93860eb04e803022c7dc482f204c8f5"
server_key_iv: "0b3a610a1304305091a964ee34479fb4"
server_key_version: "encryptionkey@0"
I20260927 15:12:07.047837 19421 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790521920546562-17952-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790521920546562-17952-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790521920546562-17952-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260927 15:12:07.061077 19421 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260927 15:12:07.064205 19421 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260927 15:12:07.064378 19421 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260927 15:12:07.065773 19421 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260927 15:12:07.065822 19421 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260927 15:12:07.065874 19421 ts_tablet_manager.cc:610] Registered 0 tablets
I20260927 15:12:07.065902 19421 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Sep 27 15:12:07 dist-test-slave-5s2t krb5kdc[19024](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790521927, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.136.3@KRBTEST.COM for kudu/127.17.136.62@KRBTEST.COM
I20260927 15:12:07.076061 19421 rpc_server.cc:307] RPC server started. Bound to: 127.17.136.3:42129
I20260927 15:12:07.077108 19421 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790521920546562-17952-0/minicluster-data/ts-2/data/info.pb
I20260927 15:12:07.078087 19551 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.136.3:42129 every 8 connection(s)
I20260927 15:12:07.078927 19118 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:07.066568 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.136.3:57857 (local address 127.17.136.62:42991)
0927 15:12:07.066678 (+ 110us) server_negotiation.cc:206] Beginning negotiation
0927 15:12:07.066681 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0927 15:12:07.067716 (+ 1035us) server_negotiation.cc:407] Connection header received
0927 15:12:07.068709 (+ 993us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:12:07.068713 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:12:07.068770 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:12:07.068863 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0927 15:12:07.070125 (+ 1262us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:07.070914 (+ 789us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:07.072230 (+ 1316us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:07.072571 (+ 341us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:07.072686 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:07.075424 (+ 2738us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0927 15:12:07.075427 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0927 15:12:07.075429 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0927 15:12:07.075453 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0927 15:12:07.077000 (+ 1547us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:12:07.077494 (+ 494us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:12:07.077497 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:12:07.077499 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:12:07.077575 (+ 76us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:12:07.077916 (+ 341us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:12:07.077920 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:12:07.077921 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:12:07.078107 (+ 186us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0927 15:12:07.078189 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0927 15:12:07.078655 (+ 466us) server_negotiation.cc:299] Negotiation successful
0927 15:12:07.078768 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260927 15:12:07.079694 19445 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:07.067099 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.62:42991 (local address 127.17.136.3:57857)
0927 15:12:07.067573 (+ 474us) negotiation.cc:107] Waiting for socket to connect
0927 15:12:07.067614 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0927 15:12:07.068441 (+ 827us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0927 15:12:07.069071 (+ 630us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0927 15:12:07.069080 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0927 15:12:07.069430 (+ 350us) client_negotiation.cc:189] Negotiated authn=SASL
0927 15:12:07.069939 (+ 509us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:12:07.069952 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:12:07.071062 (+ 1110us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:12:07.071066 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:12:07.072121 (+ 1055us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:12:07.072133 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:12:07.072736 (+ 603us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:12:07.072740 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:12:07.072924 (+ 184us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:07.073553 (+ 629us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0927 15:12:07.073572 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0927 15:12:07.075240 (+ 1668us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0927 15:12:07.077104 (+ 1864us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0927 15:12:07.077109 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0927 15:12:07.077120 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0927 15:12:07.077390 (+ 270us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0927 15:12:07.077653 (+ 263us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0927 15:12:07.077656 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0927 15:12:07.077658 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0927 15:12:07.077823 (+ 165us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0927 15:12:07.078199 (+ 376us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0927 15:12:07.078204 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0927 15:12:07.078427 (+ 223us) client_negotiation.cc:769] Sending connection context
0927 15:12:07.078583 (+ 156us) client_negotiation.cc:240] Negotiation successful
0927 15:12:07.078874 (+ 291us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":284,"thread_start_us":152,"threads_started":1}
I20260927 15:12:07.080837 19552 heartbeater.cc:347] Connected to a master server at 127.17.136.62:42991
I20260927 15:12:07.080966 19552 heartbeater.cc:464] Registering TS with master...
I20260927 15:12:07.081527 19552 heartbeater.cc:511] Master 127.17.136.62:42991 requested a full tablet report, sending...
I20260927 15:12:07.081631 17952 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu as pid 19421
I20260927 15:12:07.081724 17952 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790521920546562-17952-0/minicluster-data/ts-2/wal/instance
I20260927 15:12:07.081948 17952 external_mini_cluster.cc:1428] Setting key d3124ac12ec229280657eea8d82ee2df
I20260927 15:12:07.082602 19068 ts_manager.cc:194] Registered new tserver with Master: 6ccd1369ea5e4190a1587e169207b244 (127.17.136.3:42129)
I20260927 15:12:07.083308 19068 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.136.3@KRBTEST.COM'} at 127.17.136.3:57857
I20260927 15:12:07.084653 17952 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260927 15:12:07.089689 19558 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:07.082890 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.62:42991 (local address 127.17.136.3:44885)
0927 15:12:07.083222 (+ 332us) negotiation.cc:107] Waiting for socket to connect
0927 15:12:07.083235 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0927 15:12:07.083345 (+ 110us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0927 15:12:07.083643 (+ 298us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0927 15:12:07.083645 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0927 15:12:07.083813 (+ 168us) client_negotiation.cc:189] Negotiated authn=SASL
0927 15:12:07.083925 (+ 112us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:12:07.083932 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:12:07.084775 (+ 843us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:12:07.084779 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:12:07.085571 (+ 792us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:12:07.085581 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:12:07.086074 (+ 493us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:12:07.086076 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:12:07.086144 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:07.086545 (+ 401us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0927 15:12:07.086558 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0927 15:12:07.086924 (+ 366us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0927 15:12:07.088390 (+ 1466us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0927 15:12:07.088393 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0927 15:12:07.088396 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0927 15:12:07.088618 (+ 222us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0927 15:12:07.088837 (+ 219us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0927 15:12:07.088840 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0927 15:12:07.088842 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0927 15:12:07.088927 (+ 85us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0927 15:12:07.089275 (+ 348us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0927 15:12:07.089278 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0927 15:12:07.089349 (+ 71us) client_negotiation.cc:769] Sending connection context
0927 15:12:07.089427 (+ 78us) client_negotiation.cc:240] Negotiation successful
0927 15:12:07.089536 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":260,"thread_start_us":93,"threads_started":1}
I20260927 15:12:07.089756 19118 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:07.082983 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.136.3:44885 (local address 127.17.136.62:42991)
0927 15:12:07.083085 (+ 102us) server_negotiation.cc:206] Beginning negotiation
0927 15:12:07.083089 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0927 15:12:07.083308 (+ 219us) server_negotiation.cc:407] Connection header received
0927 15:12:07.083447 (+ 139us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:12:07.083449 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:12:07.083488 (+ 39us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:12:07.083534 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0927 15:12:07.084074 (+ 540us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:07.084635 (+ 561us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:07.085682 (+ 1047us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:07.085966 (+ 284us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:07.086061 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:07.087051 (+ 990us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0927 15:12:07.087054 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0927 15:12:07.087056 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0927 15:12:07.087075 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0927 15:12:07.088279 (+ 1204us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:12:07.088697 (+ 418us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:12:07.088700 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:12:07.088701 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:12:07.088765 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:12:07.089007 (+ 242us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:12:07.089010 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:12:07.089011 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:12:07.089188 (+ 177us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0927 15:12:07.089281 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0927 15:12:07.089506 (+ 225us) server_negotiation.cc:299] Negotiation successful
0927 15:12:07.089611 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
Sep 27 15:12:07 dist-test-slave-5s2t krb5kdc[19024](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790521927, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Sep 27 15:12:07 dist-test-slave-5s2t krb5kdc[19024](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790521927, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.17.136.62@KRBTEST.COM
I20260927 15:12:07.108203 19118 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:07.101062 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43700 (local address 127.17.136.62:42991)
0927 15:12:07.101171 (+ 109us) server_negotiation.cc:206] Beginning negotiation
0927 15:12:07.101174 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0927 15:12:07.101186 (+ 12us) server_negotiation.cc:407] Connection header received
0927 15:12:07.101223 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:12:07.101225 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:12:07.101261 (+ 36us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:12:07.101327 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0927 15:12:07.101938 (+ 611us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:07.102467 (+ 529us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:07.103223 (+ 756us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:07.103476 (+ 253us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:07.103556 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:07.105627 (+ 2071us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0927 15:12:07.105630 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0927 15:12:07.105632 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0927 15:12:07.105653 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0927 15:12:07.106901 (+ 1248us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:12:07.107296 (+ 395us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:12:07.107299 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:12:07.107300 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:12:07.107369 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:12:07.107566 (+ 197us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:12:07.107568 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:12:07.107569 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:12:07.107729 (+ 160us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0927 15:12:07.107822 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0927 15:12:07.107969 (+ 147us) server_negotiation.cc:299] Negotiation successful
0927 15:12:07.108086 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260927 15:12:07.110918 19068 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:43700:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:12:07.113871 19068 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:12:07.127084 19573 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:07.122279 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57836 (local address 127.17.136.2:42875)
0927 15:12:07.122836 (+ 557us) server_negotiation.cc:206] Beginning negotiation
0927 15:12:07.122850 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0927 15:12:07.122870 (+ 20us) server_negotiation.cc:407] Connection header received
0927 15:12:07.122937 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:12:07.122941 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:12:07.123106 (+ 165us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:12:07.123244 (+ 138us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0927 15:12:07.123602 (+ 358us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:07.124337 (+ 735us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:07.125782 (+ 1445us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:07.126458 (+ 676us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:07.126555 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:07.126719 (+ 164us) server_negotiation.cc:1035] Waiting for connection context
0927 15:12:07.126855 (+ 136us) server_negotiation.cc:299] Negotiation successful
0927 15:12:07.126941 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":470,"thread_start_us":106,"threads_started":1}
I20260927 15:12:07.127076 19569 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:07.121641 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.2:42875 (local address 127.0.0.1:57836)
0927 15:12:07.122384 (+ 743us) negotiation.cc:107] Waiting for socket to connect
0927 15:12:07.122399 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0927 15:12:07.122477 (+ 78us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0927 15:12:07.123233 (+ 756us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0927 15:12:07.123236 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0927 15:12:07.123279 (+ 43us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0927 15:12:07.123474 (+ 195us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:12:07.123489 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:12:07.124438 (+ 949us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:12:07.124441 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:12:07.125650 (+ 1209us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:12:07.125660 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:12:07.126567 (+ 907us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:12:07.126570 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:12:07.126680 (+ 110us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:07.126717 (+ 37us) client_negotiation.cc:769] Sending connection context
0927 15:12:07.126821 (+ 104us) client_negotiation.cc:240] Negotiation successful
0927 15:12:07.126935 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":684,"mutex_wait_us":36,"thread_start_us":89,"threads_started":1}
I20260927 15:12:07.127498 19570 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:07.121516 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.1:37499 (local address 127.0.0.1:46054)
0927 15:12:07.122121 (+ 605us) negotiation.cc:107] Waiting for socket to connect
0927 15:12:07.122168 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0927 15:12:07.122296 (+ 128us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0927 15:12:07.123207 (+ 911us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0927 15:12:07.123214 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0927 15:12:07.123235 (+ 21us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0927 15:12:07.123464 (+ 229us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:12:07.123472 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:12:07.124909 (+ 1437us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:12:07.124911 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:12:07.125899 (+ 988us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:12:07.125907 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:12:07.127098 (+ 1191us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:12:07.127101 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:12:07.127186 (+ 85us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:07.127210 (+ 24us) client_negotiation.cc:769] Sending connection context
0927 15:12:07.127303 (+ 93us) client_negotiation.cc:240] Negotiation successful
0927 15:12:07.127367 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":423,"mutex_wait_us":56,"thread_start_us":72,"threads_started":1}
I20260927 15:12:07.127744 19574 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:07.122290 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56444 (local address 127.17.136.3:42129)
0927 15:12:07.123006 (+ 716us) server_negotiation.cc:206] Beginning negotiation
0927 15:12:07.123018 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0927 15:12:07.123039 (+ 21us) server_negotiation.cc:407] Connection header received
0927 15:12:07.123108 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:12:07.123112 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:12:07.123289 (+ 177us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:12:07.123427 (+ 138us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0927 15:12:07.123647 (+ 220us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:07.124768 (+ 1121us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:07.126165 (+ 1397us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:07.126883 (+ 718us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:07.126967 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:07.127091 (+ 124us) server_negotiation.cc:1035] Waiting for connection context
0927 15:12:07.127520 (+ 429us) server_negotiation.cc:299] Negotiation successful
0927 15:12:07.127615 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":609,"thread_start_us":112,"threads_started":1}
I20260927 15:12:07.127941 19571 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:07.121656 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46054 (local address 127.17.136.1:37499)
0927 15:12:07.122569 (+ 913us) server_negotiation.cc:206] Beginning negotiation
0927 15:12:07.122581 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0927 15:12:07.122602 (+ 21us) server_negotiation.cc:407] Connection header received
0927 15:12:07.122673 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:12:07.122678 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:12:07.122882 (+ 204us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:12:07.123018 (+ 136us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0927 15:12:07.123587 (+ 569us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:07.124766 (+ 1179us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:07.126005 (+ 1239us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:07.126777 (+ 772us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:07.126876 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:07.127025 (+ 149us) server_negotiation.cc:1035] Waiting for connection context
0927 15:12:07.127710 (+ 685us) server_negotiation.cc:299] Negotiation successful
0927 15:12:07.127793 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":814,"thread_start_us":84,"threads_started":1}
I20260927 15:12:07.128000 19572 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:07.121845 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.3:42129 (local address 127.0.0.1:56444)
0927 15:12:07.122695 (+ 850us) negotiation.cc:107] Waiting for socket to connect
0927 15:12:07.122707 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0927 15:12:07.122779 (+ 72us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0927 15:12:07.123402 (+ 623us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0927 15:12:07.123405 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0927 15:12:07.123419 (+ 14us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0927 15:12:07.123523 (+ 104us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:12:07.123529 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:12:07.124879 (+ 1350us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:12:07.124883 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:12:07.126057 (+ 1174us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:12:07.126066 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:12:07.127288 (+ 1222us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:12:07.127293 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:12:07.127378 (+ 85us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:07.127397 (+ 19us) client_negotiation.cc:769] Sending connection context
0927 15:12:07.127465 (+ 68us) client_negotiation.cc:240] Negotiation successful
0927 15:12:07.127522 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":800,"mutex_wait_us":44,"thread_start_us":85,"threads_started":1}
I20260927 15:12:07.130256 19486 tablet_service.cc:1467] Processing CreateTablet for tablet c957f1c2d2c141af8c24ddb6d6eb8339 (DEFAULT_TABLE table=test-table [id=81a694c31ae54b259ed883e2d5519224]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:12:07.130265 19346 tablet_service.cc:1467] Processing CreateTablet for tablet c957f1c2d2c141af8c24ddb6d6eb8339 (DEFAULT_TABLE table=test-table [id=81a694c31ae54b259ed883e2d5519224]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:12:07.130265 19206 tablet_service.cc:1467] Processing CreateTablet for tablet c957f1c2d2c141af8c24ddb6d6eb8339 (DEFAULT_TABLE table=test-table [id=81a694c31ae54b259ed883e2d5519224]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:12:07.131168 19486 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c957f1c2d2c141af8c24ddb6d6eb8339. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:12:07.131206 19346 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c957f1c2d2c141af8c24ddb6d6eb8339. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:12:07.131206 19206 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c957f1c2d2c141af8c24ddb6d6eb8339. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:12:07.138324 19575 tablet_bootstrap.cc:492] T c957f1c2d2c141af8c24ddb6d6eb8339 P 6ccd1369ea5e4190a1587e169207b244: Bootstrap starting.
I20260927 15:12:07.139302 19576 tablet_bootstrap.cc:492] T c957f1c2d2c141af8c24ddb6d6eb8339 P ee396b1c470f43f5a82199ea49511d5f: Bootstrap starting.
I20260927 15:12:07.139302 19577 tablet_bootstrap.cc:492] T c957f1c2d2c141af8c24ddb6d6eb8339 P 470d26ed44b749b983f748436754bb95: Bootstrap starting.
I20260927 15:12:07.140286 19575 tablet_bootstrap.cc:654] T c957f1c2d2c141af8c24ddb6d6eb8339 P 6ccd1369ea5e4190a1587e169207b244: Neither blocks nor log segments found. Creating new log.
I20260927 15:12:07.141017 19575 log.cc:824] T c957f1c2d2c141af8c24ddb6d6eb8339 P 6ccd1369ea5e4190a1587e169207b244: Log is configured to *not* fsync() on all Append() calls
I20260927 15:12:07.141325 19576 tablet_bootstrap.cc:654] T c957f1c2d2c141af8c24ddb6d6eb8339 P ee396b1c470f43f5a82199ea49511d5f: Neither blocks nor log segments found. Creating new log.
I20260927 15:12:07.141325 19577 tablet_bootstrap.cc:654] T c957f1c2d2c141af8c24ddb6d6eb8339 P 470d26ed44b749b983f748436754bb95: Neither blocks nor log segments found. Creating new log.
I20260927 15:12:07.142113 19577 log.cc:824] T c957f1c2d2c141af8c24ddb6d6eb8339 P 470d26ed44b749b983f748436754bb95: Log is configured to *not* fsync() on all Append() calls
I20260927 15:12:07.142112 19576 log.cc:824] T c957f1c2d2c141af8c24ddb6d6eb8339 P ee396b1c470f43f5a82199ea49511d5f: Log is configured to *not* fsync() on all Append() calls
I20260927 15:12:07.142743 19575 tablet_bootstrap.cc:492] T c957f1c2d2c141af8c24ddb6d6eb8339 P 6ccd1369ea5e4190a1587e169207b244: No bootstrap required, opened a new log
I20260927 15:12:07.142935 19575 ts_tablet_manager.cc:1397] T c957f1c2d2c141af8c24ddb6d6eb8339 P 6ccd1369ea5e4190a1587e169207b244: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s
I20260927 15:12:07.143858 19577 tablet_bootstrap.cc:492] T c957f1c2d2c141af8c24ddb6d6eb8339 P 470d26ed44b749b983f748436754bb95: No bootstrap required, opened a new log
I20260927 15:12:07.144030 19577 ts_tablet_manager.cc:1397] T c957f1c2d2c141af8c24ddb6d6eb8339 P 470d26ed44b749b983f748436754bb95: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s
I20260927 15:12:07.144178 19576 tablet_bootstrap.cc:492] T c957f1c2d2c141af8c24ddb6d6eb8339 P ee396b1c470f43f5a82199ea49511d5f: No bootstrap required, opened a new log
I20260927 15:12:07.144336 19576 ts_tablet_manager.cc:1397] T c957f1c2d2c141af8c24ddb6d6eb8339 P ee396b1c470f43f5a82199ea49511d5f: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s
I20260927 15:12:07.146772 19575 raft_consensus.cc:348] T c957f1c2d2c141af8c24ddb6d6eb8339 P 6ccd1369ea5e4190a1587e169207b244 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee396b1c470f43f5a82199ea49511d5f" member_type: VOTER last_known_addr { host: "127.17.136.1" port: 37499 } } peers { permanent_uuid: "470d26ed44b749b983f748436754bb95" member_type: VOTER last_known_addr { host: "127.17.136.2" port: 42875 } } peers { permanent_uuid: "6ccd1369ea5e4190a1587e169207b244" member_type: VOTER last_known_addr { host: "127.17.136.3" port: 42129 } }
I20260927 15:12:07.146862 19577 raft_consensus.cc:348] T c957f1c2d2c141af8c24ddb6d6eb8339 P 470d26ed44b749b983f748436754bb95 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee396b1c470f43f5a82199ea49511d5f" member_type: VOTER last_known_addr { host: "127.17.136.1" port: 37499 } } peers { permanent_uuid: "470d26ed44b749b983f748436754bb95" member_type: VOTER last_known_addr { host: "127.17.136.2" port: 42875 } } peers { permanent_uuid: "6ccd1369ea5e4190a1587e169207b244" member_type: VOTER last_known_addr { host: "127.17.136.3" port: 42129 } }
I20260927 15:12:07.147039 19575 raft_consensus.cc:374] T c957f1c2d2c141af8c24ddb6d6eb8339 P 6ccd1369ea5e4190a1587e169207b244 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:12:07.147068 19577 raft_consensus.cc:374] T c957f1c2d2c141af8c24ddb6d6eb8339 P 470d26ed44b749b983f748436754bb95 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:12:07.147089 19575 raft_consensus.cc:729] T c957f1c2d2c141af8c24ddb6d6eb8339 P 6ccd1369ea5e4190a1587e169207b244 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6ccd1369ea5e4190a1587e169207b244, State: Initialized, Role: FOLLOWER
I20260927 15:12:07.147122 19577 raft_consensus.cc:729] T c957f1c2d2c141af8c24ddb6d6eb8339 P 470d26ed44b749b983f748436754bb95 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 470d26ed44b749b983f748436754bb95, State: Initialized, Role: FOLLOWER
I20260927 15:12:07.147543 19577 consensus_queue.cc:260] T c957f1c2d2c141af8c24ddb6d6eb8339 P 470d26ed44b749b983f748436754bb95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee396b1c470f43f5a82199ea49511d5f" member_type: VOTER last_known_addr { host: "127.17.136.1" port: 37499 } } peers { permanent_uuid: "470d26ed44b749b983f748436754bb95" member_type: VOTER last_known_addr { host: "127.17.136.2" port: 42875 } } peers { permanent_uuid: "6ccd1369ea5e4190a1587e169207b244" member_type: VOTER last_known_addr { host: "127.17.136.3" port: 42129 } }
I20260927 15:12:07.147570 19575 consensus_queue.cc:260] T c957f1c2d2c141af8c24ddb6d6eb8339 P 6ccd1369ea5e4190a1587e169207b244 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee396b1c470f43f5a82199ea49511d5f" member_type: VOTER last_known_addr { host: "127.17.136.1" port: 37499 } } peers { permanent_uuid: "470d26ed44b749b983f748436754bb95" member_type: VOTER last_known_addr { host: "127.17.136.2" port: 42875 } } peers { permanent_uuid: "6ccd1369ea5e4190a1587e169207b244" member_type: VOTER last_known_addr { host: "127.17.136.3" port: 42129 } }
I20260927 15:12:07.147857 19576 raft_consensus.cc:348] T c957f1c2d2c141af8c24ddb6d6eb8339 P ee396b1c470f43f5a82199ea49511d5f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee396b1c470f43f5a82199ea49511d5f" member_type: VOTER last_known_addr { host: "127.17.136.1" port: 37499 } } peers { permanent_uuid: "470d26ed44b749b983f748436754bb95" member_type: VOTER last_known_addr { host: "127.17.136.2" port: 42875 } } peers { permanent_uuid: "6ccd1369ea5e4190a1587e169207b244" member_type: VOTER last_known_addr { host: "127.17.136.3" port: 42129 } }
I20260927 15:12:07.148087 19576 raft_consensus.cc:374] T c957f1c2d2c141af8c24ddb6d6eb8339 P ee396b1c470f43f5a82199ea49511d5f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:12:07.148138 19576 raft_consensus.cc:729] T c957f1c2d2c141af8c24ddb6d6eb8339 P ee396b1c470f43f5a82199ea49511d5f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ee396b1c470f43f5a82199ea49511d5f, State: Initialized, Role: FOLLOWER
I20260927 15:12:07.148375 19552 heartbeater.cc:503] Master 127.17.136.62:42991 was elected leader, sending a full tablet report...
I20260927 15:12:07.148481 19576 consensus_queue.cc:260] T c957f1c2d2c141af8c24ddb6d6eb8339 P ee396b1c470f43f5a82199ea49511d5f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee396b1c470f43f5a82199ea49511d5f" member_type: VOTER last_known_addr { host: "127.17.136.1" port: 37499 } } peers { permanent_uuid: "470d26ed44b749b983f748436754bb95" member_type: VOTER last_known_addr { host: "127.17.136.2" port: 42875 } } peers { permanent_uuid: "6ccd1369ea5e4190a1587e169207b244" member_type: VOTER last_known_addr { host: "127.17.136.3" port: 42129 } }
I20260927 15:12:07.148586 19577 ts_tablet_manager.cc:1428] T c957f1c2d2c141af8c24ddb6d6eb8339 P 470d26ed44b749b983f748436754bb95: Time spent starting tablet: real 0.005s user 0.005s sys 0.000s
I20260927 15:12:07.148890 19412 heartbeater.cc:503] Master 127.17.136.62:42991 was elected leader, sending a full tablet report...
I20260927 15:12:07.149132 19272 heartbeater.cc:503] Master 127.17.136.62:42991 was elected leader, sending a full tablet report...
I20260927 15:12:07.149325 19576 ts_tablet_manager.cc:1428] T c957f1c2d2c141af8c24ddb6d6eb8339 P ee396b1c470f43f5a82199ea49511d5f: Time spent starting tablet: real 0.005s user 0.005s sys 0.000s
I20260927 15:12:07.149861 19575 ts_tablet_manager.cc:1428] T c957f1c2d2c141af8c24ddb6d6eb8339 P 6ccd1369ea5e4190a1587e169207b244: Time spent starting tablet: real 0.007s user 0.006s sys 0.000s
W20260927 15:12:07.170644 19273 tablet.cc:2369] T c957f1c2d2c141af8c24ddb6d6eb8339 P ee396b1c470f43f5a82199ea49511d5f: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260927 15:12:07.328275 19553 tablet.cc:2369] T c957f1c2d2c141af8c24ddb6d6eb8339 P 6ccd1369ea5e4190a1587e169207b244: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260927 15:12:07.366281 19581 raft_consensus.cc:482] T c957f1c2d2c141af8c24ddb6d6eb8339 P 470d26ed44b749b983f748436754bb95 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:12:07.366509 19581 raft_consensus.cc:504] T c957f1c2d2c141af8c24ddb6d6eb8339 P 470d26ed44b749b983f748436754bb95 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee396b1c470f43f5a82199ea49511d5f" member_type: VOTER last_known_addr { host: "127.17.136.1" port: 37499 } } peers { permanent_uuid: "470d26ed44b749b983f748436754bb95" member_type: VOTER last_known_addr { host: "127.17.136.2" port: 42875 } } peers { permanent_uuid: "6ccd1369ea5e4190a1587e169207b244" member_type: VOTER last_known_addr { host: "127.17.136.3" port: 42129 } }
I20260927 15:12:07.367798 19581 leader_election.cc:288] T c957f1c2d2c141af8c24ddb6d6eb8339 P 470d26ed44b749b983f748436754bb95 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ee396b1c470f43f5a82199ea49511d5f (127.17.136.1:37499), 6ccd1369ea5e4190a1587e169207b244 (127.17.136.3:42129)
I20260927 15:12:07.371421 19305 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:07.368092 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.3:42129 (local address 127.17.136.2:52577)
0927 15:12:07.368292 (+ 200us) negotiation.cc:107] Waiting for socket to connect
0927 15:12:07.368307 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0927 15:12:07.368412 (+ 105us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0927 15:12:07.368677 (+ 265us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0927 15:12:07.368679 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0927 15:12:07.368696 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0927 15:12:07.368796 (+ 100us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:12:07.368802 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:12:07.369510 (+ 708us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:12:07.369513 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:12:07.370378 (+ 865us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:12:07.370387 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:12:07.370999 (+ 612us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:12:07.371002 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:12:07.371105 (+ 103us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:07.371123 (+ 18us) client_negotiation.cc:769] Sending connection context
0927 15:12:07.371186 (+ 63us) client_negotiation.cc:240] Negotiation successful
0927 15:12:07.371284 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":119,"mutex_wait_us":43}
I20260927 15:12:07.371421 19574 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:07.368184 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.136.2:52577 (local address 127.17.136.3:42129)
0927 15:12:07.368314 (+ 130us) server_negotiation.cc:206] Beginning negotiation
0927 15:12:07.368319 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0927 15:12:07.368488 (+ 169us) server_negotiation.cc:407] Connection header received
0927 15:12:07.368539 (+ 51us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:12:07.368542 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:12:07.368589 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:12:07.368656 (+ 67us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0927 15:12:07.368898 (+ 242us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:07.369400 (+ 502us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:07.370501 (+ 1101us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:07.370892 (+ 391us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:07.370999 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:07.371052 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0927 15:12:07.371212 (+ 160us) server_negotiation.cc:299] Negotiation successful
0927 15:12:07.371300 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260927 15:12:07.372112 19584 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:07.368130 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.1:37499 (local address 127.17.136.2:42359)
0927 15:12:07.368473 (+ 343us) negotiation.cc:107] Waiting for socket to connect
0927 15:12:07.368484 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0927 15:12:07.368601 (+ 117us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0927 15:12:07.368841 (+ 240us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0927 15:12:07.368844 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0927 15:12:07.368859 (+ 15us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0927 15:12:07.368971 (+ 112us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:12:07.368976 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:12:07.369662 (+ 686us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:12:07.369666 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:12:07.370862 (+ 1196us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:12:07.370871 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:12:07.371678 (+ 807us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:12:07.371681 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:12:07.371769 (+ 88us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:07.371791 (+ 22us) client_negotiation.cc:769] Sending connection context
0927 15:12:07.371927 (+ 136us) client_negotiation.cc:240] Negotiation successful
0927 15:12:07.371989 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":292,"mutex_wait_us":19,"thread_start_us":99,"threads_started":1}
I20260927 15:12:07.372153 19571 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:07.368155 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.136.2:42359 (local address 127.17.136.1:37499)
0927 15:12:07.368324 (+ 169us) server_negotiation.cc:206] Beginning negotiation
0927 15:12:07.368329 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0927 15:12:07.368566 (+ 237us) server_negotiation.cc:407] Connection header received
0927 15:12:07.368722 (+ 156us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:12:07.368724 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:12:07.368764 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:12:07.368824 (+ 60us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0927 15:12:07.369074 (+ 250us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:07.369569 (+ 495us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:07.370981 (+ 1412us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:07.371422 (+ 441us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:07.371532 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:07.371583 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0927 15:12:07.371959 (+ 376us) server_negotiation.cc:299] Negotiation successful
0927 15:12:07.372044 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":91}
I20260927 15:12:07.372242 19506 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c957f1c2d2c141af8c24ddb6d6eb8339" candidate_uuid: "470d26ed44b749b983f748436754bb95" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ccd1369ea5e4190a1587e169207b244" is_pre_election: true
I20260927 15:12:07.372577 19506 raft_consensus.cc:2454] T c957f1c2d2c141af8c24ddb6d6eb8339 P 6ccd1369ea5e4190a1587e169207b244 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 470d26ed44b749b983f748436754bb95 in term 0.
I20260927 15:12:07.372685 19226 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c957f1c2d2c141af8c24ddb6d6eb8339" candidate_uuid: "470d26ed44b749b983f748436754bb95" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee396b1c470f43f5a82199ea49511d5f" is_pre_election: true
I20260927 15:12:07.373018 19226 raft_consensus.cc:2454] T c957f1c2d2c141af8c24ddb6d6eb8339 P ee396b1c470f43f5a82199ea49511d5f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 470d26ed44b749b983f748436754bb95 in term 0.
I20260927 15:12:07.373064 19297 leader_election.cc:302] T c957f1c2d2c141af8c24ddb6d6eb8339 P 470d26ed44b749b983f748436754bb95 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 470d26ed44b749b983f748436754bb95, 6ccd1369ea5e4190a1587e169207b244; no voters:
I20260927 15:12:07.373349 19581 raft_consensus.cc:2781] T c957f1c2d2c141af8c24ddb6d6eb8339 P 470d26ed44b749b983f748436754bb95 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 15:12:07.373427 19581 raft_consensus.cc:482] T c957f1c2d2c141af8c24ddb6d6eb8339 P 470d26ed44b749b983f748436754bb95 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 15:12:07.373458 19581 raft_consensus.cc:3037] T c957f1c2d2c141af8c24ddb6d6eb8339 P 470d26ed44b749b983f748436754bb95 [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:12:07.374503 19581 raft_consensus.cc:504] T c957f1c2d2c141af8c24ddb6d6eb8339 P 470d26ed44b749b983f748436754bb95 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee396b1c470f43f5a82199ea49511d5f" member_type: VOTER last_known_addr { host: "127.17.136.1" port: 37499 } } peers { permanent_uuid: "470d26ed44b749b983f748436754bb95" member_type: VOTER last_known_addr { host: "127.17.136.2" port: 42875 } } peers { permanent_uuid: "6ccd1369ea5e4190a1587e169207b244" member_type: VOTER last_known_addr { host: "127.17.136.3" port: 42129 } }
I20260927 15:12:07.374845 19581 leader_election.cc:288] T c957f1c2d2c141af8c24ddb6d6eb8339 P 470d26ed44b749b983f748436754bb95 [CANDIDATE]: Term 1 election: Requested vote from peers ee396b1c470f43f5a82199ea49511d5f (127.17.136.1:37499), 6ccd1369ea5e4190a1587e169207b244 (127.17.136.3:42129)
I20260927 15:12:07.375196 19226 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c957f1c2d2c141af8c24ddb6d6eb8339" candidate_uuid: "470d26ed44b749b983f748436754bb95" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee396b1c470f43f5a82199ea49511d5f"
I20260927 15:12:07.375221 19506 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c957f1c2d2c141af8c24ddb6d6eb8339" candidate_uuid: "470d26ed44b749b983f748436754bb95" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ccd1369ea5e4190a1587e169207b244"
I20260927 15:12:07.375353 19506 raft_consensus.cc:3037] T c957f1c2d2c141af8c24ddb6d6eb8339 P 6ccd1369ea5e4190a1587e169207b244 [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:12:07.375353 19226 raft_consensus.cc:3037] T c957f1c2d2c141af8c24ddb6d6eb8339 P ee396b1c470f43f5a82199ea49511d5f [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:12:07.376641 19226 raft_consensus.cc:2454] T c957f1c2d2c141af8c24ddb6d6eb8339 P ee396b1c470f43f5a82199ea49511d5f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 470d26ed44b749b983f748436754bb95 in term 1.
I20260927 15:12:07.376947 19299 leader_election.cc:302] T c957f1c2d2c141af8c24ddb6d6eb8339 P 470d26ed44b749b983f748436754bb95 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 470d26ed44b749b983f748436754bb95, ee396b1c470f43f5a82199ea49511d5f; no voters:
I20260927 15:12:07.377087 19506 raft_consensus.cc:2454] T c957f1c2d2c141af8c24ddb6d6eb8339 P 6ccd1369ea5e4190a1587e169207b244 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 470d26ed44b749b983f748436754bb95 in term 1.
I20260927 15:12:07.377115 19581 raft_consensus.cc:2781] T c957f1c2d2c141af8c24ddb6d6eb8339 P 470d26ed44b749b983f748436754bb95 [term 1 FOLLOWER]: Leader election won for term 1
I20260927 15:12:07.377331 19581 raft_consensus.cc:686] T c957f1c2d2c141af8c24ddb6d6eb8339 P 470d26ed44b749b983f748436754bb95 [term 1 LEADER]: Becoming Leader. State: Replica: 470d26ed44b749b983f748436754bb95, State: Running, Role: LEADER
I20260927 15:12:07.377689 19581 consensus_queue.cc:237] T c957f1c2d2c141af8c24ddb6d6eb8339 P 470d26ed44b749b983f748436754bb95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee396b1c470f43f5a82199ea49511d5f" member_type: VOTER last_known_addr { host: "127.17.136.1" port: 37499 } } peers { permanent_uuid: "470d26ed44b749b983f748436754bb95" member_type: VOTER last_known_addr { host: "127.17.136.2" port: 42875 } } peers { permanent_uuid: "6ccd1369ea5e4190a1587e169207b244" member_type: VOTER last_known_addr { host: "127.17.136.3" port: 42129 } }
W20260927 15:12:07.378432 19413 tablet.cc:2369] T c957f1c2d2c141af8c24ddb6d6eb8339 P 470d26ed44b749b983f748436754bb95: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260927 15:12:07.380849 19068 catalog_manager.cc:5495] T c957f1c2d2c141af8c24ddb6d6eb8339 P 470d26ed44b749b983f748436754bb95 reported cstate change: term changed from 0 to 1, leader changed from <none> to 470d26ed44b749b983f748436754bb95 (127.17.136.2). New cstate: current_term: 1 leader_uuid: "470d26ed44b749b983f748436754bb95" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee396b1c470f43f5a82199ea49511d5f" member_type: VOTER last_known_addr { host: "127.17.136.1" port: 37499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "470d26ed44b749b983f748436754bb95" member_type: VOTER last_known_addr { host: "127.17.136.2" port: 42875 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6ccd1369ea5e4190a1587e169207b244" member_type: VOTER last_known_addr { host: "127.17.136.3" port: 42129 } health_report { overall_health: UNKNOWN } } }
I20260927 15:12:07.423808 19573 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:07.419717 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57852 (local address 127.17.136.2:42875)
0927 15:12:07.419835 (+ 118us) server_negotiation.cc:206] Beginning negotiation
0927 15:12:07.419838 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0927 15:12:07.419874 (+ 36us) server_negotiation.cc:407] Connection header received
0927 15:12:07.420107 (+ 233us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:12:07.420110 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:12:07.420164 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:12:07.420241 (+ 77us) server_negotiation.cc:226] Negotiated authn=TOKEN
0927 15:12:07.420490 (+ 249us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:07.421001 (+ 511us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:07.422282 (+ 1281us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:07.422510 (+ 228us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:07.422589 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:07.422951 (+ 362us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0927 15:12:07.423430 (+ 479us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0927 15:12:07.423518 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0927 15:12:07.423622 (+ 104us) server_negotiation.cc:299] Negotiation successful
0927 15:12:07.423674 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260927 15:12:07.429173 19506 raft_consensus.cc:1261] T c957f1c2d2c141af8c24ddb6d6eb8339 P 6ccd1369ea5e4190a1587e169207b244 [term 1 FOLLOWER]: Refusing update from remote peer 470d26ed44b749b983f748436754bb95: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260927 15:12:07.429173 19226 raft_consensus.cc:1261] T c957f1c2d2c141af8c24ddb6d6eb8339 P ee396b1c470f43f5a82199ea49511d5f [term 1 FOLLOWER]: Refusing update from remote peer 470d26ed44b749b983f748436754bb95: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260927 15:12:07.429768 19585 consensus_queue.cc:1035] T c957f1c2d2c141af8c24ddb6d6eb8339 P 470d26ed44b749b983f748436754bb95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ccd1369ea5e4190a1587e169207b244" member_type: VOTER last_known_addr { host: "127.17.136.3" port: 42129 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260927 15:12:07.429924 19581 consensus_queue.cc:1035] T c957f1c2d2c141af8c24ddb6d6eb8339 P 470d26ed44b749b983f748436754bb95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee396b1c470f43f5a82199ea49511d5f" member_type: VOTER last_known_addr { host: "127.17.136.1" port: 37499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260927 15:12:07.437531 19589 mvcc.cc:205] Tried to move back new op lower bound from 7333977814743638016 to 7333977814541926400. Current Snapshot: MvccSnapshot[applied={T|T < 7333977814743638016}]
I20260927 15:12:07.439335 19590 mvcc.cc:205] Tried to move back new op lower bound from 7333977814743638016 to 7333977814541926400. Current Snapshot: MvccSnapshot[applied={T|T < 7333977814743638016 or (T in {7333977814743638016})}]
I20260927 15:12:07.447839 19067 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:43700:
table { table_name: "test-table" } modify_external_catalogs: true
I20260927 15:12:07.447986 19067 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:43700:
table { table_name: "test-table" } modify_external_catalogs: true
I20260927 15:12:07.450158 19067 catalog_manager.cc:5782] T 00000000000000000000000000000000 P b0f010545b374681bbbcbeb162563687: Sending DeleteTablet for 3 replicas of tablet c957f1c2d2c141af8c24ddb6d6eb8339
I20260927 15:12:07.450847 19346 tablet_service.cc:1514] Processing DeleteTablet for tablet c957f1c2d2c141af8c24ddb6d6eb8339 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:12:07 UTC) from {username='kudu', principal='kudu/127.17.136.62@KRBTEST.COM'} at 127.0.0.1:57836
I20260927 15:12:07.451025 19206 tablet_service.cc:1514] Processing DeleteTablet for tablet c957f1c2d2c141af8c24ddb6d6eb8339 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:12:07 UTC) from {username='kudu', principal='kudu/127.17.136.62@KRBTEST.COM'} at 127.0.0.1:46054
I20260927 15:12:07.451382 19597 tablet_replica.cc:330] T c957f1c2d2c141af8c24ddb6d6eb8339 P 470d26ed44b749b983f748436754bb95: stopping tablet replica
I20260927 15:12:07.451519 19486 tablet_service.cc:1514] Processing DeleteTablet for tablet c957f1c2d2c141af8c24ddb6d6eb8339 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:12:07 UTC) from {username='kudu', principal='kudu/127.17.136.62@KRBTEST.COM'} at 127.0.0.1:56444
I20260927 15:12:07.451700 19597 raft_consensus.cc:2229] T c957f1c2d2c141af8c24ddb6d6eb8339 P 470d26ed44b749b983f748436754bb95 [term 1 LEADER]: Raft consensus shutting down.
I20260927 15:12:07.451678 19067 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:43700:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260927 15:12:07.452011 19597 raft_consensus.cc:2258] T c957f1c2d2c141af8c24ddb6d6eb8339 P 470d26ed44b749b983f748436754bb95 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260927 15:12:07.452065 19067 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:12:07.452317 19598 tablet_replica.cc:330] T c957f1c2d2c141af8c24ddb6d6eb8339 P ee396b1c470f43f5a82199ea49511d5f: stopping tablet replica
I20260927 15:12:07.452634 19598 raft_consensus.cc:2229] T c957f1c2d2c141af8c24ddb6d6eb8339 P ee396b1c470f43f5a82199ea49511d5f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260927 15:12:07.452980 19598 raft_consensus.cc:2258] T c957f1c2d2c141af8c24ddb6d6eb8339 P ee396b1c470f43f5a82199ea49511d5f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 15:12:07.453370 19597 ts_tablet_manager.cc:1905] T c957f1c2d2c141af8c24ddb6d6eb8339 P 470d26ed44b749b983f748436754bb95: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:12:07.453437 19599 tablet_replica.cc:330] T c957f1c2d2c141af8c24ddb6d6eb8339 P 6ccd1369ea5e4190a1587e169207b244: stopping tablet replica
I20260927 15:12:07.454665 19598 ts_tablet_manager.cc:1905] T c957f1c2d2c141af8c24ddb6d6eb8339 P ee396b1c470f43f5a82199ea49511d5f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:12:07.456410 19597 ts_tablet_manager.cc:1918] T c957f1c2d2c141af8c24ddb6d6eb8339 P 470d26ed44b749b983f748436754bb95: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260927 15:12:07.456517 19597 log.cc:1196] T c957f1c2d2c141af8c24ddb6d6eb8339 P 470d26ed44b749b983f748436754bb95: Deleting WAL directory at /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790521920546562-17952-0/minicluster-data/ts-1/wal/wals/c957f1c2d2c141af8c24ddb6d6eb8339
I20260927 15:12:07.456813 19597 ts_tablet_manager.cc:1939] T c957f1c2d2c141af8c24ddb6d6eb8339 P 470d26ed44b749b983f748436754bb95: Deleting consensus metadata
I20260927 15:12:07.457465 19598 ts_tablet_manager.cc:1918] T c957f1c2d2c141af8c24ddb6d6eb8339 P ee396b1c470f43f5a82199ea49511d5f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260927 15:12:07.457614 19598 log.cc:1196] T c957f1c2d2c141af8c24ddb6d6eb8339 P ee396b1c470f43f5a82199ea49511d5f: Deleting WAL directory at /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790521920546562-17952-0/minicluster-data/ts-0/wal/wals/c957f1c2d2c141af8c24ddb6d6eb8339
I20260927 15:12:07.457957 19598 ts_tablet_manager.cc:1939] T c957f1c2d2c141af8c24ddb6d6eb8339 P ee396b1c470f43f5a82199ea49511d5f: Deleting consensus metadata
I20260927 15:12:07.457947 19054 catalog_manager.cc:4841] TS 470d26ed44b749b983f748436754bb95 (127.17.136.2:42875): tablet c957f1c2d2c141af8c24ddb6d6eb8339 (table test-table [id=81a694c31ae54b259ed883e2d5519224]) successfully deleted
I20260927 15:12:07.458563 19206 tablet_service.cc:1467] Processing CreateTablet for tablet a87b6b6132b641f286fa89d80e354d4b (DEFAULT_TABLE table=test-table [id=1926927844af4d9280ce77e0e4d83848]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:12:07.458693 19486 tablet_service.cc:1467] Processing CreateTablet for tablet a87b6b6132b641f286fa89d80e354d4b (DEFAULT_TABLE table=test-table [id=1926927844af4d9280ce77e0e4d83848]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:12:07.458797 19206 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a87b6b6132b641f286fa89d80e354d4b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:12:07.458907 19486 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a87b6b6132b641f286fa89d80e354d4b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:12:07.460837 19576 tablet_bootstrap.cc:492] T a87b6b6132b641f286fa89d80e354d4b P ee396b1c470f43f5a82199ea49511d5f: Bootstrap starting.
I20260927 15:12:07.461108 19575 tablet_bootstrap.cc:492] T a87b6b6132b641f286fa89d80e354d4b P 6ccd1369ea5e4190a1587e169207b244: Bootstrap starting.
I20260927 15:12:07.461427 19346 tablet_service.cc:1467] Processing CreateTablet for tablet a87b6b6132b641f286fa89d80e354d4b (DEFAULT_TABLE table=test-table [id=1926927844af4d9280ce77e0e4d83848]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:12:07.461659 19346 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a87b6b6132b641f286fa89d80e354d4b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:12:07.461727 19576 tablet_bootstrap.cc:654] T a87b6b6132b641f286fa89d80e354d4b P ee396b1c470f43f5a82199ea49511d5f: Neither blocks nor log segments found. Creating new log.
I20260927 15:12:07.462013 19575 tablet_bootstrap.cc:654] T a87b6b6132b641f286fa89d80e354d4b P 6ccd1369ea5e4190a1587e169207b244: Neither blocks nor log segments found. Creating new log.
I20260927 15:12:07.463168 19576 tablet_bootstrap.cc:492] T a87b6b6132b641f286fa89d80e354d4b P ee396b1c470f43f5a82199ea49511d5f: No bootstrap required, opened a new log
I20260927 15:12:07.463279 19576 ts_tablet_manager.cc:1397] T a87b6b6132b641f286fa89d80e354d4b P ee396b1c470f43f5a82199ea49511d5f: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260927 15:12:07.463762 19577 tablet_bootstrap.cc:492] T a87b6b6132b641f286fa89d80e354d4b P 470d26ed44b749b983f748436754bb95: Bootstrap starting.
I20260927 15:12:07.463753 19576 raft_consensus.cc:348] T a87b6b6132b641f286fa89d80e354d4b P ee396b1c470f43f5a82199ea49511d5f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee396b1c470f43f5a82199ea49511d5f" member_type: VOTER last_known_addr { host: "127.17.136.1" port: 37499 } } peers { permanent_uuid: "470d26ed44b749b983f748436754bb95" member_type: VOTER last_known_addr { host: "127.17.136.2" port: 42875 } } peers { permanent_uuid: "6ccd1369ea5e4190a1587e169207b244" member_type: VOTER last_known_addr { host: "127.17.136.3" port: 42129 } }
I20260927 15:12:07.463857 19576 raft_consensus.cc:374] T a87b6b6132b641f286fa89d80e354d4b P ee396b1c470f43f5a82199ea49511d5f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:12:07.463891 19576 raft_consensus.cc:729] T a87b6b6132b641f286fa89d80e354d4b P ee396b1c470f43f5a82199ea49511d5f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ee396b1c470f43f5a82199ea49511d5f, State: Initialized, Role: FOLLOWER
I20260927 15:12:07.464004 19576 consensus_queue.cc:260] T a87b6b6132b641f286fa89d80e354d4b P ee396b1c470f43f5a82199ea49511d5f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee396b1c470f43f5a82199ea49511d5f" member_type: VOTER last_known_addr { host: "127.17.136.1" port: 37499 } } peers { permanent_uuid: "470d26ed44b749b983f748436754bb95" member_type: VOTER last_known_addr { host: "127.17.136.2" port: 42875 } } peers { permanent_uuid: "6ccd1369ea5e4190a1587e169207b244" member_type: VOTER last_known_addr { host: "127.17.136.3" port: 42129 } }
I20260927 15:12:07.463943 19055 catalog_manager.cc:4841] TS ee396b1c470f43f5a82199ea49511d5f (127.17.136.1:37499): tablet c957f1c2d2c141af8c24ddb6d6eb8339 (table test-table [id=81a694c31ae54b259ed883e2d5519224]) successfully deleted
I20260927 15:12:07.464247 19576 ts_tablet_manager.cc:1428] T a87b6b6132b641f286fa89d80e354d4b P ee396b1c470f43f5a82199ea49511d5f: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260927 15:12:07.464634 19577 tablet_bootstrap.cc:654] T a87b6b6132b641f286fa89d80e354d4b P 470d26ed44b749b983f748436754bb95: Neither blocks nor log segments found. Creating new log.
I20260927 15:12:07.465756 19599 raft_consensus.cc:2229] T c957f1c2d2c141af8c24ddb6d6eb8339 P 6ccd1369ea5e4190a1587e169207b244 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260927 15:12:07.465831 19577 tablet_bootstrap.cc:492] T a87b6b6132b641f286fa89d80e354d4b P 470d26ed44b749b983f748436754bb95: No bootstrap required, opened a new log
I20260927 15:12:07.465898 19577 ts_tablet_manager.cc:1397] T a87b6b6132b641f286fa89d80e354d4b P 470d26ed44b749b983f748436754bb95: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260927 15:12:07.466069 19599 raft_consensus.cc:2258] T c957f1c2d2c141af8c24ddb6d6eb8339 P 6ccd1369ea5e4190a1587e169207b244 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 15:12:07.466312 19577 raft_consensus.cc:348] T a87b6b6132b641f286fa89d80e354d4b P 470d26ed44b749b983f748436754bb95 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee396b1c470f43f5a82199ea49511d5f" member_type: VOTER last_known_addr { host: "127.17.136.1" port: 37499 } } peers { permanent_uuid: "470d26ed44b749b983f748436754bb95" member_type: VOTER last_known_addr { host: "127.17.136.2" port: 42875 } } peers { permanent_uuid: "6ccd1369ea5e4190a1587e169207b244" member_type: VOTER last_known_addr { host: "127.17.136.3" port: 42129 } }
I20260927 15:12:07.466406 19577 raft_consensus.cc:374] T a87b6b6132b641f286fa89d80e354d4b P 470d26ed44b749b983f748436754bb95 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:12:07.466434 19577 raft_consensus.cc:729] T a87b6b6132b641f286fa89d80e354d4b P 470d26ed44b749b983f748436754bb95 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 470d26ed44b749b983f748436754bb95, State: Initialized, Role: FOLLOWER
I20260927 15:12:07.466536 19577 consensus_queue.cc:260] T a87b6b6132b641f286fa89d80e354d4b P 470d26ed44b749b983f748436754bb95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee396b1c470f43f5a82199ea49511d5f" member_type: VOTER last_known_addr { host: "127.17.136.1" port: 37499 } } peers { permanent_uuid: "470d26ed44b749b983f748436754bb95" member_type: VOTER last_known_addr { host: "127.17.136.2" port: 42875 } } peers { permanent_uuid: "6ccd1369ea5e4190a1587e169207b244" member_type: VOTER last_known_addr { host: "127.17.136.3" port: 42129 } }
I20260927 15:12:07.466758 19577 ts_tablet_manager.cc:1428] T a87b6b6132b641f286fa89d80e354d4b P 470d26ed44b749b983f748436754bb95: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260927 15:12:07.466864 19575 tablet_bootstrap.cc:492] T a87b6b6132b641f286fa89d80e354d4b P 6ccd1369ea5e4190a1587e169207b244: No bootstrap required, opened a new log
I20260927 15:12:07.466943 19575 ts_tablet_manager.cc:1397] T a87b6b6132b641f286fa89d80e354d4b P 6ccd1369ea5e4190a1587e169207b244: Time spent bootstrapping tablet: real 0.006s user 0.002s sys 0.000s
I20260927 15:12:07.467389 19575 raft_consensus.cc:348] T a87b6b6132b641f286fa89d80e354d4b P 6ccd1369ea5e4190a1587e169207b244 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee396b1c470f43f5a82199ea49511d5f" member_type: VOTER last_known_addr { host: "127.17.136.1" port: 37499 } } peers { permanent_uuid: "470d26ed44b749b983f748436754bb95" member_type: VOTER last_known_addr { host: "127.17.136.2" port: 42875 } } peers { permanent_uuid: "6ccd1369ea5e4190a1587e169207b244" member_type: VOTER last_known_addr { host: "127.17.136.3" port: 42129 } }
I20260927 15:12:07.467492 19575 raft_consensus.cc:374] T a87b6b6132b641f286fa89d80e354d4b P 6ccd1369ea5e4190a1587e169207b244 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:12:07.467521 19575 raft_consensus.cc:729] T a87b6b6132b641f286fa89d80e354d4b P 6ccd1369ea5e4190a1587e169207b244 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6ccd1369ea5e4190a1587e169207b244, State: Initialized, Role: FOLLOWER
I20260927 15:12:07.467623 19575 consensus_queue.cc:260] T a87b6b6132b641f286fa89d80e354d4b P 6ccd1369ea5e4190a1587e169207b244 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee396b1c470f43f5a82199ea49511d5f" member_type: VOTER last_known_addr { host: "127.17.136.1" port: 37499 } } peers { permanent_uuid: "470d26ed44b749b983f748436754bb95" member_type: VOTER last_known_addr { host: "127.17.136.2" port: 42875 } } peers { permanent_uuid: "6ccd1369ea5e4190a1587e169207b244" member_type: VOTER last_known_addr { host: "127.17.136.3" port: 42129 } }
I20260927 15:12:07.467655 19599 ts_tablet_manager.cc:1905] T c957f1c2d2c141af8c24ddb6d6eb8339 P 6ccd1369ea5e4190a1587e169207b244: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:12:07.467847 19575 ts_tablet_manager.cc:1428] T a87b6b6132b641f286fa89d80e354d4b P 6ccd1369ea5e4190a1587e169207b244: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260927 15:12:07.470069 19599 ts_tablet_manager.cc:1918] T c957f1c2d2c141af8c24ddb6d6eb8339 P 6ccd1369ea5e4190a1587e169207b244: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260927 15:12:07.470156 19599 log.cc:1196] T c957f1c2d2c141af8c24ddb6d6eb8339 P 6ccd1369ea5e4190a1587e169207b244: Deleting WAL directory at /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790521920546562-17952-0/minicluster-data/ts-2/wal/wals/c957f1c2d2c141af8c24ddb6d6eb8339
I20260927 15:12:07.470413 19599 ts_tablet_manager.cc:1939] T c957f1c2d2c141af8c24ddb6d6eb8339 P 6ccd1369ea5e4190a1587e169207b244: Deleting consensus metadata
I20260927 15:12:07.471553 19053 catalog_manager.cc:4841] TS 6ccd1369ea5e4190a1587e169207b244 (127.17.136.3:42129): tablet c957f1c2d2c141af8c24ddb6d6eb8339 (table test-table [id=81a694c31ae54b259ed883e2d5519224]) successfully deleted
I20260927 15:12:07.678274 19582 raft_consensus.cc:482] T a87b6b6132b641f286fa89d80e354d4b P 6ccd1369ea5e4190a1587e169207b244 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:12:07.678416 19582 raft_consensus.cc:504] T a87b6b6132b641f286fa89d80e354d4b P 6ccd1369ea5e4190a1587e169207b244 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee396b1c470f43f5a82199ea49511d5f" member_type: VOTER last_known_addr { host: "127.17.136.1" port: 37499 } } peers { permanent_uuid: "470d26ed44b749b983f748436754bb95" member_type: VOTER last_known_addr { host: "127.17.136.2" port: 42875 } } peers { permanent_uuid: "6ccd1369ea5e4190a1587e169207b244" member_type: VOTER last_known_addr { host: "127.17.136.3" port: 42129 } }
I20260927 15:12:07.679445 19582 leader_election.cc:288] T a87b6b6132b641f286fa89d80e354d4b P 6ccd1369ea5e4190a1587e169207b244 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ee396b1c470f43f5a82199ea49511d5f (127.17.136.1:37499), 470d26ed44b749b983f748436754bb95 (127.17.136.2:42875)
I20260927 15:12:07.683509 19571 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:07.679857 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.136.3:48927 (local address 127.17.136.1:37499)
0927 15:12:07.679954 (+ 97us) server_negotiation.cc:206] Beginning negotiation
0927 15:12:07.679959 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0927 15:12:07.680034 (+ 75us) server_negotiation.cc:407] Connection header received
0927 15:12:07.680244 (+ 210us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:12:07.680247 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:12:07.680291 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:12:07.680360 (+ 69us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0927 15:12:07.680646 (+ 286us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:07.681335 (+ 689us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:07.682566 (+ 1231us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:07.682954 (+ 388us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:07.683074 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:07.683130 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0927 15:12:07.683329 (+ 199us) server_negotiation.cc:299] Negotiation successful
0927 15:12:07.683397 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260927 15:12:07.683538 19603 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:07.679692 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.1:37499 (local address 127.17.136.3:48927)
0927 15:12:07.679952 (+ 260us) negotiation.cc:107] Waiting for socket to connect
0927 15:12:07.679967 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0927 15:12:07.680093 (+ 126us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0927 15:12:07.680372 (+ 279us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0927 15:12:07.680375 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0927 15:12:07.680391 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0927 15:12:07.680525 (+ 134us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:12:07.680532 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:12:07.681441 (+ 909us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:12:07.681444 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:12:07.682439 (+ 995us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:12:07.682449 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:12:07.683074 (+ 625us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:12:07.683078 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:12:07.683181 (+ 103us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:07.683226 (+ 45us) client_negotiation.cc:769] Sending connection context
0927 15:12:07.683303 (+ 77us) client_negotiation.cc:240] Negotiation successful
0927 15:12:07.683383 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":186,"mutex_wait_us":48,"thread_start_us":69,"threads_started":1}
I20260927 15:12:07.683621 19573 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:07.679782 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.136.3:58827 (local address 127.17.136.2:42875)
0927 15:12:07.679974 (+ 192us) server_negotiation.cc:206] Beginning negotiation
0927 15:12:07.679979 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0927 15:12:07.680295 (+ 316us) server_negotiation.cc:407] Connection header received
0927 15:12:07.680434 (+ 139us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:12:07.680437 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:12:07.680494 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:12:07.680539 (+ 45us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0927 15:12:07.680926 (+ 387us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:07.681613 (+ 687us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:07.682686 (+ 1073us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:07.683089 (+ 403us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:07.683188 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:07.683238 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0927 15:12:07.683437 (+ 199us) server_negotiation.cc:299] Negotiation successful
0927 15:12:07.683505 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":102}
I20260927 15:12:07.683925 19226 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a87b6b6132b641f286fa89d80e354d4b" candidate_uuid: "6ccd1369ea5e4190a1587e169207b244" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee396b1c470f43f5a82199ea49511d5f" is_pre_election: true
I20260927 15:12:07.684021 19604 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:07.679696 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.2:42875 (local address 127.17.136.3:58827)
0927 15:12:07.680209 (+ 513us) negotiation.cc:107] Waiting for socket to connect
0927 15:12:07.680221 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0927 15:12:07.680318 (+ 97us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0927 15:12:07.680659 (+ 341us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0927 15:12:07.680661 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0927 15:12:07.680676 (+ 15us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0927 15:12:07.680807 (+ 131us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:12:07.680813 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:12:07.681709 (+ 896us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:12:07.681712 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:12:07.682573 (+ 861us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:12:07.682582 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:12:07.683188 (+ 606us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:12:07.683191 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:12:07.683332 (+ 141us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:07.683350 (+ 18us) client_negotiation.cc:769] Sending connection context
0927 15:12:07.683412 (+ 62us) client_negotiation.cc:240] Negotiation successful
0927 15:12:07.683480 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":452,"mutex_wait_us":295,"thread_start_us":79,"threads_started":1}
I20260927 15:12:07.684090 19226 raft_consensus.cc:2454] T a87b6b6132b641f286fa89d80e354d4b P ee396b1c470f43f5a82199ea49511d5f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ccd1369ea5e4190a1587e169207b244 in term 0.
I20260927 15:12:07.684444 19439 leader_election.cc:302] T a87b6b6132b641f286fa89d80e354d4b P 6ccd1369ea5e4190a1587e169207b244 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ccd1369ea5e4190a1587e169207b244, ee396b1c470f43f5a82199ea49511d5f; no voters:
I20260927 15:12:07.684522 19366 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a87b6b6132b641f286fa89d80e354d4b" candidate_uuid: "6ccd1369ea5e4190a1587e169207b244" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "470d26ed44b749b983f748436754bb95" is_pre_election: true
I20260927 15:12:07.684724 19582 raft_consensus.cc:2781] T a87b6b6132b641f286fa89d80e354d4b P 6ccd1369ea5e4190a1587e169207b244 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 15:12:07.684738 19366 raft_consensus.cc:2454] T a87b6b6132b641f286fa89d80e354d4b P 470d26ed44b749b983f748436754bb95 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ccd1369ea5e4190a1587e169207b244 in term 0.
I20260927 15:12:07.684789 19582 raft_consensus.cc:482] T a87b6b6132b641f286fa89d80e354d4b P 6ccd1369ea5e4190a1587e169207b244 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 15:12:07.684824 19582 raft_consensus.cc:3037] T a87b6b6132b641f286fa89d80e354d4b P 6ccd1369ea5e4190a1587e169207b244 [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:12:07.685838 19582 raft_consensus.cc:504] T a87b6b6132b641f286fa89d80e354d4b P 6ccd1369ea5e4190a1587e169207b244 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee396b1c470f43f5a82199ea49511d5f" member_type: VOTER last_known_addr { host: "127.17.136.1" port: 37499 } } peers { permanent_uuid: "470d26ed44b749b983f748436754bb95" member_type: VOTER last_known_addr { host: "127.17.136.2" port: 42875 } } peers { permanent_uuid: "6ccd1369ea5e4190a1587e169207b244" member_type: VOTER last_known_addr { host: "127.17.136.3" port: 42129 } }
I20260927 15:12:07.686156 19582 leader_election.cc:288] T a87b6b6132b641f286fa89d80e354d4b P 6ccd1369ea5e4190a1587e169207b244 [CANDIDATE]: Term 1 election: Requested vote from peers ee396b1c470f43f5a82199ea49511d5f (127.17.136.1:37499), 470d26ed44b749b983f748436754bb95 (127.17.136.2:42875)
I20260927 15:12:07.686452 19226 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a87b6b6132b641f286fa89d80e354d4b" candidate_uuid: "6ccd1369ea5e4190a1587e169207b244" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee396b1c470f43f5a82199ea49511d5f"
I20260927 15:12:07.686472 19366 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a87b6b6132b641f286fa89d80e354d4b" candidate_uuid: "6ccd1369ea5e4190a1587e169207b244" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "470d26ed44b749b983f748436754bb95"
I20260927 15:12:07.686563 19226 raft_consensus.cc:3037] T a87b6b6132b641f286fa89d80e354d4b P ee396b1c470f43f5a82199ea49511d5f [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:12:07.686570 19366 raft_consensus.cc:3037] T a87b6b6132b641f286fa89d80e354d4b P 470d26ed44b749b983f748436754bb95 [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:12:07.687404 19226 raft_consensus.cc:2454] T a87b6b6132b641f286fa89d80e354d4b P ee396b1c470f43f5a82199ea49511d5f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ccd1369ea5e4190a1587e169207b244 in term 1.
I20260927 15:12:07.687579 19366 raft_consensus.cc:2454] T a87b6b6132b641f286fa89d80e354d4b P 470d26ed44b749b983f748436754bb95 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ccd1369ea5e4190a1587e169207b244 in term 1.
I20260927 15:12:07.687656 19439 leader_election.cc:302] T a87b6b6132b641f286fa89d80e354d4b P 6ccd1369ea5e4190a1587e169207b244 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ccd1369ea5e4190a1587e169207b244, ee396b1c470f43f5a82199ea49511d5f; no voters:
I20260927 15:12:07.687815 19582 raft_consensus.cc:2781] T a87b6b6132b641f286fa89d80e354d4b P 6ccd1369ea5e4190a1587e169207b244 [term 1 FOLLOWER]: Leader election won for term 1
I20260927 15:12:07.687975 19582 raft_consensus.cc:686] T a87b6b6132b641f286fa89d80e354d4b P 6ccd1369ea5e4190a1587e169207b244 [term 1 LEADER]: Becoming Leader. State: Replica: 6ccd1369ea5e4190a1587e169207b244, State: Running, Role: LEADER
I20260927 15:12:07.688192 19582 consensus_queue.cc:237] T a87b6b6132b641f286fa89d80e354d4b P 6ccd1369ea5e4190a1587e169207b244 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee396b1c470f43f5a82199ea49511d5f" member_type: VOTER last_known_addr { host: "127.17.136.1" port: 37499 } } peers { permanent_uuid: "470d26ed44b749b983f748436754bb95" member_type: VOTER last_known_addr { host: "127.17.136.2" port: 42875 } } peers { permanent_uuid: "6ccd1369ea5e4190a1587e169207b244" member_type: VOTER last_known_addr { host: "127.17.136.3" port: 42129 } }
I20260927 15:12:07.690166 19068 catalog_manager.cc:5495] T a87b6b6132b641f286fa89d80e354d4b P 6ccd1369ea5e4190a1587e169207b244 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6ccd1369ea5e4190a1587e169207b244 (127.17.136.3). New cstate: current_term: 1 leader_uuid: "6ccd1369ea5e4190a1587e169207b244" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee396b1c470f43f5a82199ea49511d5f" member_type: VOTER last_known_addr { host: "127.17.136.1" port: 37499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "470d26ed44b749b983f748436754bb95" member_type: VOTER last_known_addr { host: "127.17.136.2" port: 42875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6ccd1369ea5e4190a1587e169207b244" member_type: VOTER last_known_addr { host: "127.17.136.3" port: 42129 } health_report { overall_health: HEALTHY } } }
Sep 27 15:12:07 dist-test-slave-5s2t krb5kdc[19024](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790521926, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.136.62@KRBTEST.COM for kudu/127.17.136.62@KRBTEST.COM
I20260927 15:12:07.730533 19612 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:07.716722 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.62:42991 (local address 127.0.0.1:43702)
0927 15:12:07.716998 (+ 276us) negotiation.cc:107] Waiting for socket to connect
0927 15:12:07.717012 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0927 15:12:07.717138 (+ 126us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0927 15:12:07.717350 (+ 212us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0927 15:12:07.717353 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0927 15:12:07.717749 (+ 396us) client_negotiation.cc:189] Negotiated authn=SASL
0927 15:12:07.717845 (+ 96us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:12:07.717852 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:12:07.718567 (+ 715us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:12:07.718571 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:12:07.719121 (+ 550us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:12:07.719129 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:12:07.719560 (+ 431us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:12:07.719563 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:12:07.719660 (+ 97us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:07.725539 (+ 5879us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0927 15:12:07.725552 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0927 15:12:07.727292 (+ 1740us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0927 15:12:07.729042 (+ 1750us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0927 15:12:07.729052 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0927 15:12:07.729059 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0927 15:12:07.729279 (+ 220us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0927 15:12:07.729520 (+ 241us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0927 15:12:07.729523 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0927 15:12:07.729525 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0927 15:12:07.729599 (+ 74us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0927 15:12:07.729995 (+ 396us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0927 15:12:07.730000 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0927 15:12:07.730096 (+ 96us) client_negotiation.cc:769] Sending connection context
0927 15:12:07.730184 (+ 88us) client_negotiation.cc:240] Negotiation successful
0927 15:12:07.730334 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":179,"mutex_wait_us":17,"thread_start_us":105,"threads_started":1}
I20260927 15:12:07.730639 19613 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:07.716795 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43702 (local address 127.17.136.62:42991)
0927 15:12:07.716987 (+ 192us) server_negotiation.cc:206] Beginning negotiation
0927 15:12:07.716996 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0927 15:12:07.717099 (+ 103us) server_negotiation.cc:407] Connection header received
0927 15:12:07.717216 (+ 117us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:12:07.717219 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:12:07.717255 (+ 36us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:12:07.717325 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0927 15:12:07.717958 (+ 633us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:07.718475 (+ 517us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:07.719222 (+ 747us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:07.719470 (+ 248us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:07.719563 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:07.727459 (+ 7896us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0927 15:12:07.727463 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0927 15:12:07.727466 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0927 15:12:07.727493 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0927 15:12:07.728942 (+ 1449us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:12:07.729363 (+ 421us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:12:07.729367 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:12:07.729369 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:12:07.729446 (+ 77us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:12:07.729669 (+ 223us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:12:07.729672 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:12:07.729674 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:12:07.729858 (+ 184us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0927 15:12:07.729956 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0927 15:12:07.730289 (+ 333us) server_negotiation.cc:299] Negotiation successful
0927 15:12:07.730422 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":4,"server-negotiator.queue_time_us":142,"thread_start_us":79,"threads_started":1}
I20260927 15:12:07.735383 19068 catalog_manager.cc:1908] Servicing CreateTable request from {username='kudu', principal='kudu/127.17.136.62@KRBTEST.COM'} at 127.0.0.1:43702:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260927 15:12:07.736162 19068 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:12:07.741395 19206 tablet_service.cc:1467] Processing CreateTablet for tablet 217b8bd1a99a4895aff969d9b1c5cb68 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=03478f0637ae4106b64122ade4c1c41f]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260927 15:12:07.741418 19486 tablet_service.cc:1467] Processing CreateTablet for tablet 217b8bd1a99a4895aff969d9b1c5cb68 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=03478f0637ae4106b64122ade4c1c41f]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260927 15:12:07.741778 19486 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 217b8bd1a99a4895aff969d9b1c5cb68. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:12:07.741782 19206 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 217b8bd1a99a4895aff969d9b1c5cb68. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:12:07.744287 19575 tablet_bootstrap.cc:492] T 217b8bd1a99a4895aff969d9b1c5cb68 P 6ccd1369ea5e4190a1587e169207b244: Bootstrap starting.
I20260927 15:12:07.744556 19346 tablet_service.cc:1467] Processing CreateTablet for tablet 217b8bd1a99a4895aff969d9b1c5cb68 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=03478f0637ae4106b64122ade4c1c41f]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260927 15:12:07.744889 19346 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 217b8bd1a99a4895aff969d9b1c5cb68. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:12:07.745198 19575 tablet_bootstrap.cc:654] T 217b8bd1a99a4895aff969d9b1c5cb68 P 6ccd1369ea5e4190a1587e169207b244: Neither blocks nor log segments found. Creating new log.
I20260927 15:12:07.746368 19575 tablet_bootstrap.cc:492] T 217b8bd1a99a4895aff969d9b1c5cb68 P 6ccd1369ea5e4190a1587e169207b244: No bootstrap required, opened a new log
I20260927 15:12:07.746457 19575 ts_tablet_manager.cc:1397] T 217b8bd1a99a4895aff969d9b1c5cb68 P 6ccd1369ea5e4190a1587e169207b244: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260927 15:12:07.747507 19577 tablet_bootstrap.cc:492] T 217b8bd1a99a4895aff969d9b1c5cb68 P 470d26ed44b749b983f748436754bb95: Bootstrap starting.
I20260927 15:12:07.747833 19576 tablet_bootstrap.cc:492] T 217b8bd1a99a4895aff969d9b1c5cb68 P ee396b1c470f43f5a82199ea49511d5f: Bootstrap starting.
I20260927 15:12:07.748173 19577 tablet_bootstrap.cc:654] T 217b8bd1a99a4895aff969d9b1c5cb68 P 470d26ed44b749b983f748436754bb95: Neither blocks nor log segments found. Creating new log.
I20260927 15:12:07.748744 19576 tablet_bootstrap.cc:654] T 217b8bd1a99a4895aff969d9b1c5cb68 P ee396b1c470f43f5a82199ea49511d5f: Neither blocks nor log segments found. Creating new log.
I20260927 15:12:07.749154 19577 tablet_bootstrap.cc:492] T 217b8bd1a99a4895aff969d9b1c5cb68 P 470d26ed44b749b983f748436754bb95: No bootstrap required, opened a new log
I20260927 15:12:07.749104 19575 raft_consensus.cc:348] T 217b8bd1a99a4895aff969d9b1c5cb68 P 6ccd1369ea5e4190a1587e169207b244 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee396b1c470f43f5a82199ea49511d5f" member_type: VOTER last_known_addr { host: "127.17.136.1" port: 37499 } } peers { permanent_uuid: "470d26ed44b749b983f748436754bb95" member_type: VOTER last_known_addr { host: "127.17.136.2" port: 42875 } } peers { permanent_uuid: "6ccd1369ea5e4190a1587e169207b244" member_type: VOTER last_known_addr { host: "127.17.136.3" port: 42129 } }
I20260927 15:12:07.749210 19575 raft_consensus.cc:374] T 217b8bd1a99a4895aff969d9b1c5cb68 P 6ccd1369ea5e4190a1587e169207b244 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:12:07.749228 19577 ts_tablet_manager.cc:1397] T 217b8bd1a99a4895aff969d9b1c5cb68 P 470d26ed44b749b983f748436754bb95: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260927 15:12:07.749243 19575 raft_consensus.cc:729] T 217b8bd1a99a4895aff969d9b1c5cb68 P 6ccd1369ea5e4190a1587e169207b244 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6ccd1369ea5e4190a1587e169207b244, State: Initialized, Role: FOLLOWER
I20260927 15:12:07.749353 19575 consensus_queue.cc:260] T 217b8bd1a99a4895aff969d9b1c5cb68 P 6ccd1369ea5e4190a1587e169207b244 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee396b1c470f43f5a82199ea49511d5f" member_type: VOTER last_known_addr { host: "127.17.136.1" port: 37499 } } peers { permanent_uuid: "470d26ed44b749b983f748436754bb95" member_type: VOTER last_known_addr { host: "127.17.136.2" port: 42875 } } peers { permanent_uuid: "6ccd1369ea5e4190a1587e169207b244" member_type: VOTER last_known_addr { host: "127.17.136.3" port: 42129 } }
I20260927 15:12:07.749631 19575 ts_tablet_manager.cc:1428] T 217b8bd1a99a4895aff969d9b1c5cb68 P 6ccd1369ea5e4190a1587e169207b244: Time spent starting tablet: real 0.003s user 0.001s sys 0.000s
I20260927 15:12:07.749581 19577 raft_consensus.cc:348] T 217b8bd1a99a4895aff969d9b1c5cb68 P 470d26ed44b749b983f748436754bb95 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee396b1c470f43f5a82199ea49511d5f" member_type: VOTER last_known_addr { host: "127.17.136.1" port: 37499 } } peers { permanent_uuid: "470d26ed44b749b983f748436754bb95" member_type: VOTER last_known_addr { host: "127.17.136.2" port: 42875 } } peers { permanent_uuid: "6ccd1369ea5e4190a1587e169207b244" member_type: VOTER last_known_addr { host: "127.17.136.3" port: 42129 } }
I20260927 15:12:07.749686 19577 raft_consensus.cc:374] T 217b8bd1a99a4895aff969d9b1c5cb68 P 470d26ed44b749b983f748436754bb95 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:12:07.749722 19577 raft_consensus.cc:729] T 217b8bd1a99a4895aff969d9b1c5cb68 P 470d26ed44b749b983f748436754bb95 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 470d26ed44b749b983f748436754bb95, State: Initialized, Role: FOLLOWER
I20260927 15:12:07.749819 19582 tablet_replica.cc:439] T 217b8bd1a99a4895aff969d9b1c5cb68 P 6ccd1369ea5e4190a1587e169207b244: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee396b1c470f43f5a82199ea49511d5f" member_type: VOTER last_known_addr { host: "127.17.136.1" port: 37499 } } peers { permanent_uuid: "470d26ed44b749b983f748436754bb95" member_type: VOTER last_known_addr { host: "127.17.136.2" port: 42875 } } peers { permanent_uuid: "6ccd1369ea5e4190a1587e169207b244" member_type: VOTER last_known_addr { host: "127.17.136.3" port: 42129 } } }
I20260927 15:12:07.749851 19577 consensus_queue.cc:260] T 217b8bd1a99a4895aff969d9b1c5cb68 P 470d26ed44b749b983f748436754bb95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee396b1c470f43f5a82199ea49511d5f" member_type: VOTER last_known_addr { host: "127.17.136.1" port: 37499 } } peers { permanent_uuid: "470d26ed44b749b983f748436754bb95" member_type: VOTER last_known_addr { host: "127.17.136.2" port: 42875 } } peers { permanent_uuid: "6ccd1369ea5e4190a1587e169207b244" member_type: VOTER last_known_addr { host: "127.17.136.3" port: 42129 } }
I20260927 15:12:07.749939 19582 tablet_replica.cc:442] T 217b8bd1a99a4895aff969d9b1c5cb68 P 6ccd1369ea5e4190a1587e169207b244: This TxnStatusTablet replica's current role is: FOLLOWER
I20260927 15:12:07.750097 19577 ts_tablet_manager.cc:1428] T 217b8bd1a99a4895aff969d9b1c5cb68 P 470d26ed44b749b983f748436754bb95: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260927 15:12:07.750303 19581 tablet_replica.cc:439] T 217b8bd1a99a4895aff969d9b1c5cb68 P 470d26ed44b749b983f748436754bb95: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee396b1c470f43f5a82199ea49511d5f" member_type: VOTER last_known_addr { host: "127.17.136.1" port: 37499 } } peers { permanent_uuid: "470d26ed44b749b983f748436754bb95" member_type: VOTER last_known_addr { host: "127.17.136.2" port: 42875 } } peers { permanent_uuid: "6ccd1369ea5e4190a1587e169207b244" member_type: VOTER last_known_addr { host: "127.17.136.3" port: 42129 } } }
I20260927 15:12:07.750424 19581 tablet_replica.cc:442] T 217b8bd1a99a4895aff969d9b1c5cb68 P 470d26ed44b749b983f748436754bb95: This TxnStatusTablet replica's current role is: FOLLOWER
I20260927 15:12:07.750747 19576 tablet_bootstrap.cc:492] T 217b8bd1a99a4895aff969d9b1c5cb68 P ee396b1c470f43f5a82199ea49511d5f: No bootstrap required, opened a new log
I20260927 15:12:07.750826 19576 ts_tablet_manager.cc:1397] T 217b8bd1a99a4895aff969d9b1c5cb68 P ee396b1c470f43f5a82199ea49511d5f: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20260927 15:12:07.751294 19576 raft_consensus.cc:348] T 217b8bd1a99a4895aff969d9b1c5cb68 P ee396b1c470f43f5a82199ea49511d5f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee396b1c470f43f5a82199ea49511d5f" member_type: VOTER last_known_addr { host: "127.17.136.1" port: 37499 } } peers { permanent_uuid: "470d26ed44b749b983f748436754bb95" member_type: VOTER last_known_addr { host: "127.17.136.2" port: 42875 } } peers { permanent_uuid: "6ccd1369ea5e4190a1587e169207b244" member_type: VOTER last_known_addr { host: "127.17.136.3" port: 42129 } }
I20260927 15:12:07.751407 19576 raft_consensus.cc:374] T 217b8bd1a99a4895aff969d9b1c5cb68 P ee396b1c470f43f5a82199ea49511d5f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:12:07.751437 19576 raft_consensus.cc:729] T 217b8bd1a99a4895aff969d9b1c5cb68 P ee396b1c470f43f5a82199ea49511d5f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ee396b1c470f43f5a82199ea49511d5f, State: Initialized, Role: FOLLOWER
I20260927 15:12:07.751554 19576 consensus_queue.cc:260] T 217b8bd1a99a4895aff969d9b1c5cb68 P ee396b1c470f43f5a82199ea49511d5f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee396b1c470f43f5a82199ea49511d5f" member_type: VOTER last_known_addr { host: "127.17.136.1" port: 37499 } } peers { permanent_uuid: "470d26ed44b749b983f748436754bb95" member_type: VOTER last_known_addr { host: "127.17.136.2" port: 42875 } } peers { permanent_uuid: "6ccd1369ea5e4190a1587e169207b244" member_type: VOTER last_known_addr { host: "127.17.136.3" port: 42129 } }
I20260927 15:12:07.751814 19576 ts_tablet_manager.cc:1428] T 217b8bd1a99a4895aff969d9b1c5cb68 P ee396b1c470f43f5a82199ea49511d5f: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260927 15:12:07.752020 19583 tablet_replica.cc:439] T 217b8bd1a99a4895aff969d9b1c5cb68 P ee396b1c470f43f5a82199ea49511d5f: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee396b1c470f43f5a82199ea49511d5f" member_type: VOTER last_known_addr { host: "127.17.136.1" port: 37499 } } peers { permanent_uuid: "470d26ed44b749b983f748436754bb95" member_type: VOTER last_known_addr { host: "127.17.136.2" port: 42875 } } peers { permanent_uuid: "6ccd1369ea5e4190a1587e169207b244" member_type: VOTER last_known_addr { host: "127.17.136.3" port: 42129 } } }
I20260927 15:12:07.752152 19583 tablet_replica.cc:442] T 217b8bd1a99a4895aff969d9b1c5cb68 P ee396b1c470f43f5a82199ea49511d5f: This TxnStatusTablet replica's current role is: FOLLOWER
I20260927 15:12:07.861990 19582 raft_consensus.cc:482] T 217b8bd1a99a4895aff969d9b1c5cb68 P 6ccd1369ea5e4190a1587e169207b244 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:12:07.862126 19582 raft_consensus.cc:504] T 217b8bd1a99a4895aff969d9b1c5cb68 P 6ccd1369ea5e4190a1587e169207b244 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee396b1c470f43f5a82199ea49511d5f" member_type: VOTER last_known_addr { host: "127.17.136.1" port: 37499 } } peers { permanent_uuid: "470d26ed44b749b983f748436754bb95" member_type: VOTER last_known_addr { host: "127.17.136.2" port: 42875 } } peers { permanent_uuid: "6ccd1369ea5e4190a1587e169207b244" member_type: VOTER last_known_addr { host: "127.17.136.3" port: 42129 } }
I20260927 15:12:07.862537 19582 leader_election.cc:288] T 217b8bd1a99a4895aff969d9b1c5cb68 P 6ccd1369ea5e4190a1587e169207b244 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ee396b1c470f43f5a82199ea49511d5f (127.17.136.1:37499), 470d26ed44b749b983f748436754bb95 (127.17.136.2:42875)
I20260927 15:12:07.862947 19366 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "217b8bd1a99a4895aff969d9b1c5cb68" candidate_uuid: "6ccd1369ea5e4190a1587e169207b244" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "470d26ed44b749b983f748436754bb95" is_pre_election: true
I20260927 15:12:07.862998 19226 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "217b8bd1a99a4895aff969d9b1c5cb68" candidate_uuid: "6ccd1369ea5e4190a1587e169207b244" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee396b1c470f43f5a82199ea49511d5f" is_pre_election: true
I20260927 15:12:07.863086 19366 raft_consensus.cc:2454] T 217b8bd1a99a4895aff969d9b1c5cb68 P 470d26ed44b749b983f748436754bb95 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ccd1369ea5e4190a1587e169207b244 in term 0.
I20260927 15:12:07.863162 19226 raft_consensus.cc:2454] T 217b8bd1a99a4895aff969d9b1c5cb68 P ee396b1c470f43f5a82199ea49511d5f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ccd1369ea5e4190a1587e169207b244 in term 0.
I20260927 15:12:07.863399 19438 leader_election.cc:302] T 217b8bd1a99a4895aff969d9b1c5cb68 P 6ccd1369ea5e4190a1587e169207b244 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 470d26ed44b749b983f748436754bb95, 6ccd1369ea5e4190a1587e169207b244; no voters:
I20260927 15:12:07.863574 19582 raft_consensus.cc:2781] T 217b8bd1a99a4895aff969d9b1c5cb68 P 6ccd1369ea5e4190a1587e169207b244 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 15:12:07.863631 19582 raft_consensus.cc:482] T 217b8bd1a99a4895aff969d9b1c5cb68 P 6ccd1369ea5e4190a1587e169207b244 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 15:12:07.863665 19582 raft_consensus.cc:3037] T 217b8bd1a99a4895aff969d9b1c5cb68 P 6ccd1369ea5e4190a1587e169207b244 [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:12:07.864645 19582 raft_consensus.cc:504] T 217b8bd1a99a4895aff969d9b1c5cb68 P 6ccd1369ea5e4190a1587e169207b244 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee396b1c470f43f5a82199ea49511d5f" member_type: VOTER last_known_addr { host: "127.17.136.1" port: 37499 } } peers { permanent_uuid: "470d26ed44b749b983f748436754bb95" member_type: VOTER last_known_addr { host: "127.17.136.2" port: 42875 } } peers { permanent_uuid: "6ccd1369ea5e4190a1587e169207b244" member_type: VOTER last_known_addr { host: "127.17.136.3" port: 42129 } }
I20260927 15:12:07.864933 19582 leader_election.cc:288] T 217b8bd1a99a4895aff969d9b1c5cb68 P 6ccd1369ea5e4190a1587e169207b244 [CANDIDATE]: Term 1 election: Requested vote from peers ee396b1c470f43f5a82199ea49511d5f (127.17.136.1:37499), 470d26ed44b749b983f748436754bb95 (127.17.136.2:42875)
I20260927 15:12:07.865300 19366 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "217b8bd1a99a4895aff969d9b1c5cb68" candidate_uuid: "6ccd1369ea5e4190a1587e169207b244" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "470d26ed44b749b983f748436754bb95"
I20260927 15:12:07.865300 19226 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "217b8bd1a99a4895aff969d9b1c5cb68" candidate_uuid: "6ccd1369ea5e4190a1587e169207b244" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee396b1c470f43f5a82199ea49511d5f"
I20260927 15:12:07.865424 19366 raft_consensus.cc:3037] T 217b8bd1a99a4895aff969d9b1c5cb68 P 470d26ed44b749b983f748436754bb95 [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:12:07.865424 19226 raft_consensus.cc:3037] T 217b8bd1a99a4895aff969d9b1c5cb68 P ee396b1c470f43f5a82199ea49511d5f [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:12:07.866525 19366 raft_consensus.cc:2454] T 217b8bd1a99a4895aff969d9b1c5cb68 P 470d26ed44b749b983f748436754bb95 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ccd1369ea5e4190a1587e169207b244 in term 1.
I20260927 15:12:07.866524 19226 raft_consensus.cc:2454] T 217b8bd1a99a4895aff969d9b1c5cb68 P ee396b1c470f43f5a82199ea49511d5f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ccd1369ea5e4190a1587e169207b244 in term 1.
I20260927 15:12:07.866822 19439 leader_election.cc:302] T 217b8bd1a99a4895aff969d9b1c5cb68 P 6ccd1369ea5e4190a1587e169207b244 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ccd1369ea5e4190a1587e169207b244, ee396b1c470f43f5a82199ea49511d5f; no voters:
I20260927 15:12:07.867030 19582 raft_consensus.cc:2781] T 217b8bd1a99a4895aff969d9b1c5cb68 P 6ccd1369ea5e4190a1587e169207b244 [term 1 FOLLOWER]: Leader election won for term 1
I20260927 15:12:07.867117 19582 raft_consensus.cc:686] T 217b8bd1a99a4895aff969d9b1c5cb68 P 6ccd1369ea5e4190a1587e169207b244 [term 1 LEADER]: Becoming Leader. State: Replica: 6ccd1369ea5e4190a1587e169207b244, State: Running, Role: LEADER
I20260927 15:12:07.867273 19582 consensus_queue.cc:237] T 217b8bd1a99a4895aff969d9b1c5cb68 P 6ccd1369ea5e4190a1587e169207b244 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee396b1c470f43f5a82199ea49511d5f" member_type: VOTER last_known_addr { host: "127.17.136.1" port: 37499 } } peers { permanent_uuid: "470d26ed44b749b983f748436754bb95" member_type: VOTER last_known_addr { host: "127.17.136.2" port: 42875 } } peers { permanent_uuid: "6ccd1369ea5e4190a1587e169207b244" member_type: VOTER last_known_addr { host: "127.17.136.3" port: 42129 } }
I20260927 15:12:07.867967 19605 tablet_replica.cc:439] T 217b8bd1a99a4895aff969d9b1c5cb68 P 6ccd1369ea5e4190a1587e169207b244: TxnStatusTablet state changed. Reason: New leader 6ccd1369ea5e4190a1587e169207b244. Latest consensus state: current_term: 1 leader_uuid: "6ccd1369ea5e4190a1587e169207b244" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee396b1c470f43f5a82199ea49511d5f" member_type: VOTER last_known_addr { host: "127.17.136.1" port: 37499 } } peers { permanent_uuid: "470d26ed44b749b983f748436754bb95" member_type: VOTER last_known_addr { host: "127.17.136.2" port: 42875 } } peers { permanent_uuid: "6ccd1369ea5e4190a1587e169207b244" member_type: VOTER last_known_addr { host: "127.17.136.3" port: 42129 } } }
I20260927 15:12:07.868073 19605 tablet_replica.cc:442] T 217b8bd1a99a4895aff969d9b1c5cb68 P 6ccd1369ea5e4190a1587e169207b244: This TxnStatusTablet replica's current role is: LEADER
I20260927 15:12:07.868332 19618 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260927 15:12:07.868526 19618 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260927 15:12:07.869098 19066 catalog_manager.cc:5495] T 217b8bd1a99a4895aff969d9b1c5cb68 P 6ccd1369ea5e4190a1587e169207b244 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6ccd1369ea5e4190a1587e169207b244 (127.17.136.3). New cstate: current_term: 1 leader_uuid: "6ccd1369ea5e4190a1587e169207b244" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee396b1c470f43f5a82199ea49511d5f" member_type: VOTER last_known_addr { host: "127.17.136.1" port: 37499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "470d26ed44b749b983f748436754bb95" member_type: VOTER last_known_addr { host: "127.17.136.2" port: 42875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6ccd1369ea5e4190a1587e169207b244" member_type: VOTER last_known_addr { host: "127.17.136.3" port: 42129 } health_report { overall_health: HEALTHY } } }
I20260927 15:12:07.899039 19621 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:07.895530 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56450 (local address 127.17.136.3:42129)
0927 15:12:07.895747 (+ 217us) server_negotiation.cc:206] Beginning negotiation
0927 15:12:07.895751 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0927 15:12:07.895765 (+ 14us) server_negotiation.cc:407] Connection header received
0927 15:12:07.895871 (+ 106us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:12:07.895873 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:12:07.895924 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:12:07.896011 (+ 87us) server_negotiation.cc:226] Negotiated authn=TOKEN
0927 15:12:07.896279 (+ 268us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:07.896808 (+ 529us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:07.897622 (+ 814us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:07.897852 (+ 230us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:07.897937 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:07.898220 (+ 283us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0927 15:12:07.898652 (+ 432us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0927 15:12:07.898755 (+ 103us) server_negotiation.cc:1035] Waiting for connection context
0927 15:12:07.898825 (+ 70us) server_negotiation.cc:299] Negotiation successful
0927 15:12:07.898877 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":149,"thread_start_us":65,"threads_started":1}
I20260927 15:12:07.899024 19612 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:07.895442 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.3:42129 (local address 127.0.0.1:56450)
0927 15:12:07.895604 (+ 162us) negotiation.cc:107] Waiting for socket to connect
0927 15:12:07.895621 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0927 15:12:07.895734 (+ 113us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0927 15:12:07.896047 (+ 313us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0927 15:12:07.896057 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0927 15:12:07.896065 (+ 8us) client_negotiation.cc:189] Negotiated authn=TOKEN
0927 15:12:07.896166 (+ 101us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:12:07.896171 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:12:07.896909 (+ 738us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:12:07.896912 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:12:07.897513 (+ 601us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:12:07.897522 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:12:07.897948 (+ 426us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:12:07.897952 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:12:07.898040 (+ 88us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:07.898090 (+ 50us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0927 15:12:07.898737 (+ 647us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0927 15:12:07.898753 (+ 16us) client_negotiation.cc:769] Sending connection context
0927 15:12:07.898816 (+ 63us) client_negotiation.cc:240] Negotiation successful
0927 15:12:07.898902 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":35}
I20260927 15:12:07.901846 19226 raft_consensus.cc:1261] T 217b8bd1a99a4895aff969d9b1c5cb68 P ee396b1c470f43f5a82199ea49511d5f [term 1 FOLLOWER]: Refusing update from remote peer 6ccd1369ea5e4190a1587e169207b244: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260927 15:12:07.902125 19366 raft_consensus.cc:1261] T 217b8bd1a99a4895aff969d9b1c5cb68 P 470d26ed44b749b983f748436754bb95 [term 1 FOLLOWER]: Refusing update from remote peer 6ccd1369ea5e4190a1587e169207b244: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260927 15:12:07.902309 19582 consensus_queue.cc:1035] T 217b8bd1a99a4895aff969d9b1c5cb68 P 6ccd1369ea5e4190a1587e169207b244 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee396b1c470f43f5a82199ea49511d5f" member_type: VOTER last_known_addr { host: "127.17.136.1" port: 37499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260927 15:12:07.902554 19605 consensus_queue.cc:1035] T 217b8bd1a99a4895aff969d9b1c5cb68 P 6ccd1369ea5e4190a1587e169207b244 [LEADER]: Connected to new peer: Peer: permanent_uuid: "470d26ed44b749b983f748436754bb95" member_type: VOTER last_known_addr { host: "127.17.136.2" port: 42875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260927 15:12:07.903990 19581 tablet_replica.cc:439] T 217b8bd1a99a4895aff969d9b1c5cb68 P 470d26ed44b749b983f748436754bb95: TxnStatusTablet state changed. Reason: New leader 6ccd1369ea5e4190a1587e169207b244. Latest consensus state: current_term: 1 leader_uuid: "6ccd1369ea5e4190a1587e169207b244" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee396b1c470f43f5a82199ea49511d5f" member_type: VOTER last_known_addr { host: "127.17.136.1" port: 37499 } } peers { permanent_uuid: "470d26ed44b749b983f748436754bb95" member_type: VOTER last_known_addr { host: "127.17.136.2" port: 42875 } } peers { permanent_uuid: "6ccd1369ea5e4190a1587e169207b244" member_type: VOTER last_known_addr { host: "127.17.136.3" port: 42129 } } }
I20260927 15:12:07.904103 19581 tablet_replica.cc:442] T 217b8bd1a99a4895aff969d9b1c5cb68 P 470d26ed44b749b983f748436754bb95: This TxnStatusTablet replica's current role is: FOLLOWER
I20260927 15:12:07.905319 19605 tablet_replica.cc:439] T 217b8bd1a99a4895aff969d9b1c5cb68 P 6ccd1369ea5e4190a1587e169207b244: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "6ccd1369ea5e4190a1587e169207b244" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee396b1c470f43f5a82199ea49511d5f" member_type: VOTER last_known_addr { host: "127.17.136.1" port: 37499 } } peers { permanent_uuid: "470d26ed44b749b983f748436754bb95" member_type: VOTER last_known_addr { host: "127.17.136.2" port: 42875 } } peers { permanent_uuid: "6ccd1369ea5e4190a1587e169207b244" member_type: VOTER last_known_addr { host: "127.17.136.3" port: 42129 } } }
I20260927 15:12:07.905407 19605 tablet_replica.cc:442] T 217b8bd1a99a4895aff969d9b1c5cb68 P 6ccd1369ea5e4190a1587e169207b244: This TxnStatusTablet replica's current role is: LEADER
I20260927 15:12:07.905884 19583 tablet_replica.cc:439] T 217b8bd1a99a4895aff969d9b1c5cb68 P ee396b1c470f43f5a82199ea49511d5f: TxnStatusTablet state changed. Reason: New leader 6ccd1369ea5e4190a1587e169207b244. Latest consensus state: current_term: 1 leader_uuid: "6ccd1369ea5e4190a1587e169207b244" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee396b1c470f43f5a82199ea49511d5f" member_type: VOTER last_known_addr { host: "127.17.136.1" port: 37499 } } peers { permanent_uuid: "470d26ed44b749b983f748436754bb95" member_type: VOTER last_known_addr { host: "127.17.136.2" port: 42875 } } peers { permanent_uuid: "6ccd1369ea5e4190a1587e169207b244" member_type: VOTER last_known_addr { host: "127.17.136.3" port: 42129 } } }
I20260927 15:12:07.905995 19583 tablet_replica.cc:442] T 217b8bd1a99a4895aff969d9b1c5cb68 P ee396b1c470f43f5a82199ea49511d5f: This TxnStatusTablet replica's current role is: FOLLOWER
I20260927 15:12:07.907342 19583 tablet_replica.cc:439] T 217b8bd1a99a4895aff969d9b1c5cb68 P ee396b1c470f43f5a82199ea49511d5f: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "6ccd1369ea5e4190a1587e169207b244" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee396b1c470f43f5a82199ea49511d5f" member_type: VOTER last_known_addr { host: "127.17.136.1" port: 37499 } } peers { permanent_uuid: "470d26ed44b749b983f748436754bb95" member_type: VOTER last_known_addr { host: "127.17.136.2" port: 42875 } } peers { permanent_uuid: "6ccd1369ea5e4190a1587e169207b244" member_type: VOTER last_known_addr { host: "127.17.136.3" port: 42129 } } }
I20260927 15:12:07.907442 19583 tablet_replica.cc:442] T 217b8bd1a99a4895aff969d9b1c5cb68 P ee396b1c470f43f5a82199ea49511d5f: This TxnStatusTablet replica's current role is: FOLLOWER
I20260927 15:12:07.907696 19582 tablet_replica.cc:439] T 217b8bd1a99a4895aff969d9b1c5cb68 P 6ccd1369ea5e4190a1587e169207b244: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "6ccd1369ea5e4190a1587e169207b244" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee396b1c470f43f5a82199ea49511d5f" member_type: VOTER last_known_addr { host: "127.17.136.1" port: 37499 } } peers { permanent_uuid: "470d26ed44b749b983f748436754bb95" member_type: VOTER last_known_addr { host: "127.17.136.2" port: 42875 } } peers { permanent_uuid: "6ccd1369ea5e4190a1587e169207b244" member_type: VOTER last_known_addr { host: "127.17.136.3" port: 42129 } } }
I20260927 15:12:07.907783 19582 tablet_replica.cc:442] T 217b8bd1a99a4895aff969d9b1c5cb68 P 6ccd1369ea5e4190a1587e169207b244: This TxnStatusTablet replica's current role is: LEADER
I20260927 15:12:07.909782 19588 mvcc.cc:205] Tried to move back new op lower bound from 7333977816680886272 to 7333977816545734656. Current Snapshot: MvccSnapshot[applied={T|T < 7333977816680886272}]
I20260927 15:12:07.909937 19581 tablet_replica.cc:439] T 217b8bd1a99a4895aff969d9b1c5cb68 P 470d26ed44b749b983f748436754bb95: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "6ccd1369ea5e4190a1587e169207b244" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee396b1c470f43f5a82199ea49511d5f" member_type: VOTER last_known_addr { host: "127.17.136.1" port: 37499 } } peers { permanent_uuid: "470d26ed44b749b983f748436754bb95" member_type: VOTER last_known_addr { host: "127.17.136.2" port: 42875 } } peers { permanent_uuid: "6ccd1369ea5e4190a1587e169207b244" member_type: VOTER last_known_addr { host: "127.17.136.3" port: 42129 } } }
I20260927 15:12:07.910022 19581 tablet_replica.cc:442] T 217b8bd1a99a4895aff969d9b1c5cb68 P 470d26ed44b749b983f748436754bb95: This TxnStatusTablet replica's current role is: FOLLOWER
I20260927 15:12:07.914105 19621 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:07.910525 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56466 (local address 127.17.136.3:42129)
0927 15:12:07.910729 (+ 204us) server_negotiation.cc:206] Beginning negotiation
0927 15:12:07.910734 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0927 15:12:07.910745 (+ 11us) server_negotiation.cc:407] Connection header received
0927 15:12:07.911221 (+ 476us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:12:07.911224 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:12:07.911288 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:12:07.911442 (+ 154us) server_negotiation.cc:226] Negotiated authn=TOKEN
0927 15:12:07.911693 (+ 251us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:07.912171 (+ 478us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:07.913260 (+ 1089us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:07.913456 (+ 196us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:07.913517 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:07.913747 (+ 230us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0927 15:12:07.913806 (+ 59us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0927 15:12:07.913847 (+ 41us) server_negotiation.cc:1035] Waiting for connection context
0927 15:12:07.913939 (+ 92us) server_negotiation.cc:299] Negotiation successful
0927 15:12:07.913986 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":134}
I20260927 15:12:07.923771 19621 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:07.920452 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.136.3:57973 (local address 127.17.136.3:42129)
0927 15:12:07.920547 (+ 95us) server_negotiation.cc:206] Beginning negotiation
0927 15:12:07.920551 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0927 15:12:07.920769 (+ 218us) server_negotiation.cc:407] Connection header received
0927 15:12:07.920875 (+ 106us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:12:07.920877 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:12:07.920913 (+ 36us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:12:07.920967 (+ 54us) server_negotiation.cc:226] Negotiated authn=TOKEN
0927 15:12:07.921184 (+ 217us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:07.921652 (+ 468us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:07.922821 (+ 1169us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:07.923022 (+ 201us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:07.923101 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:07.923407 (+ 306us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0927 15:12:07.923465 (+ 58us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0927 15:12:07.923510 (+ 45us) server_negotiation.cc:1035] Waiting for connection context
0927 15:12:07.923600 (+ 90us) server_negotiation.cc:299] Negotiation successful
0927 15:12:07.923652 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":2,"server-negotiator.queue_time_us":32}
I20260927 15:12:07.923908 19626 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:07.920384 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.3:42129 (local address 127.17.136.3:57973)
0927 15:12:07.920699 (+ 315us) negotiation.cc:107] Waiting for socket to connect
0927 15:12:07.920713 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0927 15:12:07.920806 (+ 93us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0927 15:12:07.920988 (+ 182us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0927 15:12:07.920990 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0927 15:12:07.920998 (+ 8us) client_negotiation.cc:189] Negotiated authn=TOKEN
0927 15:12:07.921107 (+ 109us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:12:07.921113 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:12:07.921736 (+ 623us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:12:07.921739 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:12:07.922720 (+ 981us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:12:07.922730 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:12:07.923134 (+ 404us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:12:07.923137 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:12:07.923227 (+ 90us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:07.923299 (+ 72us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0927 15:12:07.923527 (+ 228us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0927 15:12:07.923533 (+ 6us) client_negotiation.cc:769] Sending connection context
0927 15:12:07.923594 (+ 61us) client_negotiation.cc:240] Negotiation successful
0927 15:12:07.923692 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":229,"mutex_wait_us":18,"thread_start_us":93,"threads_started":1}
I20260927 15:12:07.929782 19366 raft_consensus.cc:1261] T a87b6b6132b641f286fa89d80e354d4b P 470d26ed44b749b983f748436754bb95 [term 1 FOLLOWER]: Refusing update from remote peer 6ccd1369ea5e4190a1587e169207b244: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260927 15:12:07.929905 19226 raft_consensus.cc:1261] T a87b6b6132b641f286fa89d80e354d4b P ee396b1c470f43f5a82199ea49511d5f [term 1 FOLLOWER]: Refusing update from remote peer 6ccd1369ea5e4190a1587e169207b244: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260927 15:12:07.930248 19582 consensus_queue.cc:1035] T a87b6b6132b641f286fa89d80e354d4b P 6ccd1369ea5e4190a1587e169207b244 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee396b1c470f43f5a82199ea49511d5f" member_type: VOTER last_known_addr { host: "127.17.136.1" port: 37499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260927 15:12:07.930516 19605 consensus_queue.cc:1035] T a87b6b6132b641f286fa89d80e354d4b P 6ccd1369ea5e4190a1587e169207b244 [LEADER]: Connected to new peer: Peer: permanent_uuid: "470d26ed44b749b983f748436754bb95" member_type: VOTER last_known_addr { host: "127.17.136.2" port: 42875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260927 15:12:07.966269 19066 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:43700:
table { table_name: "test-table" } modify_external_catalogs: true
I20260927 15:12:07.966439 19066 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:43700:
table { table_name: "test-table" } modify_external_catalogs: true
I20260927 15:12:07.968309 19066 catalog_manager.cc:5782] T 00000000000000000000000000000000 P b0f010545b374681bbbcbeb162563687: Sending DeleteTablet for 3 replicas of tablet a87b6b6132b641f286fa89d80e354d4b
I20260927 15:12:07.968765 19206 tablet_service.cc:1514] Processing DeleteTablet for tablet a87b6b6132b641f286fa89d80e354d4b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:12:07 UTC) from {username='kudu', principal='kudu/127.17.136.62@KRBTEST.COM'} at 127.0.0.1:46054
I20260927 15:12:07.969018 19346 tablet_service.cc:1514] Processing DeleteTablet for tablet a87b6b6132b641f286fa89d80e354d4b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:12:07 UTC) from {username='kudu', principal='kudu/127.17.136.62@KRBTEST.COM'} at 127.0.0.1:57836
I20260927 15:12:07.969048 19631 tablet_replica.cc:330] T a87b6b6132b641f286fa89d80e354d4b P ee396b1c470f43f5a82199ea49511d5f: stopping tablet replica
I20260927 15:12:07.969276 19632 tablet_replica.cc:330] T a87b6b6132b641f286fa89d80e354d4b P 470d26ed44b749b983f748436754bb95: stopping tablet replica
I20260927 15:12:07.969269 19631 raft_consensus.cc:2229] T a87b6b6132b641f286fa89d80e354d4b P ee396b1c470f43f5a82199ea49511d5f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260927 15:12:07.969390 19632 raft_consensus.cc:2229] T a87b6b6132b641f286fa89d80e354d4b P 470d26ed44b749b983f748436754bb95 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260927 15:12:07.969496 19631 raft_consensus.cc:2258] T a87b6b6132b641f286fa89d80e354d4b P ee396b1c470f43f5a82199ea49511d5f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 15:12:07.969506 19632 raft_consensus.cc:2258] T a87b6b6132b641f286fa89d80e354d4b P 470d26ed44b749b983f748436754bb95 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 15:12:07.969914 19486 tablet_service.cc:1514] Processing DeleteTablet for tablet a87b6b6132b641f286fa89d80e354d4b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:12:07 UTC) from {username='kudu', principal='kudu/127.17.136.62@KRBTEST.COM'} at 127.0.0.1:56444
I20260927 15:12:07.970082 19599 tablet_replica.cc:330] T a87b6b6132b641f286fa89d80e354d4b P 6ccd1369ea5e4190a1587e169207b244: stopping tablet replica
I20260927 15:12:07.970122 19632 ts_tablet_manager.cc:1905] T a87b6b6132b641f286fa89d80e354d4b P 470d26ed44b749b983f748436754bb95: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:12:07.970191 19599 raft_consensus.cc:2229] T a87b6b6132b641f286fa89d80e354d4b P 6ccd1369ea5e4190a1587e169207b244 [term 1 LEADER]: Raft consensus shutting down.
I20260927 15:12:07.970369 19631 ts_tablet_manager.cc:1905] T a87b6b6132b641f286fa89d80e354d4b P ee396b1c470f43f5a82199ea49511d5f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:12:07.970464 19599 raft_consensus.cc:2258] T a87b6b6132b641f286fa89d80e354d4b P 6ccd1369ea5e4190a1587e169207b244 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 15:12:07.971022 19599 ts_tablet_manager.cc:1905] T a87b6b6132b641f286fa89d80e354d4b P 6ccd1369ea5e4190a1587e169207b244: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:12:07.973014 19632 ts_tablet_manager.cc:1918] T a87b6b6132b641f286fa89d80e354d4b P 470d26ed44b749b983f748436754bb95: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260927 15:12:07.973090 19632 log.cc:1196] T a87b6b6132b641f286fa89d80e354d4b P 470d26ed44b749b983f748436754bb95: Deleting WAL directory at /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790521920546562-17952-0/minicluster-data/ts-1/wal/wals/a87b6b6132b641f286fa89d80e354d4b
I20260927 15:12:07.973343 19631 ts_tablet_manager.cc:1918] T a87b6b6132b641f286fa89d80e354d4b P ee396b1c470f43f5a82199ea49511d5f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260927 15:12:07.973380 19632 ts_tablet_manager.cc:1939] T a87b6b6132b641f286fa89d80e354d4b P 470d26ed44b749b983f748436754bb95: Deleting consensus metadata
I20260927 15:12:07.973500 19631 log.cc:1196] T a87b6b6132b641f286fa89d80e354d4b P ee396b1c470f43f5a82199ea49511d5f: Deleting WAL directory at /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790521920546562-17952-0/minicluster-data/ts-0/wal/wals/a87b6b6132b641f286fa89d80e354d4b
I20260927 15:12:07.973519 19599 ts_tablet_manager.cc:1918] T a87b6b6132b641f286fa89d80e354d4b P 6ccd1369ea5e4190a1587e169207b244: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260927 15:12:07.973574 19599 log.cc:1196] T a87b6b6132b641f286fa89d80e354d4b P 6ccd1369ea5e4190a1587e169207b244: Deleting WAL directory at /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790521920546562-17952-0/minicluster-data/ts-2/wal/wals/a87b6b6132b641f286fa89d80e354d4b
I20260927 15:12:07.973831 19631 ts_tablet_manager.cc:1939] T a87b6b6132b641f286fa89d80e354d4b P ee396b1c470f43f5a82199ea49511d5f: Deleting consensus metadata
I20260927 15:12:07.973821 19599 ts_tablet_manager.cc:1939] T a87b6b6132b641f286fa89d80e354d4b P 6ccd1369ea5e4190a1587e169207b244: Deleting consensus metadata
I20260927 15:12:07.974458 19053 catalog_manager.cc:4841] TS 6ccd1369ea5e4190a1587e169207b244 (127.17.136.3:42129): tablet a87b6b6132b641f286fa89d80e354d4b (table test-table [id=1926927844af4d9280ce77e0e4d83848]) successfully deleted
I20260927 15:12:07.974506 19054 catalog_manager.cc:4841] TS 470d26ed44b749b983f748436754bb95 (127.17.136.2:42875): tablet a87b6b6132b641f286fa89d80e354d4b (table test-table [id=1926927844af4d9280ce77e0e4d83848]) successfully deleted
I20260927 15:12:07.974458 19055 catalog_manager.cc:4841] TS ee396b1c470f43f5a82199ea49511d5f (127.17.136.1:37499): tablet a87b6b6132b641f286fa89d80e354d4b (table test-table [id=1926927844af4d9280ce77e0e4d83848]) successfully deleted
Sep 27 15:12:07 dist-test-slave-5s2t krb5kdc[19024](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790521927, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.17.136.1@KRBTEST.COM
I20260927 15:12:07.984387 19571 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:07.973872 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46066 (local address 127.17.136.1:37499)
0927 15:12:07.973976 (+ 104us) server_negotiation.cc:206] Beginning negotiation
0927 15:12:07.973981 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0927 15:12:07.975032 (+ 1051us) server_negotiation.cc:407] Connection header received
0927 15:12:07.975128 (+ 96us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:12:07.975131 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:12:07.975181 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:12:07.975288 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0927 15:12:07.975901 (+ 613us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:07.976657 (+ 756us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:07.977414 (+ 757us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:07.977768 (+ 354us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:07.977866 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:07.980819 (+ 2953us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0927 15:12:07.980830 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0927 15:12:07.980845 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0927 15:12:07.980873 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0927 15:12:07.982708 (+ 1835us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:12:07.983080 (+ 372us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:12:07.983086 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:12:07.983088 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:12:07.983175 (+ 87us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:12:07.983420 (+ 245us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:12:07.983423 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:12:07.983425 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:12:07.983739 (+ 314us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0927 15:12:07.983955 (+ 216us) server_negotiation.cc:1035] Waiting for connection context
0927 15:12:07.984100 (+ 145us) server_negotiation.cc:299] Negotiation successful
0927 15:12:07.984223 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
W20260927 15:12:07.984839 19261 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.SetFlag from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:46066
I20260927 15:12:07.993244 19613 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:07.986434 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43712 (local address 127.17.136.62:42991)
0927 15:12:07.986569 (+ 135us) server_negotiation.cc:206] Beginning negotiation
0927 15:12:07.986573 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0927 15:12:07.986624 (+ 51us) server_negotiation.cc:407] Connection header received
0927 15:12:07.986749 (+ 125us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:12:07.986752 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:12:07.986797 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:12:07.986859 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0927 15:12:07.987472 (+ 613us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:07.987995 (+ 523us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:07.988733 (+ 738us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:07.988963 (+ 230us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:07.989046 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:07.990370 (+ 1324us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0927 15:12:07.990373 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0927 15:12:07.990376 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0927 15:12:07.990400 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0927 15:12:07.991741 (+ 1341us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:12:07.992087 (+ 346us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:12:07.992091 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:12:07.992092 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:12:07.992166 (+ 74us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:12:07.992393 (+ 227us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:12:07.992396 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:12:07.992398 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:12:07.992576 (+ 178us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0927 15:12:07.992712 (+ 136us) server_negotiation.cc:1035] Waiting for connection context
0927 15:12:07.992944 (+ 232us) server_negotiation.cc:299] Negotiation successful
0927 15:12:07.993078 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
W20260927 15:12:07.993682 19066 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.TSHeartbeat from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:43712
I20260927 15:12:07.995056 17952 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu with pid 19141
I20260927 15:12:08.002032 17952 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu with pid 19281
I20260927 15:12:08.007565 17952 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu with pid 19421
I20260927 15:12:08.012949 17952 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu with pid 19037
2026-09-27T15:12:08Z chronyd exiting
[ OK ] SecurityITest.SmokeTestAsAuthorizedUser (2839 ms)
[ RUN ] SecurityITest.TxnSmokeWithDifferentUserTypes
Loading random data
Initializing database '/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790521920546562-17952-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 27 15:12:08 dist-test-slave-5s2t krb5kdc[19639](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 27 15:12:08 dist-test-slave-5s2t krb5kdc[19639](info): set up 2 sockets
Sep 27 15:12:08 dist-test-slave-5s2t krb5kdc[19639](info): commencing operation
krb5kdc: starting...
W20260927 15:12:08.958667 17952 mini_kdc.cc:121] Time spent starting KDC: real 0.925s user 0.003s sys 0.003s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790521920546562-17952-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790521920546562-17952-0/krb5kdc/test-user.keytab.
Sep 27 15:12:09 dist-test-slave-5s2t krb5kdc[19639](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790521929, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-27T15:12:09Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-27T15:12:09Z Disabled control of system clock
WARNING: no policy specified for kudu/127.17.136.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.136.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.136.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790521920546562-17952-0/krb5kdc/kudu_127.17.136.62.keytab.
Entry for principal kudu/127.17.136.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790521920546562-17952-0/krb5kdc/kudu_127.17.136.62.keytab.
I20260927 15:12:09.077942 17952 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu
/tmp/dist-test-taskiFOyeW/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790521920546562-17952-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790521920546562-17952-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790521920546562-17952-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790521920546562-17952-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.136.62:33149
--webserver_interface=127.17.136.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790521920546562-17952-0/krb5kdc/kudu_127.17.136.62.keytab
--principal=kudu/127.17.136.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.136.20:38711
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.136.62:33149
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790521920546562-17952-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790521920546562-17952-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790521920546562-17952-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260927 15:12:09.184839 19652 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260927 15:12:09.185117 19652 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260927 15:12:09.185158 19652 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260927 15:12:09.189139 19652 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260927 15:12:09.189191 19652 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260927 15:12:09.189208 19652 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260927 15:12:09.189247 19652 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260927 15:12:09.189275 19652 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260927 15:12:09.189301 19652 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260927 15:12:09.194485 19652 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.136.20:38711
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790521920546562-17952-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790521920546562-17952-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.17.136.62:33149
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790521920546562-17952-0/krb5kdc/kudu_127.17.136.62.keytab
--principal=kudu/127.17.136.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.136.62:33149
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790521920546562-17952-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.17.136.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19652
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790521920546562-17952-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 27 Sep 2026 14:27:13 UTC on ccycloud.quasar-psqrth.root.comops.site
build id 4676138
I20260927 15:12:09.195541 19652 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260927 15:12:09.196511 19652 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260927 15:12:09.204469 19657 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260927 15:12:09.204514 19652 server_base.cc:1034] running on GCE node
W20260927 15:12:09.204469 19658 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260927 15:12:09.204679 19660 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260927 15:12:09.205206 19652 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260927 15:12:09.206202 19652 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260927 15:12:09.207309 19652 hybrid_clock.cc:648] HybridClock initialized: now 1790521929207281 us; error 40 us; skew 500 ppm
Sep 27 15:12:09 dist-test-slave-5s2t krb5kdc[19639](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790521929, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.136.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260927 15:12:09.216384 19652 init.cc:377] Logged in from keytab as kudu/127.17.136.62@KRBTEST.COM (short username kudu)
I20260927 15:12:09.217375 19652 webserver.cc:460] Webserver started at http://127.17.136.62:37789/ using document root <none> and password file <none>
I20260927 15:12:09.217907 19652 fs_manager.cc:359] Metadata directory not provided
I20260927 15:12:09.217971 19652 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260927 15:12:09.218164 19652 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260927 15:12:09.220191 19652 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790521920546562-17952-0/minicluster-data/master-0/data/instance:
uuid: "8cde25cd4d294afea7e09d68815618d0"
format_stamp: "Formatted at 2026-09-27 15:12:09 on dist-test-slave-5s2t"
server_key: "53106fd71cafde5d0ea00ec314a7db65"
server_key_iv: "e48ec6a4c170f345e3fd3a4edd75ae63"
server_key_version: "encryptionkey@0"
I20260927 15:12:09.220698 19652 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790521920546562-17952-0/minicluster-data/master-0/wal/instance:
uuid: "8cde25cd4d294afea7e09d68815618d0"
format_stamp: "Formatted at 2026-09-27 15:12:09 on dist-test-slave-5s2t"
server_key: "53106fd71cafde5d0ea00ec314a7db65"
server_key_iv: "e48ec6a4c170f345e3fd3a4edd75ae63"
server_key_version: "encryptionkey@0"
I20260927 15:12:09.224303 19652 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260927 15:12:09.226598 19667 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260927 15:12:09.227804 19652 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260927 15:12:09.227911 19652 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790521920546562-17952-0/minicluster-data/master-0/data,/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790521920546562-17952-0/minicluster-data/master-0/wal
uuid: "8cde25cd4d294afea7e09d68815618d0"
format_stamp: "Formatted at 2026-09-27 15:12:09 on dist-test-slave-5s2t"
server_key: "53106fd71cafde5d0ea00ec314a7db65"
server_key_iv: "e48ec6a4c170f345e3fd3a4edd75ae63"
server_key_version: "encryptionkey@0"
I20260927 15:12:09.228001 19652 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790521920546562-17952-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790521920546562-17952-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790521920546562-17952-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260927 15:12:09.242432 19652 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260927 15:12:09.245285 19652 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260927 15:12:09.245447 19652 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260927 15:12:09.252681 19652 rpc_server.cc:307] RPC server started. Bound to: 127.17.136.62:33149
I20260927 15:12:09.252709 19729 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.136.62:33149 every 8 connection(s)
I20260927 15:12:09.253584 19652 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790521920546562-17952-0/minicluster-data/master-0/data/info.pb
I20260927 15:12:09.253756 17952 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu as pid 19652
I20260927 15:12:09.253858 17952 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790521920546562-17952-0/minicluster-data/master-0/wal/instance
I20260927 15:12:09.254148 17952 external_mini_cluster.cc:1428] Setting key 793a45fd3685f477248a24e93e8df14f
I20260927 15:12:09.256803 19730 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:12:09.263098 19730 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8cde25cd4d294afea7e09d68815618d0: Bootstrap starting.
Sep 27 15:12:09 dist-test-slave-5s2t krb5kdc[19639](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790521929, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.136.62@KRBTEST.COM
I20260927 15:12:09.265443 19730 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 8cde25cd4d294afea7e09d68815618d0: Neither blocks nor log segments found. Creating new log.
I20260927 15:12:09.266568 19730 log.cc:824] T 00000000000000000000000000000000 P 8cde25cd4d294afea7e09d68815618d0: Log is configured to *not* fsync() on all Append() calls
I20260927 15:12:09.267923 19733 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:09.255470 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59248 (local address 127.17.136.62:33149)
0927 15:12:09.255876 (+ 406us) server_negotiation.cc:206] Beginning negotiation
0927 15:12:09.255894 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0927 15:12:09.255935 (+ 41us) server_negotiation.cc:407] Connection header received
0927 15:12:09.256746 (+ 811us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:12:09.256768 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:12:09.257162 (+ 394us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:12:09.257515 (+ 353us) server_negotiation.cc:226] Negotiated authn=SASL
0927 15:12:09.258130 (+ 615us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:09.259594 (+ 1464us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:09.260458 (+ 864us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:09.261099 (+ 641us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:09.261294 (+ 195us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:09.263761 (+ 2467us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0927 15:12:09.263765 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0927 15:12:09.263777 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0927 15:12:09.263803 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0927 15:12:09.265282 (+ 1479us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:12:09.265741 (+ 459us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:12:09.265745 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:12:09.265749 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:12:09.265854 (+ 105us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:12:09.266106 (+ 252us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:12:09.266108 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:12:09.266109 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:12:09.266451 (+ 342us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0927 15:12:09.266599 (+ 148us) server_negotiation.cc:1035] Waiting for connection context
0927 15:12:09.266882 (+ 283us) server_negotiation.cc:299] Negotiation successful
0927 15:12:09.267171 (+ 289us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":250,"thread_start_us":102,"threads_started":1}
I20260927 15:12:09.268517 19730 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8cde25cd4d294afea7e09d68815618d0: No bootstrap required, opened a new log
I20260927 15:12:09.271404 19730 raft_consensus.cc:348] T 00000000000000000000000000000000 P 8cde25cd4d294afea7e09d68815618d0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8cde25cd4d294afea7e09d68815618d0" member_type: VOTER last_known_addr { host: "127.17.136.62" port: 33149 } }
I20260927 15:12:09.271607 19730 raft_consensus.cc:374] T 00000000000000000000000000000000 P 8cde25cd4d294afea7e09d68815618d0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:12:09.271677 19730 raft_consensus.cc:729] T 00000000000000000000000000000000 P 8cde25cd4d294afea7e09d68815618d0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8cde25cd4d294afea7e09d68815618d0, State: Initialized, Role: FOLLOWER
I20260927 15:12:09.272060 19730 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8cde25cd4d294afea7e09d68815618d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8cde25cd4d294afea7e09d68815618d0" member_type: VOTER last_known_addr { host: "127.17.136.62" port: 33149 } }
I20260927 15:12:09.272179 19730 raft_consensus.cc:388] T 00000000000000000000000000000000 P 8cde25cd4d294afea7e09d68815618d0 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260927 15:12:09.272238 19730 raft_consensus.cc:482] T 00000000000000000000000000000000 P 8cde25cd4d294afea7e09d68815618d0 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260927 15:12:09.272328 19730 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 8cde25cd4d294afea7e09d68815618d0 [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:12:09.273128 19730 raft_consensus.cc:504] T 00000000000000000000000000000000 P 8cde25cd4d294afea7e09d68815618d0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8cde25cd4d294afea7e09d68815618d0" member_type: VOTER last_known_addr { host: "127.17.136.62" port: 33149 } }
I20260927 15:12:09.273418 19730 leader_election.cc:302] T 00000000000000000000000000000000 P 8cde25cd4d294afea7e09d68815618d0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 8cde25cd4d294afea7e09d68815618d0; no voters:
I20260927 15:12:09.273692 19730 leader_election.cc:288] T 00000000000000000000000000000000 P 8cde25cd4d294afea7e09d68815618d0 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260927 15:12:09.273806 19735 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 8cde25cd4d294afea7e09d68815618d0 [term 1 FOLLOWER]: Leader election won for term 1
I20260927 15:12:09.274003 19735 raft_consensus.cc:686] T 00000000000000000000000000000000 P 8cde25cd4d294afea7e09d68815618d0 [term 1 LEADER]: Becoming Leader. State: Replica: 8cde25cd4d294afea7e09d68815618d0, State: Running, Role: LEADER
I20260927 15:12:09.274276 19735 consensus_queue.cc:237] T 00000000000000000000000000000000 P 8cde25cd4d294afea7e09d68815618d0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8cde25cd4d294afea7e09d68815618d0" member_type: VOTER last_known_addr { host: "127.17.136.62" port: 33149 } }
I20260927 15:12:09.274847 19730 sys_catalog.cc:564] T 00000000000000000000000000000000 P 8cde25cd4d294afea7e09d68815618d0 [sys.catalog]: configured and running, proceeding with master startup.
I20260927 15:12:09.275952 19737 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8cde25cd4d294afea7e09d68815618d0 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8cde25cd4d294afea7e09d68815618d0. Latest consensus state: current_term: 1 leader_uuid: "8cde25cd4d294afea7e09d68815618d0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8cde25cd4d294afea7e09d68815618d0" member_type: VOTER last_known_addr { host: "127.17.136.62" port: 33149 } } }
I20260927 15:12:09.276080 19737 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8cde25cd4d294afea7e09d68815618d0 [sys.catalog]: This master's current role is: LEADER
I20260927 15:12:09.275970 19736 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8cde25cd4d294afea7e09d68815618d0 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "8cde25cd4d294afea7e09d68815618d0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8cde25cd4d294afea7e09d68815618d0" member_type: VOTER last_known_addr { host: "127.17.136.62" port: 33149 } } }
I20260927 15:12:09.276226 19736 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8cde25cd4d294afea7e09d68815618d0 [sys.catalog]: This master's current role is: LEADER
I20260927 15:12:09.276466 19744 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260927 15:12:09.278977 19744 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260927 15:12:09.284353 19744 catalog_manager.cc:1347] Generated new cluster ID: 6f0f8149b3274dd6a864f14229ed3efa
I20260927 15:12:09.284420 19744 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260927 15:12:09.294034 19744 catalog_manager.cc:1370] Generated new certificate authority record
I20260927 15:12:09.295285 19744 catalog_manager.cc:1504] Loading token signing keys...
I20260927 15:12:09.300581 19744 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 8cde25cd4d294afea7e09d68815618d0: Generated new TSK 0
I20260927 15:12:09.301339 19744 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.17.136.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.136.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.136.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790521920546562-17952-0/krb5kdc/kudu_127.17.136.1.keytab.
Entry for principal kudu/127.17.136.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790521920546562-17952-0/krb5kdc/kudu_127.17.136.1.keytab.
I20260927 15:12:09.334613 17952 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu
/tmp/dist-test-taskiFOyeW/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790521920546562-17952-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790521920546562-17952-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790521920546562-17952-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790521920546562-17952-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.136.1:0
--local_ip_for_outbound_sockets=127.17.136.1
--webserver_interface=127.17.136.1
--webserver_port=0
--tserver_master_addrs=127.17.136.62:33149
--keytab_file=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790521920546562-17952-0/krb5kdc/kudu_127.17.136.1.keytab
--principal=kudu/127.17.136.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.136.20:38711
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790521920546562-17952-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790521920546562-17952-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790521920546562-17952-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260927 15:12:09.445891 19756 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260927 15:12:09.446157 19756 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260927 15:12:09.446203 19756 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260927 15:12:09.450239 19756 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260927 15:12:09.450300 19756 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260927 15:12:09.450340 19756 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260927 15:12:09.450351 19756 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260927 15:12:09.450382 19756 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.136.1
I20260927 15:12:09.455634 19756 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.136.20:38711
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790521920546562-17952-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790521920546562-17952-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790521920546562-17952-0/krb5kdc/kudu_127.17.136.1.keytab
--principal=kudu/127.17.136.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.136.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790521920546562-17952-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.17.136.1
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.17.136.62:33149
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19756
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.136.1
--log_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790521920546562-17952-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 27 Sep 2026 14:27:13 UTC on ccycloud.quasar-psqrth.root.comops.site
build id 4676138
I20260927 15:12:09.456705 19756 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260927 15:12:09.457685 19756 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260927 15:12:09.466845 19762 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260927 15:12:09.466813 19764 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260927 15:12:09.466813 19761 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260927 15:12:09.467195 19756 server_base.cc:1034] running on GCE node
I20260927 15:12:09.467581 19756 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260927 15:12:09.468140 19756 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260927 15:12:09.469295 19756 hybrid_clock.cc:648] HybridClock initialized: now 1790521929469275 us; error 31 us; skew 500 ppm
Sep 27 15:12:09 dist-test-slave-5s2t krb5kdc[19639](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790521929, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.136.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260927 15:12:09.471894 19756 init.cc:377] Logged in from keytab as kudu/127.17.136.1@KRBTEST.COM (short username kudu)
I20260927 15:12:09.472683 19756 webserver.cc:460] Webserver started at http://127.17.136.1:39427/ using document root <none> and password file <none>
I20260927 15:12:09.473169 19756 fs_manager.cc:359] Metadata directory not provided
I20260927 15:12:09.473222 19756 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260927 15:12:09.473382 19756 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260927 15:12:09.475358 19756 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790521920546562-17952-0/minicluster-data/ts-0/data/instance:
uuid: "7e780b9761974a01892b38c81c7542f8"
format_stamp: "Formatted at 2026-09-27 15:12:09 on dist-test-slave-5s2t"
server_key: "85e58bbe0f65c5fcd990a1dd2d6fef9b"
server_key_iv: "f2d9d29988c2ae45cc8ba9e51bc4dc7b"
server_key_version: "encryptionkey@0"
I20260927 15:12:09.475864 19756 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790521920546562-17952-0/minicluster-data/ts-0/wal/instance:
uuid: "7e780b9761974a01892b38c81c7542f8"
format_stamp: "Formatted at 2026-09-27 15:12:09 on dist-test-slave-5s2t"
server_key: "85e58bbe0f65c5fcd990a1dd2d6fef9b"
server_key_iv: "f2d9d29988c2ae45cc8ba9e51bc4dc7b"
server_key_version: "encryptionkey@0"
I20260927 15:12:09.479387 19756 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.000s
I20260927 15:12:09.481693 19771 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260927 15:12:09.482836 19756 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260927 15:12:09.482928 19756 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790521920546562-17952-0/minicluster-data/ts-0/data,/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790521920546562-17952-0/minicluster-data/ts-0/wal
uuid: "7e780b9761974a01892b38c81c7542f8"
format_stamp: "Formatted at 2026-09-27 15:12:09 on dist-test-slave-5s2t"
server_key: "85e58bbe0f65c5fcd990a1dd2d6fef9b"
server_key_iv: "f2d9d29988c2ae45cc8ba9e51bc4dc7b"
server_key_version: "encryptionkey@0"
I20260927 15:12:09.483011 19756 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790521920546562-17952-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790521920546562-17952-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790521920546562-17952-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260927 15:12:09.510501 19756 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260927 15:12:09.513679 19756 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260927 15:12:09.513847 19756 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260927 15:12:09.515214 19756 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260927 15:12:09.515280 19756 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260927 15:12:09.515334 19756 ts_tablet_manager.cc:610] Registered 0 tablets
I20260927 15:12:09.515358 19756 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Sep 27 15:12:09 dist-test-slave-5s2t krb5kdc[19639](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790521929, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.136.1@KRBTEST.COM for kudu/127.17.136.62@KRBTEST.COM
I20260927 15:12:09.525270 19756 rpc_server.cc:307] RPC server started. Bound to: 127.17.136.1:37191
I20260927 15:12:09.525317 19886 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.136.1:37191 every 8 connection(s)
I20260927 15:12:09.526226 19756 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790521920546562-17952-0/minicluster-data/ts-0/data/info.pb
I20260927 15:12:09.528118 19733 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:09.516052 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.136.1:33409 (local address 127.17.136.62:33149)
0927 15:12:09.516206 (+ 154us) server_negotiation.cc:206] Beginning negotiation
0927 15:12:09.516210 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0927 15:12:09.517059 (+ 849us) server_negotiation.cc:407] Connection header received
0927 15:12:09.518248 (+ 1189us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:12:09.518251 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:12:09.518305 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:12:09.518381 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0927 15:12:09.519979 (+ 1598us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:09.520629 (+ 650us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:09.521790 (+ 1161us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:09.522040 (+ 250us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:09.522127 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:09.524780 (+ 2653us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0927 15:12:09.524783 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0927 15:12:09.524785 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0927 15:12:09.524812 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0927 15:12:09.526222 (+ 1410us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:12:09.526795 (+ 573us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:12:09.526798 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:12:09.526800 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:12:09.526893 (+ 93us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:12:09.527202 (+ 309us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:12:09.527205 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:12:09.527206 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:12:09.527416 (+ 210us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0927 15:12:09.527494 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0927 15:12:09.527899 (+ 405us) server_negotiation.cc:299] Negotiation successful
0927 15:12:09.527998 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260927 15:12:09.528860 19780 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:09.516495 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.62:33149 (local address 127.17.136.1:33409)
0927 15:12:09.516922 (+ 427us) negotiation.cc:107] Waiting for socket to connect
0927 15:12:09.516969 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0927 15:12:09.518057 (+ 1088us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0927 15:12:09.518595 (+ 538us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0927 15:12:09.518605 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0927 15:12:09.519050 (+ 445us) client_negotiation.cc:189] Negotiated authn=SASL
0927 15:12:09.519774 (+ 724us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:12:09.519795 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:12:09.520749 (+ 954us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:12:09.520752 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:12:09.521683 (+ 931us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:12:09.521693 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:12:09.522190 (+ 497us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:12:09.522194 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:12:09.522342 (+ 148us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:09.522876 (+ 534us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0927 15:12:09.522892 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0927 15:12:09.524582 (+ 1690us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0927 15:12:09.526333 (+ 1751us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0927 15:12:09.526338 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0927 15:12:09.526352 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0927 15:12:09.526684 (+ 332us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0927 15:12:09.526989 (+ 305us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0927 15:12:09.526992 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0927 15:12:09.526994 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0927 15:12:09.527128 (+ 134us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0927 15:12:09.527495 (+ 367us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0927 15:12:09.527500 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0927 15:12:09.527720 (+ 220us) client_negotiation.cc:769] Sending connection context
0927 15:12:09.527866 (+ 146us) client_negotiation.cc:240] Negotiation successful
0927 15:12:09.528109 (+ 243us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":241,"thread_start_us":99,"threads_started":1}
I20260927 15:12:09.530015 19887 heartbeater.cc:347] Connected to a master server at 127.17.136.62:33149
I20260927 15:12:09.530151 19887 heartbeater.cc:464] Registering TS with master...
I20260927 15:12:09.530501 17952 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu as pid 19756
I20260927 15:12:09.530625 17952 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790521920546562-17952-0/minicluster-data/ts-0/wal/instance
I20260927 15:12:09.530726 19887 heartbeater.cc:511] Master 127.17.136.62:33149 requested a full tablet report, sending...
I20260927 15:12:09.530915 17952 external_mini_cluster.cc:1428] Setting key afcfa194254fefd6f3ba8bf70745c5b1
I20260927 15:12:09.532310 19684 ts_manager.cc:194] Registered new tserver with Master: 7e780b9761974a01892b38c81c7542f8 (127.17.136.1:37191)
I20260927 15:12:09.533715 19684 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.136.1@KRBTEST.COM'} at 127.17.136.1:33409
I20260927 15:12:09.539062 19733 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:09.532219 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.136.1:35217 (local address 127.17.136.62:33149)
0927 15:12:09.532330 (+ 111us) server_negotiation.cc:206] Beginning negotiation
0927 15:12:09.532334 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0927 15:12:09.532529 (+ 195us) server_negotiation.cc:407] Connection header received
0927 15:12:09.532674 (+ 145us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:12:09.532677 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:12:09.532717 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:12:09.532776 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0927 15:12:09.533169 (+ 393us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:09.533672 (+ 503us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:09.534843 (+ 1171us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:09.535165 (+ 322us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:09.535292 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:09.536380 (+ 1088us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0927 15:12:09.536383 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0927 15:12:09.536385 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0927 15:12:09.536410 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0927 15:12:09.537644 (+ 1234us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:12:09.538101 (+ 457us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:12:09.538103 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:12:09.538104 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:12:09.538170 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:12:09.538409 (+ 239us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:12:09.538411 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:12:09.538412 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:12:09.538555 (+ 143us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0927 15:12:09.538623 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0927 15:12:09.538863 (+ 240us) server_negotiation.cc:299] Negotiation successful
0927 15:12:09.538951 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260927 15:12:09.539167 19893 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:09.532244 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.62:33149 (local address 127.17.136.1:35217)
0927 15:12:09.532463 (+ 219us) negotiation.cc:107] Waiting for socket to connect
0927 15:12:09.532474 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0927 15:12:09.532596 (+ 122us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0927 15:12:09.532798 (+ 202us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0927 15:12:09.532801 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0927 15:12:09.532977 (+ 176us) client_negotiation.cc:189] Negotiated authn=SASL
0927 15:12:09.533073 (+ 96us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:12:09.533078 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:12:09.533778 (+ 700us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:12:09.533781 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:12:09.534729 (+ 948us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:12:09.534740 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:12:09.535293 (+ 553us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:12:09.535297 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:12:09.535380 (+ 83us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:09.535860 (+ 480us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0927 15:12:09.535873 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0927 15:12:09.536256 (+ 383us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0927 15:12:09.537745 (+ 1489us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0927 15:12:09.537748 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0927 15:12:09.537751 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0927 15:12:09.537987 (+ 236us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0927 15:12:09.538246 (+ 259us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0927 15:12:09.538249 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0927 15:12:09.538251 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0927 15:12:09.538338 (+ 87us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0927 15:12:09.538632 (+ 294us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0927 15:12:09.538634 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0927 15:12:09.538725 (+ 91us) client_negotiation.cc:769] Sending connection context
0927 15:12:09.538830 (+ 105us) client_negotiation.cc:240] Negotiation successful
0927 15:12:09.538967 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":149,"thread_start_us":77,"threads_started":1}
WARNING: no policy specified for kudu/127.17.136.2@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.136.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.136.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790521920546562-17952-0/krb5kdc/kudu_127.17.136.2.keytab.
Entry for principal kudu/127.17.136.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790521920546562-17952-0/krb5kdc/kudu_127.17.136.2.keytab.
I20260927 15:12:09.557761 17952 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu
/tmp/dist-test-taskiFOyeW/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790521920546562-17952-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790521920546562-17952-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790521920546562-17952-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790521920546562-17952-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.136.2:0
--local_ip_for_outbound_sockets=127.17.136.2
--webserver_interface=127.17.136.2
--webserver_port=0
--tserver_master_addrs=127.17.136.62:33149
--keytab_file=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790521920546562-17952-0/krb5kdc/kudu_127.17.136.2.keytab
--principal=kudu/127.17.136.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.136.20:38711
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790521920546562-17952-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790521920546562-17952-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790521920546562-17952-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260927 15:12:09.662734 19896 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260927 15:12:09.662971 19896 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260927 15:12:09.663024 19896 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260927 15:12:09.667040 19896 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260927 15:12:09.667105 19896 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260927 15:12:09.667145 19896 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260927 15:12:09.667156 19896 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260927 15:12:09.667187 19896 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.136.2
I20260927 15:12:09.672256 19896 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.136.20:38711
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790521920546562-17952-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790521920546562-17952-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790521920546562-17952-0/krb5kdc/kudu_127.17.136.2.keytab
--principal=kudu/127.17.136.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.136.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790521920546562-17952-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.17.136.2
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.17.136.62:33149
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19896
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.136.2
--log_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790521920546562-17952-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 27 Sep 2026 14:27:13 UTC on ccycloud.quasar-psqrth.root.comops.site
build id 4676138
I20260927 15:12:09.673213 19896 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260927 15:12:09.674111 19896 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260927 15:12:09.682991 19904 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260927 15:12:09.682974 19902 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260927 15:12:09.683081 19896 server_base.cc:1034] running on GCE node
W20260927 15:12:09.682987 19901 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260927 15:12:09.683638 19896 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260927 15:12:09.684201 19896 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260927 15:12:09.685346 19896 hybrid_clock.cc:648] HybridClock initialized: now 1790521929685325 us; error 34 us; skew 500 ppm
Sep 27 15:12:09 dist-test-slave-5s2t krb5kdc[19639](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790521929, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.136.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260927 15:12:09.687862 19896 init.cc:377] Logged in from keytab as kudu/127.17.136.2@KRBTEST.COM (short username kudu)
I20260927 15:12:09.688676 19896 webserver.cc:460] Webserver started at http://127.17.136.2:46157/ using document root <none> and password file <none>
I20260927 15:12:09.689193 19896 fs_manager.cc:359] Metadata directory not provided
I20260927 15:12:09.689254 19896 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260927 15:12:09.689427 19896 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260927 15:12:09.691341 19896 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790521920546562-17952-0/minicluster-data/ts-1/data/instance:
uuid: "0a92c656775c4ef4995411712bf186cb"
format_stamp: "Formatted at 2026-09-27 15:12:09 on dist-test-slave-5s2t"
server_key: "1fa89da70260d38f455326f763125187"
server_key_iv: "eac820436c75f826479f6bd890f4e127"
server_key_version: "encryptionkey@0"
I20260927 15:12:09.691843 19896 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790521920546562-17952-0/minicluster-data/ts-1/wal/instance:
uuid: "0a92c656775c4ef4995411712bf186cb"
format_stamp: "Formatted at 2026-09-27 15:12:09 on dist-test-slave-5s2t"
server_key: "1fa89da70260d38f455326f763125187"
server_key_iv: "eac820436c75f826479f6bd890f4e127"
server_key_version: "encryptionkey@0"
I20260927 15:12:09.695225 19896 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.000s
I20260927 15:12:09.697595 19911 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260927 15:12:09.698756 19896 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260927 15:12:09.698854 19896 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790521920546562-17952-0/minicluster-data/ts-1/data,/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790521920546562-17952-0/minicluster-data/ts-1/wal
uuid: "0a92c656775c4ef4995411712bf186cb"
format_stamp: "Formatted at 2026-09-27 15:12:09 on dist-test-slave-5s2t"
server_key: "1fa89da70260d38f455326f763125187"
server_key_iv: "eac820436c75f826479f6bd890f4e127"
server_key_version: "encryptionkey@0"
I20260927 15:12:09.698940 19896 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790521920546562-17952-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790521920546562-17952-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790521920546562-17952-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260927 15:12:09.709877 19896 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260927 15:12:09.712800 19896 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260927 15:12:09.712961 19896 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260927 15:12:09.714286 19896 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260927 15:12:09.714332 19896 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260927 15:12:09.714382 19896 ts_tablet_manager.cc:610] Registered 0 tablets
I20260927 15:12:09.714409 19896 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Sep 27 15:12:09 dist-test-slave-5s2t krb5kdc[19639](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790521929, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.136.2@KRBTEST.COM for kudu/127.17.136.62@KRBTEST.COM
I20260927 15:12:09.724597 19896 rpc_server.cc:307] RPC server started. Bound to: 127.17.136.2:40665
I20260927 15:12:09.724620 20026 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.136.2:40665 every 8 connection(s)
I20260927 15:12:09.725592 19896 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790521920546562-17952-0/minicluster-data/ts-1/data/info.pb
I20260927 15:12:09.727171 19733 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:09.715048 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.136.2:58819 (local address 127.17.136.62:33149)
0927 15:12:09.715160 (+ 112us) server_negotiation.cc:206] Beginning negotiation
0927 15:12:09.715163 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0927 15:12:09.716188 (+ 1025us) server_negotiation.cc:407] Connection header received
0927 15:12:09.717190 (+ 1002us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:12:09.717194 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:12:09.717253 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:12:09.717308 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0927 15:12:09.718757 (+ 1449us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:09.719445 (+ 688us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:09.720620 (+ 1175us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:09.720849 (+ 229us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:09.720947 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:09.723616 (+ 2669us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0927 15:12:09.723620 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0927 15:12:09.723623 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0927 15:12:09.723652 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0927 15:12:09.725119 (+ 1467us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:12:09.725593 (+ 474us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:12:09.725596 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:12:09.725598 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:12:09.725690 (+ 92us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:12:09.725997 (+ 307us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:12:09.726000 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:12:09.726002 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:12:09.726255 (+ 253us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0927 15:12:09.726351 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0927 15:12:09.726844 (+ 493us) server_negotiation.cc:299] Negotiation successful
0927 15:12:09.726964 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260927 15:12:09.727875 19920 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:09.715566 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.62:33149 (local address 127.17.136.2:58819)
0927 15:12:09.716047 (+ 481us) negotiation.cc:107] Waiting for socket to connect
0927 15:12:09.716086 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0927 15:12:09.716913 (+ 827us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0927 15:12:09.717772 (+ 859us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0927 15:12:09.717781 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0927 15:12:09.718122 (+ 341us) client_negotiation.cc:189] Negotiated authn=SASL
0927 15:12:09.718610 (+ 488us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:12:09.718628 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:12:09.719561 (+ 933us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:12:09.719565 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:12:09.720500 (+ 935us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:12:09.720510 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:12:09.721000 (+ 490us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:12:09.721004 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:12:09.721161 (+ 157us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:09.721684 (+ 523us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0927 15:12:09.721699 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0927 15:12:09.723436 (+ 1737us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0927 15:12:09.725225 (+ 1789us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0927 15:12:09.725229 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0927 15:12:09.725240 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0927 15:12:09.725469 (+ 229us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0927 15:12:09.725768 (+ 299us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0927 15:12:09.725770 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0927 15:12:09.725772 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0927 15:12:09.725897 (+ 125us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0927 15:12:09.726344 (+ 447us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0927 15:12:09.726350 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0927 15:12:09.726624 (+ 274us) client_negotiation.cc:769] Sending connection context
0927 15:12:09.726783 (+ 159us) client_negotiation.cc:240] Negotiation successful
0927 15:12:09.727084 (+ 301us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":266,"thread_start_us":124,"threads_started":1}
I20260927 15:12:09.728957 20027 heartbeater.cc:347] Connected to a master server at 127.17.136.62:33149
I20260927 15:12:09.729091 20027 heartbeater.cc:464] Registering TS with master...
I20260927 15:12:09.729641 20027 heartbeater.cc:511] Master 127.17.136.62:33149 requested a full tablet report, sending...
I20260927 15:12:09.730633 19681 ts_manager.cc:194] Registered new tserver with Master: 0a92c656775c4ef4995411712bf186cb (127.17.136.2:40665)
I20260927 15:12:09.731344 19681 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.136.2@KRBTEST.COM'} at 127.17.136.2:58819
I20260927 15:12:09.733363 17952 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu as pid 19896
I20260927 15:12:09.733474 17952 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790521920546562-17952-0/minicluster-data/ts-1/wal/instance
I20260927 15:12:09.733773 17952 external_mini_cluster.cc:1428] Setting key 3582b78d284af9a56f790cdd49387bad
I20260927 15:12:09.737769 19733 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:09.731097 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.136.2:47771 (local address 127.17.136.62:33149)
0927 15:12:09.731200 (+ 103us) server_negotiation.cc:206] Beginning negotiation
0927 15:12:09.731203 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0927 15:12:09.731598 (+ 395us) server_negotiation.cc:407] Connection header received
0927 15:12:09.731715 (+ 117us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:12:09.731718 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:12:09.731758 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:12:09.731819 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0927 15:12:09.732233 (+ 414us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:09.732788 (+ 555us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:09.733758 (+ 970us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:09.734014 (+ 256us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:09.734120 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:09.735098 (+ 978us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0927 15:12:09.735100 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0927 15:12:09.735102 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0927 15:12:09.735122 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0927 15:12:09.736331 (+ 1209us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:12:09.736707 (+ 376us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:12:09.736710 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:12:09.736712 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:12:09.736787 (+ 75us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:12:09.737015 (+ 228us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:12:09.737018 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:12:09.737020 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:12:09.737219 (+ 199us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0927 15:12:09.737300 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0927 15:12:09.737530 (+ 230us) server_negotiation.cc:299] Negotiation successful
0927 15:12:09.737627 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260927 15:12:09.737782 20033 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:09.731185 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.62:33149 (local address 127.17.136.2:47771)
0927 15:12:09.731522 (+ 337us) negotiation.cc:107] Waiting for socket to connect
0927 15:12:09.731537 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0927 15:12:09.731624 (+ 87us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0927 15:12:09.731840 (+ 216us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0927 15:12:09.731843 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0927 15:12:09.732037 (+ 194us) client_negotiation.cc:189] Negotiated authn=SASL
0927 15:12:09.732133 (+ 96us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:12:09.732139 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:12:09.732905 (+ 766us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:12:09.732909 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:12:09.733625 (+ 716us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:12:09.733636 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:12:09.734133 (+ 497us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:12:09.734136 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:12:09.734203 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:09.734657 (+ 454us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0927 15:12:09.734667 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0927 15:12:09.734979 (+ 312us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0927 15:12:09.736431 (+ 1452us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0927 15:12:09.736433 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0927 15:12:09.736436 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0927 15:12:09.736626 (+ 190us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0927 15:12:09.736862 (+ 236us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0927 15:12:09.736865 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0927 15:12:09.736867 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0927 15:12:09.736942 (+ 75us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0927 15:12:09.737303 (+ 361us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0927 15:12:09.737305 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0927 15:12:09.737391 (+ 86us) client_negotiation.cc:769] Sending connection context
0927 15:12:09.737470 (+ 79us) client_negotiation.cc:240] Negotiation successful
0927 15:12:09.737614 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":202,"thread_start_us":109,"threads_started":1}
WARNING: no policy specified for kudu/127.17.136.3@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.136.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.136.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790521920546562-17952-0/krb5kdc/kudu_127.17.136.3.keytab.
Entry for principal kudu/127.17.136.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790521920546562-17952-0/krb5kdc/kudu_127.17.136.3.keytab.
I20260927 15:12:09.758191 17952 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu
/tmp/dist-test-taskiFOyeW/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790521920546562-17952-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790521920546562-17952-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790521920546562-17952-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790521920546562-17952-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.136.3:0
--local_ip_for_outbound_sockets=127.17.136.3
--webserver_interface=127.17.136.3
--webserver_port=0
--tserver_master_addrs=127.17.136.62:33149
--keytab_file=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790521920546562-17952-0/krb5kdc/kudu_127.17.136.3.keytab
--principal=kudu/127.17.136.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.136.20:38711
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790521920546562-17952-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790521920546562-17952-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790521920546562-17952-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260927 15:12:09.866526 20036 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260927 15:12:09.866803 20036 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260927 15:12:09.866849 20036 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260927 15:12:09.870859 20036 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260927 15:12:09.870920 20036 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260927 15:12:09.870958 20036 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260927 15:12:09.870971 20036 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260927 15:12:09.871012 20036 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.136.3
I20260927 15:12:09.876375 20036 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.136.20:38711
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790521920546562-17952-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790521920546562-17952-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790521920546562-17952-0/krb5kdc/kudu_127.17.136.3.keytab
--principal=kudu/127.17.136.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.136.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790521920546562-17952-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.17.136.3
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.17.136.62:33149
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20036
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.136.3
--log_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790521920546562-17952-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 27 Sep 2026 14:27:13 UTC on ccycloud.quasar-psqrth.root.comops.site
build id 4676138
I20260927 15:12:09.877427 20036 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260927 15:12:09.878404 20036 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260927 15:12:09.887562 20041 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260927 15:12:09.887568 20042 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260927 15:12:09.887601 20036 server_base.cc:1034] running on GCE node
W20260927 15:12:09.887804 20044 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260927 15:12:09.888180 20036 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260927 15:12:09.888787 20036 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260927 15:12:09.889940 20036 hybrid_clock.cc:648] HybridClock initialized: now 1790521929889914 us; error 37 us; skew 500 ppm
Sep 27 15:12:09 dist-test-slave-5s2t krb5kdc[19639](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790521929, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.136.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260927 15:12:09.892536 20036 init.cc:377] Logged in from keytab as kudu/127.17.136.3@KRBTEST.COM (short username kudu)
I20260927 15:12:09.893352 20036 webserver.cc:460] Webserver started at http://127.17.136.3:45709/ using document root <none> and password file <none>
I20260927 15:12:09.893850 20036 fs_manager.cc:359] Metadata directory not provided
I20260927 15:12:09.893903 20036 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260927 15:12:09.894070 20036 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260927 15:12:09.896100 20036 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790521920546562-17952-0/minicluster-data/ts-2/data/instance:
uuid: "8395c661562d41e2af64d5a5fbd7b55e"
format_stamp: "Formatted at 2026-09-27 15:12:09 on dist-test-slave-5s2t"
server_key: "38428eac052db3bef66661a3ec989cba"
server_key_iv: "f53b87f071be9625be324ae2aadf63cb"
server_key_version: "encryptionkey@0"
I20260927 15:12:09.896597 20036 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790521920546562-17952-0/minicluster-data/ts-2/wal/instance:
uuid: "8395c661562d41e2af64d5a5fbd7b55e"
format_stamp: "Formatted at 2026-09-27 15:12:09 on dist-test-slave-5s2t"
server_key: "38428eac052db3bef66661a3ec989cba"
server_key_iv: "f53b87f071be9625be324ae2aadf63cb"
server_key_version: "encryptionkey@0"
I20260927 15:12:09.900207 20036 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.000s
I20260927 15:12:09.902572 20051 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260927 15:12:09.903813 20036 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260927 15:12:09.903904 20036 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790521920546562-17952-0/minicluster-data/ts-2/data,/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790521920546562-17952-0/minicluster-data/ts-2/wal
uuid: "8395c661562d41e2af64d5a5fbd7b55e"
format_stamp: "Formatted at 2026-09-27 15:12:09 on dist-test-slave-5s2t"
server_key: "38428eac052db3bef66661a3ec989cba"
server_key_iv: "f53b87f071be9625be324ae2aadf63cb"
server_key_version: "encryptionkey@0"
I20260927 15:12:09.903990 20036 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790521920546562-17952-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790521920546562-17952-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790521920546562-17952-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260927 15:12:09.926398 20036 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260927 15:12:09.929378 20036 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260927 15:12:09.929566 20036 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260927 15:12:09.931128 20036 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260927 15:12:09.931176 20036 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260927 15:12:09.931228 20036 ts_tablet_manager.cc:610] Registered 0 tablets
I20260927 15:12:09.931281 20036 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Sep 27 15:12:09 dist-test-slave-5s2t krb5kdc[19639](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790521929, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.136.3@KRBTEST.COM for kudu/127.17.136.62@KRBTEST.COM
I20260927 15:12:09.940939 20036 rpc_server.cc:307] RPC server started. Bound to: 127.17.136.3:39291
I20260927 15:12:09.940963 20166 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.136.3:39291 every 8 connection(s)
I20260927 15:12:09.941951 20036 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790521920546562-17952-0/minicluster-data/ts-2/data/info.pb
I20260927 15:12:09.943832 17952 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu as pid 20036
I20260927 15:12:09.943924 17952 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790521920546562-17952-0/minicluster-data/ts-2/wal/instance
I20260927 15:12:09.944224 17952 external_mini_cluster.cc:1428] Setting key 1268a4862f079994dc4c4b89c6b2b690
I20260927 15:12:09.944316 19733 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:09.931813 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.136.3:49889 (local address 127.17.136.62:33149)
0927 15:12:09.931943 (+ 130us) server_negotiation.cc:206] Beginning negotiation
0927 15:12:09.931948 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0927 15:12:09.933575 (+ 1627us) server_negotiation.cc:407] Connection header received
0927 15:12:09.934764 (+ 1189us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:12:09.934767 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:12:09.934826 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:12:09.934904 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0927 15:12:09.936260 (+ 1356us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:09.936795 (+ 535us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:09.937966 (+ 1171us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:09.938184 (+ 218us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:09.938270 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:09.940756 (+ 2486us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0927 15:12:09.940759 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0927 15:12:09.940762 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0927 15:12:09.940791 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0927 15:12:09.942337 (+ 1546us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:12:09.942914 (+ 577us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:12:09.942917 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:12:09.942919 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:12:09.943007 (+ 88us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:12:09.943329 (+ 322us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:12:09.943331 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:12:09.943332 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:12:09.943517 (+ 185us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0927 15:12:09.943591 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0927 15:12:09.944036 (+ 445us) server_negotiation.cc:299] Negotiation successful
0927 15:12:09.944161 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260927 15:12:09.945096 20061 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:09.932923 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.62:33149 (local address 127.17.136.3:49889)
0927 15:12:09.933419 (+ 496us) negotiation.cc:107] Waiting for socket to connect
0927 15:12:09.933475 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0927 15:12:09.934561 (+ 1086us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0927 15:12:09.935137 (+ 576us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0927 15:12:09.935147 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0927 15:12:09.935572 (+ 425us) client_negotiation.cc:189] Negotiated authn=SASL
0927 15:12:09.936123 (+ 551us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:12:09.936144 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:12:09.936910 (+ 766us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:12:09.936914 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:12:09.937850 (+ 936us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:12:09.937860 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:12:09.938318 (+ 458us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:12:09.938322 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:12:09.938495 (+ 173us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:09.939036 (+ 541us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0927 15:12:09.939055 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0927 15:12:09.940539 (+ 1484us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0927 15:12:09.942458 (+ 1919us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0927 15:12:09.942464 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0927 15:12:09.942479 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0927 15:12:09.942818 (+ 339us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0927 15:12:09.943089 (+ 271us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0927 15:12:09.943092 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0927 15:12:09.943095 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0927 15:12:09.943221 (+ 126us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0927 15:12:09.943593 (+ 372us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0927 15:12:09.943598 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0927 15:12:09.943812 (+ 214us) client_negotiation.cc:769] Sending connection context
0927 15:12:09.943962 (+ 150us) client_negotiation.cc:240] Negotiation successful
0927 15:12:09.944219 (+ 257us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":263,"thread_start_us":124,"threads_started":1}
I20260927 15:12:09.946203 20167 heartbeater.cc:347] Connected to a master server at 127.17.136.62:33149
I20260927 15:12:09.946336 20167 heartbeater.cc:464] Registering TS with master...
I20260927 15:12:09.946866 20167 heartbeater.cc:511] Master 127.17.136.62:33149 requested a full tablet report, sending...
I20260927 15:12:09.947829 19681 ts_manager.cc:194] Registered new tserver with Master: 8395c661562d41e2af64d5a5fbd7b55e (127.17.136.3:39291)
I20260927 15:12:09.948519 19681 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.136.3@KRBTEST.COM'} at 127.17.136.3:49889
I20260927 15:12:09.953859 20173 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:09.948129 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.62:33149 (local address 127.17.136.3:49553)
0927 15:12:09.948388 (+ 259us) negotiation.cc:107] Waiting for socket to connect
0927 15:12:09.948402 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0927 15:12:09.948494 (+ 92us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0927 15:12:09.948696 (+ 202us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0927 15:12:09.948699 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0927 15:12:09.948861 (+ 162us) client_negotiation.cc:189] Negotiated authn=SASL
0927 15:12:09.948950 (+ 89us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:12:09.948955 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:12:09.949641 (+ 686us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:12:09.949644 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:12:09.950397 (+ 753us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:12:09.950405 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:12:09.950768 (+ 363us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:12:09.950771 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:12:09.950837 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:09.951301 (+ 464us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0927 15:12:09.951312 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0927 15:12:09.951588 (+ 276us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0927 15:12:09.952822 (+ 1234us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0927 15:12:09.952825 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0927 15:12:09.952826 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0927 15:12:09.953027 (+ 201us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0927 15:12:09.953209 (+ 182us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0927 15:12:09.953211 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0927 15:12:09.953212 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0927 15:12:09.953273 (+ 61us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0927 15:12:09.953516 (+ 243us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0927 15:12:09.953518 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0927 15:12:09.953581 (+ 63us) client_negotiation.cc:769] Sending connection context
0927 15:12:09.953649 (+ 68us) client_negotiation.cc:240] Negotiation successful
0927 15:12:09.953742 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":184,"thread_start_us":93,"threads_started":1}
I20260927 15:12:09.953866 19733 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:09.948210 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.136.3:49553 (local address 127.17.136.62:33149)
0927 15:12:09.948312 (+ 102us) server_negotiation.cc:206] Beginning negotiation
0927 15:12:09.948316 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0927 15:12:09.948462 (+ 146us) server_negotiation.cc:407] Connection header received
0927 15:12:09.948570 (+ 108us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:12:09.948572 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:12:09.948611 (+ 39us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:12:09.948678 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0927 15:12:09.949048 (+ 370us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:09.949523 (+ 475us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:09.950479 (+ 956us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:09.950685 (+ 206us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:09.950747 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:09.951690 (+ 943us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0927 15:12:09.951692 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0927 15:12:09.951694 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0927 15:12:09.951709 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0927 15:12:09.952737 (+ 1028us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:12:09.953094 (+ 357us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:12:09.953096 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:12:09.953097 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:12:09.953154 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:12:09.953326 (+ 172us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:12:09.953328 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:12:09.953329 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:12:09.953459 (+ 130us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0927 15:12:09.953524 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0927 15:12:09.953692 (+ 168us) server_negotiation.cc:299] Negotiation successful
0927 15:12:09.953769 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260927 15:12:09.957412 17952 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Sep 27 15:12:09 dist-test-slave-5s2t krb5kdc[19639](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790521929, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Sep 27 15:12:09 dist-test-slave-5s2t krb5kdc[19639](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790521929, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.136.62@KRBTEST.COM
I20260927 15:12:09.980942 19733 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:09.973264 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49728 (local address 127.17.136.62:33149)
0927 15:12:09.973389 (+ 125us) server_negotiation.cc:206] Beginning negotiation
0927 15:12:09.973392 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0927 15:12:09.973403 (+ 11us) server_negotiation.cc:407] Connection header received
0927 15:12:09.973441 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:12:09.973443 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:12:09.973480 (+ 37us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:12:09.973561 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0927 15:12:09.974224 (+ 663us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:09.974729 (+ 505us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:09.975604 (+ 875us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:09.975845 (+ 241us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:09.975928 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:09.978305 (+ 2377us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0927 15:12:09.978308 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0927 15:12:09.978310 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0927 15:12:09.978337 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0927 15:12:09.979688 (+ 1351us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:12:09.980056 (+ 368us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:12:09.980058 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:12:09.980059 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:12:09.980128 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:12:09.980308 (+ 180us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:12:09.980310 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:12:09.980311 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:12:09.980463 (+ 152us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0927 15:12:09.980571 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0927 15:12:09.980735 (+ 164us) server_negotiation.cc:299] Negotiation successful
0927 15:12:09.980822 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260927 15:12:09.983727 19681 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:49728:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:12:09.986661 19681 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:12:09.999771 20188 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:09.995076 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50522 (local address 127.17.136.2:40665)
0927 15:12:09.995610 (+ 534us) server_negotiation.cc:206] Beginning negotiation
0927 15:12:09.995620 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0927 15:12:09.995638 (+ 18us) server_negotiation.cc:407] Connection header received
0927 15:12:09.995698 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:12:09.995703 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:12:09.995905 (+ 202us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:12:09.996060 (+ 155us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0927 15:12:09.996437 (+ 377us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:09.997164 (+ 727us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:09.998535 (+ 1371us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:09.999117 (+ 582us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:09.999216 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:09.999404 (+ 188us) server_negotiation.cc:1035] Waiting for connection context
0927 15:12:09.999534 (+ 130us) server_negotiation.cc:299] Negotiation successful
0927 15:12:09.999630 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":452,"thread_start_us":94,"threads_started":1}
I20260927 15:12:09.999761 20186 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:09.994624 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.2:40665 (local address 127.0.0.1:50522)
0927 15:12:09.994859 (+ 235us) negotiation.cc:107] Waiting for socket to connect
0927 15:12:09.994871 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0927 15:12:09.994937 (+ 66us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0927 15:12:09.996059 (+ 1122us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0927 15:12:09.996066 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0927 15:12:09.996089 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0927 15:12:09.996318 (+ 229us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:12:09.996324 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:12:09.997282 (+ 958us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:12:09.997286 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:12:09.998409 (+ 1123us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:12:09.998418 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:12:09.999232 (+ 814us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:12:09.999236 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:12:09.999359 (+ 123us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:09.999397 (+ 38us) client_negotiation.cc:769] Sending connection context
0927 15:12:09.999497 (+ 100us) client_negotiation.cc:240] Negotiation successful
0927 15:12:09.999618 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":179,"mutex_wait_us":64,"thread_start_us":99,"threads_started":1}
I20260927 15:12:10.000540 20187 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:09.995002 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.3:39291 (local address 127.0.0.1:34946)
0927 15:12:09.995313 (+ 311us) negotiation.cc:107] Waiting for socket to connect
0927 15:12:09.995325 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0927 15:12:09.995404 (+ 79us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0927 15:12:09.996106 (+ 702us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0927 15:12:09.996109 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0927 15:12:09.996121 (+ 12us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0927 15:12:09.996300 (+ 179us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:12:09.996309 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:12:09.997725 (+ 1416us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:12:09.997728 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:12:09.998960 (+ 1232us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:12:09.998970 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:12:10.000192 (+ 1222us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:12:10.000196 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:12:10.000273 (+ 77us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:10.000296 (+ 23us) client_negotiation.cc:769] Sending connection context
0927 15:12:10.000343 (+ 47us) client_negotiation.cc:240] Negotiation successful
0927 15:12:10.000409 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":225,"mutex_wait_us":47,"thread_start_us":86,"threads_started":1}
I20260927 15:12:10.000774 20184 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:09.994324 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.1:37191 (local address 127.0.0.1:41686)
0927 15:12:09.994661 (+ 337us) negotiation.cc:107] Waiting for socket to connect
0927 15:12:09.994710 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0927 15:12:09.994831 (+ 121us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0927 15:12:09.996194 (+ 1363us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0927 15:12:09.996196 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0927 15:12:09.996208 (+ 12us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0927 15:12:09.996349 (+ 141us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:12:09.996356 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:12:09.997725 (+ 1369us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:12:09.997728 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:12:09.999216 (+ 1488us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:12:09.999224 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:12:10.000396 (+ 1172us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:12:10.000399 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:12:10.000487 (+ 88us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:10.000519 (+ 32us) client_negotiation.cc:769] Sending connection context
0927 15:12:10.000591 (+ 72us) client_negotiation.cc:240] Negotiation successful
0927 15:12:10.000661 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":148,"mutex_wait_us":125,"thread_start_us":80,"threads_started":1}
I20260927 15:12:10.001156 20189 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:09.995318 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34946 (local address 127.17.136.3:39291)
0927 15:12:09.995590 (+ 272us) server_negotiation.cc:206] Beginning negotiation
0927 15:12:09.995601 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0927 15:12:09.995623 (+ 22us) server_negotiation.cc:407] Connection header received
0927 15:12:09.995697 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:12:09.995701 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:12:09.995921 (+ 220us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:12:09.996264 (+ 343us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0927 15:12:09.996383 (+ 119us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:09.997603 (+ 1220us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:09.999109 (+ 1506us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:10.000063 (+ 954us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:10.000785 (+ 722us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:10.000937 (+ 152us) server_negotiation.cc:1035] Waiting for connection context
0927 15:12:10.000976 (+ 39us) server_negotiation.cc:299] Negotiation successful
0927 15:12:10.001053 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":176,"thread_start_us":84,"threads_started":1}
I20260927 15:12:10.002902 19961 tablet_service.cc:1467] Processing CreateTablet for tablet 9ede8c18278a44c08bfed45bd5fe1035 (DEFAULT_TABLE table=test-table [id=825334beffa446aab65965eb8b374aee]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:12:10.003764 20185 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:09.994431 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41686 (local address 127.17.136.1:37191)
0927 15:12:09.995589 (+ 1158us) server_negotiation.cc:206] Beginning negotiation
0927 15:12:09.995602 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0927 15:12:09.995626 (+ 24us) server_negotiation.cc:407] Connection header received
0927 15:12:09.995705 (+ 79us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:12:09.995713 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:12:09.995904 (+ 191us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:12:09.996057 (+ 153us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0927 15:12:09.996483 (+ 426us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:09.997618 (+ 1135us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:09.999369 (+ 1751us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:10.000099 (+ 730us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:10.000185 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:10.000344 (+ 159us) server_negotiation.cc:1035] Waiting for connection context
0927 15:12:10.003561 (+ 3217us) server_negotiation.cc:299] Negotiation successful
0927 15:12:10.003653 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1044,"thread_start_us":103,"threads_started":1}
I20260927 15:12:10.004078 19961 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9ede8c18278a44c08bfed45bd5fe1035. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:12:10.003901 20101 tablet_service.cc:1467] Processing CreateTablet for tablet 9ede8c18278a44c08bfed45bd5fe1035 (DEFAULT_TABLE table=test-table [id=825334beffa446aab65965eb8b374aee]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:12:10.004931 20101 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9ede8c18278a44c08bfed45bd5fe1035. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:12:10.005962 19821 tablet_service.cc:1467] Processing CreateTablet for tablet 9ede8c18278a44c08bfed45bd5fe1035 (DEFAULT_TABLE table=test-table [id=825334beffa446aab65965eb8b374aee]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:12:10.006731 19821 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9ede8c18278a44c08bfed45bd5fe1035. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:12:10.012310 20190 tablet_bootstrap.cc:492] T 9ede8c18278a44c08bfed45bd5fe1035 P 0a92c656775c4ef4995411712bf186cb: Bootstrap starting.
I20260927 15:12:10.013446 20191 tablet_bootstrap.cc:492] T 9ede8c18278a44c08bfed45bd5fe1035 P 8395c661562d41e2af64d5a5fbd7b55e: Bootstrap starting.
I20260927 15:12:10.014276 20190 tablet_bootstrap.cc:654] T 9ede8c18278a44c08bfed45bd5fe1035 P 0a92c656775c4ef4995411712bf186cb: Neither blocks nor log segments found. Creating new log.
I20260927 15:12:10.014954 20190 log.cc:824] T 9ede8c18278a44c08bfed45bd5fe1035 P 0a92c656775c4ef4995411712bf186cb: Log is configured to *not* fsync() on all Append() calls
I20260927 15:12:10.015087 20191 tablet_bootstrap.cc:654] T 9ede8c18278a44c08bfed45bd5fe1035 P 8395c661562d41e2af64d5a5fbd7b55e: Neither blocks nor log segments found. Creating new log.
I20260927 15:12:10.015590 20192 tablet_bootstrap.cc:492] T 9ede8c18278a44c08bfed45bd5fe1035 P 7e780b9761974a01892b38c81c7542f8: Bootstrap starting.
I20260927 15:12:10.015873 20191 log.cc:824] T 9ede8c18278a44c08bfed45bd5fe1035 P 8395c661562d41e2af64d5a5fbd7b55e: Log is configured to *not* fsync() on all Append() calls
I20260927 15:12:10.016904 20190 tablet_bootstrap.cc:492] T 9ede8c18278a44c08bfed45bd5fe1035 P 0a92c656775c4ef4995411712bf186cb: No bootstrap required, opened a new log
I20260927 15:12:10.017082 20190 ts_tablet_manager.cc:1397] T 9ede8c18278a44c08bfed45bd5fe1035 P 0a92c656775c4ef4995411712bf186cb: Time spent bootstrapping tablet: real 0.005s user 0.000s sys 0.003s
I20260927 15:12:10.017458 20192 tablet_bootstrap.cc:654] T 9ede8c18278a44c08bfed45bd5fe1035 P 7e780b9761974a01892b38c81c7542f8: Neither blocks nor log segments found. Creating new log.
I20260927 15:12:10.018158 20192 log.cc:824] T 9ede8c18278a44c08bfed45bd5fe1035 P 7e780b9761974a01892b38c81c7542f8: Log is configured to *not* fsync() on all Append() calls
I20260927 15:12:10.020147 20192 tablet_bootstrap.cc:492] T 9ede8c18278a44c08bfed45bd5fe1035 P 7e780b9761974a01892b38c81c7542f8: No bootstrap required, opened a new log
I20260927 15:12:10.020224 20191 tablet_bootstrap.cc:492] T 9ede8c18278a44c08bfed45bd5fe1035 P 8395c661562d41e2af64d5a5fbd7b55e: No bootstrap required, opened a new log
I20260927 15:12:10.020326 20192 ts_tablet_manager.cc:1397] T 9ede8c18278a44c08bfed45bd5fe1035 P 7e780b9761974a01892b38c81c7542f8: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s
I20260927 15:12:10.020394 20191 ts_tablet_manager.cc:1397] T 9ede8c18278a44c08bfed45bd5fe1035 P 8395c661562d41e2af64d5a5fbd7b55e: Time spent bootstrapping tablet: real 0.007s user 0.003s sys 0.000s
I20260927 15:12:10.020444 20190 raft_consensus.cc:348] T 9ede8c18278a44c08bfed45bd5fe1035 P 0a92c656775c4ef4995411712bf186cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e780b9761974a01892b38c81c7542f8" member_type: VOTER last_known_addr { host: "127.17.136.1" port: 37191 } } peers { permanent_uuid: "8395c661562d41e2af64d5a5fbd7b55e" member_type: VOTER last_known_addr { host: "127.17.136.3" port: 39291 } } peers { permanent_uuid: "0a92c656775c4ef4995411712bf186cb" member_type: VOTER last_known_addr { host: "127.17.136.2" port: 40665 } }
I20260927 15:12:10.020717 20190 raft_consensus.cc:374] T 9ede8c18278a44c08bfed45bd5fe1035 P 0a92c656775c4ef4995411712bf186cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:12:10.020772 20190 raft_consensus.cc:729] T 9ede8c18278a44c08bfed45bd5fe1035 P 0a92c656775c4ef4995411712bf186cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0a92c656775c4ef4995411712bf186cb, State: Initialized, Role: FOLLOWER
I20260927 15:12:10.021209 20190 consensus_queue.cc:260] T 9ede8c18278a44c08bfed45bd5fe1035 P 0a92c656775c4ef4995411712bf186cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e780b9761974a01892b38c81c7542f8" member_type: VOTER last_known_addr { host: "127.17.136.1" port: 37191 } } peers { permanent_uuid: "8395c661562d41e2af64d5a5fbd7b55e" member_type: VOTER last_known_addr { host: "127.17.136.3" port: 39291 } } peers { permanent_uuid: "0a92c656775c4ef4995411712bf186cb" member_type: VOTER last_known_addr { host: "127.17.136.2" port: 40665 } }
I20260927 15:12:10.021881 20027 heartbeater.cc:503] Master 127.17.136.62:33149 was elected leader, sending a full tablet report...
I20260927 15:12:10.022215 20190 ts_tablet_manager.cc:1428] T 9ede8c18278a44c08bfed45bd5fe1035 P 0a92c656775c4ef4995411712bf186cb: Time spent starting tablet: real 0.005s user 0.004s sys 0.002s
I20260927 15:12:10.023926 20192 raft_consensus.cc:348] T 9ede8c18278a44c08bfed45bd5fe1035 P 7e780b9761974a01892b38c81c7542f8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e780b9761974a01892b38c81c7542f8" member_type: VOTER last_known_addr { host: "127.17.136.1" port: 37191 } } peers { permanent_uuid: "8395c661562d41e2af64d5a5fbd7b55e" member_type: VOTER last_known_addr { host: "127.17.136.3" port: 39291 } } peers { permanent_uuid: "0a92c656775c4ef4995411712bf186cb" member_type: VOTER last_known_addr { host: "127.17.136.2" port: 40665 } }
I20260927 15:12:10.024222 20192 raft_consensus.cc:374] T 9ede8c18278a44c08bfed45bd5fe1035 P 7e780b9761974a01892b38c81c7542f8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:12:10.024277 20192 raft_consensus.cc:729] T 9ede8c18278a44c08bfed45bd5fe1035 P 7e780b9761974a01892b38c81c7542f8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e780b9761974a01892b38c81c7542f8, State: Initialized, Role: FOLLOWER
I20260927 15:12:10.024714 20192 consensus_queue.cc:260] T 9ede8c18278a44c08bfed45bd5fe1035 P 7e780b9761974a01892b38c81c7542f8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e780b9761974a01892b38c81c7542f8" member_type: VOTER last_known_addr { host: "127.17.136.1" port: 37191 } } peers { permanent_uuid: "8395c661562d41e2af64d5a5fbd7b55e" member_type: VOTER last_known_addr { host: "127.17.136.3" port: 39291 } } peers { permanent_uuid: "0a92c656775c4ef4995411712bf186cb" member_type: VOTER last_known_addr { host: "127.17.136.2" port: 40665 } }
I20260927 15:12:10.024853 20191 raft_consensus.cc:348] T 9ede8c18278a44c08bfed45bd5fe1035 P 8395c661562d41e2af64d5a5fbd7b55e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e780b9761974a01892b38c81c7542f8" member_type: VOTER last_known_addr { host: "127.17.136.1" port: 37191 } } peers { permanent_uuid: "8395c661562d41e2af64d5a5fbd7b55e" member_type: VOTER last_known_addr { host: "127.17.136.3" port: 39291 } } peers { permanent_uuid: "0a92c656775c4ef4995411712bf186cb" member_type: VOTER last_known_addr { host: "127.17.136.2" port: 40665 } }
I20260927 15:12:10.025115 20191 raft_consensus.cc:374] T 9ede8c18278a44c08bfed45bd5fe1035 P 8395c661562d41e2af64d5a5fbd7b55e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:12:10.025172 20191 raft_consensus.cc:729] T 9ede8c18278a44c08bfed45bd5fe1035 P 8395c661562d41e2af64d5a5fbd7b55e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8395c661562d41e2af64d5a5fbd7b55e, State: Initialized, Role: FOLLOWER
I20260927 15:12:10.025566 19887 heartbeater.cc:503] Master 127.17.136.62:33149 was elected leader, sending a full tablet report...
I20260927 15:12:10.025573 20191 consensus_queue.cc:260] T 9ede8c18278a44c08bfed45bd5fe1035 P 8395c661562d41e2af64d5a5fbd7b55e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e780b9761974a01892b38c81c7542f8" member_type: VOTER last_known_addr { host: "127.17.136.1" port: 37191 } } peers { permanent_uuid: "8395c661562d41e2af64d5a5fbd7b55e" member_type: VOTER last_known_addr { host: "127.17.136.3" port: 39291 } } peers { permanent_uuid: "0a92c656775c4ef4995411712bf186cb" member_type: VOTER last_known_addr { host: "127.17.136.2" port: 40665 } }
I20260927 15:12:10.025699 20192 ts_tablet_manager.cc:1428] T 9ede8c18278a44c08bfed45bd5fe1035 P 7e780b9761974a01892b38c81c7542f8: Time spent starting tablet: real 0.005s user 0.006s sys 0.000s
I20260927 15:12:10.026161 20167 heartbeater.cc:503] Master 127.17.136.62:33149 was elected leader, sending a full tablet report...
I20260927 15:12:10.026427 20191 ts_tablet_manager.cc:1428] T 9ede8c18278a44c08bfed45bd5fe1035 P 8395c661562d41e2af64d5a5fbd7b55e: Time spent starting tablet: real 0.006s user 0.005s sys 0.000s
W20260927 15:12:10.027374 19888 tablet.cc:2369] T 9ede8c18278a44c08bfed45bd5fe1035 P 7e780b9761974a01892b38c81c7542f8: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260927 15:12:10.066432 20196 raft_consensus.cc:482] T 9ede8c18278a44c08bfed45bd5fe1035 P 0a92c656775c4ef4995411712bf186cb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:12:10.066618 20196 raft_consensus.cc:504] T 9ede8c18278a44c08bfed45bd5fe1035 P 0a92c656775c4ef4995411712bf186cb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e780b9761974a01892b38c81c7542f8" member_type: VOTER last_known_addr { host: "127.17.136.1" port: 37191 } } peers { permanent_uuid: "8395c661562d41e2af64d5a5fbd7b55e" member_type: VOTER last_known_addr { host: "127.17.136.3" port: 39291 } } peers { permanent_uuid: "0a92c656775c4ef4995411712bf186cb" member_type: VOTER last_known_addr { host: "127.17.136.2" port: 40665 } }
I20260927 15:12:10.067708 20196 leader_election.cc:288] T 9ede8c18278a44c08bfed45bd5fe1035 P 0a92c656775c4ef4995411712bf186cb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7e780b9761974a01892b38c81c7542f8 (127.17.136.1:37191), 8395c661562d41e2af64d5a5fbd7b55e (127.17.136.3:39291)
I20260927 15:12:10.071871 20185 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:10.068021 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.136.2:41195 (local address 127.17.136.1:37191)
0927 15:12:10.068137 (+ 116us) server_negotiation.cc:206] Beginning negotiation
0927 15:12:10.068142 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0927 15:12:10.068161 (+ 19us) server_negotiation.cc:407] Connection header received
0927 15:12:10.068304 (+ 143us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:12:10.068307 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:12:10.068349 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:12:10.068413 (+ 64us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0927 15:12:10.068744 (+ 331us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:10.069489 (+ 745us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:10.070767 (+ 1278us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:10.071392 (+ 625us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:10.071504 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:10.071547 (+ 43us) server_negotiation.cc:1035] Waiting for connection context
0927 15:12:10.071716 (+ 169us) server_negotiation.cc:299] Negotiation successful
0927 15:12:10.071771 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260927 15:12:10.071911 19920 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:10.067950 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.1:37191 (local address 127.17.136.2:41195)
0927 15:12:10.068100 (+ 150us) negotiation.cc:107] Waiting for socket to connect
0927 15:12:10.068115 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0927 15:12:10.068212 (+ 97us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0927 15:12:10.068502 (+ 290us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0927 15:12:10.068505 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0927 15:12:10.068526 (+ 21us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0927 15:12:10.068633 (+ 107us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:12:10.068640 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:12:10.069585 (+ 945us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:12:10.069588 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:12:10.070653 (+ 1065us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:12:10.070662 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:12:10.071481 (+ 819us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:12:10.071484 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:12:10.071593 (+ 109us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:10.071618 (+ 25us) client_negotiation.cc:769] Sending connection context
0927 15:12:10.071706 (+ 88us) client_negotiation.cc:240] Negotiation successful
0927 15:12:10.071775 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":64,"mutex_wait_us":35}
I20260927 15:12:10.072553 19841 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9ede8c18278a44c08bfed45bd5fe1035" candidate_uuid: "0a92c656775c4ef4995411712bf186cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e780b9761974a01892b38c81c7542f8" is_pre_election: true
I20260927 15:12:10.072659 20199 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:10.068225 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.3:39291 (local address 127.17.136.2:59165)
0927 15:12:10.068545 (+ 320us) negotiation.cc:107] Waiting for socket to connect
0927 15:12:10.068555 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0927 15:12:10.068629 (+ 74us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0927 15:12:10.068827 (+ 198us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0927 15:12:10.068830 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0927 15:12:10.068845 (+ 15us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0927 15:12:10.068962 (+ 117us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:12:10.068968 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:12:10.070286 (+ 1318us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:12:10.070288 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:12:10.071354 (+ 1066us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:12:10.071365 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:12:10.072282 (+ 917us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:12:10.072286 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:12:10.072379 (+ 93us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:10.072401 (+ 22us) client_negotiation.cc:769] Sending connection context
0927 15:12:10.072463 (+ 62us) client_negotiation.cc:240] Negotiation successful
0927 15:12:10.072512 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":257,"mutex_wait_us":2,"thread_start_us":116,"threads_started":1}
I20260927 15:12:10.072671 20189 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:10.068348 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.136.2:59165 (local address 127.17.136.3:39291)
0927 15:12:10.068459 (+ 111us) server_negotiation.cc:206] Beginning negotiation
0927 15:12:10.068463 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0927 15:12:10.068620 (+ 157us) server_negotiation.cc:407] Connection header received
0927 15:12:10.068699 (+ 79us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:12:10.068702 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:12:10.068749 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:12:10.068803 (+ 54us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0927 15:12:10.069453 (+ 650us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:10.070178 (+ 725us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:10.071466 (+ 1288us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:10.072082 (+ 616us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:10.072191 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:10.072225 (+ 34us) server_negotiation.cc:1035] Waiting for connection context
0927 15:12:10.072491 (+ 266us) server_negotiation.cc:299] Negotiation successful
0927 15:12:10.072568 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260927 15:12:10.072896 19841 raft_consensus.cc:2454] T 9ede8c18278a44c08bfed45bd5fe1035 P 7e780b9761974a01892b38c81c7542f8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0a92c656775c4ef4995411712bf186cb in term 0.
I20260927 15:12:10.073302 20121 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9ede8c18278a44c08bfed45bd5fe1035" candidate_uuid: "0a92c656775c4ef4995411712bf186cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8395c661562d41e2af64d5a5fbd7b55e" is_pre_election: true
I20260927 15:12:10.073396 19913 leader_election.cc:302] T 9ede8c18278a44c08bfed45bd5fe1035 P 0a92c656775c4ef4995411712bf186cb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0a92c656775c4ef4995411712bf186cb, 7e780b9761974a01892b38c81c7542f8; no voters:
I20260927 15:12:10.073575 20121 raft_consensus.cc:2454] T 9ede8c18278a44c08bfed45bd5fe1035 P 8395c661562d41e2af64d5a5fbd7b55e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0a92c656775c4ef4995411712bf186cb in term 0.
I20260927 15:12:10.073673 20196 raft_consensus.cc:2781] T 9ede8c18278a44c08bfed45bd5fe1035 P 0a92c656775c4ef4995411712bf186cb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 15:12:10.073750 20196 raft_consensus.cc:482] T 9ede8c18278a44c08bfed45bd5fe1035 P 0a92c656775c4ef4995411712bf186cb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 15:12:10.073794 20196 raft_consensus.cc:3037] T 9ede8c18278a44c08bfed45bd5fe1035 P 0a92c656775c4ef4995411712bf186cb [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:12:10.074872 20196 raft_consensus.cc:504] T 9ede8c18278a44c08bfed45bd5fe1035 P 0a92c656775c4ef4995411712bf186cb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e780b9761974a01892b38c81c7542f8" member_type: VOTER last_known_addr { host: "127.17.136.1" port: 37191 } } peers { permanent_uuid: "8395c661562d41e2af64d5a5fbd7b55e" member_type: VOTER last_known_addr { host: "127.17.136.3" port: 39291 } } peers { permanent_uuid: "0a92c656775c4ef4995411712bf186cb" member_type: VOTER last_known_addr { host: "127.17.136.2" port: 40665 } }
I20260927 15:12:10.075173 20196 leader_election.cc:288] T 9ede8c18278a44c08bfed45bd5fe1035 P 0a92c656775c4ef4995411712bf186cb [CANDIDATE]: Term 1 election: Requested vote from peers 7e780b9761974a01892b38c81c7542f8 (127.17.136.1:37191), 8395c661562d41e2af64d5a5fbd7b55e (127.17.136.3:39291)
I20260927 15:12:10.075487 19841 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9ede8c18278a44c08bfed45bd5fe1035" candidate_uuid: "0a92c656775c4ef4995411712bf186cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e780b9761974a01892b38c81c7542f8"
I20260927 15:12:10.075568 20121 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9ede8c18278a44c08bfed45bd5fe1035" candidate_uuid: "0a92c656775c4ef4995411712bf186cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8395c661562d41e2af64d5a5fbd7b55e"
I20260927 15:12:10.075613 19841 raft_consensus.cc:3037] T 9ede8c18278a44c08bfed45bd5fe1035 P 7e780b9761974a01892b38c81c7542f8 [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:12:10.075688 20121 raft_consensus.cc:3037] T 9ede8c18278a44c08bfed45bd5fe1035 P 8395c661562d41e2af64d5a5fbd7b55e [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:12:10.076706 19841 raft_consensus.cc:2454] T 9ede8c18278a44c08bfed45bd5fe1035 P 7e780b9761974a01892b38c81c7542f8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0a92c656775c4ef4995411712bf186cb in term 1.
I20260927 15:12:10.076789 20121 raft_consensus.cc:2454] T 9ede8c18278a44c08bfed45bd5fe1035 P 8395c661562d41e2af64d5a5fbd7b55e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0a92c656775c4ef4995411712bf186cb in term 1.
I20260927 15:12:10.076961 19913 leader_election.cc:302] T 9ede8c18278a44c08bfed45bd5fe1035 P 0a92c656775c4ef4995411712bf186cb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0a92c656775c4ef4995411712bf186cb, 7e780b9761974a01892b38c81c7542f8; no voters:
I20260927 15:12:10.077122 20196 raft_consensus.cc:2781] T 9ede8c18278a44c08bfed45bd5fe1035 P 0a92c656775c4ef4995411712bf186cb [term 1 FOLLOWER]: Leader election won for term 1
I20260927 15:12:10.077327 20196 raft_consensus.cc:686] T 9ede8c18278a44c08bfed45bd5fe1035 P 0a92c656775c4ef4995411712bf186cb [term 1 LEADER]: Becoming Leader. State: Replica: 0a92c656775c4ef4995411712bf186cb, State: Running, Role: LEADER
I20260927 15:12:10.077675 20196 consensus_queue.cc:237] T 9ede8c18278a44c08bfed45bd5fe1035 P 0a92c656775c4ef4995411712bf186cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e780b9761974a01892b38c81c7542f8" member_type: VOTER last_known_addr { host: "127.17.136.1" port: 37191 } } peers { permanent_uuid: "8395c661562d41e2af64d5a5fbd7b55e" member_type: VOTER last_known_addr { host: "127.17.136.3" port: 39291 } } peers { permanent_uuid: "0a92c656775c4ef4995411712bf186cb" member_type: VOTER last_known_addr { host: "127.17.136.2" port: 40665 } }
I20260927 15:12:10.080567 19681 catalog_manager.cc:5495] T 9ede8c18278a44c08bfed45bd5fe1035 P 0a92c656775c4ef4995411712bf186cb reported cstate change: term changed from 0 to 1, leader changed from <none> to 0a92c656775c4ef4995411712bf186cb (127.17.136.2). New cstate: current_term: 1 leader_uuid: "0a92c656775c4ef4995411712bf186cb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e780b9761974a01892b38c81c7542f8" member_type: VOTER last_known_addr { host: "127.17.136.1" port: 37191 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8395c661562d41e2af64d5a5fbd7b55e" member_type: VOTER last_known_addr { host: "127.17.136.3" port: 39291 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0a92c656775c4ef4995411712bf186cb" member_type: VOTER last_known_addr { host: "127.17.136.2" port: 40665 } health_report { overall_health: HEALTHY } } }
Sep 27 15:12:10 dist-test-slave-5s2t krb5kdc[19639](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790521929, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.136.62@KRBTEST.COM for kudu/127.17.136.62@KRBTEST.COM
I20260927 15:12:10.132871 20207 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:10.124978 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.62:33149 (local address 127.0.0.1:49736)
0927 15:12:10.125243 (+ 265us) negotiation.cc:107] Waiting for socket to connect
0927 15:12:10.125260 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0927 15:12:10.125379 (+ 119us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0927 15:12:10.125597 (+ 218us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0927 15:12:10.125600 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0927 15:12:10.126012 (+ 412us) client_negotiation.cc:189] Negotiated authn=SASL
0927 15:12:10.126114 (+ 102us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:12:10.126120 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:12:10.126827 (+ 707us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:12:10.126830 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:12:10.127395 (+ 565us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:12:10.127403 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:12:10.127797 (+ 394us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:12:10.127800 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:12:10.127928 (+ 128us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:10.128424 (+ 496us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0927 15:12:10.128435 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0927 15:12:10.129813 (+ 1378us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0927 15:12:10.131434 (+ 1621us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0927 15:12:10.131443 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0927 15:12:10.131450 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0927 15:12:10.131681 (+ 231us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0927 15:12:10.131913 (+ 232us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0927 15:12:10.131916 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0927 15:12:10.131917 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0927 15:12:10.131990 (+ 73us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0927 15:12:10.132323 (+ 333us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0927 15:12:10.132330 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0927 15:12:10.132441 (+ 111us) client_negotiation.cc:769] Sending connection context
0927 15:12:10.132533 (+ 92us) client_negotiation.cc:240] Negotiation successful
0927 15:12:10.132683 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":197,"mutex_wait_us":32,"thread_start_us":86,"threads_started":1}
I20260927 15:12:10.132870 19733 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:10.125004 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49736 (local address 127.17.136.62:33149)
0927 15:12:10.125145 (+ 141us) server_negotiation.cc:206] Beginning negotiation
0927 15:12:10.125150 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0927 15:12:10.125338 (+ 188us) server_negotiation.cc:407] Connection header received
0927 15:12:10.125460 (+ 122us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:12:10.125463 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:12:10.125501 (+ 38us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:12:10.125564 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0927 15:12:10.126225 (+ 661us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:10.126731 (+ 506us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:10.127496 (+ 765us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:10.127705 (+ 209us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:10.127786 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:10.129948 (+ 2162us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0927 15:12:10.129952 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0927 15:12:10.129955 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0927 15:12:10.129980 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0927 15:12:10.131333 (+ 1353us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:12:10.131765 (+ 432us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:12:10.131768 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:12:10.131770 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:12:10.131839 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:12:10.132061 (+ 222us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:12:10.132064 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:12:10.132066 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:12:10.132239 (+ 173us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0927 15:12:10.132324 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0927 15:12:10.132599 (+ 275us) server_negotiation.cc:299] Negotiation successful
0927 15:12:10.132731 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":56,"server-negotiator.queue_time_us":58}
I20260927 15:12:10.136479 19681 catalog_manager.cc:1908] Servicing CreateTable request from {username='kudu', principal='kudu/127.17.136.62@KRBTEST.COM'} at 127.0.0.1:49736:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260927 15:12:10.137228 19681 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:12:10.141911 19961 tablet_service.cc:1467] Processing CreateTablet for tablet 83268b81a073441689353c0fea822f8e (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=8599cfd543d14b09b3b369e4a75585e6]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260927 15:12:10.141873 19821 tablet_service.cc:1467] Processing CreateTablet for tablet 83268b81a073441689353c0fea822f8e (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=8599cfd543d14b09b3b369e4a75585e6]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260927 15:12:10.142153 20101 tablet_service.cc:1467] Processing CreateTablet for tablet 83268b81a073441689353c0fea822f8e (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=8599cfd543d14b09b3b369e4a75585e6]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260927 15:12:10.142588 19961 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 83268b81a073441689353c0fea822f8e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:12:10.142598 19821 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 83268b81a073441689353c0fea822f8e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:12:10.142669 20101 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 83268b81a073441689353c0fea822f8e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:12:10.144940 20190 tablet_bootstrap.cc:492] T 83268b81a073441689353c0fea822f8e P 0a92c656775c4ef4995411712bf186cb: Bootstrap starting.
I20260927 15:12:10.145413 20192 tablet_bootstrap.cc:492] T 83268b81a073441689353c0fea822f8e P 7e780b9761974a01892b38c81c7542f8: Bootstrap starting.
I20260927 15:12:10.145630 20191 tablet_bootstrap.cc:492] T 83268b81a073441689353c0fea822f8e P 8395c661562d41e2af64d5a5fbd7b55e: Bootstrap starting.
I20260927 15:12:10.145872 20190 tablet_bootstrap.cc:654] T 83268b81a073441689353c0fea822f8e P 0a92c656775c4ef4995411712bf186cb: Neither blocks nor log segments found. Creating new log.
I20260927 15:12:10.146344 20192 tablet_bootstrap.cc:654] T 83268b81a073441689353c0fea822f8e P 7e780b9761974a01892b38c81c7542f8: Neither blocks nor log segments found. Creating new log.
I20260927 15:12:10.146507 20191 tablet_bootstrap.cc:654] T 83268b81a073441689353c0fea822f8e P 8395c661562d41e2af64d5a5fbd7b55e: Neither blocks nor log segments found. Creating new log.
I20260927 15:12:10.147641 20190 tablet_bootstrap.cc:492] T 83268b81a073441689353c0fea822f8e P 0a92c656775c4ef4995411712bf186cb: No bootstrap required, opened a new log
I20260927 15:12:10.147675 20191 tablet_bootstrap.cc:492] T 83268b81a073441689353c0fea822f8e P 8395c661562d41e2af64d5a5fbd7b55e: No bootstrap required, opened a new log
I20260927 15:12:10.147737 20191 ts_tablet_manager.cc:1397] T 83268b81a073441689353c0fea822f8e P 8395c661562d41e2af64d5a5fbd7b55e: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260927 15:12:10.147733 20190 ts_tablet_manager.cc:1397] T 83268b81a073441689353c0fea822f8e P 0a92c656775c4ef4995411712bf186cb: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.001s
I20260927 15:12:10.148149 20191 raft_consensus.cc:348] T 83268b81a073441689353c0fea822f8e P 8395c661562d41e2af64d5a5fbd7b55e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e780b9761974a01892b38c81c7542f8" member_type: VOTER last_known_addr { host: "127.17.136.1" port: 37191 } } peers { permanent_uuid: "0a92c656775c4ef4995411712bf186cb" member_type: VOTER last_known_addr { host: "127.17.136.2" port: 40665 } } peers { permanent_uuid: "8395c661562d41e2af64d5a5fbd7b55e" member_type: VOTER last_known_addr { host: "127.17.136.3" port: 39291 } }
I20260927 15:12:10.148149 20190 raft_consensus.cc:348] T 83268b81a073441689353c0fea822f8e P 0a92c656775c4ef4995411712bf186cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e780b9761974a01892b38c81c7542f8" member_type: VOTER last_known_addr { host: "127.17.136.1" port: 37191 } } peers { permanent_uuid: "0a92c656775c4ef4995411712bf186cb" member_type: VOTER last_known_addr { host: "127.17.136.2" port: 40665 } } peers { permanent_uuid: "8395c661562d41e2af64d5a5fbd7b55e" member_type: VOTER last_known_addr { host: "127.17.136.3" port: 39291 } }
I20260927 15:12:10.148262 20190 raft_consensus.cc:374] T 83268b81a073441689353c0fea822f8e P 0a92c656775c4ef4995411712bf186cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:12:10.148262 20191 raft_consensus.cc:374] T 83268b81a073441689353c0fea822f8e P 8395c661562d41e2af64d5a5fbd7b55e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:12:10.148301 20191 raft_consensus.cc:729] T 83268b81a073441689353c0fea822f8e P 8395c661562d41e2af64d5a5fbd7b55e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8395c661562d41e2af64d5a5fbd7b55e, State: Initialized, Role: FOLLOWER
I20260927 15:12:10.148301 20190 raft_consensus.cc:729] T 83268b81a073441689353c0fea822f8e P 0a92c656775c4ef4995411712bf186cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0a92c656775c4ef4995411712bf186cb, State: Initialized, Role: FOLLOWER
I20260927 15:12:10.148419 20191 consensus_queue.cc:260] T 83268b81a073441689353c0fea822f8e P 8395c661562d41e2af64d5a5fbd7b55e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e780b9761974a01892b38c81c7542f8" member_type: VOTER last_known_addr { host: "127.17.136.1" port: 37191 } } peers { permanent_uuid: "0a92c656775c4ef4995411712bf186cb" member_type: VOTER last_known_addr { host: "127.17.136.2" port: 40665 } } peers { permanent_uuid: "8395c661562d41e2af64d5a5fbd7b55e" member_type: VOTER last_known_addr { host: "127.17.136.3" port: 39291 } }
I20260927 15:12:10.148419 20190 consensus_queue.cc:260] T 83268b81a073441689353c0fea822f8e P 0a92c656775c4ef4995411712bf186cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e780b9761974a01892b38c81c7542f8" member_type: VOTER last_known_addr { host: "127.17.136.1" port: 37191 } } peers { permanent_uuid: "0a92c656775c4ef4995411712bf186cb" member_type: VOTER last_known_addr { host: "127.17.136.2" port: 40665 } } peers { permanent_uuid: "8395c661562d41e2af64d5a5fbd7b55e" member_type: VOTER last_known_addr { host: "127.17.136.3" port: 39291 } }
I20260927 15:12:10.148671 20190 ts_tablet_manager.cc:1428] T 83268b81a073441689353c0fea822f8e P 0a92c656775c4ef4995411712bf186cb: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20260927 15:12:10.148671 20191 ts_tablet_manager.cc:1428] T 83268b81a073441689353c0fea822f8e P 8395c661562d41e2af64d5a5fbd7b55e: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260927 15:12:10.148681 20198 tablet_replica.cc:439] T 83268b81a073441689353c0fea822f8e P 8395c661562d41e2af64d5a5fbd7b55e: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e780b9761974a01892b38c81c7542f8" member_type: VOTER last_known_addr { host: "127.17.136.1" port: 37191 } } peers { permanent_uuid: "0a92c656775c4ef4995411712bf186cb" member_type: VOTER last_known_addr { host: "127.17.136.2" port: 40665 } } peers { permanent_uuid: "8395c661562d41e2af64d5a5fbd7b55e" member_type: VOTER last_known_addr { host: "127.17.136.3" port: 39291 } } }
I20260927 15:12:10.148865 20198 tablet_replica.cc:442] T 83268b81a073441689353c0fea822f8e P 8395c661562d41e2af64d5a5fbd7b55e: This TxnStatusTablet replica's current role is: FOLLOWER
I20260927 15:12:10.148847 20196 tablet_replica.cc:439] T 83268b81a073441689353c0fea822f8e P 0a92c656775c4ef4995411712bf186cb: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e780b9761974a01892b38c81c7542f8" member_type: VOTER last_known_addr { host: "127.17.136.1" port: 37191 } } peers { permanent_uuid: "0a92c656775c4ef4995411712bf186cb" member_type: VOTER last_known_addr { host: "127.17.136.2" port: 40665 } } peers { permanent_uuid: "8395c661562d41e2af64d5a5fbd7b55e" member_type: VOTER last_known_addr { host: "127.17.136.3" port: 39291 } } }
I20260927 15:12:10.148957 20196 tablet_replica.cc:442] T 83268b81a073441689353c0fea822f8e P 0a92c656775c4ef4995411712bf186cb: This TxnStatusTablet replica's current role is: FOLLOWER
I20260927 15:12:10.149174 20192 tablet_bootstrap.cc:492] T 83268b81a073441689353c0fea822f8e P 7e780b9761974a01892b38c81c7542f8: No bootstrap required, opened a new log
I20260927 15:12:10.149256 20192 ts_tablet_manager.cc:1397] T 83268b81a073441689353c0fea822f8e P 7e780b9761974a01892b38c81c7542f8: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.000s
I20260927 15:12:10.149686 20192 raft_consensus.cc:348] T 83268b81a073441689353c0fea822f8e P 7e780b9761974a01892b38c81c7542f8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e780b9761974a01892b38c81c7542f8" member_type: VOTER last_known_addr { host: "127.17.136.1" port: 37191 } } peers { permanent_uuid: "0a92c656775c4ef4995411712bf186cb" member_type: VOTER last_known_addr { host: "127.17.136.2" port: 40665 } } peers { permanent_uuid: "8395c661562d41e2af64d5a5fbd7b55e" member_type: VOTER last_known_addr { host: "127.17.136.3" port: 39291 } }
I20260927 15:12:10.149792 20192 raft_consensus.cc:374] T 83268b81a073441689353c0fea822f8e P 7e780b9761974a01892b38c81c7542f8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:12:10.149823 20192 raft_consensus.cc:729] T 83268b81a073441689353c0fea822f8e P 7e780b9761974a01892b38c81c7542f8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e780b9761974a01892b38c81c7542f8, State: Initialized, Role: FOLLOWER
I20260927 15:12:10.149928 20192 consensus_queue.cc:260] T 83268b81a073441689353c0fea822f8e P 7e780b9761974a01892b38c81c7542f8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e780b9761974a01892b38c81c7542f8" member_type: VOTER last_known_addr { host: "127.17.136.1" port: 37191 } } peers { permanent_uuid: "0a92c656775c4ef4995411712bf186cb" member_type: VOTER last_known_addr { host: "127.17.136.2" port: 40665 } } peers { permanent_uuid: "8395c661562d41e2af64d5a5fbd7b55e" member_type: VOTER last_known_addr { host: "127.17.136.3" port: 39291 } }
I20260927 15:12:10.150192 20192 ts_tablet_manager.cc:1428] T 83268b81a073441689353c0fea822f8e P 7e780b9761974a01892b38c81c7542f8: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260927 15:12:10.150233 20197 tablet_replica.cc:439] T 83268b81a073441689353c0fea822f8e P 7e780b9761974a01892b38c81c7542f8: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e780b9761974a01892b38c81c7542f8" member_type: VOTER last_known_addr { host: "127.17.136.1" port: 37191 } } peers { permanent_uuid: "0a92c656775c4ef4995411712bf186cb" member_type: VOTER last_known_addr { host: "127.17.136.2" port: 40665 } } peers { permanent_uuid: "8395c661562d41e2af64d5a5fbd7b55e" member_type: VOTER last_known_addr { host: "127.17.136.3" port: 39291 } } }
I20260927 15:12:10.150377 20197 tablet_replica.cc:442] T 83268b81a073441689353c0fea822f8e P 7e780b9761974a01892b38c81c7542f8: This TxnStatusTablet replica's current role is: FOLLOWER
W20260927 15:12:10.192930 20168 tablet.cc:2369] T 83268b81a073441689353c0fea822f8e P 8395c661562d41e2af64d5a5fbd7b55e: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260927 15:12:10.223866 20196 raft_consensus.cc:482] T 83268b81a073441689353c0fea822f8e P 0a92c656775c4ef4995411712bf186cb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:12:10.224026 20196 raft_consensus.cc:504] T 83268b81a073441689353c0fea822f8e P 0a92c656775c4ef4995411712bf186cb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e780b9761974a01892b38c81c7542f8" member_type: VOTER last_known_addr { host: "127.17.136.1" port: 37191 } } peers { permanent_uuid: "0a92c656775c4ef4995411712bf186cb" member_type: VOTER last_known_addr { host: "127.17.136.2" port: 40665 } } peers { permanent_uuid: "8395c661562d41e2af64d5a5fbd7b55e" member_type: VOTER last_known_addr { host: "127.17.136.3" port: 39291 } }
I20260927 15:12:10.224365 20196 leader_election.cc:288] T 83268b81a073441689353c0fea822f8e P 0a92c656775c4ef4995411712bf186cb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7e780b9761974a01892b38c81c7542f8 (127.17.136.1:37191), 8395c661562d41e2af64d5a5fbd7b55e (127.17.136.3:39291)
I20260927 15:12:10.224761 19841 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "83268b81a073441689353c0fea822f8e" candidate_uuid: "0a92c656775c4ef4995411712bf186cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e780b9761974a01892b38c81c7542f8" is_pre_election: true
I20260927 15:12:10.224793 20121 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "83268b81a073441689353c0fea822f8e" candidate_uuid: "0a92c656775c4ef4995411712bf186cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8395c661562d41e2af64d5a5fbd7b55e" is_pre_election: true
I20260927 15:12:10.224902 19841 raft_consensus.cc:2454] T 83268b81a073441689353c0fea822f8e P 7e780b9761974a01892b38c81c7542f8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0a92c656775c4ef4995411712bf186cb in term 0.
I20260927 15:12:10.224913 20121 raft_consensus.cc:2454] T 83268b81a073441689353c0fea822f8e P 8395c661562d41e2af64d5a5fbd7b55e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0a92c656775c4ef4995411712bf186cb in term 0.
I20260927 15:12:10.225184 19913 leader_election.cc:302] T 83268b81a073441689353c0fea822f8e P 0a92c656775c4ef4995411712bf186cb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0a92c656775c4ef4995411712bf186cb, 7e780b9761974a01892b38c81c7542f8; no voters:
I20260927 15:12:10.225374 20196 raft_consensus.cc:2781] T 83268b81a073441689353c0fea822f8e P 0a92c656775c4ef4995411712bf186cb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 15:12:10.225451 20196 raft_consensus.cc:482] T 83268b81a073441689353c0fea822f8e P 0a92c656775c4ef4995411712bf186cb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 15:12:10.225481 20196 raft_consensus.cc:3037] T 83268b81a073441689353c0fea822f8e P 0a92c656775c4ef4995411712bf186cb [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:12:10.226425 20196 raft_consensus.cc:504] T 83268b81a073441689353c0fea822f8e P 0a92c656775c4ef4995411712bf186cb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e780b9761974a01892b38c81c7542f8" member_type: VOTER last_known_addr { host: "127.17.136.1" port: 37191 } } peers { permanent_uuid: "0a92c656775c4ef4995411712bf186cb" member_type: VOTER last_known_addr { host: "127.17.136.2" port: 40665 } } peers { permanent_uuid: "8395c661562d41e2af64d5a5fbd7b55e" member_type: VOTER last_known_addr { host: "127.17.136.3" port: 39291 } }
I20260927 15:12:10.226745 20196 leader_election.cc:288] T 83268b81a073441689353c0fea822f8e P 0a92c656775c4ef4995411712bf186cb [CANDIDATE]: Term 1 election: Requested vote from peers 7e780b9761974a01892b38c81c7542f8 (127.17.136.1:37191), 8395c661562d41e2af64d5a5fbd7b55e (127.17.136.3:39291)
W20260927 15:12:10.226866 20028 tablet.cc:2369] T 83268b81a073441689353c0fea822f8e P 0a92c656775c4ef4995411712bf186cb: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260927 15:12:10.227108 20121 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "83268b81a073441689353c0fea822f8e" candidate_uuid: "0a92c656775c4ef4995411712bf186cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8395c661562d41e2af64d5a5fbd7b55e"
I20260927 15:12:10.227129 19841 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "83268b81a073441689353c0fea822f8e" candidate_uuid: "0a92c656775c4ef4995411712bf186cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e780b9761974a01892b38c81c7542f8"
I20260927 15:12:10.227231 19841 raft_consensus.cc:3037] T 83268b81a073441689353c0fea822f8e P 7e780b9761974a01892b38c81c7542f8 [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:12:10.227219 20121 raft_consensus.cc:3037] T 83268b81a073441689353c0fea822f8e P 8395c661562d41e2af64d5a5fbd7b55e [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:12:10.228103 20121 raft_consensus.cc:2454] T 83268b81a073441689353c0fea822f8e P 8395c661562d41e2af64d5a5fbd7b55e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0a92c656775c4ef4995411712bf186cb in term 1.
I20260927 15:12:10.228166 19841 raft_consensus.cc:2454] T 83268b81a073441689353c0fea822f8e P 7e780b9761974a01892b38c81c7542f8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0a92c656775c4ef4995411712bf186cb in term 1.
I20260927 15:12:10.228371 19913 leader_election.cc:302] T 83268b81a073441689353c0fea822f8e P 0a92c656775c4ef4995411712bf186cb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0a92c656775c4ef4995411712bf186cb, 8395c661562d41e2af64d5a5fbd7b55e; no voters:
I20260927 15:12:10.228523 20196 raft_consensus.cc:2781] T 83268b81a073441689353c0fea822f8e P 0a92c656775c4ef4995411712bf186cb [term 1 FOLLOWER]: Leader election won for term 1
I20260927 15:12:10.228607 20196 raft_consensus.cc:686] T 83268b81a073441689353c0fea822f8e P 0a92c656775c4ef4995411712bf186cb [term 1 LEADER]: Becoming Leader. State: Replica: 0a92c656775c4ef4995411712bf186cb, State: Running, Role: LEADER
I20260927 15:12:10.228739 20196 consensus_queue.cc:237] T 83268b81a073441689353c0fea822f8e P 0a92c656775c4ef4995411712bf186cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e780b9761974a01892b38c81c7542f8" member_type: VOTER last_known_addr { host: "127.17.136.1" port: 37191 } } peers { permanent_uuid: "0a92c656775c4ef4995411712bf186cb" member_type: VOTER last_known_addr { host: "127.17.136.2" port: 40665 } } peers { permanent_uuid: "8395c661562d41e2af64d5a5fbd7b55e" member_type: VOTER last_known_addr { host: "127.17.136.3" port: 39291 } }
I20260927 15:12:10.229396 20200 tablet_replica.cc:439] T 83268b81a073441689353c0fea822f8e P 0a92c656775c4ef4995411712bf186cb: TxnStatusTablet state changed. Reason: New leader 0a92c656775c4ef4995411712bf186cb. Latest consensus state: current_term: 1 leader_uuid: "0a92c656775c4ef4995411712bf186cb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e780b9761974a01892b38c81c7542f8" member_type: VOTER last_known_addr { host: "127.17.136.1" port: 37191 } } peers { permanent_uuid: "0a92c656775c4ef4995411712bf186cb" member_type: VOTER last_known_addr { host: "127.17.136.2" port: 40665 } } peers { permanent_uuid: "8395c661562d41e2af64d5a5fbd7b55e" member_type: VOTER last_known_addr { host: "127.17.136.3" port: 39291 } } }
I20260927 15:12:10.229525 20200 tablet_replica.cc:442] T 83268b81a073441689353c0fea822f8e P 0a92c656775c4ef4995411712bf186cb: This TxnStatusTablet replica's current role is: LEADER
I20260927 15:12:10.229944 20212 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260927 15:12:10.230170 20212 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260927 15:12:10.230556 19684 catalog_manager.cc:5495] T 83268b81a073441689353c0fea822f8e P 0a92c656775c4ef4995411712bf186cb reported cstate change: term changed from 0 to 1, leader changed from <none> to 0a92c656775c4ef4995411712bf186cb (127.17.136.2). New cstate: current_term: 1 leader_uuid: "0a92c656775c4ef4995411712bf186cb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e780b9761974a01892b38c81c7542f8" member_type: VOTER last_known_addr { host: "127.17.136.1" port: 37191 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0a92c656775c4ef4995411712bf186cb" member_type: VOTER last_known_addr { host: "127.17.136.2" port: 40665 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8395c661562d41e2af64d5a5fbd7b55e" member_type: VOTER last_known_addr { host: "127.17.136.3" port: 39291 } health_report { overall_health: UNKNOWN } } }
I20260927 15:12:10.252586 20188 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:10.248563 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50526 (local address 127.17.136.2:40665)
0927 15:12:10.248686 (+ 123us) server_negotiation.cc:206] Beginning negotiation
0927 15:12:10.248690 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0927 15:12:10.248777 (+ 87us) server_negotiation.cc:407] Connection header received
0927 15:12:10.248949 (+ 172us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:12:10.248951 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:12:10.249001 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:12:10.249103 (+ 102us) server_negotiation.cc:226] Negotiated authn=TOKEN
0927 15:12:10.249297 (+ 194us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:10.249781 (+ 484us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:10.251036 (+ 1255us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:10.251299 (+ 263us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:10.251385 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:10.251758 (+ 373us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0927 15:12:10.252201 (+ 443us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0927 15:12:10.252284 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0927 15:12:10.252375 (+ 91us) server_negotiation.cc:299] Negotiation successful
0927 15:12:10.252442 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260927 15:12:10.252621 20207 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:10.248470 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.2:40665 (local address 127.0.0.1:50526)
0927 15:12:10.248708 (+ 238us) negotiation.cc:107] Waiting for socket to connect
0927 15:12:10.248723 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0927 15:12:10.248831 (+ 108us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0927 15:12:10.249102 (+ 271us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0927 15:12:10.249105 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0927 15:12:10.249113 (+ 8us) client_negotiation.cc:189] Negotiated authn=TOKEN
0927 15:12:10.249220 (+ 107us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:12:10.249226 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:12:10.249864 (+ 638us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:12:10.249867 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:12:10.250884 (+ 1017us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:12:10.250895 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:12:10.251433 (+ 538us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:12:10.251438 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:12:10.251559 (+ 121us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:10.251613 (+ 54us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0927 15:12:10.252282 (+ 669us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0927 15:12:10.252293 (+ 11us) client_negotiation.cc:769] Sending connection context
0927 15:12:10.252366 (+ 73us) client_negotiation.cc:240] Negotiation successful
0927 15:12:10.252453 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":136}
I20260927 15:12:10.258244 19841 raft_consensus.cc:1261] T 83268b81a073441689353c0fea822f8e P 7e780b9761974a01892b38c81c7542f8 [term 1 FOLLOWER]: Refusing update from remote peer 0a92c656775c4ef4995411712bf186cb: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260927 15:12:10.258955 20200 consensus_queue.cc:1035] T 83268b81a073441689353c0fea822f8e P 0a92c656775c4ef4995411712bf186cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e780b9761974a01892b38c81c7542f8" member_type: VOTER last_known_addr { host: "127.17.136.1" port: 37191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260927 15:12:10.259058 20121 raft_consensus.cc:1261] T 83268b81a073441689353c0fea822f8e P 8395c661562d41e2af64d5a5fbd7b55e [term 1 FOLLOWER]: Refusing update from remote peer 0a92c656775c4ef4995411712bf186cb: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260927 15:12:10.259708 20200 consensus_queue.cc:1035] T 83268b81a073441689353c0fea822f8e P 0a92c656775c4ef4995411712bf186cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "8395c661562d41e2af64d5a5fbd7b55e" member_type: VOTER last_known_addr { host: "127.17.136.3" port: 39291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260927 15:12:10.266333 20198 tablet_replica.cc:439] T 83268b81a073441689353c0fea822f8e P 8395c661562d41e2af64d5a5fbd7b55e: TxnStatusTablet state changed. Reason: New leader 0a92c656775c4ef4995411712bf186cb. Latest consensus state: current_term: 1 leader_uuid: "0a92c656775c4ef4995411712bf186cb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e780b9761974a01892b38c81c7542f8" member_type: VOTER last_known_addr { host: "127.17.136.1" port: 37191 } } peers { permanent_uuid: "0a92c656775c4ef4995411712bf186cb" member_type: VOTER last_known_addr { host: "127.17.136.2" port: 40665 } } peers { permanent_uuid: "8395c661562d41e2af64d5a5fbd7b55e" member_type: VOTER last_known_addr { host: "127.17.136.3" port: 39291 } } }
I20260927 15:12:10.266469 20198 tablet_replica.cc:442] T 83268b81a073441689353c0fea822f8e P 8395c661562d41e2af64d5a5fbd7b55e: This TxnStatusTablet replica's current role is: FOLLOWER
I20260927 15:12:10.267282 20197 tablet_replica.cc:439] T 83268b81a073441689353c0fea822f8e P 7e780b9761974a01892b38c81c7542f8: TxnStatusTablet state changed. Reason: New leader 0a92c656775c4ef4995411712bf186cb. Latest consensus state: current_term: 1 leader_uuid: "0a92c656775c4ef4995411712bf186cb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e780b9761974a01892b38c81c7542f8" member_type: VOTER last_known_addr { host: "127.17.136.1" port: 37191 } } peers { permanent_uuid: "0a92c656775c4ef4995411712bf186cb" member_type: VOTER last_known_addr { host: "127.17.136.2" port: 40665 } } peers { permanent_uuid: "8395c661562d41e2af64d5a5fbd7b55e" member_type: VOTER last_known_addr { host: "127.17.136.3" port: 39291 } } }
I20260927 15:12:10.267391 20197 tablet_replica.cc:442] T 83268b81a073441689353c0fea822f8e P 7e780b9761974a01892b38c81c7542f8: This TxnStatusTablet replica's current role is: FOLLOWER
I20260927 15:12:10.269232 20196 tablet_replica.cc:439] T 83268b81a073441689353c0fea822f8e P 0a92c656775c4ef4995411712bf186cb: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "0a92c656775c4ef4995411712bf186cb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e780b9761974a01892b38c81c7542f8" member_type: VOTER last_known_addr { host: "127.17.136.1" port: 37191 } } peers { permanent_uuid: "0a92c656775c4ef4995411712bf186cb" member_type: VOTER last_known_addr { host: "127.17.136.2" port: 40665 } } peers { permanent_uuid: "8395c661562d41e2af64d5a5fbd7b55e" member_type: VOTER last_known_addr { host: "127.17.136.3" port: 39291 } } }
I20260927 15:12:10.269332 20196 tablet_replica.cc:442] T 83268b81a073441689353c0fea822f8e P 0a92c656775c4ef4995411712bf186cb: This TxnStatusTablet replica's current role is: LEADER
I20260927 15:12:10.269428 20215 mvcc.cc:205] Tried to move back new op lower bound from 7333977826330427392 to 7333977826218344448. Current Snapshot: MvccSnapshot[applied={T|T < 7333977826330427392}]
I20260927 15:12:10.269713 20198 tablet_replica.cc:439] T 83268b81a073441689353c0fea822f8e P 8395c661562d41e2af64d5a5fbd7b55e: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "0a92c656775c4ef4995411712bf186cb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e780b9761974a01892b38c81c7542f8" member_type: VOTER last_known_addr { host: "127.17.136.1" port: 37191 } } peers { permanent_uuid: "0a92c656775c4ef4995411712bf186cb" member_type: VOTER last_known_addr { host: "127.17.136.2" port: 40665 } } peers { permanent_uuid: "8395c661562d41e2af64d5a5fbd7b55e" member_type: VOTER last_known_addr { host: "127.17.136.3" port: 39291 } } }
I20260927 15:12:10.269830 20198 tablet_replica.cc:442] T 83268b81a073441689353c0fea822f8e P 8395c661562d41e2af64d5a5fbd7b55e: This TxnStatusTablet replica's current role is: FOLLOWER
I20260927 15:12:10.269874 20217 mvcc.cc:205] Tried to move back new op lower bound from 7333977826330427392 to 7333977826218344448. Current Snapshot: MvccSnapshot[applied={T|T < 7333977826330427392}]
I20260927 15:12:10.270892 20196 tablet_replica.cc:439] T 83268b81a073441689353c0fea822f8e P 0a92c656775c4ef4995411712bf186cb: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "0a92c656775c4ef4995411712bf186cb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e780b9761974a01892b38c81c7542f8" member_type: VOTER last_known_addr { host: "127.17.136.1" port: 37191 } } peers { permanent_uuid: "0a92c656775c4ef4995411712bf186cb" member_type: VOTER last_known_addr { host: "127.17.136.2" port: 40665 } } peers { permanent_uuid: "8395c661562d41e2af64d5a5fbd7b55e" member_type: VOTER last_known_addr { host: "127.17.136.3" port: 39291 } } }
I20260927 15:12:10.270999 20196 tablet_replica.cc:442] T 83268b81a073441689353c0fea822f8e P 0a92c656775c4ef4995411712bf186cb: This TxnStatusTablet replica's current role is: LEADER
I20260927 15:12:10.272125 20197 tablet_replica.cc:439] T 83268b81a073441689353c0fea822f8e P 7e780b9761974a01892b38c81c7542f8: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "0a92c656775c4ef4995411712bf186cb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e780b9761974a01892b38c81c7542f8" member_type: VOTER last_known_addr { host: "127.17.136.1" port: 37191 } } peers { permanent_uuid: "0a92c656775c4ef4995411712bf186cb" member_type: VOTER last_known_addr { host: "127.17.136.2" port: 40665 } } peers { permanent_uuid: "8395c661562d41e2af64d5a5fbd7b55e" member_type: VOTER last_known_addr { host: "127.17.136.3" port: 39291 } } }
I20260927 15:12:10.272228 20197 tablet_replica.cc:442] T 83268b81a073441689353c0fea822f8e P 7e780b9761974a01892b38c81c7542f8: This TxnStatusTablet replica's current role is: FOLLOWER
I20260927 15:12:10.280620 20188 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:10.277357 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50542 (local address 127.17.136.2:40665)
0927 15:12:10.277471 (+ 114us) server_negotiation.cc:206] Beginning negotiation
0927 15:12:10.277476 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0927 15:12:10.277490 (+ 14us) server_negotiation.cc:407] Connection header received
0927 15:12:10.277574 (+ 84us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:12:10.277577 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:12:10.277622 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:12:10.277701 (+ 79us) server_negotiation.cc:226] Negotiated authn=TOKEN
0927 15:12:10.277864 (+ 163us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:10.278636 (+ 772us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:10.279532 (+ 896us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:10.279871 (+ 339us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:10.279962 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:10.280182 (+ 220us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0927 15:12:10.280258 (+ 76us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0927 15:12:10.280321 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0927 15:12:10.280418 (+ 97us) server_negotiation.cc:299] Negotiation successful
0927 15:12:10.280494 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260927 15:12:10.291383 20188 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:10.288362 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.136.2:36211 (local address 127.17.136.2:40665)
0927 15:12:10.288467 (+ 105us) server_negotiation.cc:206] Beginning negotiation
0927 15:12:10.288471 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0927 15:12:10.288699 (+ 228us) server_negotiation.cc:407] Connection header received
0927 15:12:10.288830 (+ 131us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:12:10.288832 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:12:10.288866 (+ 34us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:12:10.288919 (+ 53us) server_negotiation.cc:226] Negotiated authn=TOKEN
0927 15:12:10.289135 (+ 216us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:10.289620 (+ 485us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:10.290412 (+ 792us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:10.290603 (+ 191us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:10.290681 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:10.290947 (+ 266us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0927 15:12:10.291015 (+ 68us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0927 15:12:10.291069 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0927 15:12:10.291145 (+ 76us) server_negotiation.cc:299] Negotiation successful
0927 15:12:10.291190 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":22,"server-negotiator.queue_time_us":40}
I20260927 15:12:10.291397 20227 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:10.288297 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.2:40665 (local address 127.17.136.2:36211)
0927 15:12:10.288627 (+ 330us) negotiation.cc:107] Waiting for socket to connect
0927 15:12:10.288638 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0927 15:12:10.288737 (+ 99us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0927 15:12:10.288930 (+ 193us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0927 15:12:10.288933 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0927 15:12:10.288939 (+ 6us) client_negotiation.cc:189] Negotiated authn=TOKEN
0927 15:12:10.289048 (+ 109us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:12:10.289054 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:12:10.289703 (+ 649us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:12:10.289705 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:12:10.290316 (+ 611us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:12:10.290324 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:12:10.290686 (+ 362us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:12:10.290689 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:12:10.290787 (+ 98us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:10.290825 (+ 38us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0927 15:12:10.291078 (+ 253us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0927 15:12:10.291084 (+ 6us) client_negotiation.cc:769] Sending connection context
0927 15:12:10.291139 (+ 55us) client_negotiation.cc:240] Negotiation successful
0927 15:12:10.291214 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":263,"mutex_wait_us":3,"thread_start_us":84,"threads_started":1}
I20260927 15:12:10.298439 20121 raft_consensus.cc:1261] T 9ede8c18278a44c08bfed45bd5fe1035 P 8395c661562d41e2af64d5a5fbd7b55e [term 1 FOLLOWER]: Refusing update from remote peer 0a92c656775c4ef4995411712bf186cb: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260927 15:12:10.298497 19841 raft_consensus.cc:1261] T 9ede8c18278a44c08bfed45bd5fe1035 P 7e780b9761974a01892b38c81c7542f8 [term 1 FOLLOWER]: Refusing update from remote peer 0a92c656775c4ef4995411712bf186cb: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260927 15:12:10.298846 20200 consensus_queue.cc:1035] T 9ede8c18278a44c08bfed45bd5fe1035 P 0a92c656775c4ef4995411712bf186cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e780b9761974a01892b38c81c7542f8" member_type: VOTER last_known_addr { host: "127.17.136.1" port: 37191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260927 15:12:10.299131 20222 consensus_queue.cc:1035] T 9ede8c18278a44c08bfed45bd5fe1035 P 0a92c656775c4ef4995411712bf186cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "8395c661562d41e2af64d5a5fbd7b55e" member_type: VOTER last_known_addr { host: "127.17.136.3" port: 39291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260927 15:12:10.344738 19683 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:49728:
table { table_name: "test-table" } modify_external_catalogs: true
I20260927 15:12:10.344928 19683 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:49728:
table { table_name: "test-table" } modify_external_catalogs: true
I20260927 15:12:10.347350 19683 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 8cde25cd4d294afea7e09d68815618d0: Sending DeleteTablet for 3 replicas of tablet 9ede8c18278a44c08bfed45bd5fe1035
I20260927 15:12:10.348088 19960 tablet_service.cc:1514] Processing DeleteTablet for tablet 9ede8c18278a44c08bfed45bd5fe1035 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:12:10 UTC) from {username='kudu', principal='kudu/127.17.136.62@KRBTEST.COM'} at 127.0.0.1:50522
I20260927 15:12:10.348201 20101 tablet_service.cc:1514] Processing DeleteTablet for tablet 9ede8c18278a44c08bfed45bd5fe1035 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:12:10 UTC) from {username='kudu', principal='kudu/127.17.136.62@KRBTEST.COM'} at 127.0.0.1:34946
I20260927 15:12:10.348675 20232 tablet_replica.cc:330] T 9ede8c18278a44c08bfed45bd5fe1035 P 8395c661562d41e2af64d5a5fbd7b55e: stopping tablet replica
I20260927 15:12:10.348629 19683 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:49728:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260927 15:12:10.348789 19821 tablet_service.cc:1514] Processing DeleteTablet for tablet 9ede8c18278a44c08bfed45bd5fe1035 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:12:10 UTC) from {username='kudu', principal='kudu/127.17.136.62@KRBTEST.COM'} at 127.0.0.1:41686
I20260927 15:12:10.349007 20231 tablet_replica.cc:330] T 9ede8c18278a44c08bfed45bd5fe1035 P 0a92c656775c4ef4995411712bf186cb: stopping tablet replica
W20260927 15:12:10.349011 19683 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:12:10.349334 20231 raft_consensus.cc:2229] T 9ede8c18278a44c08bfed45bd5fe1035 P 0a92c656775c4ef4995411712bf186cb [term 1 LEADER]: Raft consensus shutting down.
I20260927 15:12:10.349466 20233 tablet_replica.cc:330] T 9ede8c18278a44c08bfed45bd5fe1035 P 7e780b9761974a01892b38c81c7542f8: stopping tablet replica
I20260927 15:12:10.349746 20232 raft_consensus.cc:2229] T 9ede8c18278a44c08bfed45bd5fe1035 P 8395c661562d41e2af64d5a5fbd7b55e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260927 15:12:10.349745 20233 raft_consensus.cc:2229] T 9ede8c18278a44c08bfed45bd5fe1035 P 7e780b9761974a01892b38c81c7542f8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260927 15:12:10.349960 20233 raft_consensus.cc:2258] T 9ede8c18278a44c08bfed45bd5fe1035 P 7e780b9761974a01892b38c81c7542f8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 15:12:10.350346 20231 raft_consensus.cc:2258] T 9ede8c18278a44c08bfed45bd5fe1035 P 0a92c656775c4ef4995411712bf186cb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 15:12:10.349980 20232 raft_consensus.cc:2258] T 9ede8c18278a44c08bfed45bd5fe1035 P 8395c661562d41e2af64d5a5fbd7b55e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 15:12:10.351372 20233 ts_tablet_manager.cc:1905] T 9ede8c18278a44c08bfed45bd5fe1035 P 7e780b9761974a01892b38c81c7542f8: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:12:10.352069 20231 ts_tablet_manager.cc:1905] T 9ede8c18278a44c08bfed45bd5fe1035 P 0a92c656775c4ef4995411712bf186cb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:12:10.353946 19821 tablet_service.cc:1467] Processing CreateTablet for tablet 0b660e0edaa74afb9d15bd80588e22e6 (DEFAULT_TABLE table=test-table [id=96647656d64c44bba208219014ef1a68]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:12:10.354203 19821 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0b660e0edaa74afb9d15bd80588e22e6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:12:10.354154 19960 tablet_service.cc:1467] Processing CreateTablet for tablet 0b660e0edaa74afb9d15bd80588e22e6 (DEFAULT_TABLE table=test-table [id=96647656d64c44bba208219014ef1a68]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:12:10.354399 19960 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0b660e0edaa74afb9d15bd80588e22e6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:12:10.354425 20233 ts_tablet_manager.cc:1918] T 9ede8c18278a44c08bfed45bd5fe1035 P 7e780b9761974a01892b38c81c7542f8: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260927 15:12:10.354508 20233 log.cc:1196] T 9ede8c18278a44c08bfed45bd5fe1035 P 7e780b9761974a01892b38c81c7542f8: Deleting WAL directory at /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790521920546562-17952-0/minicluster-data/ts-0/wal/wals/9ede8c18278a44c08bfed45bd5fe1035
I20260927 15:12:10.354846 20233 ts_tablet_manager.cc:1939] T 9ede8c18278a44c08bfed45bd5fe1035 P 7e780b9761974a01892b38c81c7542f8: Deleting consensus metadata
I20260927 15:12:10.356277 19669 catalog_manager.cc:4841] TS 7e780b9761974a01892b38c81c7542f8 (127.17.136.1:37191): tablet 9ede8c18278a44c08bfed45bd5fe1035 (table test-table [id=825334beffa446aab65965eb8b374aee]) successfully deleted
I20260927 15:12:10.356695 20192 tablet_bootstrap.cc:492] T 0b660e0edaa74afb9d15bd80588e22e6 P 7e780b9761974a01892b38c81c7542f8: Bootstrap starting.
I20260927 15:12:10.356863 20190 tablet_bootstrap.cc:492] T 0b660e0edaa74afb9d15bd80588e22e6 P 0a92c656775c4ef4995411712bf186cb: Bootstrap starting.
I20260927 15:12:10.357694 20192 tablet_bootstrap.cc:654] T 0b660e0edaa74afb9d15bd80588e22e6 P 7e780b9761974a01892b38c81c7542f8: Neither blocks nor log segments found. Creating new log.
I20260927 15:12:10.357707 20190 tablet_bootstrap.cc:654] T 0b660e0edaa74afb9d15bd80588e22e6 P 0a92c656775c4ef4995411712bf186cb: Neither blocks nor log segments found. Creating new log.
I20260927 15:12:10.358543 20101 tablet_service.cc:1467] Processing CreateTablet for tablet 0b660e0edaa74afb9d15bd80588e22e6 (DEFAULT_TABLE table=test-table [id=96647656d64c44bba208219014ef1a68]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:12:10.358784 20101 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0b660e0edaa74afb9d15bd80588e22e6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:12:10.358904 20190 tablet_bootstrap.cc:492] T 0b660e0edaa74afb9d15bd80588e22e6 P 0a92c656775c4ef4995411712bf186cb: No bootstrap required, opened a new log
I20260927 15:12:10.358979 20190 ts_tablet_manager.cc:1397] T 0b660e0edaa74afb9d15bd80588e22e6 P 0a92c656775c4ef4995411712bf186cb: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.002s
I20260927 15:12:10.359436 20190 raft_consensus.cc:348] T 0b660e0edaa74afb9d15bd80588e22e6 P 0a92c656775c4ef4995411712bf186cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e780b9761974a01892b38c81c7542f8" member_type: VOTER last_known_addr { host: "127.17.136.1" port: 37191 } } peers { permanent_uuid: "0a92c656775c4ef4995411712bf186cb" member_type: VOTER last_known_addr { host: "127.17.136.2" port: 40665 } } peers { permanent_uuid: "8395c661562d41e2af64d5a5fbd7b55e" member_type: VOTER last_known_addr { host: "127.17.136.3" port: 39291 } }
I20260927 15:12:10.359571 20190 raft_consensus.cc:374] T 0b660e0edaa74afb9d15bd80588e22e6 P 0a92c656775c4ef4995411712bf186cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:12:10.359616 20190 raft_consensus.cc:729] T 0b660e0edaa74afb9d15bd80588e22e6 P 0a92c656775c4ef4995411712bf186cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0a92c656775c4ef4995411712bf186cb, State: Initialized, Role: FOLLOWER
I20260927 15:12:10.359743 20190 consensus_queue.cc:260] T 0b660e0edaa74afb9d15bd80588e22e6 P 0a92c656775c4ef4995411712bf186cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e780b9761974a01892b38c81c7542f8" member_type: VOTER last_known_addr { host: "127.17.136.1" port: 37191 } } peers { permanent_uuid: "0a92c656775c4ef4995411712bf186cb" member_type: VOTER last_known_addr { host: "127.17.136.2" port: 40665 } } peers { permanent_uuid: "8395c661562d41e2af64d5a5fbd7b55e" member_type: VOTER last_known_addr { host: "127.17.136.3" port: 39291 } }
I20260927 15:12:10.360019 20190 ts_tablet_manager.cc:1428] T 0b660e0edaa74afb9d15bd80588e22e6 P 0a92c656775c4ef4995411712bf186cb: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260927 15:12:10.361258 20191 tablet_bootstrap.cc:492] T 0b660e0edaa74afb9d15bd80588e22e6 P 8395c661562d41e2af64d5a5fbd7b55e: Bootstrap starting.
I20260927 15:12:10.361272 20231 ts_tablet_manager.cc:1918] T 9ede8c18278a44c08bfed45bd5fe1035 P 0a92c656775c4ef4995411712bf186cb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260927 15:12:10.361388 20231 log.cc:1196] T 9ede8c18278a44c08bfed45bd5fe1035 P 0a92c656775c4ef4995411712bf186cb: Deleting WAL directory at /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790521920546562-17952-0/minicluster-data/ts-1/wal/wals/9ede8c18278a44c08bfed45bd5fe1035
I20260927 15:12:10.361542 20232 ts_tablet_manager.cc:1905] T 9ede8c18278a44c08bfed45bd5fe1035 P 8395c661562d41e2af64d5a5fbd7b55e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:12:10.361739 20231 ts_tablet_manager.cc:1939] T 9ede8c18278a44c08bfed45bd5fe1035 P 0a92c656775c4ef4995411712bf186cb: Deleting consensus metadata
I20260927 15:12:10.362155 20191 tablet_bootstrap.cc:654] T 0b660e0edaa74afb9d15bd80588e22e6 P 8395c661562d41e2af64d5a5fbd7b55e: Neither blocks nor log segments found. Creating new log.
I20260927 15:12:10.362799 19671 catalog_manager.cc:4841] TS 0a92c656775c4ef4995411712bf186cb (127.17.136.2:40665): tablet 9ede8c18278a44c08bfed45bd5fe1035 (table test-table [id=825334beffa446aab65965eb8b374aee]) successfully deleted
I20260927 15:12:10.364248 20232 ts_tablet_manager.cc:1918] T 9ede8c18278a44c08bfed45bd5fe1035 P 8395c661562d41e2af64d5a5fbd7b55e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260927 15:12:10.364351 20232 log.cc:1196] T 9ede8c18278a44c08bfed45bd5fe1035 P 8395c661562d41e2af64d5a5fbd7b55e: Deleting WAL directory at /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790521920546562-17952-0/minicluster-data/ts-2/wal/wals/9ede8c18278a44c08bfed45bd5fe1035
I20260927 15:12:10.364681 20191 tablet_bootstrap.cc:492] T 0b660e0edaa74afb9d15bd80588e22e6 P 8395c661562d41e2af64d5a5fbd7b55e: No bootstrap required, opened a new log
I20260927 15:12:10.364751 20191 ts_tablet_manager.cc:1397] T 0b660e0edaa74afb9d15bd80588e22e6 P 8395c661562d41e2af64d5a5fbd7b55e: Time spent bootstrapping tablet: real 0.004s user 0.001s sys 0.000s
I20260927 15:12:10.365046 20232 ts_tablet_manager.cc:1939] T 9ede8c18278a44c08bfed45bd5fe1035 P 8395c661562d41e2af64d5a5fbd7b55e: Deleting consensus metadata
I20260927 15:12:10.365152 20191 raft_consensus.cc:348] T 0b660e0edaa74afb9d15bd80588e22e6 P 8395c661562d41e2af64d5a5fbd7b55e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e780b9761974a01892b38c81c7542f8" member_type: VOTER last_known_addr { host: "127.17.136.1" port: 37191 } } peers { permanent_uuid: "0a92c656775c4ef4995411712bf186cb" member_type: VOTER last_known_addr { host: "127.17.136.2" port: 40665 } } peers { permanent_uuid: "8395c661562d41e2af64d5a5fbd7b55e" member_type: VOTER last_known_addr { host: "127.17.136.3" port: 39291 } }
I20260927 15:12:10.365239 20191 raft_consensus.cc:374] T 0b660e0edaa74afb9d15bd80588e22e6 P 8395c661562d41e2af64d5a5fbd7b55e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:12:10.365258 20191 raft_consensus.cc:729] T 0b660e0edaa74afb9d15bd80588e22e6 P 8395c661562d41e2af64d5a5fbd7b55e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8395c661562d41e2af64d5a5fbd7b55e, State: Initialized, Role: FOLLOWER
I20260927 15:12:10.365352 20191 consensus_queue.cc:260] T 0b660e0edaa74afb9d15bd80588e22e6 P 8395c661562d41e2af64d5a5fbd7b55e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e780b9761974a01892b38c81c7542f8" member_type: VOTER last_known_addr { host: "127.17.136.1" port: 37191 } } peers { permanent_uuid: "0a92c656775c4ef4995411712bf186cb" member_type: VOTER last_known_addr { host: "127.17.136.2" port: 40665 } } peers { permanent_uuid: "8395c661562d41e2af64d5a5fbd7b55e" member_type: VOTER last_known_addr { host: "127.17.136.3" port: 39291 } }
I20260927 15:12:10.365751 20191 ts_tablet_manager.cc:1428] T 0b660e0edaa74afb9d15bd80588e22e6 P 8395c661562d41e2af64d5a5fbd7b55e: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260927 15:12:10.366638 20192 tablet_bootstrap.cc:492] T 0b660e0edaa74afb9d15bd80588e22e6 P 7e780b9761974a01892b38c81c7542f8: No bootstrap required, opened a new log
I20260927 15:12:10.366719 20192 ts_tablet_manager.cc:1397] T 0b660e0edaa74afb9d15bd80588e22e6 P 7e780b9761974a01892b38c81c7542f8: Time spent bootstrapping tablet: real 0.010s user 0.002s sys 0.000s
I20260927 15:12:10.367130 20192 raft_consensus.cc:348] T 0b660e0edaa74afb9d15bd80588e22e6 P 7e780b9761974a01892b38c81c7542f8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e780b9761974a01892b38c81c7542f8" member_type: VOTER last_known_addr { host: "127.17.136.1" port: 37191 } } peers { permanent_uuid: "0a92c656775c4ef4995411712bf186cb" member_type: VOTER last_known_addr { host: "127.17.136.2" port: 40665 } } peers { permanent_uuid: "8395c661562d41e2af64d5a5fbd7b55e" member_type: VOTER last_known_addr { host: "127.17.136.3" port: 39291 } }
I20260927 15:12:10.367237 20192 raft_consensus.cc:374] T 0b660e0edaa74afb9d15bd80588e22e6 P 7e780b9761974a01892b38c81c7542f8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:12:10.367304 20192 raft_consensus.cc:729] T 0b660e0edaa74afb9d15bd80588e22e6 P 7e780b9761974a01892b38c81c7542f8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e780b9761974a01892b38c81c7542f8, State: Initialized, Role: FOLLOWER
I20260927 15:12:10.367414 20192 consensus_queue.cc:260] T 0b660e0edaa74afb9d15bd80588e22e6 P 7e780b9761974a01892b38c81c7542f8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e780b9761974a01892b38c81c7542f8" member_type: VOTER last_known_addr { host: "127.17.136.1" port: 37191 } } peers { permanent_uuid: "0a92c656775c4ef4995411712bf186cb" member_type: VOTER last_known_addr { host: "127.17.136.2" port: 40665 } } peers { permanent_uuid: "8395c661562d41e2af64d5a5fbd7b55e" member_type: VOTER last_known_addr { host: "127.17.136.3" port: 39291 } }
I20260927 15:12:10.367580 19669 catalog_manager.cc:4841] TS 8395c661562d41e2af64d5a5fbd7b55e (127.17.136.3:39291): tablet 9ede8c18278a44c08bfed45bd5fe1035 (table test-table [id=825334beffa446aab65965eb8b374aee]) successfully deleted
I20260927 15:12:10.367677 20192 ts_tablet_manager.cc:1428] T 0b660e0edaa74afb9d15bd80588e22e6 P 7e780b9761974a01892b38c81c7542f8: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20260927 15:12:10.499862 20197 raft_consensus.cc:482] T 0b660e0edaa74afb9d15bd80588e22e6 P 7e780b9761974a01892b38c81c7542f8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:12:10.500003 20197 raft_consensus.cc:504] T 0b660e0edaa74afb9d15bd80588e22e6 P 7e780b9761974a01892b38c81c7542f8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e780b9761974a01892b38c81c7542f8" member_type: VOTER last_known_addr { host: "127.17.136.1" port: 37191 } } peers { permanent_uuid: "0a92c656775c4ef4995411712bf186cb" member_type: VOTER last_known_addr { host: "127.17.136.2" port: 40665 } } peers { permanent_uuid: "8395c661562d41e2af64d5a5fbd7b55e" member_type: VOTER last_known_addr { host: "127.17.136.3" port: 39291 } }
I20260927 15:12:10.501323 20197 leader_election.cc:288] T 0b660e0edaa74afb9d15bd80588e22e6 P 7e780b9761974a01892b38c81c7542f8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0a92c656775c4ef4995411712bf186cb (127.17.136.2:40665), 8395c661562d41e2af64d5a5fbd7b55e (127.17.136.3:39291)
I20260927 15:12:10.505555 20189 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:10.501767 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.136.1:39431 (local address 127.17.136.3:39291)
0927 15:12:10.501890 (+ 123us) server_negotiation.cc:206] Beginning negotiation
0927 15:12:10.501895 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0927 15:12:10.501987 (+ 92us) server_negotiation.cc:407] Connection header received
0927 15:12:10.502173 (+ 186us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:12:10.502177 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:12:10.502222 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:12:10.502265 (+ 43us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0927 15:12:10.502683 (+ 418us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:10.503571 (+ 888us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:10.504676 (+ 1105us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:10.505065 (+ 389us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:10.505170 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:10.505221 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0927 15:12:10.505370 (+ 149us) server_negotiation.cc:299] Negotiation successful
0927 15:12:10.505448 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260927 15:12:10.505578 20237 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:10.501619 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.3:39291 (local address 127.17.136.1:39431)
0927 15:12:10.501902 (+ 283us) negotiation.cc:107] Waiting for socket to connect
0927 15:12:10.501913 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0927 15:12:10.502038 (+ 125us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0927 15:12:10.502385 (+ 347us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0927 15:12:10.502387 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0927 15:12:10.502400 (+ 13us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0927 15:12:10.502564 (+ 164us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:12:10.502571 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:12:10.503683 (+ 1112us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:12:10.503686 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:12:10.504560 (+ 874us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:12:10.504569 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:12:10.505179 (+ 610us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:12:10.505183 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:12:10.505269 (+ 86us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:10.505287 (+ 18us) client_negotiation.cc:769] Sending connection context
0927 15:12:10.505349 (+ 62us) client_negotiation.cc:240] Negotiation successful
0927 15:12:10.505416 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":240,"mutex_wait_us":27,"thread_start_us":82,"threads_started":1}
I20260927 15:12:10.506039 20121 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0b660e0edaa74afb9d15bd80588e22e6" candidate_uuid: "7e780b9761974a01892b38c81c7542f8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8395c661562d41e2af64d5a5fbd7b55e" is_pre_election: true
I20260927 15:12:10.506217 20121 raft_consensus.cc:2454] T 0b660e0edaa74afb9d15bd80588e22e6 P 8395c661562d41e2af64d5a5fbd7b55e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e780b9761974a01892b38c81c7542f8 in term 0.
I20260927 15:12:10.506577 20188 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:10.501997 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.136.1:49295 (local address 127.17.136.2:40665)
0927 15:12:10.502111 (+ 114us) server_negotiation.cc:206] Beginning negotiation
0927 15:12:10.502115 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0927 15:12:10.502129 (+ 14us) server_negotiation.cc:407] Connection header received
0927 15:12:10.502186 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:12:10.502189 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:12:10.502238 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:12:10.502361 (+ 123us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0927 15:12:10.503224 (+ 863us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:10.503809 (+ 585us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:10.505229 (+ 1420us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:10.505812 (+ 583us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:10.505896 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:10.505938 (+ 42us) server_negotiation.cc:1035] Waiting for connection context
0927 15:12:10.506378 (+ 440us) server_negotiation.cc:299] Negotiation successful
0927 15:12:10.506469 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260927 15:12:10.506604 19773 leader_election.cc:302] T 0b660e0edaa74afb9d15bd80588e22e6 P 7e780b9761974a01892b38c81c7542f8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e780b9761974a01892b38c81c7542f8, 8395c661562d41e2af64d5a5fbd7b55e; no voters:
I20260927 15:12:10.506876 20197 raft_consensus.cc:2781] T 0b660e0edaa74afb9d15bd80588e22e6 P 7e780b9761974a01892b38c81c7542f8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 15:12:10.506901 20238 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:10.501511 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.2:40665 (local address 127.17.136.1:49295)
0927 15:12:10.501886 (+ 375us) negotiation.cc:107] Waiting for socket to connect
0927 15:12:10.501900 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0927 15:12:10.502075 (+ 175us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0927 15:12:10.502362 (+ 287us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0927 15:12:10.502365 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0927 15:12:10.502383 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0927 15:12:10.502566 (+ 183us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:12:10.502571 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:12:10.503929 (+ 1358us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:12:10.503933 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:12:10.505092 (+ 1159us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:12:10.505103 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:12:10.506128 (+ 1025us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:12:10.506131 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:12:10.506238 (+ 107us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:10.506260 (+ 22us) client_negotiation.cc:769] Sending connection context
0927 15:12:10.506703 (+ 443us) client_negotiation.cc:240] Negotiation successful
0927 15:12:10.506769 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":301,"mutex_wait_us":6,"spinlock_wait_cycles":22912,"thread_start_us":65,"threads_started":1}
I20260927 15:12:10.506969 20197 raft_consensus.cc:482] T 0b660e0edaa74afb9d15bd80588e22e6 P 7e780b9761974a01892b38c81c7542f8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 15:12:10.507009 20197 raft_consensus.cc:3037] T 0b660e0edaa74afb9d15bd80588e22e6 P 7e780b9761974a01892b38c81c7542f8 [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:12:10.508224 20197 raft_consensus.cc:504] T 0b660e0edaa74afb9d15bd80588e22e6 P 7e780b9761974a01892b38c81c7542f8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e780b9761974a01892b38c81c7542f8" member_type: VOTER last_known_addr { host: "127.17.136.1" port: 37191 } } peers { permanent_uuid: "0a92c656775c4ef4995411712bf186cb" member_type: VOTER last_known_addr { host: "127.17.136.2" port: 40665 } } peers { permanent_uuid: "8395c661562d41e2af64d5a5fbd7b55e" member_type: VOTER last_known_addr { host: "127.17.136.3" port: 39291 } }
I20260927 15:12:10.508563 20197 leader_election.cc:288] T 0b660e0edaa74afb9d15bd80588e22e6 P 7e780b9761974a01892b38c81c7542f8 [CANDIDATE]: Term 1 election: Requested vote from peers 0a92c656775c4ef4995411712bf186cb (127.17.136.2:40665), 8395c661562d41e2af64d5a5fbd7b55e (127.17.136.3:39291)
I20260927 15:12:10.508812 19981 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0b660e0edaa74afb9d15bd80588e22e6" candidate_uuid: "7e780b9761974a01892b38c81c7542f8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0a92c656775c4ef4995411712bf186cb" is_pre_election: true
I20260927 15:12:10.509059 19981 raft_consensus.cc:2454] T 0b660e0edaa74afb9d15bd80588e22e6 P 0a92c656775c4ef4995411712bf186cb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e780b9761974a01892b38c81c7542f8 in term 0.
I20260927 15:12:10.509301 19980 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0b660e0edaa74afb9d15bd80588e22e6" candidate_uuid: "7e780b9761974a01892b38c81c7542f8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0a92c656775c4ef4995411712bf186cb"
I20260927 15:12:10.509392 19980 raft_consensus.cc:3037] T 0b660e0edaa74afb9d15bd80588e22e6 P 0a92c656775c4ef4995411712bf186cb [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:12:10.510409 19980 raft_consensus.cc:2454] T 0b660e0edaa74afb9d15bd80588e22e6 P 0a92c656775c4ef4995411712bf186cb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e780b9761974a01892b38c81c7542f8 in term 1.
I20260927 15:12:10.510670 19775 leader_election.cc:302] T 0b660e0edaa74afb9d15bd80588e22e6 P 7e780b9761974a01892b38c81c7542f8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0a92c656775c4ef4995411712bf186cb, 7e780b9761974a01892b38c81c7542f8; no voters:
I20260927 15:12:10.510852 20121 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0b660e0edaa74afb9d15bd80588e22e6" candidate_uuid: "7e780b9761974a01892b38c81c7542f8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8395c661562d41e2af64d5a5fbd7b55e"
I20260927 15:12:10.510998 20121 raft_consensus.cc:3037] T 0b660e0edaa74afb9d15bd80588e22e6 P 8395c661562d41e2af64d5a5fbd7b55e [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:12:10.511358 20197 raft_consensus.cc:2781] T 0b660e0edaa74afb9d15bd80588e22e6 P 7e780b9761974a01892b38c81c7542f8 [term 1 FOLLOWER]: Leader election won for term 1
I20260927 15:12:10.511567 20197 raft_consensus.cc:686] T 0b660e0edaa74afb9d15bd80588e22e6 P 7e780b9761974a01892b38c81c7542f8 [term 1 LEADER]: Becoming Leader. State: Replica: 7e780b9761974a01892b38c81c7542f8, State: Running, Role: LEADER
I20260927 15:12:10.511822 20197 consensus_queue.cc:237] T 0b660e0edaa74afb9d15bd80588e22e6 P 7e780b9761974a01892b38c81c7542f8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e780b9761974a01892b38c81c7542f8" member_type: VOTER last_known_addr { host: "127.17.136.1" port: 37191 } } peers { permanent_uuid: "0a92c656775c4ef4995411712bf186cb" member_type: VOTER last_known_addr { host: "127.17.136.2" port: 40665 } } peers { permanent_uuid: "8395c661562d41e2af64d5a5fbd7b55e" member_type: VOTER last_known_addr { host: "127.17.136.3" port: 39291 } }
I20260927 15:12:10.512022 20121 raft_consensus.cc:2454] T 0b660e0edaa74afb9d15bd80588e22e6 P 8395c661562d41e2af64d5a5fbd7b55e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e780b9761974a01892b38c81c7542f8 in term 1.
I20260927 15:12:10.514063 19683 catalog_manager.cc:5495] T 0b660e0edaa74afb9d15bd80588e22e6 P 7e780b9761974a01892b38c81c7542f8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7e780b9761974a01892b38c81c7542f8 (127.17.136.1). New cstate: current_term: 1 leader_uuid: "7e780b9761974a01892b38c81c7542f8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e780b9761974a01892b38c81c7542f8" member_type: VOTER last_known_addr { host: "127.17.136.1" port: 37191 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0a92c656775c4ef4995411712bf186cb" member_type: VOTER last_known_addr { host: "127.17.136.2" port: 40665 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8395c661562d41e2af64d5a5fbd7b55e" member_type: VOTER last_known_addr { host: "127.17.136.3" port: 39291 } health_report { overall_health: UNKNOWN } } }
I20260927 15:12:10.562305 20185 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:10.559051 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41700 (local address 127.17.136.1:37191)
0927 15:12:10.559165 (+ 114us) server_negotiation.cc:206] Beginning negotiation
0927 15:12:10.559169 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0927 15:12:10.559184 (+ 15us) server_negotiation.cc:407] Connection header received
0927 15:12:10.559288 (+ 104us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:12:10.559291 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:12:10.559351 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:12:10.559440 (+ 89us) server_negotiation.cc:226] Negotiated authn=TOKEN
0927 15:12:10.559673 (+ 233us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:10.560177 (+ 504us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:10.560958 (+ 781us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:10.561186 (+ 228us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:10.561267 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:10.561509 (+ 242us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0927 15:12:10.561953 (+ 444us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0927 15:12:10.562059 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0927 15:12:10.562130 (+ 71us) server_negotiation.cc:299] Negotiation successful
0927 15:12:10.562179 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260927 15:12:10.570966 20243 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:10.568162 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.2:40665 (local address 127.17.136.1:45937)
0927 15:12:10.568413 (+ 251us) negotiation.cc:107] Waiting for socket to connect
0927 15:12:10.568425 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0927 15:12:10.568501 (+ 76us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0927 15:12:10.568682 (+ 181us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0927 15:12:10.568684 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0927 15:12:10.568689 (+ 5us) client_negotiation.cc:189] Negotiated authn=TOKEN
0927 15:12:10.568768 (+ 79us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:12:10.568771 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:12:10.569385 (+ 614us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:12:10.569387 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:12:10.569957 (+ 570us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:12:10.569963 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:12:10.570395 (+ 432us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:12:10.570398 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:12:10.570459 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:10.570498 (+ 39us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0927 15:12:10.570743 (+ 245us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0927 15:12:10.570747 (+ 4us) client_negotiation.cc:769] Sending connection context
0927 15:12:10.570788 (+ 41us) client_negotiation.cc:240] Negotiation successful
0927 15:12:10.570844 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":172,"thread_start_us":82,"threads_started":1}
I20260927 15:12:10.570959 20188 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:10.568279 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.136.1:45937 (local address 127.17.136.2:40665)
0927 15:12:10.568385 (+ 106us) server_negotiation.cc:206] Beginning negotiation
0927 15:12:10.568388 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0927 15:12:10.568467 (+ 79us) server_negotiation.cc:407] Connection header received
0927 15:12:10.568563 (+ 96us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:12:10.568565 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:12:10.568608 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:12:10.568675 (+ 67us) server_negotiation.cc:226] Negotiated authn=TOKEN
0927 15:12:10.568825 (+ 150us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:10.569306 (+ 481us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:10.570061 (+ 755us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:10.570281 (+ 220us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:10.570369 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:10.570615 (+ 246us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0927 15:12:10.570678 (+ 63us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0927 15:12:10.570733 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0927 15:12:10.570797 (+ 64us) server_negotiation.cc:299] Negotiation successful
0927 15:12:10.570837 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260927 15:12:10.576200 20121 raft_consensus.cc:1261] T 0b660e0edaa74afb9d15bd80588e22e6 P 8395c661562d41e2af64d5a5fbd7b55e [term 1 FOLLOWER]: Refusing update from remote peer 7e780b9761974a01892b38c81c7542f8: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260927 15:12:10.576499 19980 raft_consensus.cc:1261] T 0b660e0edaa74afb9d15bd80588e22e6 P 0a92c656775c4ef4995411712bf186cb [term 1 FOLLOWER]: Refusing update from remote peer 7e780b9761974a01892b38c81c7542f8: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260927 15:12:10.576663 20239 consensus_queue.cc:1035] T 0b660e0edaa74afb9d15bd80588e22e6 P 7e780b9761974a01892b38c81c7542f8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8395c661562d41e2af64d5a5fbd7b55e" member_type: VOTER last_known_addr { host: "127.17.136.3" port: 39291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260927 15:12:10.576905 20197 consensus_queue.cc:1035] T 0b660e0edaa74afb9d15bd80588e22e6 P 7e780b9761974a01892b38c81c7542f8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0a92c656775c4ef4995411712bf186cb" member_type: VOTER last_known_addr { host: "127.17.136.2" port: 40665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260927 15:12:10.591980 20185 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:10.589058 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.136.2:42405 (local address 127.17.136.1:37191)
0927 15:12:10.589158 (+ 100us) server_negotiation.cc:206] Beginning negotiation
0927 15:12:10.589163 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0927 15:12:10.589221 (+ 58us) server_negotiation.cc:407] Connection header received
0927 15:12:10.589358 (+ 137us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:12:10.589361 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:12:10.589406 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:12:10.589464 (+ 58us) server_negotiation.cc:226] Negotiated authn=TOKEN
0927 15:12:10.589696 (+ 232us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:10.590250 (+ 554us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:10.591026 (+ 776us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:10.591224 (+ 198us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:10.591324 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:10.591562 (+ 238us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0927 15:12:10.591640 (+ 78us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0927 15:12:10.591720 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0927 15:12:10.591811 (+ 91us) server_negotiation.cc:299] Negotiation successful
0927 15:12:10.591861 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
I20260927 15:12:10.591996 20227 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:10.589015 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.1:37191 (local address 127.17.136.2:42405)
0927 15:12:10.589165 (+ 150us) negotiation.cc:107] Waiting for socket to connect
0927 15:12:10.589181 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0927 15:12:10.589265 (+ 84us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0927 15:12:10.589487 (+ 222us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0927 15:12:10.589490 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0927 15:12:10.589498 (+ 8us) client_negotiation.cc:189] Negotiated authn=TOKEN
0927 15:12:10.589596 (+ 98us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:12:10.589601 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:12:10.590347 (+ 746us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:12:10.590350 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:12:10.590908 (+ 558us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:12:10.590916 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:12:10.591334 (+ 418us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:12:10.591338 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:12:10.591411 (+ 73us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:10.591443 (+ 32us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0927 15:12:10.591731 (+ 288us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0927 15:12:10.591738 (+ 7us) client_negotiation.cc:769] Sending connection context
0927 15:12:10.591802 (+ 64us) client_negotiation.cc:240] Negotiation successful
0927 15:12:10.591884 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":76}
W20260927 15:12:10.592603 20216 tablet_replica.cc:1298] Aborted: operation has been aborted: cancelling pending write operations
I20260927 15:12:12.142783 19683 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:49728:
table { table_name: "test-table" } modify_external_catalogs: true
I20260927 15:12:12.142925 19683 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:49728:
table { table_name: "test-table" } modify_external_catalogs: true
I20260927 15:12:12.145159 19683 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 8cde25cd4d294afea7e09d68815618d0: Sending DeleteTablet for 3 replicas of tablet 0b660e0edaa74afb9d15bd80588e22e6
I20260927 15:12:12.145679 19821 tablet_service.cc:1514] Processing DeleteTablet for tablet 0b660e0edaa74afb9d15bd80588e22e6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:12:12 UTC) from {username='kudu', principal='kudu/127.17.136.62@KRBTEST.COM'} at 127.0.0.1:41686
I20260927 15:12:12.145679 19960 tablet_service.cc:1514] Processing DeleteTablet for tablet 0b660e0edaa74afb9d15bd80588e22e6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:12:12 UTC) from {username='kudu', principal='kudu/127.17.136.62@KRBTEST.COM'} at 127.0.0.1:50522
I20260927 15:12:12.145695 20101 tablet_service.cc:1514] Processing DeleteTablet for tablet 0b660e0edaa74afb9d15bd80588e22e6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:12:12 UTC) from {username='kudu', principal='kudu/127.17.136.62@KRBTEST.COM'} at 127.0.0.1:34946
I20260927 15:12:12.146061 20269 tablet_replica.cc:330] T 0b660e0edaa74afb9d15bd80588e22e6 P 7e780b9761974a01892b38c81c7542f8: stopping tablet replica
I20260927 15:12:12.146163 20271 tablet_replica.cc:330] T 0b660e0edaa74afb9d15bd80588e22e6 P 8395c661562d41e2af64d5a5fbd7b55e: stopping tablet replica
I20260927 15:12:12.146203 20269 raft_consensus.cc:2229] T 0b660e0edaa74afb9d15bd80588e22e6 P 7e780b9761974a01892b38c81c7542f8 [term 1 LEADER]: Raft consensus shutting down.
I20260927 15:12:12.146340 20271 raft_consensus.cc:2229] T 0b660e0edaa74afb9d15bd80588e22e6 P 8395c661562d41e2af64d5a5fbd7b55e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260927 15:12:12.146452 20271 raft_consensus.cc:2258] T 0b660e0edaa74afb9d15bd80588e22e6 P 8395c661562d41e2af64d5a5fbd7b55e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 15:12:12.146510 20269 raft_consensus.cc:2258] T 0b660e0edaa74afb9d15bd80588e22e6 P 7e780b9761974a01892b38c81c7542f8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 15:12:12.147099 20269 ts_tablet_manager.cc:1905] T 0b660e0edaa74afb9d15bd80588e22e6 P 7e780b9761974a01892b38c81c7542f8: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:12:12.147409 20270 tablet_replica.cc:330] T 0b660e0edaa74afb9d15bd80588e22e6 P 0a92c656775c4ef4995411712bf186cb: stopping tablet replica
I20260927 15:12:12.147578 20270 raft_consensus.cc:2229] T 0b660e0edaa74afb9d15bd80588e22e6 P 0a92c656775c4ef4995411712bf186cb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260927 15:12:12.147734 20270 raft_consensus.cc:2258] T 0b660e0edaa74afb9d15bd80588e22e6 P 0a92c656775c4ef4995411712bf186cb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 15:12:12.148484 20270 ts_tablet_manager.cc:1905] T 0b660e0edaa74afb9d15bd80588e22e6 P 0a92c656775c4ef4995411712bf186cb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:12:12.148622 20271 ts_tablet_manager.cc:1905] T 0b660e0edaa74afb9d15bd80588e22e6 P 8395c661562d41e2af64d5a5fbd7b55e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:12:12.149683 20269 ts_tablet_manager.cc:1918] T 0b660e0edaa74afb9d15bd80588e22e6 P 7e780b9761974a01892b38c81c7542f8: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260927 15:12:12.149793 20269 log.cc:1196] T 0b660e0edaa74afb9d15bd80588e22e6 P 7e780b9761974a01892b38c81c7542f8: Deleting WAL directory at /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790521920546562-17952-0/minicluster-data/ts-0/wal/wals/0b660e0edaa74afb9d15bd80588e22e6
I20260927 15:12:12.150098 20269 ts_tablet_manager.cc:1939] T 0b660e0edaa74afb9d15bd80588e22e6 P 7e780b9761974a01892b38c81c7542f8: Deleting consensus metadata
I20260927 15:12:12.150785 19669 catalog_manager.cc:4841] TS 7e780b9761974a01892b38c81c7542f8 (127.17.136.1:37191): tablet 0b660e0edaa74afb9d15bd80588e22e6 (table test-table [id=96647656d64c44bba208219014ef1a68]) successfully deleted
I20260927 15:12:12.150985 20270 ts_tablet_manager.cc:1918] T 0b660e0edaa74afb9d15bd80588e22e6 P 0a92c656775c4ef4995411712bf186cb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260927 15:12:12.151055 20270 log.cc:1196] T 0b660e0edaa74afb9d15bd80588e22e6 P 0a92c656775c4ef4995411712bf186cb: Deleting WAL directory at /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790521920546562-17952-0/minicluster-data/ts-1/wal/wals/0b660e0edaa74afb9d15bd80588e22e6
I20260927 15:12:12.151036 20271 ts_tablet_manager.cc:1918] T 0b660e0edaa74afb9d15bd80588e22e6 P 8395c661562d41e2af64d5a5fbd7b55e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260927 15:12:12.151103 20271 log.cc:1196] T 0b660e0edaa74afb9d15bd80588e22e6 P 8395c661562d41e2af64d5a5fbd7b55e: Deleting WAL directory at /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790521920546562-17952-0/minicluster-data/ts-2/wal/wals/0b660e0edaa74afb9d15bd80588e22e6
I20260927 15:12:12.151343 20270 ts_tablet_manager.cc:1939] T 0b660e0edaa74afb9d15bd80588e22e6 P 0a92c656775c4ef4995411712bf186cb: Deleting consensus metadata
I20260927 15:12:12.151378 20271 ts_tablet_manager.cc:1939] T 0b660e0edaa74afb9d15bd80588e22e6 P 8395c661562d41e2af64d5a5fbd7b55e: Deleting consensus metadata
I20260927 15:12:12.152123 19669 catalog_manager.cc:4841] TS 8395c661562d41e2af64d5a5fbd7b55e (127.17.136.3:39291): tablet 0b660e0edaa74afb9d15bd80588e22e6 (table test-table [id=96647656d64c44bba208219014ef1a68]) successfully deleted
I20260927 15:12:12.152168 19671 catalog_manager.cc:4841] TS 0a92c656775c4ef4995411712bf186cb (127.17.136.2:40665): tablet 0b660e0edaa74afb9d15bd80588e22e6 (table test-table [id=96647656d64c44bba208219014ef1a68]) successfully deleted
Sep 27 15:12:12 dist-test-slave-5s2t krb5kdc[19639](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790521932, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Sep 27 15:12:12 dist-test-slave-5s2t krb5kdc[19639](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790521932, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.17.136.62@KRBTEST.COM
I20260927 15:12:12.173689 20279 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:12.164857 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49750 (local address 127.17.136.62:33149)
0927 15:12:12.165114 (+ 257us) server_negotiation.cc:206] Beginning negotiation
0927 15:12:12.165123 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0927 15:12:12.165200 (+ 77us) server_negotiation.cc:407] Connection header received
0927 15:12:12.165339 (+ 139us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:12:12.165343 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:12:12.165389 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:12:12.165483 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0927 15:12:12.166137 (+ 654us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:12.166684 (+ 547us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:12.167539 (+ 855us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:12.167763 (+ 224us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:12.167847 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:12.170417 (+ 2570us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0927 15:12:12.170421 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0927 15:12:12.170423 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0927 15:12:12.170452 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0927 15:12:12.172089 (+ 1637us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:12:12.172543 (+ 454us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:12:12.172547 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:12:12.172551 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:12:12.172638 (+ 87us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:12:12.172889 (+ 251us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:12:12.172891 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:12:12.172892 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:12:12.173092 (+ 200us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0927 15:12:12.173193 (+ 101us) server_negotiation.cc:1035] Waiting for connection context
0927 15:12:12.173431 (+ 238us) server_negotiation.cc:299] Negotiation successful
0927 15:12:12.173553 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":178,"thread_start_us":87,"threads_started":1}
I20260927 15:12:12.176371 19683 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:49750:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:12:12.176817 19683 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:12:12.181581 19821 tablet_service.cc:1467] Processing CreateTablet for tablet 783ddfb218c44702b61c484e85731dd8 (DEFAULT_TABLE table=test-table [id=df37d2b480ea440298607f5436bb4499]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:12:12.181581 19960 tablet_service.cc:1467] Processing CreateTablet for tablet 783ddfb218c44702b61c484e85731dd8 (DEFAULT_TABLE table=test-table [id=df37d2b480ea440298607f5436bb4499]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:12:12.181676 20101 tablet_service.cc:1467] Processing CreateTablet for tablet 783ddfb218c44702b61c484e85731dd8 (DEFAULT_TABLE table=test-table [id=df37d2b480ea440298607f5436bb4499]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:12:12.181877 19821 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 783ddfb218c44702b61c484e85731dd8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:12:12.181877 19960 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 783ddfb218c44702b61c484e85731dd8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:12:12.181958 20101 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 783ddfb218c44702b61c484e85731dd8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:12:12.184365 20280 tablet_bootstrap.cc:492] T 783ddfb218c44702b61c484e85731dd8 P 8395c661562d41e2af64d5a5fbd7b55e: Bootstrap starting.
I20260927 15:12:12.184609 20281 tablet_bootstrap.cc:492] T 783ddfb218c44702b61c484e85731dd8 P 0a92c656775c4ef4995411712bf186cb: Bootstrap starting.
I20260927 15:12:12.184713 20282 tablet_bootstrap.cc:492] T 783ddfb218c44702b61c484e85731dd8 P 7e780b9761974a01892b38c81c7542f8: Bootstrap starting.
I20260927 15:12:12.185367 20281 tablet_bootstrap.cc:654] T 783ddfb218c44702b61c484e85731dd8 P 0a92c656775c4ef4995411712bf186cb: Neither blocks nor log segments found. Creating new log.
I20260927 15:12:12.185467 20282 tablet_bootstrap.cc:654] T 783ddfb218c44702b61c484e85731dd8 P 7e780b9761974a01892b38c81c7542f8: Neither blocks nor log segments found. Creating new log.
I20260927 15:12:12.186442 20281 tablet_bootstrap.cc:492] T 783ddfb218c44702b61c484e85731dd8 P 0a92c656775c4ef4995411712bf186cb: No bootstrap required, opened a new log
I20260927 15:12:12.186524 20281 ts_tablet_manager.cc:1397] T 783ddfb218c44702b61c484e85731dd8 P 0a92c656775c4ef4995411712bf186cb: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260927 15:12:12.186545 20282 tablet_bootstrap.cc:492] T 783ddfb218c44702b61c484e85731dd8 P 7e780b9761974a01892b38c81c7542f8: No bootstrap required, opened a new log
I20260927 15:12:12.186658 20280 tablet_bootstrap.cc:654] T 783ddfb218c44702b61c484e85731dd8 P 8395c661562d41e2af64d5a5fbd7b55e: Neither blocks nor log segments found. Creating new log.
I20260927 15:12:12.186657 20282 ts_tablet_manager.cc:1397] T 783ddfb218c44702b61c484e85731dd8 P 7e780b9761974a01892b38c81c7542f8: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260927 15:12:12.187065 20282 raft_consensus.cc:348] T 783ddfb218c44702b61c484e85731dd8 P 7e780b9761974a01892b38c81c7542f8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e780b9761974a01892b38c81c7542f8" member_type: VOTER last_known_addr { host: "127.17.136.1" port: 37191 } } peers { permanent_uuid: "0a92c656775c4ef4995411712bf186cb" member_type: VOTER last_known_addr { host: "127.17.136.2" port: 40665 } } peers { permanent_uuid: "8395c661562d41e2af64d5a5fbd7b55e" member_type: VOTER last_known_addr { host: "127.17.136.3" port: 39291 } }
I20260927 15:12:12.187068 20281 raft_consensus.cc:348] T 783ddfb218c44702b61c484e85731dd8 P 0a92c656775c4ef4995411712bf186cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e780b9761974a01892b38c81c7542f8" member_type: VOTER last_known_addr { host: "127.17.136.1" port: 37191 } } peers { permanent_uuid: "0a92c656775c4ef4995411712bf186cb" member_type: VOTER last_known_addr { host: "127.17.136.2" port: 40665 } } peers { permanent_uuid: "8395c661562d41e2af64d5a5fbd7b55e" member_type: VOTER last_known_addr { host: "127.17.136.3" port: 39291 } }
I20260927 15:12:12.187175 20282 raft_consensus.cc:374] T 783ddfb218c44702b61c484e85731dd8 P 7e780b9761974a01892b38c81c7542f8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:12:12.187177 20281 raft_consensus.cc:374] T 783ddfb218c44702b61c484e85731dd8 P 0a92c656775c4ef4995411712bf186cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:12:12.187208 20282 raft_consensus.cc:729] T 783ddfb218c44702b61c484e85731dd8 P 7e780b9761974a01892b38c81c7542f8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e780b9761974a01892b38c81c7542f8, State: Initialized, Role: FOLLOWER
I20260927 15:12:12.187213 20281 raft_consensus.cc:729] T 783ddfb218c44702b61c484e85731dd8 P 0a92c656775c4ef4995411712bf186cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0a92c656775c4ef4995411712bf186cb, State: Initialized, Role: FOLLOWER
I20260927 15:12:12.187366 20281 consensus_queue.cc:260] T 783ddfb218c44702b61c484e85731dd8 P 0a92c656775c4ef4995411712bf186cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e780b9761974a01892b38c81c7542f8" member_type: VOTER last_known_addr { host: "127.17.136.1" port: 37191 } } peers { permanent_uuid: "0a92c656775c4ef4995411712bf186cb" member_type: VOTER last_known_addr { host: "127.17.136.2" port: 40665 } } peers { permanent_uuid: "8395c661562d41e2af64d5a5fbd7b55e" member_type: VOTER last_known_addr { host: "127.17.136.3" port: 39291 } }
I20260927 15:12:12.187364 20282 consensus_queue.cc:260] T 783ddfb218c44702b61c484e85731dd8 P 7e780b9761974a01892b38c81c7542f8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e780b9761974a01892b38c81c7542f8" member_type: VOTER last_known_addr { host: "127.17.136.1" port: 37191 } } peers { permanent_uuid: "0a92c656775c4ef4995411712bf186cb" member_type: VOTER last_known_addr { host: "127.17.136.2" port: 40665 } } peers { permanent_uuid: "8395c661562d41e2af64d5a5fbd7b55e" member_type: VOTER last_known_addr { host: "127.17.136.3" port: 39291 } }
I20260927 15:12:12.187609 20281 ts_tablet_manager.cc:1428] T 783ddfb218c44702b61c484e85731dd8 P 0a92c656775c4ef4995411712bf186cb: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20260927 15:12:12.187629 20282 ts_tablet_manager.cc:1428] T 783ddfb218c44702b61c484e85731dd8 P 7e780b9761974a01892b38c81c7542f8: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20260927 15:12:12.188331 20280 tablet_bootstrap.cc:492] T 783ddfb218c44702b61c484e85731dd8 P 8395c661562d41e2af64d5a5fbd7b55e: No bootstrap required, opened a new log
I20260927 15:12:12.188417 20280 ts_tablet_manager.cc:1397] T 783ddfb218c44702b61c484e85731dd8 P 8395c661562d41e2af64d5a5fbd7b55e: Time spent bootstrapping tablet: real 0.004s user 0.001s sys 0.000s
I20260927 15:12:12.188853 20280 raft_consensus.cc:348] T 783ddfb218c44702b61c484e85731dd8 P 8395c661562d41e2af64d5a5fbd7b55e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e780b9761974a01892b38c81c7542f8" member_type: VOTER last_known_addr { host: "127.17.136.1" port: 37191 } } peers { permanent_uuid: "0a92c656775c4ef4995411712bf186cb" member_type: VOTER last_known_addr { host: "127.17.136.2" port: 40665 } } peers { permanent_uuid: "8395c661562d41e2af64d5a5fbd7b55e" member_type: VOTER last_known_addr { host: "127.17.136.3" port: 39291 } }
I20260927 15:12:12.188970 20280 raft_consensus.cc:374] T 783ddfb218c44702b61c484e85731dd8 P 8395c661562d41e2af64d5a5fbd7b55e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:12:12.189003 20280 raft_consensus.cc:729] T 783ddfb218c44702b61c484e85731dd8 P 8395c661562d41e2af64d5a5fbd7b55e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8395c661562d41e2af64d5a5fbd7b55e, State: Initialized, Role: FOLLOWER
I20260927 15:12:12.189119 20280 consensus_queue.cc:260] T 783ddfb218c44702b61c484e85731dd8 P 8395c661562d41e2af64d5a5fbd7b55e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e780b9761974a01892b38c81c7542f8" member_type: VOTER last_known_addr { host: "127.17.136.1" port: 37191 } } peers { permanent_uuid: "0a92c656775c4ef4995411712bf186cb" member_type: VOTER last_known_addr { host: "127.17.136.2" port: 40665 } } peers { permanent_uuid: "8395c661562d41e2af64d5a5fbd7b55e" member_type: VOTER last_known_addr { host: "127.17.136.3" port: 39291 } }
I20260927 15:12:12.189447 20280 ts_tablet_manager.cc:1428] T 783ddfb218c44702b61c484e85731dd8 P 8395c661562d41e2af64d5a5fbd7b55e: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260927 15:12:12.341091 20256 raft_consensus.cc:482] T 783ddfb218c44702b61c484e85731dd8 P 0a92c656775c4ef4995411712bf186cb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:12:12.341228 20256 raft_consensus.cc:504] T 783ddfb218c44702b61c484e85731dd8 P 0a92c656775c4ef4995411712bf186cb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e780b9761974a01892b38c81c7542f8" member_type: VOTER last_known_addr { host: "127.17.136.1" port: 37191 } } peers { permanent_uuid: "0a92c656775c4ef4995411712bf186cb" member_type: VOTER last_known_addr { host: "127.17.136.2" port: 40665 } } peers { permanent_uuid: "8395c661562d41e2af64d5a5fbd7b55e" member_type: VOTER last_known_addr { host: "127.17.136.3" port: 39291 } }
I20260927 15:12:12.341598 20256 leader_election.cc:288] T 783ddfb218c44702b61c484e85731dd8 P 0a92c656775c4ef4995411712bf186cb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7e780b9761974a01892b38c81c7542f8 (127.17.136.1:37191), 8395c661562d41e2af64d5a5fbd7b55e (127.17.136.3:39291)
I20260927 15:12:12.342067 19840 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "783ddfb218c44702b61c484e85731dd8" candidate_uuid: "0a92c656775c4ef4995411712bf186cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e780b9761974a01892b38c81c7542f8" is_pre_election: true
I20260927 15:12:12.342062 20121 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "783ddfb218c44702b61c484e85731dd8" candidate_uuid: "0a92c656775c4ef4995411712bf186cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8395c661562d41e2af64d5a5fbd7b55e" is_pre_election: true
I20260927 15:12:12.342203 20121 raft_consensus.cc:2454] T 783ddfb218c44702b61c484e85731dd8 P 8395c661562d41e2af64d5a5fbd7b55e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0a92c656775c4ef4995411712bf186cb in term 0.
I20260927 15:12:12.342218 19840 raft_consensus.cc:2454] T 783ddfb218c44702b61c484e85731dd8 P 7e780b9761974a01892b38c81c7542f8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0a92c656775c4ef4995411712bf186cb in term 0.
I20260927 15:12:12.342511 19913 leader_election.cc:302] T 783ddfb218c44702b61c484e85731dd8 P 0a92c656775c4ef4995411712bf186cb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0a92c656775c4ef4995411712bf186cb, 7e780b9761974a01892b38c81c7542f8; no voters:
I20260927 15:12:12.342674 20256 raft_consensus.cc:2781] T 783ddfb218c44702b61c484e85731dd8 P 0a92c656775c4ef4995411712bf186cb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 15:12:12.342729 20256 raft_consensus.cc:482] T 783ddfb218c44702b61c484e85731dd8 P 0a92c656775c4ef4995411712bf186cb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 15:12:12.342772 20256 raft_consensus.cc:3037] T 783ddfb218c44702b61c484e85731dd8 P 0a92c656775c4ef4995411712bf186cb [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:12:12.343794 20256 raft_consensus.cc:504] T 783ddfb218c44702b61c484e85731dd8 P 0a92c656775c4ef4995411712bf186cb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e780b9761974a01892b38c81c7542f8" member_type: VOTER last_known_addr { host: "127.17.136.1" port: 37191 } } peers { permanent_uuid: "0a92c656775c4ef4995411712bf186cb" member_type: VOTER last_known_addr { host: "127.17.136.2" port: 40665 } } peers { permanent_uuid: "8395c661562d41e2af64d5a5fbd7b55e" member_type: VOTER last_known_addr { host: "127.17.136.3" port: 39291 } }
I20260927 15:12:12.344117 20256 leader_election.cc:288] T 783ddfb218c44702b61c484e85731dd8 P 0a92c656775c4ef4995411712bf186cb [CANDIDATE]: Term 1 election: Requested vote from peers 7e780b9761974a01892b38c81c7542f8 (127.17.136.1:37191), 8395c661562d41e2af64d5a5fbd7b55e (127.17.136.3:39291)
I20260927 15:12:12.344453 19840 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "783ddfb218c44702b61c484e85731dd8" candidate_uuid: "0a92c656775c4ef4995411712bf186cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e780b9761974a01892b38c81c7542f8"
I20260927 15:12:12.344482 20121 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "783ddfb218c44702b61c484e85731dd8" candidate_uuid: "0a92c656775c4ef4995411712bf186cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8395c661562d41e2af64d5a5fbd7b55e"
I20260927 15:12:12.344575 20121 raft_consensus.cc:3037] T 783ddfb218c44702b61c484e85731dd8 P 8395c661562d41e2af64d5a5fbd7b55e [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:12:12.344580 19840 raft_consensus.cc:3037] T 783ddfb218c44702b61c484e85731dd8 P 7e780b9761974a01892b38c81c7542f8 [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:12:12.345429 19840 raft_consensus.cc:2454] T 783ddfb218c44702b61c484e85731dd8 P 7e780b9761974a01892b38c81c7542f8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0a92c656775c4ef4995411712bf186cb in term 1.
I20260927 15:12:12.345448 20121 raft_consensus.cc:2454] T 783ddfb218c44702b61c484e85731dd8 P 8395c661562d41e2af64d5a5fbd7b55e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0a92c656775c4ef4995411712bf186cb in term 1.
I20260927 15:12:12.345696 19913 leader_election.cc:302] T 783ddfb218c44702b61c484e85731dd8 P 0a92c656775c4ef4995411712bf186cb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0a92c656775c4ef4995411712bf186cb, 7e780b9761974a01892b38c81c7542f8; no voters:
I20260927 15:12:12.345870 20256 raft_consensus.cc:2781] T 783ddfb218c44702b61c484e85731dd8 P 0a92c656775c4ef4995411712bf186cb [term 1 FOLLOWER]: Leader election won for term 1
I20260927 15:12:12.345960 20256 raft_consensus.cc:686] T 783ddfb218c44702b61c484e85731dd8 P 0a92c656775c4ef4995411712bf186cb [term 1 LEADER]: Becoming Leader. State: Replica: 0a92c656775c4ef4995411712bf186cb, State: Running, Role: LEADER
I20260927 15:12:12.346128 20256 consensus_queue.cc:237] T 783ddfb218c44702b61c484e85731dd8 P 0a92c656775c4ef4995411712bf186cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e780b9761974a01892b38c81c7542f8" member_type: VOTER last_known_addr { host: "127.17.136.1" port: 37191 } } peers { permanent_uuid: "0a92c656775c4ef4995411712bf186cb" member_type: VOTER last_known_addr { host: "127.17.136.2" port: 40665 } } peers { permanent_uuid: "8395c661562d41e2af64d5a5fbd7b55e" member_type: VOTER last_known_addr { host: "127.17.136.3" port: 39291 } }
I20260927 15:12:12.347744 19683 catalog_manager.cc:5495] T 783ddfb218c44702b61c484e85731dd8 P 0a92c656775c4ef4995411712bf186cb reported cstate change: term changed from 0 to 1, leader changed from <none> to 0a92c656775c4ef4995411712bf186cb (127.17.136.2). New cstate: current_term: 1 leader_uuid: "0a92c656775c4ef4995411712bf186cb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e780b9761974a01892b38c81c7542f8" member_type: VOTER last_known_addr { host: "127.17.136.1" port: 37191 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0a92c656775c4ef4995411712bf186cb" member_type: VOTER last_known_addr { host: "127.17.136.2" port: 40665 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8395c661562d41e2af64d5a5fbd7b55e" member_type: VOTER last_known_addr { host: "127.17.136.3" port: 39291 } health_report { overall_health: UNKNOWN } } }
I20260927 15:12:12.379827 20289 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:12.376786 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50552 (local address 127.17.136.2:40665)
0927 15:12:12.377014 (+ 228us) server_negotiation.cc:206] Beginning negotiation
0927 15:12:12.377028 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0927 15:12:12.377042 (+ 14us) server_negotiation.cc:407] Connection header received
0927 15:12:12.377085 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:12:12.377088 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:12:12.377134 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:12:12.377201 (+ 67us) server_negotiation.cc:226] Negotiated authn=TOKEN
0927 15:12:12.377444 (+ 243us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:12.377967 (+ 523us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:12.378792 (+ 825us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:12.379026 (+ 234us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:12.379110 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:12.379396 (+ 286us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0927 15:12:12.379477 (+ 81us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0927 15:12:12.379532 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0927 15:12:12.379628 (+ 96us) server_negotiation.cc:299] Negotiation successful
0927 15:12:12.379680 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":162,"thread_start_us":90,"threads_started":1}
I20260927 15:12:12.385375 19840 raft_consensus.cc:1261] T 783ddfb218c44702b61c484e85731dd8 P 7e780b9761974a01892b38c81c7542f8 [term 1 FOLLOWER]: Refusing update from remote peer 0a92c656775c4ef4995411712bf186cb: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260927 15:12:12.385399 20121 raft_consensus.cc:1261] T 783ddfb218c44702b61c484e85731dd8 P 8395c661562d41e2af64d5a5fbd7b55e [term 1 FOLLOWER]: Refusing update from remote peer 0a92c656775c4ef4995411712bf186cb: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260927 15:12:12.385710 20256 consensus_queue.cc:1035] T 783ddfb218c44702b61c484e85731dd8 P 0a92c656775c4ef4995411712bf186cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e780b9761974a01892b38c81c7542f8" member_type: VOTER last_known_addr { host: "127.17.136.1" port: 37191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260927 15:12:12.385869 20248 consensus_queue.cc:1035] T 783ddfb218c44702b61c484e85731dd8 P 0a92c656775c4ef4995411712bf186cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "8395c661562d41e2af64d5a5fbd7b55e" member_type: VOTER last_known_addr { host: "127.17.136.3" port: 39291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260927 15:12:12.390245 20252 mvcc.cc:205] Tried to move back new op lower bound from 7333977835046924288 to 7333977834891141120. Current Snapshot: MvccSnapshot[applied={T|T < 7333977835046924288}]
I20260927 15:12:12.415171 19683 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:49750:
table { table_name: "test-table" } modify_external_catalogs: true
I20260927 15:12:12.415345 19683 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:49750:
table { table_name: "test-table" } modify_external_catalogs: true
I20260927 15:12:12.417270 19683 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 8cde25cd4d294afea7e09d68815618d0: Sending DeleteTablet for 3 replicas of tablet 783ddfb218c44702b61c484e85731dd8
I20260927 15:12:12.417856 19821 tablet_service.cc:1514] Processing DeleteTablet for tablet 783ddfb218c44702b61c484e85731dd8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:12:12 UTC) from {username='kudu', principal='kudu/127.17.136.62@KRBTEST.COM'} at 127.0.0.1:41686
I20260927 15:12:12.417886 20101 tablet_service.cc:1514] Processing DeleteTablet for tablet 783ddfb218c44702b61c484e85731dd8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:12:12 UTC) from {username='kudu', principal='kudu/127.17.136.62@KRBTEST.COM'} at 127.0.0.1:34946
I20260927 15:12:12.417891 19961 tablet_service.cc:1514] Processing DeleteTablet for tablet 783ddfb218c44702b61c484e85731dd8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:12:12 UTC) from {username='kudu', principal='kudu/127.17.136.62@KRBTEST.COM'} at 127.0.0.1:50522
I20260927 15:12:12.418076 20269 tablet_replica.cc:330] T 783ddfb218c44702b61c484e85731dd8 P 7e780b9761974a01892b38c81c7542f8: stopping tablet replica
I20260927 15:12:12.418085 20270 tablet_replica.cc:330] T 783ddfb218c44702b61c484e85731dd8 P 0a92c656775c4ef4995411712bf186cb: stopping tablet replica
I20260927 15:12:12.418195 20269 raft_consensus.cc:2229] T 783ddfb218c44702b61c484e85731dd8 P 7e780b9761974a01892b38c81c7542f8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260927 15:12:12.418196 20270 raft_consensus.cc:2229] T 783ddfb218c44702b61c484e85731dd8 P 0a92c656775c4ef4995411712bf186cb [term 1 LEADER]: Raft consensus shutting down.
I20260927 15:12:12.418313 20269 raft_consensus.cc:2258] T 783ddfb218c44702b61c484e85731dd8 P 7e780b9761974a01892b38c81c7542f8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 15:12:12.418372 20270 raft_consensus.cc:2258] T 783ddfb218c44702b61c484e85731dd8 P 0a92c656775c4ef4995411712bf186cb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 15:12:12.418560 20271 tablet_replica.cc:330] T 783ddfb218c44702b61c484e85731dd8 P 8395c661562d41e2af64d5a5fbd7b55e: stopping tablet replica
I20260927 15:12:12.418672 20271 raft_consensus.cc:2229] T 783ddfb218c44702b61c484e85731dd8 P 8395c661562d41e2af64d5a5fbd7b55e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260927 15:12:12.418774 20271 raft_consensus.cc:2258] T 783ddfb218c44702b61c484e85731dd8 P 8395c661562d41e2af64d5a5fbd7b55e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 15:12:12.419139 20269 ts_tablet_manager.cc:1905] T 783ddfb218c44702b61c484e85731dd8 P 7e780b9761974a01892b38c81c7542f8: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:12:12.419466 20270 ts_tablet_manager.cc:1905] T 783ddfb218c44702b61c484e85731dd8 P 0a92c656775c4ef4995411712bf186cb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:12:12.419519 20271 ts_tablet_manager.cc:1905] T 783ddfb218c44702b61c484e85731dd8 P 8395c661562d41e2af64d5a5fbd7b55e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:12:12.419991 19683 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:49750:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:12:12.420387 19683 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:12:12.424852 19961 tablet_service.cc:1467] Processing CreateTablet for tablet 800c322e68c44e4082daff2d4e6f5189 (DEFAULT_TABLE table=test-table [id=98f57a8190c040d09e5c557fc7e0a24a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:12:12.424999 20101 tablet_service.cc:1467] Processing CreateTablet for tablet 800c322e68c44e4082daff2d4e6f5189 (DEFAULT_TABLE table=test-table [id=98f57a8190c040d09e5c557fc7e0a24a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:12:12.425073 19821 tablet_service.cc:1467] Processing CreateTablet for tablet 800c322e68c44e4082daff2d4e6f5189 (DEFAULT_TABLE table=test-table [id=98f57a8190c040d09e5c557fc7e0a24a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:12:12.427037 20271 ts_tablet_manager.cc:1918] T 783ddfb218c44702b61c484e85731dd8 P 8395c661562d41e2af64d5a5fbd7b55e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260927 15:12:12.427037 20269 ts_tablet_manager.cc:1918] T 783ddfb218c44702b61c484e85731dd8 P 7e780b9761974a01892b38c81c7542f8: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260927 15:12:12.427083 20270 ts_tablet_manager.cc:1918] T 783ddfb218c44702b61c484e85731dd8 P 0a92c656775c4ef4995411712bf186cb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260927 15:12:12.427122 20269 log.cc:1196] T 783ddfb218c44702b61c484e85731dd8 P 7e780b9761974a01892b38c81c7542f8: Deleting WAL directory at /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790521920546562-17952-0/minicluster-data/ts-0/wal/wals/783ddfb218c44702b61c484e85731dd8
I20260927 15:12:12.427122 20271 log.cc:1196] T 783ddfb218c44702b61c484e85731dd8 P 8395c661562d41e2af64d5a5fbd7b55e: Deleting WAL directory at /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790521920546562-17952-0/minicluster-data/ts-2/wal/wals/783ddfb218c44702b61c484e85731dd8
I20260927 15:12:12.427134 20101 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 800c322e68c44e4082daff2d4e6f5189. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:12:12.427161 20270 log.cc:1196] T 783ddfb218c44702b61c484e85731dd8 P 0a92c656775c4ef4995411712bf186cb: Deleting WAL directory at /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790521920546562-17952-0/minicluster-data/ts-1/wal/wals/783ddfb218c44702b61c484e85731dd8
I20260927 15:12:12.427407 20269 ts_tablet_manager.cc:1939] T 783ddfb218c44702b61c484e85731dd8 P 7e780b9761974a01892b38c81c7542f8: Deleting consensus metadata
I20260927 15:12:12.427407 20271 ts_tablet_manager.cc:1939] T 783ddfb218c44702b61c484e85731dd8 P 8395c661562d41e2af64d5a5fbd7b55e: Deleting consensus metadata
I20260927 15:12:12.427444 20270 ts_tablet_manager.cc:1939] T 783ddfb218c44702b61c484e85731dd8 P 0a92c656775c4ef4995411712bf186cb: Deleting consensus metadata
I20260927 15:12:12.427722 19961 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 800c322e68c44e4082daff2d4e6f5189. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:12:12.428092 19669 catalog_manager.cc:4841] TS 8395c661562d41e2af64d5a5fbd7b55e (127.17.136.3:39291): tablet 783ddfb218c44702b61c484e85731dd8 (table test-table [id=df37d2b480ea440298607f5436bb4499]) successfully deleted
I20260927 15:12:12.428231 19669 catalog_manager.cc:4841] TS 7e780b9761974a01892b38c81c7542f8 (127.17.136.1:37191): tablet 783ddfb218c44702b61c484e85731dd8 (table test-table [id=df37d2b480ea440298607f5436bb4499]) successfully deleted
I20260927 15:12:12.427039 19821 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 800c322e68c44e4082daff2d4e6f5189. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:12:12.429458 20280 tablet_bootstrap.cc:492] T 800c322e68c44e4082daff2d4e6f5189 P 8395c661562d41e2af64d5a5fbd7b55e: Bootstrap starting.
I20260927 15:12:12.430028 20281 tablet_bootstrap.cc:492] T 800c322e68c44e4082daff2d4e6f5189 P 0a92c656775c4ef4995411712bf186cb: Bootstrap starting.
I20260927 15:12:12.430398 20280 tablet_bootstrap.cc:654] T 800c322e68c44e4082daff2d4e6f5189 P 8395c661562d41e2af64d5a5fbd7b55e: Neither blocks nor log segments found. Creating new log.
I20260927 15:12:12.430804 20281 tablet_bootstrap.cc:654] T 800c322e68c44e4082daff2d4e6f5189 P 0a92c656775c4ef4995411712bf186cb: Neither blocks nor log segments found. Creating new log.
I20260927 15:12:12.430778 19671 catalog_manager.cc:4841] TS 0a92c656775c4ef4995411712bf186cb (127.17.136.2:40665): tablet 783ddfb218c44702b61c484e85731dd8 (table test-table [id=df37d2b480ea440298607f5436bb4499]) successfully deleted
I20260927 15:12:12.431613 20282 tablet_bootstrap.cc:492] T 800c322e68c44e4082daff2d4e6f5189 P 7e780b9761974a01892b38c81c7542f8: Bootstrap starting.
I20260927 15:12:12.431821 20280 tablet_bootstrap.cc:492] T 800c322e68c44e4082daff2d4e6f5189 P 8395c661562d41e2af64d5a5fbd7b55e: No bootstrap required, opened a new log
I20260927 15:12:12.431850 20281 tablet_bootstrap.cc:492] T 800c322e68c44e4082daff2d4e6f5189 P 0a92c656775c4ef4995411712bf186cb: No bootstrap required, opened a new log
I20260927 15:12:12.431888 20280 ts_tablet_manager.cc:1397] T 800c322e68c44e4082daff2d4e6f5189 P 8395c661562d41e2af64d5a5fbd7b55e: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260927 15:12:12.431928 20281 ts_tablet_manager.cc:1397] T 800c322e68c44e4082daff2d4e6f5189 P 0a92c656775c4ef4995411712bf186cb: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.002s
I20260927 15:12:12.432322 20280 raft_consensus.cc:348] T 800c322e68c44e4082daff2d4e6f5189 P 8395c661562d41e2af64d5a5fbd7b55e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e780b9761974a01892b38c81c7542f8" member_type: VOTER last_known_addr { host: "127.17.136.1" port: 37191 } } peers { permanent_uuid: "0a92c656775c4ef4995411712bf186cb" member_type: VOTER last_known_addr { host: "127.17.136.2" port: 40665 } } peers { permanent_uuid: "8395c661562d41e2af64d5a5fbd7b55e" member_type: VOTER last_known_addr { host: "127.17.136.3" port: 39291 } }
I20260927 15:12:12.432309 20281 raft_consensus.cc:348] T 800c322e68c44e4082daff2d4e6f5189 P 0a92c656775c4ef4995411712bf186cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e780b9761974a01892b38c81c7542f8" member_type: VOTER last_known_addr { host: "127.17.136.1" port: 37191 } } peers { permanent_uuid: "0a92c656775c4ef4995411712bf186cb" member_type: VOTER last_known_addr { host: "127.17.136.2" port: 40665 } } peers { permanent_uuid: "8395c661562d41e2af64d5a5fbd7b55e" member_type: VOTER last_known_addr { host: "127.17.136.3" port: 39291 } }
I20260927 15:12:12.432410 20282 tablet_bootstrap.cc:654] T 800c322e68c44e4082daff2d4e6f5189 P 7e780b9761974a01892b38c81c7542f8: Neither blocks nor log segments found. Creating new log.
I20260927 15:12:12.432425 20280 raft_consensus.cc:374] T 800c322e68c44e4082daff2d4e6f5189 P 8395c661562d41e2af64d5a5fbd7b55e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:12:12.432430 20281 raft_consensus.cc:374] T 800c322e68c44e4082daff2d4e6f5189 P 0a92c656775c4ef4995411712bf186cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:12:12.432459 20281 raft_consensus.cc:729] T 800c322e68c44e4082daff2d4e6f5189 P 0a92c656775c4ef4995411712bf186cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0a92c656775c4ef4995411712bf186cb, State: Initialized, Role: FOLLOWER
I20260927 15:12:12.432453 20280 raft_consensus.cc:729] T 800c322e68c44e4082daff2d4e6f5189 P 8395c661562d41e2af64d5a5fbd7b55e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8395c661562d41e2af64d5a5fbd7b55e, State: Initialized, Role: FOLLOWER
I20260927 15:12:12.432559 20281 consensus_queue.cc:260] T 800c322e68c44e4082daff2d4e6f5189 P 0a92c656775c4ef4995411712bf186cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e780b9761974a01892b38c81c7542f8" member_type: VOTER last_known_addr { host: "127.17.136.1" port: 37191 } } peers { permanent_uuid: "0a92c656775c4ef4995411712bf186cb" member_type: VOTER last_known_addr { host: "127.17.136.2" port: 40665 } } peers { permanent_uuid: "8395c661562d41e2af64d5a5fbd7b55e" member_type: VOTER last_known_addr { host: "127.17.136.3" port: 39291 } }
I20260927 15:12:12.432569 20280 consensus_queue.cc:260] T 800c322e68c44e4082daff2d4e6f5189 P 8395c661562d41e2af64d5a5fbd7b55e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e780b9761974a01892b38c81c7542f8" member_type: VOTER last_known_addr { host: "127.17.136.1" port: 37191 } } peers { permanent_uuid: "0a92c656775c4ef4995411712bf186cb" member_type: VOTER last_known_addr { host: "127.17.136.2" port: 40665 } } peers { permanent_uuid: "8395c661562d41e2af64d5a5fbd7b55e" member_type: VOTER last_known_addr { host: "127.17.136.3" port: 39291 } }
I20260927 15:12:12.432811 20280 ts_tablet_manager.cc:1428] T 800c322e68c44e4082daff2d4e6f5189 P 8395c661562d41e2af64d5a5fbd7b55e: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260927 15:12:12.432811 20281 ts_tablet_manager.cc:1428] T 800c322e68c44e4082daff2d4e6f5189 P 0a92c656775c4ef4995411712bf186cb: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20260927 15:12:12.433384 20282 tablet_bootstrap.cc:492] T 800c322e68c44e4082daff2d4e6f5189 P 7e780b9761974a01892b38c81c7542f8: No bootstrap required, opened a new log
I20260927 15:12:12.433460 20282 ts_tablet_manager.cc:1397] T 800c322e68c44e4082daff2d4e6f5189 P 7e780b9761974a01892b38c81c7542f8: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20260927 15:12:12.433779 20282 raft_consensus.cc:348] T 800c322e68c44e4082daff2d4e6f5189 P 7e780b9761974a01892b38c81c7542f8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e780b9761974a01892b38c81c7542f8" member_type: VOTER last_known_addr { host: "127.17.136.1" port: 37191 } } peers { permanent_uuid: "0a92c656775c4ef4995411712bf186cb" member_type: VOTER last_known_addr { host: "127.17.136.2" port: 40665 } } peers { permanent_uuid: "8395c661562d41e2af64d5a5fbd7b55e" member_type: VOTER last_known_addr { host: "127.17.136.3" port: 39291 } }
I20260927 15:12:12.433879 20282 raft_consensus.cc:374] T 800c322e68c44e4082daff2d4e6f5189 P 7e780b9761974a01892b38c81c7542f8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:12:12.433908 20282 raft_consensus.cc:729] T 800c322e68c44e4082daff2d4e6f5189 P 7e780b9761974a01892b38c81c7542f8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e780b9761974a01892b38c81c7542f8, State: Initialized, Role: FOLLOWER
I20260927 15:12:12.434023 20282 consensus_queue.cc:260] T 800c322e68c44e4082daff2d4e6f5189 P 7e780b9761974a01892b38c81c7542f8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e780b9761974a01892b38c81c7542f8" member_type: VOTER last_known_addr { host: "127.17.136.1" port: 37191 } } peers { permanent_uuid: "0a92c656775c4ef4995411712bf186cb" member_type: VOTER last_known_addr { host: "127.17.136.2" port: 40665 } } peers { permanent_uuid: "8395c661562d41e2af64d5a5fbd7b55e" member_type: VOTER last_known_addr { host: "127.17.136.3" port: 39291 } }
I20260927 15:12:12.434276 20282 ts_tablet_manager.cc:1428] T 800c322e68c44e4082daff2d4e6f5189 P 7e780b9761974a01892b38c81c7542f8: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260927 15:12:12.449884 20256 raft_consensus.cc:482] T 800c322e68c44e4082daff2d4e6f5189 P 0a92c656775c4ef4995411712bf186cb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:12:12.449987 20256 raft_consensus.cc:504] T 800c322e68c44e4082daff2d4e6f5189 P 0a92c656775c4ef4995411712bf186cb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e780b9761974a01892b38c81c7542f8" member_type: VOTER last_known_addr { host: "127.17.136.1" port: 37191 } } peers { permanent_uuid: "0a92c656775c4ef4995411712bf186cb" member_type: VOTER last_known_addr { host: "127.17.136.2" port: 40665 } } peers { permanent_uuid: "8395c661562d41e2af64d5a5fbd7b55e" member_type: VOTER last_known_addr { host: "127.17.136.3" port: 39291 } }
I20260927 15:12:12.450311 20256 leader_election.cc:288] T 800c322e68c44e4082daff2d4e6f5189 P 0a92c656775c4ef4995411712bf186cb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7e780b9761974a01892b38c81c7542f8 (127.17.136.1:37191), 8395c661562d41e2af64d5a5fbd7b55e (127.17.136.3:39291)
I20260927 15:12:12.450673 19840 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "800c322e68c44e4082daff2d4e6f5189" candidate_uuid: "0a92c656775c4ef4995411712bf186cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e780b9761974a01892b38c81c7542f8" is_pre_election: true
I20260927 15:12:12.450729 20120 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "800c322e68c44e4082daff2d4e6f5189" candidate_uuid: "0a92c656775c4ef4995411712bf186cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8395c661562d41e2af64d5a5fbd7b55e" is_pre_election: true
I20260927 15:12:12.450801 19840 raft_consensus.cc:2454] T 800c322e68c44e4082daff2d4e6f5189 P 7e780b9761974a01892b38c81c7542f8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0a92c656775c4ef4995411712bf186cb in term 0.
I20260927 15:12:12.450872 20120 raft_consensus.cc:2454] T 800c322e68c44e4082daff2d4e6f5189 P 8395c661562d41e2af64d5a5fbd7b55e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0a92c656775c4ef4995411712bf186cb in term 0.
I20260927 15:12:12.451093 19913 leader_election.cc:302] T 800c322e68c44e4082daff2d4e6f5189 P 0a92c656775c4ef4995411712bf186cb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0a92c656775c4ef4995411712bf186cb, 7e780b9761974a01892b38c81c7542f8; no voters:
I20260927 15:12:12.451274 20256 raft_consensus.cc:2781] T 800c322e68c44e4082daff2d4e6f5189 P 0a92c656775c4ef4995411712bf186cb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 15:12:12.451331 20256 raft_consensus.cc:482] T 800c322e68c44e4082daff2d4e6f5189 P 0a92c656775c4ef4995411712bf186cb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 15:12:12.451376 20256 raft_consensus.cc:3037] T 800c322e68c44e4082daff2d4e6f5189 P 0a92c656775c4ef4995411712bf186cb [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:12:12.452270 20256 raft_consensus.cc:504] T 800c322e68c44e4082daff2d4e6f5189 P 0a92c656775c4ef4995411712bf186cb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e780b9761974a01892b38c81c7542f8" member_type: VOTER last_known_addr { host: "127.17.136.1" port: 37191 } } peers { permanent_uuid: "0a92c656775c4ef4995411712bf186cb" member_type: VOTER last_known_addr { host: "127.17.136.2" port: 40665 } } peers { permanent_uuid: "8395c661562d41e2af64d5a5fbd7b55e" member_type: VOTER last_known_addr { host: "127.17.136.3" port: 39291 } }
I20260927 15:12:12.452553 20256 leader_election.cc:288] T 800c322e68c44e4082daff2d4e6f5189 P 0a92c656775c4ef4995411712bf186cb [CANDIDATE]: Term 1 election: Requested vote from peers 7e780b9761974a01892b38c81c7542f8 (127.17.136.1:37191), 8395c661562d41e2af64d5a5fbd7b55e (127.17.136.3:39291)
I20260927 15:12:12.452864 19840 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "800c322e68c44e4082daff2d4e6f5189" candidate_uuid: "0a92c656775c4ef4995411712bf186cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e780b9761974a01892b38c81c7542f8"
I20260927 15:12:12.452927 20120 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "800c322e68c44e4082daff2d4e6f5189" candidate_uuid: "0a92c656775c4ef4995411712bf186cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8395c661562d41e2af64d5a5fbd7b55e"
I20260927 15:12:12.452986 19840 raft_consensus.cc:3037] T 800c322e68c44e4082daff2d4e6f5189 P 7e780b9761974a01892b38c81c7542f8 [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:12:12.453047 20120 raft_consensus.cc:3037] T 800c322e68c44e4082daff2d4e6f5189 P 8395c661562d41e2af64d5a5fbd7b55e [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:12:12.453819 19840 raft_consensus.cc:2454] T 800c322e68c44e4082daff2d4e6f5189 P 7e780b9761974a01892b38c81c7542f8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0a92c656775c4ef4995411712bf186cb in term 1.
I20260927 15:12:12.454077 20120 raft_consensus.cc:2454] T 800c322e68c44e4082daff2d4e6f5189 P 8395c661562d41e2af64d5a5fbd7b55e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0a92c656775c4ef4995411712bf186cb in term 1.
I20260927 15:12:12.454087 19913 leader_election.cc:302] T 800c322e68c44e4082daff2d4e6f5189 P 0a92c656775c4ef4995411712bf186cb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0a92c656775c4ef4995411712bf186cb, 7e780b9761974a01892b38c81c7542f8; no voters:
I20260927 15:12:12.454236 20256 raft_consensus.cc:2781] T 800c322e68c44e4082daff2d4e6f5189 P 0a92c656775c4ef4995411712bf186cb [term 1 FOLLOWER]: Leader election won for term 1
I20260927 15:12:12.454311 20256 raft_consensus.cc:686] T 800c322e68c44e4082daff2d4e6f5189 P 0a92c656775c4ef4995411712bf186cb [term 1 LEADER]: Becoming Leader. State: Replica: 0a92c656775c4ef4995411712bf186cb, State: Running, Role: LEADER
I20260927 15:12:12.454438 20256 consensus_queue.cc:237] T 800c322e68c44e4082daff2d4e6f5189 P 0a92c656775c4ef4995411712bf186cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e780b9761974a01892b38c81c7542f8" member_type: VOTER last_known_addr { host: "127.17.136.1" port: 37191 } } peers { permanent_uuid: "0a92c656775c4ef4995411712bf186cb" member_type: VOTER last_known_addr { host: "127.17.136.2" port: 40665 } } peers { permanent_uuid: "8395c661562d41e2af64d5a5fbd7b55e" member_type: VOTER last_known_addr { host: "127.17.136.3" port: 39291 } }
I20260927 15:12:12.455827 19681 catalog_manager.cc:5495] T 800c322e68c44e4082daff2d4e6f5189 P 0a92c656775c4ef4995411712bf186cb reported cstate change: term changed from 0 to 1, leader changed from <none> to 0a92c656775c4ef4995411712bf186cb (127.17.136.2). New cstate: current_term: 1 leader_uuid: "0a92c656775c4ef4995411712bf186cb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e780b9761974a01892b38c81c7542f8" member_type: VOTER last_known_addr { host: "127.17.136.1" port: 37191 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0a92c656775c4ef4995411712bf186cb" member_type: VOTER last_known_addr { host: "127.17.136.2" port: 40665 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8395c661562d41e2af64d5a5fbd7b55e" member_type: VOTER last_known_addr { host: "127.17.136.3" port: 39291 } health_report { overall_health: UNKNOWN } } }
I20260927 15:12:12.472890 20120 raft_consensus.cc:1261] T 800c322e68c44e4082daff2d4e6f5189 P 8395c661562d41e2af64d5a5fbd7b55e [term 1 FOLLOWER]: Refusing update from remote peer 0a92c656775c4ef4995411712bf186cb: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260927 15:12:12.472983 19840 raft_consensus.cc:1261] T 800c322e68c44e4082daff2d4e6f5189 P 7e780b9761974a01892b38c81c7542f8 [term 1 FOLLOWER]: Refusing update from remote peer 0a92c656775c4ef4995411712bf186cb: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260927 15:12:12.473209 20256 consensus_queue.cc:1035] T 800c322e68c44e4082daff2d4e6f5189 P 0a92c656775c4ef4995411712bf186cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "8395c661562d41e2af64d5a5fbd7b55e" member_type: VOTER last_known_addr { host: "127.17.136.3" port: 39291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260927 15:12:12.473353 20251 consensus_queue.cc:1035] T 800c322e68c44e4082daff2d4e6f5189 P 0a92c656775c4ef4995411712bf186cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e780b9761974a01892b38c81c7542f8" member_type: VOTER last_known_addr { host: "127.17.136.1" port: 37191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260927 15:12:12.484089 20249 tablet_replica.cc:1298] Aborted: operation has been aborted: cancelling pending write operations
I20260927 15:12:14.029098 19684 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:49750:
table { table_name: "test-table" } modify_external_catalogs: true
I20260927 15:12:14.029261 19684 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:49750:
table { table_name: "test-table" } modify_external_catalogs: true
I20260927 15:12:14.031626 19684 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 8cde25cd4d294afea7e09d68815618d0: Sending DeleteTablet for 3 replicas of tablet 800c322e68c44e4082daff2d4e6f5189
I20260927 15:12:14.032120 19821 tablet_service.cc:1514] Processing DeleteTablet for tablet 800c322e68c44e4082daff2d4e6f5189 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:12:14 UTC) from {username='kudu', principal='kudu/127.17.136.62@KRBTEST.COM'} at 127.0.0.1:41686
I20260927 15:12:14.032208 20101 tablet_service.cc:1514] Processing DeleteTablet for tablet 800c322e68c44e4082daff2d4e6f5189 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:12:14 UTC) from {username='kudu', principal='kudu/127.17.136.62@KRBTEST.COM'} at 127.0.0.1:34946
I20260927 15:12:14.032335 19961 tablet_service.cc:1514] Processing DeleteTablet for tablet 800c322e68c44e4082daff2d4e6f5189 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:12:14 UTC) from {username='kudu', principal='kudu/127.17.136.62@KRBTEST.COM'} at 127.0.0.1:50522
I20260927 15:12:14.032544 20320 tablet_replica.cc:330] T 800c322e68c44e4082daff2d4e6f5189 P 8395c661562d41e2af64d5a5fbd7b55e: stopping tablet replica
I20260927 15:12:14.032558 17952 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu with pid 19756
I20260927 15:12:14.034148 20320 raft_consensus.cc:2229] T 800c322e68c44e4082daff2d4e6f5189 P 8395c661562d41e2af64d5a5fbd7b55e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260927 15:12:14.034271 20320 raft_consensus.cc:2258] T 800c322e68c44e4082daff2d4e6f5189 P 8395c661562d41e2af64d5a5fbd7b55e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 15:12:14.034494 20321 tablet_replica.cc:330] T 800c322e68c44e4082daff2d4e6f5189 P 0a92c656775c4ef4995411712bf186cb: stopping tablet replica
I20260927 15:12:14.034657 20321 raft_consensus.cc:2229] T 800c322e68c44e4082daff2d4e6f5189 P 0a92c656775c4ef4995411712bf186cb [term 1 LEADER]: Raft consensus shutting down.
I20260927 15:12:14.034840 20321 raft_consensus.cc:2258] T 800c322e68c44e4082daff2d4e6f5189 P 0a92c656775c4ef4995411712bf186cb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 15:12:14.034852 20320 ts_tablet_manager.cc:1905] T 800c322e68c44e4082daff2d4e6f5189 P 8395c661562d41e2af64d5a5fbd7b55e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:12:14.035389 20321 ts_tablet_manager.cc:1905] T 800c322e68c44e4082daff2d4e6f5189 P 0a92c656775c4ef4995411712bf186cb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:12:14.037403 20320 ts_tablet_manager.cc:1918] T 800c322e68c44e4082daff2d4e6f5189 P 8395c661562d41e2af64d5a5fbd7b55e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260927 15:12:14.037482 20320 log.cc:1196] T 800c322e68c44e4082daff2d4e6f5189 P 8395c661562d41e2af64d5a5fbd7b55e: Deleting WAL directory at /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790521920546562-17952-0/minicluster-data/ts-2/wal/wals/800c322e68c44e4082daff2d4e6f5189
I20260927 15:12:14.037779 20320 ts_tablet_manager.cc:1939] T 800c322e68c44e4082daff2d4e6f5189 P 8395c661562d41e2af64d5a5fbd7b55e: Deleting consensus metadata
I20260927 15:12:14.037858 20321 ts_tablet_manager.cc:1918] T 800c322e68c44e4082daff2d4e6f5189 P 0a92c656775c4ef4995411712bf186cb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260927 15:12:14.037925 20321 log.cc:1196] T 800c322e68c44e4082daff2d4e6f5189 P 0a92c656775c4ef4995411712bf186cb: Deleting WAL directory at /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790521920546562-17952-0/minicluster-data/ts-1/wal/wals/800c322e68c44e4082daff2d4e6f5189
I20260927 15:12:14.038173 20321 ts_tablet_manager.cc:1939] T 800c322e68c44e4082daff2d4e6f5189 P 0a92c656775c4ef4995411712bf186cb: Deleting consensus metadata
I20260927 15:12:14.038488 19669 catalog_manager.cc:4841] TS 8395c661562d41e2af64d5a5fbd7b55e (127.17.136.3:39291): tablet 800c322e68c44e4082daff2d4e6f5189 (table test-table [id=98f57a8190c040d09e5c557fc7e0a24a]) successfully deleted
I20260927 15:12:14.038748 19671 catalog_manager.cc:4841] TS 0a92c656775c4ef4995411712bf186cb (127.17.136.2:40665): tablet 800c322e68c44e4082daff2d4e6f5189 (table test-table [id=98f57a8190c040d09e5c557fc7e0a24a]) successfully deleted
W20260927 15:12:14.038775 19669 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.17.136.1:37191 (error 108)
I20260927 15:12:14.039119 17952 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu with pid 19896
I20260927 15:12:14.040863 20323 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:14.040467 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.1:37191 (local address 127.0.0.1:41710)
0927 15:12:14.040688 (+ 221us) negotiation.cc:107] Waiting for socket to connect
0927 15:12:14.040766 (+ 78us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.136.1:37191: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":140,"thread_start_us":69,"threads_started":1}
W20260927 15:12:14.041010 19669 catalog_manager.cc:4584] TS 7e780b9761974a01892b38c81c7542f8 (127.17.136.1:37191): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 800c322e68c44e4082daff2d4e6f5189: Network error: Client connection negotiation failed: client connection to 127.17.136.1:37191: connect: Connection refused (error 111)
I20260927 15:12:14.044780 17952 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu with pid 20036
I20260927 15:12:14.049154 17952 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu with pid 19652
2026-09-27T15:12:14Z chronyd exiting
[ OK ] SecurityITest.TxnSmokeWithDifferentUserTypes (6036 ms)
[ RUN ] SecurityITest.TestNoKerberosCredentials
Loading random data
Initializing database '/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790521920546562-17952-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 27 15:12:14 dist-test-slave-5s2t krb5kdc[20326](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 27 15:12:14 dist-test-slave-5s2t krb5kdc[20326](info): set up 2 sockets
Sep 27 15:12:14 dist-test-slave-5s2t krb5kdc[20326](info): commencing operation
krb5kdc: starting...
W20260927 15:12:14.994799 17952 mini_kdc.cc:121] Time spent starting KDC: real 0.925s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790521920546562-17952-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790521920546562-17952-0/krb5kdc/test-user.keytab.
Sep 27 15:12:15 dist-test-slave-5s2t krb5kdc[20326](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790521935, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-27T15:12:15Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-27T15:12:15Z Disabled control of system clock
WARNING: no policy specified for kudu/127.17.136.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.136.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.136.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790521920546562-17952-0/krb5kdc/kudu_127.17.136.62.keytab.
Entry for principal kudu/127.17.136.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790521920546562-17952-0/krb5kdc/kudu_127.17.136.62.keytab.
I20260927 15:12:15.108317 17952 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu
/tmp/dist-test-taskiFOyeW/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790521920546562-17952-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790521920546562-17952-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790521920546562-17952-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790521920546562-17952-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.136.62:44837
--webserver_interface=127.17.136.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790521920546562-17952-0/krb5kdc/kudu_127.17.136.62.keytab
--principal=kudu/127.17.136.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.136.20:33219
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.136.62:44837
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790521920546562-17952-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790521920546562-17952-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790521920546562-17952-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260927 15:12:15.213377 20339 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260927 15:12:15.213640 20339 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260927 15:12:15.213680 20339 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260927 15:12:15.217715 20339 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260927 15:12:15.217768 20339 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260927 15:12:15.217785 20339 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260927 15:12:15.217801 20339 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260927 15:12:15.217829 20339 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260927 15:12:15.223014 20339 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.136.20:33219
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790521920546562-17952-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790521920546562-17952-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.17.136.62:44837
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790521920546562-17952-0/krb5kdc/kudu_127.17.136.62.keytab
--principal=kudu/127.17.136.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.136.62:44837
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790521920546562-17952-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.17.136.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20339
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790521920546562-17952-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 27 Sep 2026 14:27:13 UTC on ccycloud.quasar-psqrth.root.comops.site
build id 4676138
I20260927 15:12:15.224035 20339 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260927 15:12:15.225004 20339 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260927 15:12:15.233449 20345 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260927 15:12:15.233479 20347 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260927 15:12:15.233531 20339 server_base.cc:1034] running on GCE node
W20260927 15:12:15.233479 20344 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260927 15:12:15.234193 20339 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260927 15:12:15.235239 20339 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260927 15:12:15.236433 20339 hybrid_clock.cc:648] HybridClock initialized: now 1790521935236405 us; error 39 us; skew 500 ppm
Sep 27 15:12:15 dist-test-slave-5s2t krb5kdc[20326](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790521935, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.136.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260927 15:12:15.243988 20339 init.cc:377] Logged in from keytab as kudu/127.17.136.62@KRBTEST.COM (short username kudu)
I20260927 15:12:15.244858 20339 webserver.cc:460] Webserver started at http://127.17.136.62:34797/ using document root <none> and password file <none>
I20260927 15:12:15.245383 20339 fs_manager.cc:359] Metadata directory not provided
I20260927 15:12:15.245446 20339 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260927 15:12:15.245631 20339 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260927 15:12:15.247614 20339 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790521920546562-17952-0/minicluster-data/master-0/data/instance:
uuid: "fd8d5f945edc44e0982e3d96cfd891c3"
format_stamp: "Formatted at 2026-09-27 15:12:15 on dist-test-slave-5s2t"
server_key: "79d94bbb5ff9469d3fc472087b22b664"
server_key_iv: "38f648338e9da0fbb1bc5b6be98f14e9"
server_key_version: "encryptionkey@0"
I20260927 15:12:15.248131 20339 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790521920546562-17952-0/minicluster-data/master-0/wal/instance:
uuid: "fd8d5f945edc44e0982e3d96cfd891c3"
format_stamp: "Formatted at 2026-09-27 15:12:15 on dist-test-slave-5s2t"
server_key: "79d94bbb5ff9469d3fc472087b22b664"
server_key_iv: "38f648338e9da0fbb1bc5b6be98f14e9"
server_key_version: "encryptionkey@0"
I20260927 15:12:15.251613 20339 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260927 15:12:15.253803 20354 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260927 15:12:15.254997 20339 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260927 15:12:15.255111 20339 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790521920546562-17952-0/minicluster-data/master-0/data,/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790521920546562-17952-0/minicluster-data/master-0/wal
uuid: "fd8d5f945edc44e0982e3d96cfd891c3"
format_stamp: "Formatted at 2026-09-27 15:12:15 on dist-test-slave-5s2t"
server_key: "79d94bbb5ff9469d3fc472087b22b664"
server_key_iv: "38f648338e9da0fbb1bc5b6be98f14e9"
server_key_version: "encryptionkey@0"
I20260927 15:12:15.255196 20339 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790521920546562-17952-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790521920546562-17952-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790521920546562-17952-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260927 15:12:15.274190 20339 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260927 15:12:15.276957 20339 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260927 15:12:15.277127 20339 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260927 15:12:15.283272 20339 rpc_server.cc:307] RPC server started. Bound to: 127.17.136.62:44837
I20260927 15:12:15.283317 20406 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.136.62:44837 every 8 connection(s)
I20260927 15:12:15.284157 20339 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790521920546562-17952-0/minicluster-data/master-0/data/info.pb
I20260927 15:12:15.286713 20407 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:12:15.292044 20407 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fd8d5f945edc44e0982e3d96cfd891c3: Bootstrap starting.
I20260927 15:12:15.294049 17952 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu as pid 20339
I20260927 15:12:15.294148 17952 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790521920546562-17952-0/minicluster-data/master-0/wal/instance
I20260927 15:12:15.294404 17952 external_mini_cluster.cc:1428] Setting key 53f3619175d36cb715ee582251089c4e
I20260927 15:12:15.294499 20407 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P fd8d5f945edc44e0982e3d96cfd891c3: Neither blocks nor log segments found. Creating new log.
I20260927 15:12:15.295316 20407 log.cc:824] T 00000000000000000000000000000000 P fd8d5f945edc44e0982e3d96cfd891c3: Log is configured to *not* fsync() on all Append() calls
I20260927 15:12:15.297449 20407 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fd8d5f945edc44e0982e3d96cfd891c3: No bootstrap required, opened a new log
I20260927 15:12:15.301555 20407 raft_consensus.cc:348] T 00000000000000000000000000000000 P fd8d5f945edc44e0982e3d96cfd891c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fd8d5f945edc44e0982e3d96cfd891c3" member_type: VOTER last_known_addr { host: "127.17.136.62" port: 44837 } }
I20260927 15:12:15.301826 20407 raft_consensus.cc:374] T 00000000000000000000000000000000 P fd8d5f945edc44e0982e3d96cfd891c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:12:15.301879 20407 raft_consensus.cc:729] T 00000000000000000000000000000000 P fd8d5f945edc44e0982e3d96cfd891c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fd8d5f945edc44e0982e3d96cfd891c3, State: Initialized, Role: FOLLOWER
I20260927 15:12:15.302282 20407 consensus_queue.cc:260] T 00000000000000000000000000000000 P fd8d5f945edc44e0982e3d96cfd891c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fd8d5f945edc44e0982e3d96cfd891c3" member_type: VOTER last_known_addr { host: "127.17.136.62" port: 44837 } }
I20260927 15:12:15.302393 20407 raft_consensus.cc:388] T 00000000000000000000000000000000 P fd8d5f945edc44e0982e3d96cfd891c3 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260927 15:12:15.302459 20407 raft_consensus.cc:482] T 00000000000000000000000000000000 P fd8d5f945edc44e0982e3d96cfd891c3 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260927 15:12:15.302547 20407 raft_consensus.cc:3037] T 00000000000000000000000000000000 P fd8d5f945edc44e0982e3d96cfd891c3 [term 0 FOLLOWER]: Advancing to term 1
Sep 27 15:12:15 dist-test-slave-5s2t krb5kdc[20326](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790521935, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.136.62@KRBTEST.COM
I20260927 15:12:15.303593 20407 raft_consensus.cc:504] T 00000000000000000000000000000000 P fd8d5f945edc44e0982e3d96cfd891c3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fd8d5f945edc44e0982e3d96cfd891c3" member_type: VOTER last_known_addr { host: "127.17.136.62" port: 44837 } }
I20260927 15:12:15.303987 20407 leader_election.cc:302] T 00000000000000000000000000000000 P fd8d5f945edc44e0982e3d96cfd891c3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: fd8d5f945edc44e0982e3d96cfd891c3; no voters:
I20260927 15:12:15.304352 20407 leader_election.cc:288] T 00000000000000000000000000000000 P fd8d5f945edc44e0982e3d96cfd891c3 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260927 15:12:15.304563 20412 raft_consensus.cc:2781] T 00000000000000000000000000000000 P fd8d5f945edc44e0982e3d96cfd891c3 [term 1 FOLLOWER]: Leader election won for term 1
I20260927 15:12:15.304746 20412 raft_consensus.cc:686] T 00000000000000000000000000000000 P fd8d5f945edc44e0982e3d96cfd891c3 [term 1 LEADER]: Becoming Leader. State: Replica: fd8d5f945edc44e0982e3d96cfd891c3, State: Running, Role: LEADER
I20260927 15:12:15.305128 20412 consensus_queue.cc:237] T 00000000000000000000000000000000 P fd8d5f945edc44e0982e3d96cfd891c3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fd8d5f945edc44e0982e3d96cfd891c3" member_type: VOTER last_known_addr { host: "127.17.136.62" port: 44837 } }
I20260927 15:12:15.305692 20407 sys_catalog.cc:564] T 00000000000000000000000000000000 P fd8d5f945edc44e0982e3d96cfd891c3 [sys.catalog]: configured and running, proceeding with master startup.
I20260927 15:12:15.306759 20414 sys_catalog.cc:455] T 00000000000000000000000000000000 P fd8d5f945edc44e0982e3d96cfd891c3 [sys.catalog]: SysCatalogTable state changed. Reason: New leader fd8d5f945edc44e0982e3d96cfd891c3. Latest consensus state: current_term: 1 leader_uuid: "fd8d5f945edc44e0982e3d96cfd891c3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fd8d5f945edc44e0982e3d96cfd891c3" member_type: VOTER last_known_addr { host: "127.17.136.62" port: 44837 } } }
I20260927 15:12:15.307163 20414 sys_catalog.cc:458] T 00000000000000000000000000000000 P fd8d5f945edc44e0982e3d96cfd891c3 [sys.catalog]: This master's current role is: LEADER
I20260927 15:12:15.307049 20413 sys_catalog.cc:455] T 00000000000000000000000000000000 P fd8d5f945edc44e0982e3d96cfd891c3 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "fd8d5f945edc44e0982e3d96cfd891c3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fd8d5f945edc44e0982e3d96cfd891c3" member_type: VOTER last_known_addr { host: "127.17.136.62" port: 44837 } } }
I20260927 15:12:15.307507 20413 sys_catalog.cc:458] T 00000000000000000000000000000000 P fd8d5f945edc44e0982e3d96cfd891c3 [sys.catalog]: This master's current role is: LEADER
I20260927 15:12:15.308039 20424 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260927 15:12:15.309212 20411 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:15.295508 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56040 (local address 127.17.136.62:44837)
0927 15:12:15.295868 (+ 360us) server_negotiation.cc:206] Beginning negotiation
0927 15:12:15.295882 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0927 15:12:15.295923 (+ 41us) server_negotiation.cc:407] Connection header received
0927 15:12:15.296684 (+ 761us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:12:15.296706 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:12:15.297104 (+ 398us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:12:15.297442 (+ 338us) server_negotiation.cc:226] Negotiated authn=SASL
0927 15:12:15.298099 (+ 657us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:15.299586 (+ 1487us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:15.300385 (+ 799us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:15.301081 (+ 696us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:15.301233 (+ 152us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:15.303800 (+ 2567us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0927 15:12:15.303806 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0927 15:12:15.303822 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0927 15:12:15.303860 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0927 15:12:15.305869 (+ 2009us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:12:15.306303 (+ 434us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:12:15.306309 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:12:15.306315 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:12:15.306449 (+ 134us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:12:15.306762 (+ 313us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:12:15.306765 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:12:15.306766 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:12:15.307357 (+ 591us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0927 15:12:15.307548 (+ 191us) server_negotiation.cc:1035] Waiting for connection context
0927 15:12:15.308269 (+ 721us) server_negotiation.cc:299] Negotiation successful
0927 15:12:15.308523 (+ 254us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":225,"thread_start_us":86,"threads_started":1}
I20260927 15:12:15.311126 20424 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260927 15:12:15.316080 20424 catalog_manager.cc:1347] Generated new cluster ID: a6315ab3590547e1917041714f8d0fdc
I20260927 15:12:15.316139 20424 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260927 15:12:15.332193 20424 catalog_manager.cc:1370] Generated new certificate authority record
I20260927 15:12:15.333035 20424 catalog_manager.cc:1504] Loading token signing keys...
I20260927 15:12:15.338860 20424 catalog_manager.cc:5868] T 00000000000000000000000000000000 P fd8d5f945edc44e0982e3d96cfd891c3: Generated new TSK 0
I20260927 15:12:15.339504 20424 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.17.136.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.136.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.136.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790521920546562-17952-0/krb5kdc/kudu_127.17.136.1.keytab.
Entry for principal kudu/127.17.136.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790521920546562-17952-0/krb5kdc/kudu_127.17.136.1.keytab.
I20260927 15:12:15.370245 17952 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu
/tmp/dist-test-taskiFOyeW/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790521920546562-17952-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790521920546562-17952-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790521920546562-17952-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790521920546562-17952-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.136.1:0
--local_ip_for_outbound_sockets=127.17.136.1
--webserver_interface=127.17.136.1
--webserver_port=0
--tserver_master_addrs=127.17.136.62:44837
--keytab_file=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790521920546562-17952-0/krb5kdc/kudu_127.17.136.1.keytab
--principal=kudu/127.17.136.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.136.20:33219
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790521920546562-17952-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790521920546562-17952-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790521920546562-17952-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260927 15:12:15.478406 20433 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260927 15:12:15.478672 20433 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260927 15:12:15.478724 20433 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260927 15:12:15.482684 20433 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260927 15:12:15.482748 20433 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260927 15:12:15.482815 20433 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.136.1
I20260927 15:12:15.488055 20433 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.136.20:33219
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790521920546562-17952-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790521920546562-17952-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790521920546562-17952-0/krb5kdc/kudu_127.17.136.1.keytab
--principal=kudu/127.17.136.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.136.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790521920546562-17952-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.17.136.1
--webserver_port=0
--tserver_master_addrs=127.17.136.62:44837
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20433
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.136.1
--log_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790521920546562-17952-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 27 Sep 2026 14:27:13 UTC on ccycloud.quasar-psqrth.root.comops.site
build id 4676138
I20260927 15:12:15.489102 20433 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260927 15:12:15.490093 20433 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260927 15:12:15.499361 20441 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260927 15:12:15.499358 20439 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260927 15:12:15.499517 20438 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260927 15:12:15.499564 20433 server_base.cc:1034] running on GCE node
I20260927 15:12:15.500074 20433 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260927 15:12:15.500705 20433 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260927 15:12:15.501871 20433 hybrid_clock.cc:648] HybridClock initialized: now 1790521935501854 us; error 29 us; skew 500 ppm
Sep 27 15:12:15 dist-test-slave-5s2t krb5kdc[20326](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790521935, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.136.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260927 15:12:15.504602 20433 init.cc:377] Logged in from keytab as kudu/127.17.136.1@KRBTEST.COM (short username kudu)
I20260927 15:12:15.505456 20433 webserver.cc:460] Webserver started at http://127.17.136.1:42819/ using document root <none> and password file <none>
I20260927 15:12:15.506021 20433 fs_manager.cc:359] Metadata directory not provided
I20260927 15:12:15.506084 20433 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260927 15:12:15.506275 20433 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260927 15:12:15.508383 20433 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790521920546562-17952-0/minicluster-data/ts-0/data/instance:
uuid: "a754810e2ac347f6a79eed58a034b09e"
format_stamp: "Formatted at 2026-09-27 15:12:15 on dist-test-slave-5s2t"
server_key: "0009d65bb69ab5897ed06aa17de7fd08"
server_key_iv: "602ca79c2ae583059d5946f8991e8421"
server_key_version: "encryptionkey@0"
I20260927 15:12:15.508891 20433 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790521920546562-17952-0/minicluster-data/ts-0/wal/instance:
uuid: "a754810e2ac347f6a79eed58a034b09e"
format_stamp: "Formatted at 2026-09-27 15:12:15 on dist-test-slave-5s2t"
server_key: "0009d65bb69ab5897ed06aa17de7fd08"
server_key_iv: "602ca79c2ae583059d5946f8991e8421"
server_key_version: "encryptionkey@0"
I20260927 15:12:15.512331 20433 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.000s sys 0.004s
I20260927 15:12:15.514591 20448 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260927 15:12:15.515846 20433 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260927 15:12:15.515933 20433 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790521920546562-17952-0/minicluster-data/ts-0/data,/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790521920546562-17952-0/minicluster-data/ts-0/wal
uuid: "a754810e2ac347f6a79eed58a034b09e"
format_stamp: "Formatted at 2026-09-27 15:12:15 on dist-test-slave-5s2t"
server_key: "0009d65bb69ab5897ed06aa17de7fd08"
server_key_iv: "602ca79c2ae583059d5946f8991e8421"
server_key_version: "encryptionkey@0"
I20260927 15:12:15.516009 20433 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790521920546562-17952-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790521920546562-17952-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790521920546562-17952-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260927 15:12:15.528564 20433 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260927 15:12:15.531472 20433 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260927 15:12:15.531651 20433 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260927 15:12:15.532192 20433 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260927 15:12:15.532949 20433 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260927 15:12:15.532992 20433 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260927 15:12:15.533032 20433 ts_tablet_manager.cc:610] Registered 0 tablets
I20260927 15:12:15.533061 20433 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260927 15:12:15.541105 20433 rpc_server.cc:307] RPC server started. Bound to: 127.17.136.1:38283
I20260927 15:12:15.541155 20561 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.136.1:38283 every 8 connection(s)
I20260927 15:12:15.542007 20433 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790521920546562-17952-0/minicluster-data/ts-0/data/info.pb
I20260927 15:12:15.546182 17952 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu as pid 20433
I20260927 15:12:15.546267 17952 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790521920546562-17952-0/minicluster-data/ts-0/wal/instance
I20260927 15:12:15.546489 17952 external_mini_cluster.cc:1428] Setting key 2a23fc719cb09fa354fa408b57cdd722
Sep 27 15:12:15 dist-test-slave-5s2t krb5kdc[20326](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790521935, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.136.1@KRBTEST.COM for kudu/127.17.136.62@KRBTEST.COM
WARNING: no policy specified for kudu/127.17.136.2@KRBTEST.COM; defaulting to no policy
I20260927 15:12:15.555440 20411 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:15.543695 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.136.1:52267 (local address 127.17.136.62:44837)
0927 15:12:15.543821 (+ 126us) server_negotiation.cc:206] Beginning negotiation
0927 15:12:15.543824 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0927 15:12:15.544826 (+ 1002us) server_negotiation.cc:407] Connection header received
0927 15:12:15.545658 (+ 832us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:12:15.545661 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:12:15.545715 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:12:15.545788 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0927 15:12:15.547147 (+ 1359us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:15.547776 (+ 629us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:15.549310 (+ 1534us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:15.549662 (+ 352us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:15.549771 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:15.552188 (+ 2417us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0927 15:12:15.552192 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0927 15:12:15.552194 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0927 15:12:15.552216 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0927 15:12:15.553471 (+ 1255us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:12:15.554006 (+ 535us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:12:15.554009 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:12:15.554010 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:12:15.554092 (+ 82us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:12:15.554408 (+ 316us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:12:15.554410 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:12:15.554411 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:12:15.554557 (+ 146us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0927 15:12:15.554625 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0927 15:12:15.555189 (+ 564us) server_negotiation.cc:299] Negotiation successful
0927 15:12:15.555319 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260927 15:12:15.556286 20564 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:15.544060 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.62:44837 (local address 127.17.136.1:52267)
0927 15:12:15.544685 (+ 625us) negotiation.cc:107] Waiting for socket to connect
0927 15:12:15.544724 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0927 15:12:15.545460 (+ 736us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0927 15:12:15.545959 (+ 499us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0927 15:12:15.545966 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0927 15:12:15.546337 (+ 371us) client_negotiation.cc:189] Negotiated authn=SASL
0927 15:12:15.546856 (+ 519us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:12:15.546875 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:12:15.547901 (+ 1026us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:12:15.547904 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:12:15.549170 (+ 1266us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:12:15.549181 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:12:15.549806 (+ 625us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:12:15.549809 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:12:15.549943 (+ 134us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:15.550499 (+ 556us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0927 15:12:15.550514 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0927 15:12:15.552035 (+ 1521us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0927 15:12:15.553576 (+ 1541us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0927 15:12:15.553582 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0927 15:12:15.553597 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0927 15:12:15.553925 (+ 328us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0927 15:12:15.554166 (+ 241us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0927 15:12:15.554169 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0927 15:12:15.554170 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0927 15:12:15.554334 (+ 164us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0927 15:12:15.554648 (+ 314us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0927 15:12:15.554655 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0927 15:12:15.554963 (+ 308us) client_negotiation.cc:769] Sending connection context
0927 15:12:15.555169 (+ 206us) client_negotiation.cc:240] Negotiation successful
0927 15:12:15.555494 (+ 325us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":426,"thread_start_us":106,"threads_started":1}
I20260927 15:12:15.557307 20562 heartbeater.cc:347] Connected to a master server at 127.17.136.62:44837
I20260927 15:12:15.557582 20562 heartbeater.cc:464] Registering TS with master...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.136.2@KRBTEST.COM" created.
I20260927 15:12:15.558117 20562 heartbeater.cc:511] Master 127.17.136.62:44837 requested a full tablet report, sending...
I20260927 15:12:15.559650 20371 ts_manager.cc:194] Registered new tserver with Master: a754810e2ac347f6a79eed58a034b09e (127.17.136.1:38283)
I20260927 15:12:15.560689 20371 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.136.1@KRBTEST.COM'} at 127.17.136.1:52267
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.136.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790521920546562-17952-0/krb5kdc/kudu_127.17.136.2.keytab.
Entry for principal kudu/127.17.136.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790521920546562-17952-0/krb5kdc/kudu_127.17.136.2.keytab.
I20260927 15:12:15.572153 17952 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu
/tmp/dist-test-taskiFOyeW/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790521920546562-17952-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790521920546562-17952-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790521920546562-17952-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790521920546562-17952-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.136.2:0
--local_ip_for_outbound_sockets=127.17.136.2
--webserver_interface=127.17.136.2
--webserver_port=0
--tserver_master_addrs=127.17.136.62:44837
--keytab_file=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790521920546562-17952-0/krb5kdc/kudu_127.17.136.2.keytab
--principal=kudu/127.17.136.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.136.20:33219
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790521920546562-17952-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790521920546562-17952-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790521920546562-17952-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260927 15:12:15.676616 20567 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260927 15:12:15.676851 20567 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260927 15:12:15.676890 20567 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260927 15:12:15.680773 20567 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260927 15:12:15.680825 20567 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260927 15:12:15.680884 20567 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.136.2
I20260927 15:12:15.685931 20567 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.136.20:33219
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790521920546562-17952-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790521920546562-17952-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790521920546562-17952-0/krb5kdc/kudu_127.17.136.2.keytab
--principal=kudu/127.17.136.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.136.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790521920546562-17952-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.17.136.2
--webserver_port=0
--tserver_master_addrs=127.17.136.62:44837
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20567
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.136.2
--log_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790521920546562-17952-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 27 Sep 2026 14:27:13 UTC on ccycloud.quasar-psqrth.root.comops.site
build id 4676138
I20260927 15:12:15.686928 20567 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260927 15:12:15.687885 20567 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260927 15:12:15.697036 20572 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260927 15:12:15.697046 20573 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260927 15:12:15.697126 20567 server_base.cc:1034] running on GCE node
W20260927 15:12:15.697048 20575 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260927 15:12:15.697621 20567 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260927 15:12:15.698216 20567 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260927 15:12:15.699312 20567 hybrid_clock.cc:648] HybridClock initialized: now 1790521935699296 us; error 25 us; skew 500 ppm
Sep 27 15:12:15 dist-test-slave-5s2t krb5kdc[20326](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790521935, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.136.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260927 15:12:15.701848 20567 init.cc:377] Logged in from keytab as kudu/127.17.136.2@KRBTEST.COM (short username kudu)
I20260927 15:12:15.702625 20567 webserver.cc:460] Webserver started at http://127.17.136.2:34213/ using document root <none> and password file <none>
I20260927 15:12:15.703132 20567 fs_manager.cc:359] Metadata directory not provided
I20260927 15:12:15.703187 20567 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260927 15:12:15.703388 20567 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260927 15:12:15.705322 20567 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790521920546562-17952-0/minicluster-data/ts-1/data/instance:
uuid: "f77312a4da634b78a63fe085aa62b3e0"
format_stamp: "Formatted at 2026-09-27 15:12:15 on dist-test-slave-5s2t"
server_key: "46c901c286376484160d952555ad739c"
server_key_iv: "82c4e4cdb3fa7c3148f25573639a5b52"
server_key_version: "encryptionkey@0"
I20260927 15:12:15.705822 20567 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790521920546562-17952-0/minicluster-data/ts-1/wal/instance:
uuid: "f77312a4da634b78a63fe085aa62b3e0"
format_stamp: "Formatted at 2026-09-27 15:12:15 on dist-test-slave-5s2t"
server_key: "46c901c286376484160d952555ad739c"
server_key_iv: "82c4e4cdb3fa7c3148f25573639a5b52"
server_key_version: "encryptionkey@0"
I20260927 15:12:15.709539 20567 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260927 15:12:15.711784 20582 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260927 15:12:15.712891 20567 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260927 15:12:15.712984 20567 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790521920546562-17952-0/minicluster-data/ts-1/data,/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790521920546562-17952-0/minicluster-data/ts-1/wal
uuid: "f77312a4da634b78a63fe085aa62b3e0"
format_stamp: "Formatted at 2026-09-27 15:12:15 on dist-test-slave-5s2t"
server_key: "46c901c286376484160d952555ad739c"
server_key_iv: "82c4e4cdb3fa7c3148f25573639a5b52"
server_key_version: "encryptionkey@0"
I20260927 15:12:15.713099 20567 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790521920546562-17952-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790521920546562-17952-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790521920546562-17952-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260927 15:12:15.742933 20567 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260927 15:12:15.745884 20567 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260927 15:12:15.746057 20567 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260927 15:12:15.746618 20567 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260927 15:12:15.747448 20567 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260927 15:12:15.747494 20567 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260927 15:12:15.747534 20567 ts_tablet_manager.cc:610] Registered 0 tablets
I20260927 15:12:15.747561 20567 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260927 15:12:15.755465 20567 rpc_server.cc:307] RPC server started. Bound to: 127.17.136.2:43305
I20260927 15:12:15.755563 20695 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.136.2:43305 every 8 connection(s)
I20260927 15:12:15.756300 20567 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790521920546562-17952-0/minicluster-data/ts-1/data/info.pb
I20260927 15:12:15.757534 17952 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu as pid 20567
I20260927 15:12:15.757617 17952 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790521920546562-17952-0/minicluster-data/ts-1/wal/instance
I20260927 15:12:15.757859 17952 external_mini_cluster.cc:1428] Setting key 6ce32be8ac1d4eae3c27bf0f7f8759b6
Sep 27 15:12:15 dist-test-slave-5s2t krb5kdc[20326](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790521935, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.136.2@KRBTEST.COM for kudu/127.17.136.62@KRBTEST.COM
WARNING: no policy specified for kudu/127.17.136.3@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.136.3@KRBTEST.COM" created.
I20260927 15:12:15.769372 20411 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:15.758040 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.136.2:60207 (local address 127.17.136.62:44837)
0927 15:12:15.758188 (+ 148us) server_negotiation.cc:206] Beginning negotiation
0927 15:12:15.758193 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0927 15:12:15.759413 (+ 1220us) server_negotiation.cc:407] Connection header received
0927 15:12:15.760247 (+ 834us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:12:15.760250 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:12:15.760297 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:12:15.760363 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0927 15:12:15.761442 (+ 1079us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:15.762083 (+ 641us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:15.763325 (+ 1242us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:15.763668 (+ 343us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:15.763774 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:15.766286 (+ 2512us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0927 15:12:15.766290 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0927 15:12:15.766292 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0927 15:12:15.766317 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0927 15:12:15.767591 (+ 1274us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:12:15.768029 (+ 438us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:12:15.768031 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:12:15.768033 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:12:15.768101 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:12:15.768361 (+ 260us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:12:15.768363 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:12:15.768364 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:12:15.768553 (+ 189us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0927 15:12:15.768647 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0927 15:12:15.769104 (+ 457us) server_negotiation.cc:299] Negotiation successful
0927 15:12:15.769213 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260927 15:12:15.770270 20698 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:15.758554 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.62:44837 (local address 127.17.136.2:60207)
0927 15:12:15.759292 (+ 738us) negotiation.cc:107] Waiting for socket to connect
0927 15:12:15.759340 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0927 15:12:15.760073 (+ 733us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0927 15:12:15.760536 (+ 463us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0927 15:12:15.760543 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0927 15:12:15.760867 (+ 324us) client_negotiation.cc:189] Negotiated authn=SASL
0927 15:12:15.761317 (+ 450us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:12:15.761329 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:12:15.762208 (+ 879us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:12:15.762210 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:12:15.763174 (+ 964us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:12:15.763185 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:12:15.763800 (+ 615us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:12:15.763803 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:12:15.763985 (+ 182us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:15.764543 (+ 558us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0927 15:12:15.764560 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0927 15:12:15.766129 (+ 1569us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0927 15:12:15.767689 (+ 1560us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0927 15:12:15.767693 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0927 15:12:15.767704 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0927 15:12:15.767946 (+ 242us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0927 15:12:15.768167 (+ 221us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0927 15:12:15.768169 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0927 15:12:15.768170 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0927 15:12:15.768298 (+ 128us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0927 15:12:15.768642 (+ 344us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0927 15:12:15.768646 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0927 15:12:15.768866 (+ 220us) client_negotiation.cc:769] Sending connection context
0927 15:12:15.769043 (+ 177us) client_negotiation.cc:240] Negotiation successful
0927 15:12:15.769309 (+ 266us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":480,"thread_start_us":141,"threads_started":1}
I20260927 15:12:15.771289 20696 heartbeater.cc:347] Connected to a master server at 127.17.136.62:44837
I20260927 15:12:15.771531 20696 heartbeater.cc:464] Registering TS with master...
I20260927 15:12:15.772060 20696 heartbeater.cc:511] Master 127.17.136.62:44837 requested a full tablet report, sending...
I20260927 15:12:15.773032 20371 ts_manager.cc:194] Registered new tserver with Master: f77312a4da634b78a63fe085aa62b3e0 (127.17.136.2:43305)
I20260927 15:12:15.773564 20371 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.136.2@KRBTEST.COM'} at 127.17.136.2:60207
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.136.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790521920546562-17952-0/krb5kdc/kudu_127.17.136.3.keytab.
Entry for principal kudu/127.17.136.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790521920546562-17952-0/krb5kdc/kudu_127.17.136.3.keytab.
I20260927 15:12:15.784559 17952 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu
/tmp/dist-test-taskiFOyeW/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790521920546562-17952-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790521920546562-17952-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790521920546562-17952-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790521920546562-17952-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.136.3:0
--local_ip_for_outbound_sockets=127.17.136.3
--webserver_interface=127.17.136.3
--webserver_port=0
--tserver_master_addrs=127.17.136.62:44837
--keytab_file=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790521920546562-17952-0/krb5kdc/kudu_127.17.136.3.keytab
--principal=kudu/127.17.136.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.136.20:33219
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790521920546562-17952-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790521920546562-17952-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790521920546562-17952-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260927 15:12:15.890915 20701 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260927 15:12:15.891165 20701 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260927 15:12:15.891204 20701 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260927 15:12:15.895093 20701 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260927 15:12:15.895145 20701 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260927 15:12:15.895203 20701 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.136.3
I20260927 15:12:15.900215 20701 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.136.20:33219
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790521920546562-17952-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790521920546562-17952-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790521920546562-17952-0/krb5kdc/kudu_127.17.136.3.keytab
--principal=kudu/127.17.136.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.136.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790521920546562-17952-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.17.136.3
--webserver_port=0
--tserver_master_addrs=127.17.136.62:44837
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20701
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.136.3
--log_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790521920546562-17952-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 27 Sep 2026 14:27:13 UTC on ccycloud.quasar-psqrth.root.comops.site
build id 4676138
I20260927 15:12:15.901199 20701 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260927 15:12:15.902182 20701 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260927 15:12:15.911703 20707 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260927 15:12:15.911725 20706 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260927 15:12:15.911782 20701 server_base.cc:1034] running on GCE node
W20260927 15:12:15.911715 20709 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260927 15:12:15.912382 20701 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260927 15:12:15.912966 20701 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260927 15:12:15.914119 20701 hybrid_clock.cc:648] HybridClock initialized: now 1790521935914099 us; error 32 us; skew 500 ppm
Sep 27 15:12:15 dist-test-slave-5s2t krb5kdc[20326](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790521935, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.136.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260927 15:12:15.916810 20701 init.cc:377] Logged in from keytab as kudu/127.17.136.3@KRBTEST.COM (short username kudu)
I20260927 15:12:15.917621 20701 webserver.cc:460] Webserver started at http://127.17.136.3:43201/ using document root <none> and password file <none>
I20260927 15:12:15.918123 20701 fs_manager.cc:359] Metadata directory not provided
I20260927 15:12:15.918177 20701 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260927 15:12:15.918360 20701 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260927 15:12:15.920421 20701 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790521920546562-17952-0/minicluster-data/ts-2/data/instance:
uuid: "4786fed864d34beca2821b97f367fd2a"
format_stamp: "Formatted at 2026-09-27 15:12:15 on dist-test-slave-5s2t"
server_key: "1914cf837b5bbef188f12fc6d63d855f"
server_key_iv: "ace5905ff12b0e00ffdc4e6122643f6c"
server_key_version: "encryptionkey@0"
I20260927 15:12:15.920925 20701 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790521920546562-17952-0/minicluster-data/ts-2/wal/instance:
uuid: "4786fed864d34beca2821b97f367fd2a"
format_stamp: "Formatted at 2026-09-27 15:12:15 on dist-test-slave-5s2t"
server_key: "1914cf837b5bbef188f12fc6d63d855f"
server_key_iv: "ace5905ff12b0e00ffdc4e6122643f6c"
server_key_version: "encryptionkey@0"
I20260927 15:12:15.924293 20701 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.001s sys 0.003s
I20260927 15:12:15.926414 20716 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260927 15:12:15.927533 20701 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260927 15:12:15.927623 20701 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790521920546562-17952-0/minicluster-data/ts-2/data,/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790521920546562-17952-0/minicluster-data/ts-2/wal
uuid: "4786fed864d34beca2821b97f367fd2a"
format_stamp: "Formatted at 2026-09-27 15:12:15 on dist-test-slave-5s2t"
server_key: "1914cf837b5bbef188f12fc6d63d855f"
server_key_iv: "ace5905ff12b0e00ffdc4e6122643f6c"
server_key_version: "encryptionkey@0"
I20260927 15:12:15.927706 20701 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790521920546562-17952-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790521920546562-17952-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790521920546562-17952-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260927 15:12:15.955101 20701 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260927 15:12:15.957813 20701 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260927 15:12:15.957995 20701 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260927 15:12:15.958580 20701 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260927 15:12:15.959421 20701 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260927 15:12:15.959472 20701 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260927 15:12:15.959517 20701 ts_tablet_manager.cc:610] Registered 0 tablets
I20260927 15:12:15.959544 20701 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260927 15:12:15.967613 20701 rpc_server.cc:307] RPC server started. Bound to: 127.17.136.3:36187
I20260927 15:12:15.967679 20829 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.136.3:36187 every 8 connection(s)
I20260927 15:12:15.968441 20701 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790521920546562-17952-0/minicluster-data/ts-2/data/info.pb
I20260927 15:12:15.970377 17952 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu as pid 20701
I20260927 15:12:15.970479 17952 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790521920546562-17952-0/minicluster-data/ts-2/wal/instance
I20260927 15:12:15.970777 17952 external_mini_cluster.cc:1428] Setting key 333ee5a9517194dba2db05ecfc17af75
Sep 27 15:12:15 dist-test-slave-5s2t krb5kdc[20326](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790521935, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.136.3@KRBTEST.COM for kudu/127.17.136.62@KRBTEST.COM
I20260927 15:12:15.980916 20411 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:15.970093 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.136.3:52761 (local address 127.17.136.62:44837)
0927 15:12:15.970249 (+ 156us) server_negotiation.cc:206] Beginning negotiation
0927 15:12:15.970252 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0927 15:12:15.971421 (+ 1169us) server_negotiation.cc:407] Connection header received
0927 15:12:15.972377 (+ 956us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:12:15.972380 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:12:15.972430 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:12:15.972496 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0927 15:12:15.973606 (+ 1110us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:15.974130 (+ 524us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:15.975206 (+ 1076us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:15.975482 (+ 276us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:15.975570 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:15.977843 (+ 2273us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0927 15:12:15.977847 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0927 15:12:15.977850 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0927 15:12:15.977876 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0927 15:12:15.979027 (+ 1151us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:12:15.979530 (+ 503us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:12:15.979534 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:12:15.979536 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:12:15.979608 (+ 72us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:12:15.979903 (+ 295us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:12:15.979906 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:12:15.979908 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:12:15.980088 (+ 180us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0927 15:12:15.980169 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0927 15:12:15.980631 (+ 462us) server_negotiation.cc:299] Negotiation successful
0927 15:12:15.980749 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260927 15:12:15.981685 20832 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:15.970549 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.62:44837 (local address 127.17.136.3:52761)
0927 15:12:15.971283 (+ 734us) negotiation.cc:107] Waiting for socket to connect
0927 15:12:15.971333 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0927 15:12:15.972193 (+ 860us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0927 15:12:15.972652 (+ 459us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0927 15:12:15.972661 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0927 15:12:15.973015 (+ 354us) client_negotiation.cc:189] Negotiated authn=SASL
0927 15:12:15.973475 (+ 460us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:12:15.973487 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:12:15.974239 (+ 752us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:12:15.974243 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:12:15.975091 (+ 848us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:12:15.975100 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:12:15.975611 (+ 511us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:12:15.975615 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:12:15.975765 (+ 150us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:15.976280 (+ 515us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0927 15:12:15.976296 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0927 15:12:15.977700 (+ 1404us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0927 15:12:15.979126 (+ 1426us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0927 15:12:15.979131 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0927 15:12:15.979145 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0927 15:12:15.979437 (+ 292us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0927 15:12:15.979684 (+ 247us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0927 15:12:15.979687 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0927 15:12:15.979689 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0927 15:12:15.979821 (+ 132us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0927 15:12:15.980180 (+ 359us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0927 15:12:15.980187 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0927 15:12:15.980410 (+ 223us) client_negotiation.cc:769] Sending connection context
0927 15:12:15.980577 (+ 167us) client_negotiation.cc:240] Negotiation successful
0927 15:12:15.980886 (+ 309us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":482,"thread_start_us":128,"threads_started":1}
I20260927 15:12:15.982709 20830 heartbeater.cc:347] Connected to a master server at 127.17.136.62:44837
I20260927 15:12:15.982930 20830 heartbeater.cc:464] Registering TS with master...
I20260927 15:12:15.983487 20830 heartbeater.cc:511] Master 127.17.136.62:44837 requested a full tablet report, sending...
I20260927 15:12:15.984465 20371 ts_manager.cc:194] Registered new tserver with Master: 4786fed864d34beca2821b97f367fd2a (127.17.136.3:36187)
I20260927 15:12:15.985018 20371 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.136.3@KRBTEST.COM'} at 127.17.136.3:52761
I20260927 15:12:15.996080 17952 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260927 15:12:16.008076 20411 negotiation.cc:337] Failed RPC negotiation. Trace:
0927 15:12:16.006657 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56042 (local address 127.17.136.62:44837)
0927 15:12:16.006780 (+ 123us) server_negotiation.cc:206] Beginning negotiation
0927 15:12:16.006785 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0927 15:12:16.006949 (+ 164us) server_negotiation.cc:407] Connection header received
0927 15:12:16.007074 (+ 125us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:12:16.007077 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:12:16.007121 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:12:16.007200 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0927 15:12:16.007960 (+ 760us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:56042: BlockingRecv error: recv got EOF from 127.0.0.1:56042 (error 108)
Metrics: {"server-negotiator.queue_time_us":36}
I20260927 15:12:16.009138 17952 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu with pid 20433
I20260927 15:12:16.013847 17952 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu with pid 20567
I20260927 15:12:16.018203 17952 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu with pid 20701
I20260927 15:12:16.022260 17952 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu with pid 20339
2026-09-27T15:12:16Z chronyd exiting
[ OK ] SecurityITest.TestNoKerberosCredentials (1971 ms)
[ RUN ] SecurityITest.SaslPlainFallback
Loading random data
Initializing database '/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1790521920546562-17952-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 27 15:12:16 dist-test-slave-5s2t krb5kdc[20842](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 27 15:12:16 dist-test-slave-5s2t krb5kdc[20842](info): set up 2 sockets
Sep 27 15:12:16 dist-test-slave-5s2t krb5kdc[20842](info): commencing operation
krb5kdc: starting...
W20260927 15:12:16.974907 17952 mini_kdc.cc:121] Time spent starting KDC: real 0.934s user 0.001s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1790521920546562-17952-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1790521920546562-17952-0/krb5kdc/test-user.keytab.
Sep 27 15:12:17 dist-test-slave-5s2t krb5kdc[20842](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790521937, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-27T15:12:17Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-27T15:12:17Z Disabled control of system clock
WARNING: no policy specified for kudu/127.17.136.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.136.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.136.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1790521920546562-17952-0/krb5kdc/kudu_127.17.136.62.keytab.
Entry for principal kudu/127.17.136.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1790521920546562-17952-0/krb5kdc/kudu_127.17.136.62.keytab.
I20260927 15:12:17.088269 17952 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu
/tmp/dist-test-taskiFOyeW/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1790521920546562-17952-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1790521920546562-17952-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1790521920546562-17952-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1790521920546562-17952-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.136.62:40053
--webserver_interface=127.17.136.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1790521920546562-17952-0/krb5kdc/kudu_127.17.136.62.keytab
--principal=kudu/127.17.136.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.136.20:39557
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.136.62:40053
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc-authentication=optional
--user-acl=* with env {KRB5CCNAME=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1790521920546562-17952-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1790521920546562-17952-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1790521920546562-17952-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260927 15:12:17.192785 20855 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260927 15:12:17.193065 20855 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260927 15:12:17.193121 20855 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260927 15:12:17.197113 20855 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260927 15:12:17.197175 20855 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260927 15:12:17.197201 20855 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260927 15:12:17.197219 20855 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260927 15:12:17.197240 20855 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260927 15:12:17.202371 20855 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.136.20:39557
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1790521920546562-17952-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1790521920546562-17952-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.17.136.62:40053
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1790521920546562-17952-0/krb5kdc/kudu_127.17.136.62.keytab
--principal=kudu/127.17.136.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.136.62:40053
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1790521920546562-17952-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.17.136.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20855
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1790521920546562-17952-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 27 Sep 2026 14:27:13 UTC on ccycloud.quasar-psqrth.root.comops.site
build id 4676138
I20260927 15:12:17.203414 20855 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260927 15:12:17.204401 20855 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260927 15:12:17.212697 20860 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260927 15:12:17.212678 20861 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260927 15:12:17.212749 20855 server_base.cc:1034] running on GCE node
W20260927 15:12:17.212674 20863 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260927 15:12:17.213449 20855 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260927 15:12:17.214486 20855 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260927 15:12:17.215664 20855 hybrid_clock.cc:648] HybridClock initialized: now 1790521937215645 us; error 29 us; skew 500 ppm
Sep 27 15:12:17 dist-test-slave-5s2t krb5kdc[20842](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790521937, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.136.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260927 15:12:17.218281 20855 init.cc:377] Logged in from keytab as kudu/127.17.136.62@KRBTEST.COM (short username kudu)
I20260927 15:12:17.219125 20855 webserver.cc:460] Webserver started at http://127.17.136.62:41633/ using document root <none> and password file <none>
I20260927 15:12:17.219656 20855 fs_manager.cc:359] Metadata directory not provided
I20260927 15:12:17.219722 20855 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260927 15:12:17.219901 20855 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260927 15:12:17.221861 20855 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1790521920546562-17952-0/minicluster-data/master-0/data/instance:
uuid: "556016f8dbb94142be749948f9917588"
format_stamp: "Formatted at 2026-09-27 15:12:17 on dist-test-slave-5s2t"
server_key: "0cf8d0cc34a6529b2e3a2f13def3a700"
server_key_iv: "f02e6ec635fbe90f536bfcd0fd437f78"
server_key_version: "encryptionkey@0"
I20260927 15:12:17.222358 20855 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1790521920546562-17952-0/minicluster-data/master-0/wal/instance:
uuid: "556016f8dbb94142be749948f9917588"
format_stamp: "Formatted at 2026-09-27 15:12:17 on dist-test-slave-5s2t"
server_key: "0cf8d0cc34a6529b2e3a2f13def3a700"
server_key_iv: "f02e6ec635fbe90f536bfcd0fd437f78"
server_key_version: "encryptionkey@0"
I20260927 15:12:17.225885 20855 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.004s
I20260927 15:12:17.228170 20870 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260927 15:12:17.229415 20855 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260927 15:12:17.229524 20855 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1790521920546562-17952-0/minicluster-data/master-0/data,/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1790521920546562-17952-0/minicluster-data/master-0/wal
uuid: "556016f8dbb94142be749948f9917588"
format_stamp: "Formatted at 2026-09-27 15:12:17 on dist-test-slave-5s2t"
server_key: "0cf8d0cc34a6529b2e3a2f13def3a700"
server_key_iv: "f02e6ec635fbe90f536bfcd0fd437f78"
server_key_version: "encryptionkey@0"
I20260927 15:12:17.229607 20855 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1790521920546562-17952-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1790521920546562-17952-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1790521920546562-17952-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260927 15:12:17.248317 20855 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260927 15:12:17.251145 20855 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260927 15:12:17.251327 20855 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260927 15:12:17.257680 20855 rpc_server.cc:307] RPC server started. Bound to: 127.17.136.62:40053
I20260927 15:12:17.257916 20922 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.136.62:40053 every 8 connection(s)
I20260927 15:12:17.258599 20855 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1790521920546562-17952-0/minicluster-data/master-0/data/info.pb
I20260927 15:12:17.261196 20923 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:12:17.263787 17952 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu as pid 20855
I20260927 15:12:17.263911 17952 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1790521920546562-17952-0/minicluster-data/master-0/wal/instance
I20260927 15:12:17.264199 17952 external_mini_cluster.cc:1428] Setting key 26d2fae61e8c78b104100539f4d98d2a
I20260927 15:12:17.266990 20923 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 556016f8dbb94142be749948f9917588: Bootstrap starting.
I20260927 15:12:17.269440 20923 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 556016f8dbb94142be749948f9917588: Neither blocks nor log segments found. Creating new log.
I20260927 15:12:17.270246 20923 log.cc:824] T 00000000000000000000000000000000 P 556016f8dbb94142be749948f9917588: Log is configured to *not* fsync() on all Append() calls
I20260927 15:12:17.272073 20923 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 556016f8dbb94142be749948f9917588: No bootstrap required, opened a new log
Sep 27 15:12:17 dist-test-slave-5s2t krb5kdc[20842](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790521937, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.136.62@KRBTEST.COM
I20260927 15:12:17.275650 20923 raft_consensus.cc:348] T 00000000000000000000000000000000 P 556016f8dbb94142be749948f9917588 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "556016f8dbb94142be749948f9917588" member_type: VOTER last_known_addr { host: "127.17.136.62" port: 40053 } }
I20260927 15:12:17.275910 20923 raft_consensus.cc:374] T 00000000000000000000000000000000 P 556016f8dbb94142be749948f9917588 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:12:17.275971 20923 raft_consensus.cc:729] T 00000000000000000000000000000000 P 556016f8dbb94142be749948f9917588 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 556016f8dbb94142be749948f9917588, State: Initialized, Role: FOLLOWER
I20260927 15:12:17.276430 20923 consensus_queue.cc:260] T 00000000000000000000000000000000 P 556016f8dbb94142be749948f9917588 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "556016f8dbb94142be749948f9917588" member_type: VOTER last_known_addr { host: "127.17.136.62" port: 40053 } }
I20260927 15:12:17.276593 20923 raft_consensus.cc:388] T 00000000000000000000000000000000 P 556016f8dbb94142be749948f9917588 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260927 15:12:17.276664 20923 raft_consensus.cc:482] T 00000000000000000000000000000000 P 556016f8dbb94142be749948f9917588 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260927 15:12:17.276760 20923 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 556016f8dbb94142be749948f9917588 [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:12:17.277623 20923 raft_consensus.cc:504] T 00000000000000000000000000000000 P 556016f8dbb94142be749948f9917588 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "556016f8dbb94142be749948f9917588" member_type: VOTER last_known_addr { host: "127.17.136.62" port: 40053 } }
I20260927 15:12:17.277930 20923 leader_election.cc:302] T 00000000000000000000000000000000 P 556016f8dbb94142be749948f9917588 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 556016f8dbb94142be749948f9917588; no voters:
I20260927 15:12:17.278074 20926 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:17.265450 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60400 (local address 127.17.136.62:40053)
0927 15:12:17.265836 (+ 386us) server_negotiation.cc:206] Beginning negotiation
0927 15:12:17.265854 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0927 15:12:17.265888 (+ 34us) server_negotiation.cc:407] Connection header received
0927 15:12:17.266497 (+ 609us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:12:17.266513 (+ 16us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:12:17.266838 (+ 325us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:12:17.267135 (+ 297us) server_negotiation.cc:226] Negotiated authn=SASL
0927 15:12:17.267952 (+ 817us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:17.268945 (+ 993us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:17.270033 (+ 1088us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:17.270521 (+ 488us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:17.270662 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:17.272964 (+ 2302us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0927 15:12:17.272970 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0927 15:12:17.272986 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0927 15:12:17.273022 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0927 15:12:17.275314 (+ 2292us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:12:17.275696 (+ 382us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:12:17.275702 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:12:17.275707 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:12:17.275833 (+ 126us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:12:17.276079 (+ 246us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:12:17.276082 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:12:17.276084 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:12:17.276541 (+ 457us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0927 15:12:17.276737 (+ 196us) server_negotiation.cc:1035] Waiting for connection context
0927 15:12:17.277081 (+ 344us) server_negotiation.cc:299] Negotiation successful
0927 15:12:17.277330 (+ 249us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":252,"thread_start_us":109,"threads_started":1}
I20260927 15:12:17.278187 20923 leader_election.cc:288] T 00000000000000000000000000000000 P 556016f8dbb94142be749948f9917588 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260927 15:12:17.278316 20928 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 556016f8dbb94142be749948f9917588 [term 1 FOLLOWER]: Leader election won for term 1
I20260927 15:12:17.278519 20928 raft_consensus.cc:686] T 00000000000000000000000000000000 P 556016f8dbb94142be749948f9917588 [term 1 LEADER]: Becoming Leader. State: Replica: 556016f8dbb94142be749948f9917588, State: Running, Role: LEADER
I20260927 15:12:17.278853 20928 consensus_queue.cc:237] T 00000000000000000000000000000000 P 556016f8dbb94142be749948f9917588 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "556016f8dbb94142be749948f9917588" member_type: VOTER last_known_addr { host: "127.17.136.62" port: 40053 } }
I20260927 15:12:17.279348 20923 sys_catalog.cc:564] T 00000000000000000000000000000000 P 556016f8dbb94142be749948f9917588 [sys.catalog]: configured and running, proceeding with master startup.
I20260927 15:12:17.279984 20930 sys_catalog.cc:455] T 00000000000000000000000000000000 P 556016f8dbb94142be749948f9917588 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 556016f8dbb94142be749948f9917588. Latest consensus state: current_term: 1 leader_uuid: "556016f8dbb94142be749948f9917588" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "556016f8dbb94142be749948f9917588" member_type: VOTER last_known_addr { host: "127.17.136.62" port: 40053 } } }
I20260927 15:12:17.280097 20930 sys_catalog.cc:458] T 00000000000000000000000000000000 P 556016f8dbb94142be749948f9917588 [sys.catalog]: This master's current role is: LEADER
I20260927 15:12:17.280352 20929 sys_catalog.cc:455] T 00000000000000000000000000000000 P 556016f8dbb94142be749948f9917588 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "556016f8dbb94142be749948f9917588" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "556016f8dbb94142be749948f9917588" member_type: VOTER last_known_addr { host: "127.17.136.62" port: 40053 } } }
I20260927 15:12:17.280575 20929 sys_catalog.cc:458] T 00000000000000000000000000000000 P 556016f8dbb94142be749948f9917588 [sys.catalog]: This master's current role is: LEADER
I20260927 15:12:17.280877 20936 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260927 15:12:17.281104 17952 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260927 15:12:17.283890 20936 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260927 15:12:17.289003 20936 catalog_manager.cc:1347] Generated new cluster ID: cc5dad3e9720400b9a977ef73ef05eae
I20260927 15:12:17.289060 20936 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260927 15:12:17.300769 20926 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:17.294165 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60404 (local address 127.17.136.62:40053)
0927 15:12:17.294268 (+ 103us) server_negotiation.cc:206] Beginning negotiation
0927 15:12:17.294272 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0927 15:12:17.295518 (+ 1246us) server_negotiation.cc:407] Connection header received
0927 15:12:17.295636 (+ 118us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:12:17.295639 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:12:17.295689 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:12:17.295778 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0927 15:12:17.296286 (+ 508us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:17.297111 (+ 825us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:17.298176 (+ 1065us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:17.298525 (+ 349us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:17.298614 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:17.299708 (+ 1094us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0927 15:12:17.299730 (+ 22us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0927 15:12:17.299733 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0927 15:12:17.300272 (+ 539us) server_negotiation.cc:922] calling sasl_server_start()
0927 15:12:17.300313 (+ 41us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0927 15:12:17.300332 (+ 19us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0927 15:12:17.300392 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0927 15:12:17.300572 (+ 180us) server_negotiation.cc:299] Negotiation successful
0927 15:12:17.300633 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260927 15:12:17.307193 20936 catalog_manager.cc:1370] Generated new certificate authority record
I20260927 15:12:17.308211 20936 catalog_manager.cc:1504] Loading token signing keys...
I20260927 15:12:17.314845 20936 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 556016f8dbb94142be749948f9917588: Generated new TSK 0
I20260927 15:12:17.315685 20936 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260927 15:12:17.321260 17952 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu with pid 20855
2026-09-27T15:12:17Z chronyd exiting
[ OK ] SecurityITest.SaslPlainFallback (1297 ms)
[ RUN ] SecurityITest.TestUnauthorizedClientKerberosCredentials
Loading random data
Initializing database '/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790521920546562-17952-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 27 15:12:17 dist-test-slave-5s2t krb5kdc[20956](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 27 15:12:17 dist-test-slave-5s2t krb5kdc[20956](info): set up 2 sockets
Sep 27 15:12:17 dist-test-slave-5s2t krb5kdc[20956](info): commencing operation
krb5kdc: starting...
W20260927 15:12:18.286922 17952 mini_kdc.cc:121] Time spent starting KDC: real 0.948s user 0.004s sys 0.001s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790521920546562-17952-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790521920546562-17952-0/krb5kdc/test-user.keytab.
Sep 27 15:12:18 dist-test-slave-5s2t krb5kdc[20956](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790521938, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-27T15:12:18Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-27T15:12:18Z Disabled control of system clock
WARNING: no policy specified for kudu/127.17.136.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.136.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.136.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790521920546562-17952-0/krb5kdc/kudu_127.17.136.62.keytab.
Entry for principal kudu/127.17.136.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790521920546562-17952-0/krb5kdc/kudu_127.17.136.62.keytab.
I20260927 15:12:18.402613 17952 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu
/tmp/dist-test-taskiFOyeW/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790521920546562-17952-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790521920546562-17952-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790521920546562-17952-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790521920546562-17952-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.136.62:35505
--webserver_interface=127.17.136.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790521920546562-17952-0/krb5kdc/kudu_127.17.136.62.keytab
--principal=kudu/127.17.136.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.136.20:46007
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.136.62:35505
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790521920546562-17952-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790521920546562-17952-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790521920546562-17952-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260927 15:12:18.507359 20969 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260927 15:12:18.507615 20969 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260927 15:12:18.507670 20969 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260927 15:12:18.511665 20969 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260927 15:12:18.511716 20969 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260927 15:12:18.511741 20969 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260927 15:12:18.511760 20969 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260927 15:12:18.511781 20969 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260927 15:12:18.516914 20969 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.136.20:46007
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790521920546562-17952-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790521920546562-17952-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.17.136.62:35505
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790521920546562-17952-0/krb5kdc/kudu_127.17.136.62.keytab
--principal=kudu/127.17.136.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.136.62:35505
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790521920546562-17952-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.17.136.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20969
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790521920546562-17952-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 27 Sep 2026 14:27:13 UTC on ccycloud.quasar-psqrth.root.comops.site
build id 4676138
I20260927 15:12:18.517906 20969 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260927 15:12:18.518869 20969 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260927 15:12:18.526872 20977 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260927 15:12:18.526998 20969 server_base.cc:1034] running on GCE node
W20260927 15:12:18.527055 20974 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260927 15:12:18.526880 20975 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260927 15:12:18.527704 20969 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260927 15:12:18.528723 20969 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260927 15:12:18.529886 20969 hybrid_clock.cc:648] HybridClock initialized: now 1790521938529869 us; error 32 us; skew 500 ppm
Sep 27 15:12:18 dist-test-slave-5s2t krb5kdc[20956](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790521938, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.136.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260927 15:12:18.532480 20969 init.cc:377] Logged in from keytab as kudu/127.17.136.62@KRBTEST.COM (short username kudu)
I20260927 15:12:18.533329 20969 webserver.cc:460] Webserver started at http://127.17.136.62:37853/ using document root <none> and password file <none>
I20260927 15:12:18.533839 20969 fs_manager.cc:359] Metadata directory not provided
I20260927 15:12:18.533902 20969 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260927 15:12:18.534088 20969 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260927 15:12:18.536057 20969 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790521920546562-17952-0/minicluster-data/master-0/data/instance:
uuid: "a2971d58002845ecb207568427def4d8"
format_stamp: "Formatted at 2026-09-27 15:12:18 on dist-test-slave-5s2t"
server_key: "db5c559b958a1e9be861ebd804a06803"
server_key_iv: "47391f1e465392f1ccb35e6b560c5c5e"
server_key_version: "encryptionkey@0"
I20260927 15:12:18.536571 20969 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790521920546562-17952-0/minicluster-data/master-0/wal/instance:
uuid: "a2971d58002845ecb207568427def4d8"
format_stamp: "Formatted at 2026-09-27 15:12:18 on dist-test-slave-5s2t"
server_key: "db5c559b958a1e9be861ebd804a06803"
server_key_iv: "47391f1e465392f1ccb35e6b560c5c5e"
server_key_version: "encryptionkey@0"
I20260927 15:12:18.540058 20969 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260927 15:12:18.542271 20984 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260927 15:12:18.543499 20969 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260927 15:12:18.543615 20969 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790521920546562-17952-0/minicluster-data/master-0/data,/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790521920546562-17952-0/minicluster-data/master-0/wal
uuid: "a2971d58002845ecb207568427def4d8"
format_stamp: "Formatted at 2026-09-27 15:12:18 on dist-test-slave-5s2t"
server_key: "db5c559b958a1e9be861ebd804a06803"
server_key_iv: "47391f1e465392f1ccb35e6b560c5c5e"
server_key_version: "encryptionkey@0"
I20260927 15:12:18.543701 20969 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790521920546562-17952-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790521920546562-17952-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790521920546562-17952-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260927 15:12:18.554610 20969 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260927 15:12:18.557216 20969 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260927 15:12:18.557371 20969 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260927 15:12:18.563639 20969 rpc_server.cc:307] RPC server started. Bound to: 127.17.136.62:35505
I20260927 15:12:18.563880 21036 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.136.62:35505 every 8 connection(s)
I20260927 15:12:18.564517 20969 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790521920546562-17952-0/minicluster-data/master-0/data/info.pb
I20260927 15:12:18.566977 21037 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:12:18.568171 17952 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu as pid 20969
I20260927 15:12:18.568285 17952 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790521920546562-17952-0/minicluster-data/master-0/wal/instance
I20260927 15:12:18.568595 17952 external_mini_cluster.cc:1428] Setting key f1767fb1bfa034b1c24bc1f22e8a4229
I20260927 15:12:18.572993 21037 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a2971d58002845ecb207568427def4d8: Bootstrap starting.
I20260927 15:12:18.575371 21037 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a2971d58002845ecb207568427def4d8: Neither blocks nor log segments found. Creating new log.
I20260927 15:12:18.576171 21037 log.cc:824] T 00000000000000000000000000000000 P a2971d58002845ecb207568427def4d8: Log is configured to *not* fsync() on all Append() calls
Sep 27 15:12:18 dist-test-slave-5s2t krb5kdc[20956](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790521938, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.136.62@KRBTEST.COM
I20260927 15:12:18.578190 21037 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a2971d58002845ecb207568427def4d8: No bootstrap required, opened a new log
I20260927 15:12:18.582010 21037 raft_consensus.cc:348] T 00000000000000000000000000000000 P a2971d58002845ecb207568427def4d8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a2971d58002845ecb207568427def4d8" member_type: VOTER last_known_addr { host: "127.17.136.62" port: 35505 } }
I20260927 15:12:18.582228 21037 raft_consensus.cc:374] T 00000000000000000000000000000000 P a2971d58002845ecb207568427def4d8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:12:18.582283 21037 raft_consensus.cc:729] T 00000000000000000000000000000000 P a2971d58002845ecb207568427def4d8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a2971d58002845ecb207568427def4d8, State: Initialized, Role: FOLLOWER
I20260927 15:12:18.582367 21040 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:18.569830 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49154 (local address 127.17.136.62:35505)
0927 15:12:18.570216 (+ 386us) server_negotiation.cc:206] Beginning negotiation
0927 15:12:18.570231 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0927 15:12:18.570265 (+ 34us) server_negotiation.cc:407] Connection header received
0927 15:12:18.571063 (+ 798us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:12:18.571084 (+ 21us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:12:18.571443 (+ 359us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:12:18.571735 (+ 292us) server_negotiation.cc:226] Negotiated authn=SASL
0927 15:12:18.572588 (+ 853us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:18.573617 (+ 1029us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:18.574771 (+ 1154us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:18.575313 (+ 542us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:18.575432 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:18.578066 (+ 2634us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0927 15:12:18.578071 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0927 15:12:18.578084 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0927 15:12:18.578109 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0927 15:12:18.579695 (+ 1586us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:12:18.580157 (+ 462us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:12:18.580161 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:12:18.580165 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:12:18.580265 (+ 100us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:12:18.580533 (+ 268us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:12:18.580535 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:12:18.580536 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:12:18.580895 (+ 359us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0927 15:12:18.581042 (+ 147us) server_negotiation.cc:1035] Waiting for connection context
0927 15:12:18.581308 (+ 266us) server_negotiation.cc:299] Negotiation successful
0927 15:12:18.581566 (+ 258us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":259,"thread_start_us":126,"threads_started":1}
I20260927 15:12:18.582805 21037 consensus_queue.cc:260] T 00000000000000000000000000000000 P a2971d58002845ecb207568427def4d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a2971d58002845ecb207568427def4d8" member_type: VOTER last_known_addr { host: "127.17.136.62" port: 35505 } }
I20260927 15:12:18.582983 21037 raft_consensus.cc:388] T 00000000000000000000000000000000 P a2971d58002845ecb207568427def4d8 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260927 15:12:18.583045 21037 raft_consensus.cc:482] T 00000000000000000000000000000000 P a2971d58002845ecb207568427def4d8 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260927 15:12:18.583132 21037 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a2971d58002845ecb207568427def4d8 [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:12:18.584028 21037 raft_consensus.cc:504] T 00000000000000000000000000000000 P a2971d58002845ecb207568427def4d8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a2971d58002845ecb207568427def4d8" member_type: VOTER last_known_addr { host: "127.17.136.62" port: 35505 } }
I20260927 15:12:18.584337 21037 leader_election.cc:302] T 00000000000000000000000000000000 P a2971d58002845ecb207568427def4d8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a2971d58002845ecb207568427def4d8; no voters:
I20260927 15:12:18.584659 21037 leader_election.cc:288] T 00000000000000000000000000000000 P a2971d58002845ecb207568427def4d8 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260927 15:12:18.584748 21042 raft_consensus.cc:2781] T 00000000000000000000000000000000 P a2971d58002845ecb207568427def4d8 [term 1 FOLLOWER]: Leader election won for term 1
I20260927 15:12:18.584940 21042 raft_consensus.cc:686] T 00000000000000000000000000000000 P a2971d58002845ecb207568427def4d8 [term 1 LEADER]: Becoming Leader. State: Replica: a2971d58002845ecb207568427def4d8, State: Running, Role: LEADER
I20260927 15:12:18.585242 21042 consensus_queue.cc:237] T 00000000000000000000000000000000 P a2971d58002845ecb207568427def4d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a2971d58002845ecb207568427def4d8" member_type: VOTER last_known_addr { host: "127.17.136.62" port: 35505 } }
I20260927 15:12:18.585731 21037 sys_catalog.cc:564] T 00000000000000000000000000000000 P a2971d58002845ecb207568427def4d8 [sys.catalog]: configured and running, proceeding with master startup.
I20260927 15:12:18.586671 21043 sys_catalog.cc:455] T 00000000000000000000000000000000 P a2971d58002845ecb207568427def4d8 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "a2971d58002845ecb207568427def4d8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a2971d58002845ecb207568427def4d8" member_type: VOTER last_known_addr { host: "127.17.136.62" port: 35505 } } }
I20260927 15:12:18.586787 21043 sys_catalog.cc:458] T 00000000000000000000000000000000 P a2971d58002845ecb207568427def4d8 [sys.catalog]: This master's current role is: LEADER
I20260927 15:12:18.587028 21044 sys_catalog.cc:455] T 00000000000000000000000000000000 P a2971d58002845ecb207568427def4d8 [sys.catalog]: SysCatalogTable state changed. Reason: New leader a2971d58002845ecb207568427def4d8. Latest consensus state: current_term: 1 leader_uuid: "a2971d58002845ecb207568427def4d8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a2971d58002845ecb207568427def4d8" member_type: VOTER last_known_addr { host: "127.17.136.62" port: 35505 } } }
I20260927 15:12:18.587101 21044 sys_catalog.cc:458] T 00000000000000000000000000000000 P a2971d58002845ecb207568427def4d8 [sys.catalog]: This master's current role is: LEADER
I20260927 15:12:18.587123 21051 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260927 15:12:18.589829 21051 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260927 15:12:18.600495 21051 catalog_manager.cc:1347] Generated new cluster ID: 5da13e0b32a740aa82ff08b9a28ae442
I20260927 15:12:18.600564 21051 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260927 15:12:18.614216 21051 catalog_manager.cc:1370] Generated new certificate authority record
I20260927 15:12:18.615119 21051 catalog_manager.cc:1504] Loading token signing keys...
I20260927 15:12:18.620019 21051 catalog_manager.cc:5868] T 00000000000000000000000000000000 P a2971d58002845ecb207568427def4d8: Generated new TSK 0
I20260927 15:12:18.620644 21051 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.17.136.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.136.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.136.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790521920546562-17952-0/krb5kdc/kudu_127.17.136.1.keytab.
Entry for principal kudu/127.17.136.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790521920546562-17952-0/krb5kdc/kudu_127.17.136.1.keytab.
I20260927 15:12:18.654109 17952 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu
/tmp/dist-test-taskiFOyeW/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790521920546562-17952-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790521920546562-17952-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790521920546562-17952-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790521920546562-17952-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.136.1:0
--local_ip_for_outbound_sockets=127.17.136.1
--webserver_interface=127.17.136.1
--webserver_port=0
--tserver_master_addrs=127.17.136.62:35505
--keytab_file=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790521920546562-17952-0/krb5kdc/kudu_127.17.136.1.keytab
--principal=kudu/127.17.136.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.136.20:46007
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790521920546562-17952-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790521920546562-17952-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790521920546562-17952-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260927 15:12:18.759927 21063 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260927 15:12:18.760190 21063 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260927 15:12:18.760231 21063 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260927 15:12:18.764165 21063 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260927 15:12:18.764222 21063 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260927 15:12:18.764281 21063 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.136.1
I20260927 15:12:18.769651 21063 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.136.20:46007
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790521920546562-17952-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790521920546562-17952-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790521920546562-17952-0/krb5kdc/kudu_127.17.136.1.keytab
--principal=kudu/127.17.136.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.136.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790521920546562-17952-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.17.136.1
--webserver_port=0
--tserver_master_addrs=127.17.136.62:35505
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21063
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.136.1
--log_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790521920546562-17952-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 27 Sep 2026 14:27:13 UTC on ccycloud.quasar-psqrth.root.comops.site
build id 4676138
I20260927 15:12:18.770656 21063 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260927 15:12:18.771695 21063 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260927 15:12:18.780789 21063 server_base.cc:1034] running on GCE node
W20260927 15:12:18.780743 21068 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260927 15:12:18.780745 21071 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260927 15:12:18.780809 21069 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260927 15:12:18.781400 21063 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260927 15:12:18.781980 21063 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260927 15:12:18.783143 21063 hybrid_clock.cc:648] HybridClock initialized: now 1790521938783130 us; error 32 us; skew 500 ppm
Sep 27 15:12:18 dist-test-slave-5s2t krb5kdc[20956](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790521938, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.136.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260927 15:12:18.785612 21063 init.cc:377] Logged in from keytab as kudu/127.17.136.1@KRBTEST.COM (short username kudu)
I20260927 15:12:18.786446 21063 webserver.cc:460] Webserver started at http://127.17.136.1:44643/ using document root <none> and password file <none>
I20260927 15:12:18.786962 21063 fs_manager.cc:359] Metadata directory not provided
I20260927 15:12:18.787047 21063 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260927 15:12:18.787225 21063 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260927 15:12:18.789167 21063 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790521920546562-17952-0/minicluster-data/ts-0/data/instance:
uuid: "698002f1eb344e80b220872300c4a58b"
format_stamp: "Formatted at 2026-09-27 15:12:18 on dist-test-slave-5s2t"
server_key: "ae98e0671f6c0202548e85d72629f939"
server_key_iv: "d5528ea0519568c724d71ec66a419247"
server_key_version: "encryptionkey@0"
I20260927 15:12:18.789644 21063 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790521920546562-17952-0/minicluster-data/ts-0/wal/instance:
uuid: "698002f1eb344e80b220872300c4a58b"
format_stamp: "Formatted at 2026-09-27 15:12:18 on dist-test-slave-5s2t"
server_key: "ae98e0671f6c0202548e85d72629f939"
server_key_iv: "d5528ea0519568c724d71ec66a419247"
server_key_version: "encryptionkey@0"
I20260927 15:12:18.793062 21063 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.002s
I20260927 15:12:18.795243 21078 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260927 15:12:18.796456 21063 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260927 15:12:18.796555 21063 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790521920546562-17952-0/minicluster-data/ts-0/data,/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790521920546562-17952-0/minicluster-data/ts-0/wal
uuid: "698002f1eb344e80b220872300c4a58b"
format_stamp: "Formatted at 2026-09-27 15:12:18 on dist-test-slave-5s2t"
server_key: "ae98e0671f6c0202548e85d72629f939"
server_key_iv: "d5528ea0519568c724d71ec66a419247"
server_key_version: "encryptionkey@0"
I20260927 15:12:18.796648 21063 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790521920546562-17952-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790521920546562-17952-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790521920546562-17952-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260927 15:12:18.806905 21063 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260927 15:12:18.810051 21063 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260927 15:12:18.810221 21063 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260927 15:12:18.810762 21063 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260927 15:12:18.811586 21063 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260927 15:12:18.811643 21063 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260927 15:12:18.811685 21063 ts_tablet_manager.cc:610] Registered 0 tablets
I20260927 15:12:18.811714 21063 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260927 15:12:18.819720 21063 rpc_server.cc:307] RPC server started. Bound to: 127.17.136.1:39545
I20260927 15:12:18.819772 21191 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.136.1:39545 every 8 connection(s)
I20260927 15:12:18.820605 21063 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790521920546562-17952-0/minicluster-data/ts-0/data/info.pb
Sep 27 15:12:18 dist-test-slave-5s2t krb5kdc[20956](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790521938, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.136.1@KRBTEST.COM for kudu/127.17.136.62@KRBTEST.COM
I20260927 15:12:18.829850 17952 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu as pid 21063
I20260927 15:12:18.829948 17952 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790521920546562-17952-0/minicluster-data/ts-0/wal/instance
I20260927 15:12:18.830215 17952 external_mini_cluster.cc:1428] Setting key 84b2ca4d354628287ea4affd0c03d313
I20260927 15:12:18.833439 21040 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:18.822322 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.136.1:33497 (local address 127.17.136.62:35505)
0927 15:12:18.822444 (+ 122us) server_negotiation.cc:206] Beginning negotiation
0927 15:12:18.822447 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0927 15:12:18.823293 (+ 846us) server_negotiation.cc:407] Connection header received
0927 15:12:18.824632 (+ 1339us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:12:18.824635 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:12:18.824689 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:12:18.824764 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0927 15:12:18.825885 (+ 1121us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:18.826406 (+ 521us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:18.827524 (+ 1118us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:18.827749 (+ 225us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:18.827835 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:18.830107 (+ 2272us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0927 15:12:18.830110 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0927 15:12:18.830112 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0927 15:12:18.830135 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0927 15:12:18.831638 (+ 1503us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:12:18.832091 (+ 453us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:12:18.832095 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:12:18.832097 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:12:18.832170 (+ 73us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:12:18.832459 (+ 289us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:12:18.832463 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:12:18.832465 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:12:18.832632 (+ 167us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0927 15:12:18.832715 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0927 15:12:18.833175 (+ 460us) server_negotiation.cc:299] Negotiation successful
0927 15:12:18.833285 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260927 15:12:18.834245 21194 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:18.822724 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.62:35505 (local address 127.17.136.1:33497)
0927 15:12:18.823150 (+ 426us) negotiation.cc:107] Waiting for socket to connect
0927 15:12:18.823192 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0927 15:12:18.824412 (+ 1220us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0927 15:12:18.824942 (+ 530us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0927 15:12:18.824949 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0927 15:12:18.825290 (+ 341us) client_negotiation.cc:189] Negotiated authn=SASL
0927 15:12:18.825752 (+ 462us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:12:18.825764 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:12:18.826523 (+ 759us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:12:18.826525 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:12:18.827420 (+ 895us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:12:18.827428 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:12:18.827880 (+ 452us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:12:18.827883 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:12:18.828037 (+ 154us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:18.828542 (+ 505us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0927 15:12:18.828557 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0927 15:12:18.829905 (+ 1348us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0927 15:12:18.831740 (+ 1835us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0927 15:12:18.831746 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0927 15:12:18.831760 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0927 15:12:18.832003 (+ 243us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0927 15:12:18.832245 (+ 242us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0927 15:12:18.832248 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0927 15:12:18.832250 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0927 15:12:18.832378 (+ 128us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0927 15:12:18.832724 (+ 346us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0927 15:12:18.832730 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0927 15:12:18.832966 (+ 236us) client_negotiation.cc:769] Sending connection context
0927 15:12:18.833124 (+ 158us) client_negotiation.cc:240] Negotiation successful
0927 15:12:18.833432 (+ 308us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":244,"thread_start_us":109,"threads_started":1}
I20260927 15:12:18.835409 21192 heartbeater.cc:347] Connected to a master server at 127.17.136.62:35505
I20260927 15:12:18.835652 21192 heartbeater.cc:464] Registering TS with master...
I20260927 15:12:18.836220 21192 heartbeater.cc:511] Master 127.17.136.62:35505 requested a full tablet report, sending...
I20260927 15:12:18.837828 21001 ts_manager.cc:194] Registered new tserver with Master: 698002f1eb344e80b220872300c4a58b (127.17.136.1:39545)
WARNING: no policy specified for kudu/127.17.136.2@KRBTEST.COM; defaulting to no policy
I20260927 15:12:18.839371 21001 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.136.1@KRBTEST.COM'} at 127.17.136.1:33497
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.136.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.136.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790521920546562-17952-0/krb5kdc/kudu_127.17.136.2.keytab.
Entry for principal kudu/127.17.136.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790521920546562-17952-0/krb5kdc/kudu_127.17.136.2.keytab.
I20260927 15:12:18.854990 17952 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu
/tmp/dist-test-taskiFOyeW/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790521920546562-17952-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790521920546562-17952-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790521920546562-17952-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790521920546562-17952-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.136.2:0
--local_ip_for_outbound_sockets=127.17.136.2
--webserver_interface=127.17.136.2
--webserver_port=0
--tserver_master_addrs=127.17.136.62:35505
--keytab_file=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790521920546562-17952-0/krb5kdc/kudu_127.17.136.2.keytab
--principal=kudu/127.17.136.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.136.20:46007
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790521920546562-17952-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790521920546562-17952-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790521920546562-17952-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260927 15:12:18.960542 21197 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260927 15:12:18.960759 21197 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260927 15:12:18.960798 21197 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260927 15:12:18.964627 21197 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260927 15:12:18.964671 21197 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260927 15:12:18.964725 21197 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.136.2
I20260927 15:12:18.969669 21197 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.136.20:46007
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790521920546562-17952-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790521920546562-17952-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790521920546562-17952-0/krb5kdc/kudu_127.17.136.2.keytab
--principal=kudu/127.17.136.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.136.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790521920546562-17952-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.17.136.2
--webserver_port=0
--tserver_master_addrs=127.17.136.62:35505
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21197
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.136.2
--log_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790521920546562-17952-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 27 Sep 2026 14:27:13 UTC on ccycloud.quasar-psqrth.root.comops.site
build id 4676138
I20260927 15:12:18.970538 21197 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260927 15:12:18.971427 21197 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260927 15:12:18.980189 21202 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260927 15:12:18.980204 21203 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260927 15:12:18.980197 21205 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260927 15:12:18.980263 21197 server_base.cc:1034] running on GCE node
I20260927 15:12:18.980695 21197 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260927 15:12:18.981268 21197 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260927 15:12:18.982427 21197 hybrid_clock.cc:648] HybridClock initialized: now 1790521938982403 us; error 35 us; skew 500 ppm
Sep 27 15:12:18 dist-test-slave-5s2t krb5kdc[20956](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790521938, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.136.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260927 15:12:18.985008 21197 init.cc:377] Logged in from keytab as kudu/127.17.136.2@KRBTEST.COM (short username kudu)
I20260927 15:12:18.985810 21197 webserver.cc:460] Webserver started at http://127.17.136.2:35197/ using document root <none> and password file <none>
I20260927 15:12:18.986383 21197 fs_manager.cc:359] Metadata directory not provided
I20260927 15:12:18.986447 21197 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260927 15:12:18.986606 21197 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260927 15:12:18.988579 21197 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790521920546562-17952-0/minicluster-data/ts-1/data/instance:
uuid: "fa53fd49e4ea4202bf4855bd9246515e"
format_stamp: "Formatted at 2026-09-27 15:12:18 on dist-test-slave-5s2t"
server_key: "86d64fa71513acb48cb3751dce6962c6"
server_key_iv: "404ea075113f2e4f32193b14b11fdd65"
server_key_version: "encryptionkey@0"
I20260927 15:12:18.989076 21197 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790521920546562-17952-0/minicluster-data/ts-1/wal/instance:
uuid: "fa53fd49e4ea4202bf4855bd9246515e"
format_stamp: "Formatted at 2026-09-27 15:12:18 on dist-test-slave-5s2t"
server_key: "86d64fa71513acb48cb3751dce6962c6"
server_key_iv: "404ea075113f2e4f32193b14b11fdd65"
server_key_version: "encryptionkey@0"
I20260927 15:12:18.992522 21197 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260927 15:12:18.994799 21212 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260927 15:12:18.996019 21197 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260927 15:12:18.996116 21197 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790521920546562-17952-0/minicluster-data/ts-1/data,/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790521920546562-17952-0/minicluster-data/ts-1/wal
uuid: "fa53fd49e4ea4202bf4855bd9246515e"
format_stamp: "Formatted at 2026-09-27 15:12:18 on dist-test-slave-5s2t"
server_key: "86d64fa71513acb48cb3751dce6962c6"
server_key_iv: "404ea075113f2e4f32193b14b11fdd65"
server_key_version: "encryptionkey@0"
I20260927 15:12:18.996207 21197 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790521920546562-17952-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790521920546562-17952-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790521920546562-17952-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260927 15:12:19.010851 21197 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260927 15:12:19.013530 21197 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260927 15:12:19.013687 21197 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260927 15:12:19.014235 21197 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260927 15:12:19.015002 21197 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260927 15:12:19.015043 21197 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260927 15:12:19.015086 21197 ts_tablet_manager.cc:610] Registered 0 tablets
I20260927 15:12:19.015115 21197 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260927 15:12:19.023051 21197 rpc_server.cc:307] RPC server started. Bound to: 127.17.136.2:40431
I20260927 15:12:19.023087 21325 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.136.2:40431 every 8 connection(s)
I20260927 15:12:19.023926 21197 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790521920546562-17952-0/minicluster-data/ts-1/data/info.pb
I20260927 15:12:19.030527 17952 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu as pid 21197
I20260927 15:12:19.030625 17952 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790521920546562-17952-0/minicluster-data/ts-1/wal/instance
I20260927 15:12:19.030908 17952 external_mini_cluster.cc:1428] Setting key acfc658d3f39869ea6995f37e44348ec
Sep 27 15:12:19 dist-test-slave-5s2t krb5kdc[20956](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790521938, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.136.2@KRBTEST.COM for kudu/127.17.136.62@KRBTEST.COM
I20260927 15:12:19.036809 21040 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:19.025622 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.136.2:60925 (local address 127.17.136.62:35505)
0927 15:12:19.025778 (+ 156us) server_negotiation.cc:206] Beginning negotiation
0927 15:12:19.025783 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0927 15:12:19.026627 (+ 844us) server_negotiation.cc:407] Connection header received
0927 15:12:19.027910 (+ 1283us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:12:19.027913 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:12:19.027994 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:12:19.028066 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0927 15:12:19.029165 (+ 1099us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:19.029679 (+ 514us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:19.030785 (+ 1106us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:19.031120 (+ 335us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:19.031220 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:19.033649 (+ 2429us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0927 15:12:19.033653 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0927 15:12:19.033655 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0927 15:12:19.033678 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0927 15:12:19.034908 (+ 1230us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:12:19.035383 (+ 475us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:12:19.035387 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:12:19.035388 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:12:19.035463 (+ 75us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:12:19.035766 (+ 303us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:12:19.035769 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:12:19.035771 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:12:19.035939 (+ 168us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0927 15:12:19.036018 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0927 15:12:19.036503 (+ 485us) server_negotiation.cc:299] Negotiation successful
0927 15:12:19.036653 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260927 15:12:19.037569 21328 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:19.026050 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.62:35505 (local address 127.17.136.2:60925)
0927 15:12:19.026482 (+ 432us) negotiation.cc:107] Waiting for socket to connect
0927 15:12:19.026526 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0927 15:12:19.027724 (+ 1198us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0927 15:12:19.028215 (+ 491us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0927 15:12:19.028222 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0927 15:12:19.028568 (+ 346us) client_negotiation.cc:189] Negotiated authn=SASL
0927 15:12:19.029037 (+ 469us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:12:19.029050 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:12:19.029766 (+ 716us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:12:19.029768 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:12:19.030678 (+ 910us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:12:19.030689 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:12:19.031289 (+ 600us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:12:19.031295 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:12:19.031476 (+ 181us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:19.031998 (+ 522us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0927 15:12:19.032032 (+ 34us) client_negotiation.cc:656] calling sasl_client_start()
0927 15:12:19.033447 (+ 1415us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0927 15:12:19.035016 (+ 1569us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0927 15:12:19.035021 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0927 15:12:19.035036 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0927 15:12:19.035300 (+ 264us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0927 15:12:19.035540 (+ 240us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0927 15:12:19.035543 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0927 15:12:19.035545 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0927 15:12:19.035678 (+ 133us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0927 15:12:19.036039 (+ 361us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0927 15:12:19.036045 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0927 15:12:19.036278 (+ 233us) client_negotiation.cc:769] Sending connection context
0927 15:12:19.036435 (+ 157us) client_negotiation.cc:240] Negotiation successful
0927 15:12:19.036751 (+ 316us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":248,"thread_start_us":121,"threads_started":1}
I20260927 15:12:19.038643 21326 heartbeater.cc:347] Connected to a master server at 127.17.136.62:35505
I20260927 15:12:19.038857 21326 heartbeater.cc:464] Registering TS with master...
WARNING: no policy specified for kudu/127.17.136.3@KRBTEST.COM; defaulting to no policy
I20260927 15:12:19.039350 21326 heartbeater.cc:511] Master 127.17.136.62:35505 requested a full tablet report, sending...
I20260927 15:12:19.040366 21001 ts_manager.cc:194] Registered new tserver with Master: fa53fd49e4ea4202bf4855bd9246515e (127.17.136.2:40431)
I20260927 15:12:19.040895 21001 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.136.2@KRBTEST.COM'} at 127.17.136.2:60925
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.136.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.136.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790521920546562-17952-0/krb5kdc/kudu_127.17.136.3.keytab.
Entry for principal kudu/127.17.136.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790521920546562-17952-0/krb5kdc/kudu_127.17.136.3.keytab.
I20260927 15:12:19.054891 17952 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu
/tmp/dist-test-taskiFOyeW/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790521920546562-17952-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790521920546562-17952-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790521920546562-17952-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790521920546562-17952-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.136.3:0
--local_ip_for_outbound_sockets=127.17.136.3
--webserver_interface=127.17.136.3
--webserver_port=0
--tserver_master_addrs=127.17.136.62:35505
--keytab_file=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790521920546562-17952-0/krb5kdc/kudu_127.17.136.3.keytab
--principal=kudu/127.17.136.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.136.20:46007
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790521920546562-17952-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790521920546562-17952-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790521920546562-17952-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260927 15:12:19.160806 21331 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260927 15:12:19.161048 21331 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260927 15:12:19.161087 21331 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260927 15:12:19.164908 21331 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260927 15:12:19.164953 21331 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260927 15:12:19.165006 21331 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.136.3
I20260927 15:12:19.169975 21331 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.136.20:46007
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790521920546562-17952-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790521920546562-17952-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790521920546562-17952-0/krb5kdc/kudu_127.17.136.3.keytab
--principal=kudu/127.17.136.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.136.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790521920546562-17952-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.17.136.3
--webserver_port=0
--tserver_master_addrs=127.17.136.62:35505
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21331
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.136.3
--log_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790521920546562-17952-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 27 Sep 2026 14:27:13 UTC on ccycloud.quasar-psqrth.root.comops.site
build id 4676138
I20260927 15:12:19.170881 21331 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260927 15:12:19.171821 21331 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260927 15:12:19.180891 21331 server_base.cc:1034] running on GCE node
W20260927 15:12:19.180800 21339 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260927 15:12:19.180801 21336 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260927 15:12:19.180785 21337 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260927 15:12:19.181437 21331 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260927 15:12:19.182003 21331 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260927 15:12:19.183161 21331 hybrid_clock.cc:648] HybridClock initialized: now 1790521939183128 us; error 37 us; skew 500 ppm
Sep 27 15:12:19 dist-test-slave-5s2t krb5kdc[20956](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790521939, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.136.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260927 15:12:19.185788 21331 init.cc:377] Logged in from keytab as kudu/127.17.136.3@KRBTEST.COM (short username kudu)
I20260927 15:12:19.186657 21331 webserver.cc:460] Webserver started at http://127.17.136.3:42047/ using document root <none> and password file <none>
I20260927 15:12:19.187187 21331 fs_manager.cc:359] Metadata directory not provided
I20260927 15:12:19.187273 21331 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260927 15:12:19.187469 21331 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260927 15:12:19.189356 21331 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790521920546562-17952-0/minicluster-data/ts-2/data/instance:
uuid: "1bb02fc7459249039466f450170576aa"
format_stamp: "Formatted at 2026-09-27 15:12:19 on dist-test-slave-5s2t"
server_key: "5ff22c87df25c145951f8822c2f1cd0e"
server_key_iv: "f99c08c7d7de7697543c08f2b4f6846f"
server_key_version: "encryptionkey@0"
I20260927 15:12:19.189854 21331 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790521920546562-17952-0/minicluster-data/ts-2/wal/instance:
uuid: "1bb02fc7459249039466f450170576aa"
format_stamp: "Formatted at 2026-09-27 15:12:19 on dist-test-slave-5s2t"
server_key: "5ff22c87df25c145951f8822c2f1cd0e"
server_key_iv: "f99c08c7d7de7697543c08f2b4f6846f"
server_key_version: "encryptionkey@0"
I20260927 15:12:19.193343 21331 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.002s
I20260927 15:12:19.195613 21346 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260927 15:12:19.196790 21331 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260927 15:12:19.196889 21331 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790521920546562-17952-0/minicluster-data/ts-2/data,/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790521920546562-17952-0/minicluster-data/ts-2/wal
uuid: "1bb02fc7459249039466f450170576aa"
format_stamp: "Formatted at 2026-09-27 15:12:19 on dist-test-slave-5s2t"
server_key: "5ff22c87df25c145951f8822c2f1cd0e"
server_key_iv: "f99c08c7d7de7697543c08f2b4f6846f"
server_key_version: "encryptionkey@0"
I20260927 15:12:19.197010 21331 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790521920546562-17952-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790521920546562-17952-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790521920546562-17952-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260927 15:12:19.220631 21331 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260927 15:12:19.223671 21331 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260927 15:12:19.223845 21331 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260927 15:12:19.224407 21331 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260927 15:12:19.225176 21331 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260927 15:12:19.225220 21331 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260927 15:12:19.225271 21331 ts_tablet_manager.cc:610] Registered 0 tablets
I20260927 15:12:19.225299 21331 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260927 15:12:19.233263 21331 rpc_server.cc:307] RPC server started. Bound to: 127.17.136.3:45553
I20260927 15:12:19.233294 21459 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.136.3:45553 every 8 connection(s)
I20260927 15:12:19.234118 21331 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790521920546562-17952-0/minicluster-data/ts-2/data/info.pb
I20260927 15:12:19.240067 17952 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu as pid 21331
I20260927 15:12:19.240170 17952 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790521920546562-17952-0/minicluster-data/ts-2/wal/instance
I20260927 15:12:19.240414 17952 external_mini_cluster.cc:1428] Setting key 75d806adf50feb6fbf35a208e8dbe724
Sep 27 15:12:19 dist-test-slave-5s2t krb5kdc[20956](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790521939, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.136.3@KRBTEST.COM for kudu/127.17.136.62@KRBTEST.COM
I20260927 15:12:19.246239 21040 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:19.235720 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.136.3:38349 (local address 127.17.136.62:35505)
0927 15:12:19.235843 (+ 123us) server_negotiation.cc:206] Beginning negotiation
0927 15:12:19.235847 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0927 15:12:19.236629 (+ 782us) server_negotiation.cc:407] Connection header received
0927 15:12:19.237881 (+ 1252us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:12:19.237884 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:12:19.237939 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:12:19.238018 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0927 15:12:19.239088 (+ 1070us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:19.239626 (+ 538us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:19.240767 (+ 1141us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:19.241020 (+ 253us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:19.241118 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:19.243464 (+ 2346us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0927 15:12:19.243467 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0927 15:12:19.243470 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0927 15:12:19.243492 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0927 15:12:19.244723 (+ 1231us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:12:19.245127 (+ 404us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:12:19.245130 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:12:19.245131 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:12:19.245196 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:12:19.245429 (+ 233us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:12:19.245431 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:12:19.245432 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:12:19.245594 (+ 162us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0927 15:12:19.245660 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0927 15:12:19.246046 (+ 386us) server_negotiation.cc:299] Negotiation successful
0927 15:12:19.246127 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260927 15:12:19.247004 21462 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:19.236104 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.62:35505 (local address 127.17.136.3:38349)
0927 15:12:19.236491 (+ 387us) negotiation.cc:107] Waiting for socket to connect
0927 15:12:19.236534 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0927 15:12:19.237686 (+ 1152us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0927 15:12:19.238177 (+ 491us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0927 15:12:19.238183 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0927 15:12:19.238511 (+ 328us) client_negotiation.cc:189] Negotiated authn=SASL
0927 15:12:19.238959 (+ 448us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:12:19.238976 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:12:19.239722 (+ 746us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:12:19.239725 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:12:19.240658 (+ 933us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:12:19.240667 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:12:19.241164 (+ 497us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:12:19.241168 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:12:19.241335 (+ 167us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:19.241853 (+ 518us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0927 15:12:19.241872 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0927 15:12:19.243319 (+ 1447us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0927 15:12:19.244810 (+ 1491us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0927 15:12:19.244814 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0927 15:12:19.244825 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0927 15:12:19.245057 (+ 232us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0927 15:12:19.245254 (+ 197us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0927 15:12:19.245256 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0927 15:12:19.245258 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0927 15:12:19.245370 (+ 112us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0927 15:12:19.245662 (+ 292us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0927 15:12:19.245666 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0927 15:12:19.245868 (+ 202us) client_negotiation.cc:769] Sending connection context
0927 15:12:19.246019 (+ 151us) client_negotiation.cc:240] Negotiation successful
0927 15:12:19.246244 (+ 225us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":222,"thread_start_us":106,"threads_started":1}
I20260927 15:12:19.247946 21460 heartbeater.cc:347] Connected to a master server at 127.17.136.62:35505
I20260927 15:12:19.248155 21460 heartbeater.cc:464] Registering TS with master...
I20260927 15:12:19.248582 21460 heartbeater.cc:511] Master 127.17.136.62:35505 requested a full tablet report, sending...
I20260927 15:12:19.249466 21001 ts_manager.cc:194] Registered new tserver with Master: 1bb02fc7459249039466f450170576aa (127.17.136.3:45553)
I20260927 15:12:19.249987 21001 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.136.3@KRBTEST.COM'} at 127.17.136.3:38349
I20260927 15:12:19.253737 17952 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Sep 27 15:12:19 dist-test-slave-5s2t krb5kdc[20956](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790521939, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for joe-interloper@KRBTEST.COM:
Sep 27 15:12:19 dist-test-slave-5s2t krb5kdc[20956](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790521939, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for kudu/127.17.136.62@KRBTEST.COM
I20260927 15:12:19.276471 21040 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:19.268538 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49156 (local address 127.17.136.62:35505)
0927 15:12:19.268689 (+ 151us) server_negotiation.cc:206] Beginning negotiation
0927 15:12:19.268694 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0927 15:12:19.268839 (+ 145us) server_negotiation.cc:407] Connection header received
0927 15:12:19.268948 (+ 109us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:12:19.268950 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:12:19.268995 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:12:19.269066 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0927 15:12:19.269685 (+ 619us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:19.270192 (+ 507us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:19.270917 (+ 725us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:19.271109 (+ 192us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:19.271171 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:19.273418 (+ 2247us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0927 15:12:19.273421 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0927 15:12:19.273423 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0927 15:12:19.273446 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0927 15:12:19.274955 (+ 1509us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:12:19.275339 (+ 384us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:12:19.275343 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:12:19.275345 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:12:19.275427 (+ 82us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:12:19.275656 (+ 229us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:12:19.275659 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:12:19.275661 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:12:19.275872 (+ 211us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0927 15:12:19.275994 (+ 122us) server_negotiation.cc:1035] Waiting for connection context
0927 15:12:19.276203 (+ 209us) server_negotiation.cc:299] Negotiation successful
0927 15:12:19.276305 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
W20260927 15:12:19.276808 21001 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.ConnectToMaster from {username='joe-interloper', principal='joe-interloper@KRBTEST.COM'} at 127.0.0.1:49156
I20260927 15:12:19.277590 17952 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu with pid 21063
I20260927 15:12:19.282420 17952 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu with pid 21197
I20260927 15:12:19.286685 17952 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu with pid 21331
I20260927 15:12:19.290817 17952 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu with pid 20969
2026-09-27T15:12:19Z chronyd exiting
[ OK ] SecurityITest.TestUnauthorizedClientKerberosCredentials (1970 ms)
[ RUN ] SecurityITest.TestAuthorizedSuperuser
Loading random data
Initializing database '/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790521920546562-17952-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 27 15:12:19 dist-test-slave-5s2t krb5kdc[21472](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 27 15:12:19 dist-test-slave-5s2t krb5kdc[21472](info): set up 2 sockets
Sep 27 15:12:19 dist-test-slave-5s2t krb5kdc[21472](info): commencing operation
krb5kdc: starting...
W20260927 15:12:20.230855 17952 mini_kdc.cc:121] Time spent starting KDC: real 0.921s user 0.004s sys 0.001s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790521920546562-17952-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790521920546562-17952-0/krb5kdc/test-user.keytab.
Sep 27 15:12:20 dist-test-slave-5s2t krb5kdc[21472](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790521940, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-27T15:12:20Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-27T15:12:20Z Disabled control of system clock
WARNING: no policy specified for kudu/127.17.136.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.136.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.136.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790521920546562-17952-0/krb5kdc/kudu_127.17.136.62.keytab.
Entry for principal kudu/127.17.136.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790521920546562-17952-0/krb5kdc/kudu_127.17.136.62.keytab.
I20260927 15:12:20.342386 17952 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu
/tmp/dist-test-taskiFOyeW/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790521920546562-17952-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790521920546562-17952-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790521920546562-17952-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790521920546562-17952-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.136.62:35817
--webserver_interface=127.17.136.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790521920546562-17952-0/krb5kdc/kudu_127.17.136.62.keytab
--principal=kudu/127.17.136.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.136.20:43759
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.136.62:35817
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790521920546562-17952-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790521920546562-17952-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790521920546562-17952-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260927 15:12:20.447213 21485 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260927 15:12:20.447465 21485 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260927 15:12:20.447504 21485 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260927 15:12:20.451413 21485 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260927 15:12:20.451463 21485 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260927 15:12:20.451480 21485 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260927 15:12:20.451495 21485 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260927 15:12:20.451508 21485 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260927 15:12:20.456670 21485 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.136.20:43759
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790521920546562-17952-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790521920546562-17952-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.17.136.62:35817
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790521920546562-17952-0/krb5kdc/kudu_127.17.136.62.keytab
--principal=kudu/127.17.136.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.136.62:35817
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790521920546562-17952-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.17.136.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21485
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790521920546562-17952-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 27 Sep 2026 14:27:13 UTC on ccycloud.quasar-psqrth.root.comops.site
build id 4676138
I20260927 15:12:20.457731 21485 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260927 15:12:20.458681 21485 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260927 15:12:20.466531 21490 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260927 15:12:20.466547 21493 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260927 15:12:20.466595 21491 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260927 15:12:20.466627 21485 server_base.cc:1034] running on GCE node
I20260927 15:12:20.467298 21485 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260927 15:12:20.468314 21485 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260927 15:12:20.469484 21485 hybrid_clock.cc:648] HybridClock initialized: now 1790521940469469 us; error 29 us; skew 500 ppm
Sep 27 15:12:20 dist-test-slave-5s2t krb5kdc[21472](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790521940, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.136.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260927 15:12:20.479848 21485 init.cc:377] Logged in from keytab as kudu/127.17.136.62@KRBTEST.COM (short username kudu)
I20260927 15:12:20.480729 21485 webserver.cc:460] Webserver started at http://127.17.136.62:41051/ using document root <none> and password file <none>
I20260927 15:12:20.481225 21485 fs_manager.cc:359] Metadata directory not provided
I20260927 15:12:20.481280 21485 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260927 15:12:20.481448 21485 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260927 15:12:20.483372 21485 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790521920546562-17952-0/minicluster-data/master-0/data/instance:
uuid: "3dc542f6d8024557933833906bb04ff4"
format_stamp: "Formatted at 2026-09-27 15:12:20 on dist-test-slave-5s2t"
server_key: "8df5b3288fe5c8ab0a842654213ce2d0"
server_key_iv: "4c0c74d02f21f1d3e0305612318f4cc0"
server_key_version: "encryptionkey@0"
I20260927 15:12:20.483862 21485 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790521920546562-17952-0/minicluster-data/master-0/wal/instance:
uuid: "3dc542f6d8024557933833906bb04ff4"
format_stamp: "Formatted at 2026-09-27 15:12:20 on dist-test-slave-5s2t"
server_key: "8df5b3288fe5c8ab0a842654213ce2d0"
server_key_iv: "4c0c74d02f21f1d3e0305612318f4cc0"
server_key_version: "encryptionkey@0"
I20260927 15:12:20.487159 21485 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.000s
I20260927 15:12:20.489339 21500 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260927 15:12:20.490482 21485 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260927 15:12:20.490590 21485 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790521920546562-17952-0/minicluster-data/master-0/data,/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790521920546562-17952-0/minicluster-data/master-0/wal
uuid: "3dc542f6d8024557933833906bb04ff4"
format_stamp: "Formatted at 2026-09-27 15:12:20 on dist-test-slave-5s2t"
server_key: "8df5b3288fe5c8ab0a842654213ce2d0"
server_key_iv: "4c0c74d02f21f1d3e0305612318f4cc0"
server_key_version: "encryptionkey@0"
I20260927 15:12:20.490679 21485 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790521920546562-17952-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790521920546562-17952-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790521920546562-17952-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260927 15:12:20.517478 21485 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260927 15:12:20.520159 21485 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260927 15:12:20.520323 21485 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260927 15:12:20.526794 21485 rpc_server.cc:307] RPC server started. Bound to: 127.17.136.62:35817
I20260927 15:12:20.526814 21552 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.136.62:35817 every 8 connection(s)
I20260927 15:12:20.527719 21485 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790521920546562-17952-0/minicluster-data/master-0/data/info.pb
I20260927 15:12:20.530304 21553 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:12:20.535495 21553 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3dc542f6d8024557933833906bb04ff4: Bootstrap starting.
I20260927 15:12:20.537822 21553 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3dc542f6d8024557933833906bb04ff4: Neither blocks nor log segments found. Creating new log.
I20260927 15:12:20.537920 17952 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu as pid 21485
I20260927 15:12:20.538066 17952 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790521920546562-17952-0/minicluster-data/master-0/wal/instance
I20260927 15:12:20.538309 17952 external_mini_cluster.cc:1428] Setting key a7df9902a5cfe28120ae0c7e0b16c8fa
I20260927 15:12:20.538666 21553 log.cc:824] T 00000000000000000000000000000000 P 3dc542f6d8024557933833906bb04ff4: Log is configured to *not* fsync() on all Append() calls
I20260927 15:12:20.540804 21553 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3dc542f6d8024557933833906bb04ff4: No bootstrap required, opened a new log
I20260927 15:12:20.544879 21553 raft_consensus.cc:348] T 00000000000000000000000000000000 P 3dc542f6d8024557933833906bb04ff4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3dc542f6d8024557933833906bb04ff4" member_type: VOTER last_known_addr { host: "127.17.136.62" port: 35817 } }
I20260927 15:12:20.545149 21553 raft_consensus.cc:374] T 00000000000000000000000000000000 P 3dc542f6d8024557933833906bb04ff4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:12:20.545241 21553 raft_consensus.cc:729] T 00000000000000000000000000000000 P 3dc542f6d8024557933833906bb04ff4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3dc542f6d8024557933833906bb04ff4, State: Initialized, Role: FOLLOWER
I20260927 15:12:20.545717 21553 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3dc542f6d8024557933833906bb04ff4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3dc542f6d8024557933833906bb04ff4" member_type: VOTER last_known_addr { host: "127.17.136.62" port: 35817 } }
I20260927 15:12:20.545847 21553 raft_consensus.cc:388] T 00000000000000000000000000000000 P 3dc542f6d8024557933833906bb04ff4 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260927 15:12:20.545912 21553 raft_consensus.cc:482] T 00000000000000000000000000000000 P 3dc542f6d8024557933833906bb04ff4 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260927 15:12:20.546002 21553 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3dc542f6d8024557933833906bb04ff4 [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:12:20.546784 21553 raft_consensus.cc:504] T 00000000000000000000000000000000 P 3dc542f6d8024557933833906bb04ff4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3dc542f6d8024557933833906bb04ff4" member_type: VOTER last_known_addr { host: "127.17.136.62" port: 35817 } }
Sep 27 15:12:20 dist-test-slave-5s2t krb5kdc[21472](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790521940, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.136.62@KRBTEST.COM
I20260927 15:12:20.547104 21553 leader_election.cc:302] T 00000000000000000000000000000000 P 3dc542f6d8024557933833906bb04ff4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 3dc542f6d8024557933833906bb04ff4; no voters:
I20260927 15:12:20.547417 21553 leader_election.cc:288] T 00000000000000000000000000000000 P 3dc542f6d8024557933833906bb04ff4 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260927 15:12:20.547518 21558 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 3dc542f6d8024557933833906bb04ff4 [term 1 FOLLOWER]: Leader election won for term 1
I20260927 15:12:20.547730 21558 raft_consensus.cc:686] T 00000000000000000000000000000000 P 3dc542f6d8024557933833906bb04ff4 [term 1 LEADER]: Becoming Leader. State: Replica: 3dc542f6d8024557933833906bb04ff4, State: Running, Role: LEADER
I20260927 15:12:20.548054 21558 consensus_queue.cc:237] T 00000000000000000000000000000000 P 3dc542f6d8024557933833906bb04ff4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3dc542f6d8024557933833906bb04ff4" member_type: VOTER last_known_addr { host: "127.17.136.62" port: 35817 } }
I20260927 15:12:20.548719 21553 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3dc542f6d8024557933833906bb04ff4 [sys.catalog]: configured and running, proceeding with master startup.
I20260927 15:12:20.549172 21560 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3dc542f6d8024557933833906bb04ff4 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3dc542f6d8024557933833906bb04ff4. Latest consensus state: current_term: 1 leader_uuid: "3dc542f6d8024557933833906bb04ff4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3dc542f6d8024557933833906bb04ff4" member_type: VOTER last_known_addr { host: "127.17.136.62" port: 35817 } } }
I20260927 15:12:20.549372 21560 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3dc542f6d8024557933833906bb04ff4 [sys.catalog]: This master's current role is: LEADER
I20260927 15:12:20.549495 21559 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3dc542f6d8024557933833906bb04ff4 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "3dc542f6d8024557933833906bb04ff4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3dc542f6d8024557933833906bb04ff4" member_type: VOTER last_known_addr { host: "127.17.136.62" port: 35817 } } }
I20260927 15:12:20.549578 21559 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3dc542f6d8024557933833906bb04ff4 [sys.catalog]: This master's current role is: LEADER
I20260927 15:12:20.552692 21557 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:20.539323 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54552 (local address 127.17.136.62:35817)
0927 15:12:20.539705 (+ 382us) server_negotiation.cc:206] Beginning negotiation
0927 15:12:20.539726 (+ 21us) server_negotiation.cc:399] Waiting for connection header
0927 15:12:20.539766 (+ 40us) server_negotiation.cc:407] Connection header received
0927 15:12:20.540545 (+ 779us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:12:20.540568 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:12:20.540950 (+ 382us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:12:20.541312 (+ 362us) server_negotiation.cc:226] Negotiated authn=SASL
0927 15:12:20.541928 (+ 616us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:20.543419 (+ 1491us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:20.544246 (+ 827us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:20.544906 (+ 660us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:20.545066 (+ 160us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:20.547409 (+ 2343us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0927 15:12:20.547414 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0927 15:12:20.547430 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0927 15:12:20.547459 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0927 15:12:20.549407 (+ 1948us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:12:20.549904 (+ 497us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:12:20.549910 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:12:20.549916 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:12:20.550057 (+ 141us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:12:20.550354 (+ 297us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:12:20.550357 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:12:20.550359 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:12:20.550823 (+ 464us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0927 15:12:20.551015 (+ 192us) server_negotiation.cc:1035] Waiting for connection context
0927 15:12:20.551768 (+ 753us) server_negotiation.cc:299] Negotiation successful
0927 15:12:20.552025 (+ 257us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":240,"thread_start_us":86,"threads_started":1}
W20260927 15:12:20.553296 21573 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 3dc542f6d8024557933833906bb04ff4: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260927 15:12:20.553376 21573 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260927 15:12:20.553427 21565 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260927 15:12:20.554204 21565 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260927 15:12:20.559134 21565 catalog_manager.cc:1347] Generated new cluster ID: 779e2f1af4474195bb4ad4eef0c8fc53
I20260927 15:12:20.559196 21565 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260927 15:12:20.576848 21565 catalog_manager.cc:1370] Generated new certificate authority record
I20260927 15:12:20.577775 21565 catalog_manager.cc:1504] Loading token signing keys...
I20260927 15:12:20.582777 21565 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 3dc542f6d8024557933833906bb04ff4: Generated new TSK 0
I20260927 15:12:20.583590 21565 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.17.136.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.136.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.136.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790521920546562-17952-0/krb5kdc/kudu_127.17.136.1.keytab.
Entry for principal kudu/127.17.136.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790521920546562-17952-0/krb5kdc/kudu_127.17.136.1.keytab.
I20260927 15:12:20.613531 17952 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu
/tmp/dist-test-taskiFOyeW/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790521920546562-17952-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790521920546562-17952-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790521920546562-17952-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790521920546562-17952-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.136.1:0
--local_ip_for_outbound_sockets=127.17.136.1
--webserver_interface=127.17.136.1
--webserver_port=0
--tserver_master_addrs=127.17.136.62:35817
--keytab_file=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790521920546562-17952-0/krb5kdc/kudu_127.17.136.1.keytab
--principal=kudu/127.17.136.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.136.20:43759
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790521920546562-17952-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790521920546562-17952-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790521920546562-17952-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260927 15:12:20.717442 21579 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260927 15:12:20.717693 21579 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260927 15:12:20.717752 21579 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260927 15:12:20.721665 21579 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260927 15:12:20.721710 21579 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260927 15:12:20.721764 21579 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.136.1
I20260927 15:12:20.726717 21579 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.136.20:43759
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790521920546562-17952-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790521920546562-17952-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790521920546562-17952-0/krb5kdc/kudu_127.17.136.1.keytab
--principal=kudu/127.17.136.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.136.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790521920546562-17952-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.17.136.1
--webserver_port=0
--tserver_master_addrs=127.17.136.62:35817
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21579
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.136.1
--log_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790521920546562-17952-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 27 Sep 2026 14:27:13 UTC on ccycloud.quasar-psqrth.root.comops.site
build id 4676138
I20260927 15:12:20.727653 21579 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260927 15:12:20.728618 21579 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260927 15:12:20.737771 21584 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260927 15:12:20.737798 21587 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260927 15:12:20.737836 21579 server_base.cc:1034] running on GCE node
W20260927 15:12:20.737771 21585 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260927 15:12:20.738423 21579 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260927 15:12:20.739017 21579 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260927 15:12:20.740162 21579 hybrid_clock.cc:648] HybridClock initialized: now 1790521940740144 us; error 27 us; skew 500 ppm
Sep 27 15:12:20 dist-test-slave-5s2t krb5kdc[21472](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790521940, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.136.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260927 15:12:20.742576 21579 init.cc:377] Logged in from keytab as kudu/127.17.136.1@KRBTEST.COM (short username kudu)
I20260927 15:12:20.743439 21579 webserver.cc:460] Webserver started at http://127.17.136.1:46585/ using document root <none> and password file <none>
I20260927 15:12:20.743953 21579 fs_manager.cc:359] Metadata directory not provided
I20260927 15:12:20.744014 21579 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260927 15:12:20.744210 21579 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260927 15:12:20.746170 21579 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790521920546562-17952-0/minicluster-data/ts-0/data/instance:
uuid: "18e409737c694f90937cdabc430ecc81"
format_stamp: "Formatted at 2026-09-27 15:12:20 on dist-test-slave-5s2t"
server_key: "2f1091c84643bc0e4d3d747d1a2871bf"
server_key_iv: "77f7427d6565f5dfc7a88e29ddc063fd"
server_key_version: "encryptionkey@0"
I20260927 15:12:20.746663 21579 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790521920546562-17952-0/minicluster-data/ts-0/wal/instance:
uuid: "18e409737c694f90937cdabc430ecc81"
format_stamp: "Formatted at 2026-09-27 15:12:20 on dist-test-slave-5s2t"
server_key: "2f1091c84643bc0e4d3d747d1a2871bf"
server_key_iv: "77f7427d6565f5dfc7a88e29ddc063fd"
server_key_version: "encryptionkey@0"
I20260927 15:12:20.750202 21579 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.006s sys 0.000s
I20260927 15:12:20.752478 21594 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260927 15:12:20.753604 21579 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260927 15:12:20.753702 21579 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790521920546562-17952-0/minicluster-data/ts-0/data,/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790521920546562-17952-0/minicluster-data/ts-0/wal
uuid: "18e409737c694f90937cdabc430ecc81"
format_stamp: "Formatted at 2026-09-27 15:12:20 on dist-test-slave-5s2t"
server_key: "2f1091c84643bc0e4d3d747d1a2871bf"
server_key_iv: "77f7427d6565f5dfc7a88e29ddc063fd"
server_key_version: "encryptionkey@0"
I20260927 15:12:20.753785 21579 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790521920546562-17952-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790521920546562-17952-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790521920546562-17952-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260927 15:12:20.770903 21579 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260927 15:12:20.773743 21579 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260927 15:12:20.773910 21579 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260927 15:12:20.774430 21579 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260927 15:12:20.775167 21579 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260927 15:12:20.775210 21579 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260927 15:12:20.775285 21579 ts_tablet_manager.cc:610] Registered 0 tablets
I20260927 15:12:20.775313 21579 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260927 15:12:20.783143 21579 rpc_server.cc:307] RPC server started. Bound to: 127.17.136.1:44663
I20260927 15:12:20.783176 21707 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.136.1:44663 every 8 connection(s)
I20260927 15:12:20.783988 21579 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790521920546562-17952-0/minicluster-data/ts-0/data/info.pb
I20260927 15:12:20.788822 17952 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu as pid 21579
I20260927 15:12:20.788937 17952 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790521920546562-17952-0/minicluster-data/ts-0/wal/instance
I20260927 15:12:20.789222 17952 external_mini_cluster.cc:1428] Setting key 053abbe26c69962467175e5730025b95
Sep 27 15:12:20 dist-test-slave-5s2t krb5kdc[21472](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790521940, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.136.1@KRBTEST.COM for kudu/127.17.136.62@KRBTEST.COM
I20260927 15:12:20.797617 21557 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:20.785612 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.136.1:41309 (local address 127.17.136.62:35817)
0927 15:12:20.785759 (+ 147us) server_negotiation.cc:206] Beginning negotiation
0927 15:12:20.785764 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0927 15:12:20.786659 (+ 895us) server_negotiation.cc:407] Connection header received
0927 15:12:20.787989 (+ 1330us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:12:20.787991 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:12:20.788038 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:12:20.788109 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0927 15:12:20.789483 (+ 1374us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:20.790167 (+ 684us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:20.791667 (+ 1500us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:20.791914 (+ 247us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:20.792011 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:20.794393 (+ 2382us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0927 15:12:20.794398 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0927 15:12:20.794401 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0927 15:12:20.794428 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0927 15:12:20.795750 (+ 1322us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:12:20.796212 (+ 462us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:12:20.796215 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:12:20.796217 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:12:20.796288 (+ 71us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:12:20.796598 (+ 310us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:12:20.796601 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:12:20.796603 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:12:20.796777 (+ 174us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0927 15:12:20.796857 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0927 15:12:20.797330 (+ 473us) server_negotiation.cc:299] Negotiation successful
0927 15:12:20.797458 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
WARNING: no policy specified for kudu/127.17.136.2@KRBTEST.COM; defaulting to no policy
I20260927 15:12:20.798442 21710 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:20.786049 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.62:35817 (local address 127.17.136.1:41309)
0927 15:12:20.786524 (+ 475us) negotiation.cc:107] Waiting for socket to connect
0927 15:12:20.786566 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0927 15:12:20.787808 (+ 1242us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0927 15:12:20.788282 (+ 474us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0927 15:12:20.788288 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0927 15:12:20.788647 (+ 359us) client_negotiation.cc:189] Negotiated authn=SASL
0927 15:12:20.789332 (+ 685us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:12:20.789352 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:12:20.790298 (+ 946us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:12:20.790301 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:12:20.791524 (+ 1223us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:12:20.791535 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:12:20.792057 (+ 522us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:12:20.792062 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:12:20.792237 (+ 175us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:20.792830 (+ 593us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0927 15:12:20.792846 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0927 15:12:20.794219 (+ 1373us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0927 15:12:20.795856 (+ 1637us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0927 15:12:20.795862 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0927 15:12:20.795879 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0927 15:12:20.796122 (+ 243us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0927 15:12:20.796367 (+ 245us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0927 15:12:20.796370 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0927 15:12:20.796372 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0927 15:12:20.796514 (+ 142us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0927 15:12:20.796870 (+ 356us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0927 15:12:20.796876 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0927 15:12:20.797113 (+ 237us) client_negotiation.cc:769] Sending connection context
0927 15:12:20.797276 (+ 163us) client_negotiation.cc:240] Negotiation successful
0927 15:12:20.797610 (+ 334us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":287,"thread_start_us":134,"threads_started":1}
I20260927 15:12:20.799561 21708 heartbeater.cc:347] Connected to a master server at 127.17.136.62:35817
I20260927 15:12:20.799780 21708 heartbeater.cc:464] Registering TS with master...
I20260927 15:12:20.800242 21708 heartbeater.cc:511] Master 127.17.136.62:35817 requested a full tablet report, sending...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.136.2@KRBTEST.COM" created.
I20260927 15:12:20.801891 21517 ts_manager.cc:194] Registered new tserver with Master: 18e409737c694f90937cdabc430ecc81 (127.17.136.1:44663)
I20260927 15:12:20.802980 21517 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.136.1@KRBTEST.COM'} at 127.17.136.1:41309
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.136.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790521920546562-17952-0/krb5kdc/kudu_127.17.136.2.keytab.
Entry for principal kudu/127.17.136.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790521920546562-17952-0/krb5kdc/kudu_127.17.136.2.keytab.
I20260927 15:12:20.814039 17952 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu
/tmp/dist-test-taskiFOyeW/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790521920546562-17952-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790521920546562-17952-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790521920546562-17952-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790521920546562-17952-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.136.2:0
--local_ip_for_outbound_sockets=127.17.136.2
--webserver_interface=127.17.136.2
--webserver_port=0
--tserver_master_addrs=127.17.136.62:35817
--keytab_file=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790521920546562-17952-0/krb5kdc/kudu_127.17.136.2.keytab
--principal=kudu/127.17.136.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.136.20:43759
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790521920546562-17952-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790521920546562-17952-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790521920546562-17952-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260927 15:12:20.918912 21713 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260927 15:12:20.919170 21713 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260927 15:12:20.919227 21713 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260927 15:12:20.923161 21713 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260927 15:12:20.923215 21713 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260927 15:12:20.923318 21713 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.136.2
I20260927 15:12:20.928390 21713 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.136.20:43759
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790521920546562-17952-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790521920546562-17952-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790521920546562-17952-0/krb5kdc/kudu_127.17.136.2.keytab
--principal=kudu/127.17.136.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.136.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790521920546562-17952-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.17.136.2
--webserver_port=0
--tserver_master_addrs=127.17.136.62:35817
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21713
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.136.2
--log_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790521920546562-17952-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 27 Sep 2026 14:27:13 UTC on ccycloud.quasar-psqrth.root.comops.site
build id 4676138
I20260927 15:12:20.929361 21713 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260927 15:12:20.930334 21713 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260927 15:12:20.939498 21719 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260927 15:12:20.939565 21713 server_base.cc:1034] running on GCE node
W20260927 15:12:20.939559 21718 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260927 15:12:20.939519 21721 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260927 15:12:20.940155 21713 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260927 15:12:20.940739 21713 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260927 15:12:20.941897 21713 hybrid_clock.cc:648] HybridClock initialized: now 1790521940941879 us; error 33 us; skew 500 ppm
Sep 27 15:12:20 dist-test-slave-5s2t krb5kdc[21472](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790521940, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.136.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260927 15:12:20.944470 21713 init.cc:377] Logged in from keytab as kudu/127.17.136.2@KRBTEST.COM (short username kudu)
I20260927 15:12:20.945309 21713 webserver.cc:460] Webserver started at http://127.17.136.2:46801/ using document root <none> and password file <none>
I20260927 15:12:20.945837 21713 fs_manager.cc:359] Metadata directory not provided
I20260927 15:12:20.945894 21713 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260927 15:12:20.946084 21713 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260927 15:12:20.948050 21713 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790521920546562-17952-0/minicluster-data/ts-1/data/instance:
uuid: "622fbc48eff74860af8764b9edd27de7"
format_stamp: "Formatted at 2026-09-27 15:12:20 on dist-test-slave-5s2t"
server_key: "c118092e2b608d0f94605d3b05deba7f"
server_key_iv: "9a69fb16f24b21323c954c0e9a797535"
server_key_version: "encryptionkey@0"
I20260927 15:12:20.948597 21713 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790521920546562-17952-0/minicluster-data/ts-1/wal/instance:
uuid: "622fbc48eff74860af8764b9edd27de7"
format_stamp: "Formatted at 2026-09-27 15:12:20 on dist-test-slave-5s2t"
server_key: "c118092e2b608d0f94605d3b05deba7f"
server_key_iv: "9a69fb16f24b21323c954c0e9a797535"
server_key_version: "encryptionkey@0"
I20260927 15:12:20.952028 21713 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.000s
I20260927 15:12:20.954164 21728 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260927 15:12:20.955264 21713 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260927 15:12:20.955369 21713 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790521920546562-17952-0/minicluster-data/ts-1/data,/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790521920546562-17952-0/minicluster-data/ts-1/wal
uuid: "622fbc48eff74860af8764b9edd27de7"
format_stamp: "Formatted at 2026-09-27 15:12:20 on dist-test-slave-5s2t"
server_key: "c118092e2b608d0f94605d3b05deba7f"
server_key_iv: "9a69fb16f24b21323c954c0e9a797535"
server_key_version: "encryptionkey@0"
I20260927 15:12:20.955458 21713 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790521920546562-17952-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790521920546562-17952-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790521920546562-17952-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260927 15:12:20.967156 21713 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260927 15:12:20.970050 21713 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260927 15:12:20.970199 21713 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260927 15:12:20.970688 21713 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260927 15:12:20.971451 21713 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260927 15:12:20.971494 21713 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260927 15:12:20.971537 21713 ts_tablet_manager.cc:610] Registered 0 tablets
I20260927 15:12:20.971566 21713 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260927 15:12:20.979044 21713 rpc_server.cc:307] RPC server started. Bound to: 127.17.136.2:36729
I20260927 15:12:20.979166 21841 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.136.2:36729 every 8 connection(s)
I20260927 15:12:20.979866 21713 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790521920546562-17952-0/minicluster-data/ts-1/data/info.pb
Sep 27 15:12:20 dist-test-slave-5s2t krb5kdc[21472](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790521940, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.136.2@KRBTEST.COM for kudu/127.17.136.62@KRBTEST.COM
I20260927 15:12:20.989178 17952 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu as pid 21713
I20260927 15:12:20.989310 17952 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790521920546562-17952-0/minicluster-data/ts-1/wal/instance
I20260927 15:12:20.989593 17952 external_mini_cluster.cc:1428] Setting key eb322304014aa725be4a77112ff49055
I20260927 15:12:20.992434 21557 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:20.981481 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.136.2:54303 (local address 127.17.136.62:35817)
0927 15:12:20.981629 (+ 148us) server_negotiation.cc:206] Beginning negotiation
0927 15:12:20.981634 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0927 15:12:20.982393 (+ 759us) server_negotiation.cc:407] Connection header received
0927 15:12:20.983676 (+ 1283us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:12:20.983679 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:12:20.983724 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:12:20.983785 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0927 15:12:20.984862 (+ 1077us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:20.985381 (+ 519us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:20.986404 (+ 1023us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:20.986605 (+ 201us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:20.986673 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:20.988850 (+ 2177us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0927 15:12:20.988854 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0927 15:12:20.988857 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0927 15:12:20.988884 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0927 15:12:20.990477 (+ 1593us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:12:20.990996 (+ 519us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:12:20.991000 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:12:20.991002 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:12:20.991076 (+ 74us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:12:20.991403 (+ 327us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:12:20.991407 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:12:20.991409 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:12:20.991597 (+ 188us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0927 15:12:20.991691 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0927 15:12:20.992171 (+ 480us) server_negotiation.cc:299] Negotiation successful
0927 15:12:20.992284 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260927 15:12:20.993165 21844 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:20.981847 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.62:35817 (local address 127.17.136.2:54303)
0927 15:12:20.982257 (+ 410us) negotiation.cc:107] Waiting for socket to connect
0927 15:12:20.982298 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0927 15:12:20.983486 (+ 1188us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0927 15:12:20.983930 (+ 444us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0927 15:12:20.983938 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0927 15:12:20.984273 (+ 335us) client_negotiation.cc:189] Negotiated authn=SASL
0927 15:12:20.984741 (+ 468us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:12:20.984754 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:12:20.985476 (+ 722us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:12:20.985479 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:12:20.986319 (+ 840us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:12:20.986327 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:12:20.986707 (+ 380us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:12:20.986710 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:12:20.986837 (+ 127us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:20.987370 (+ 533us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0927 15:12:20.987385 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0927 15:12:20.988704 (+ 1319us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0927 15:12:20.990589 (+ 1885us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0927 15:12:20.990593 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0927 15:12:20.990604 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0927 15:12:20.990910 (+ 306us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0927 15:12:20.991154 (+ 244us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0927 15:12:20.991157 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0927 15:12:20.991159 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0927 15:12:20.991321 (+ 162us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0927 15:12:20.991702 (+ 381us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0927 15:12:20.991708 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0927 15:12:20.991933 (+ 225us) client_negotiation.cc:769] Sending connection context
0927 15:12:20.992096 (+ 163us) client_negotiation.cc:240] Negotiation successful
0927 15:12:20.992396 (+ 300us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":236,"thread_start_us":102,"threads_started":1}
I20260927 15:12:20.994201 21842 heartbeater.cc:347] Connected to a master server at 127.17.136.62:35817
I20260927 15:12:20.994449 21842 heartbeater.cc:464] Registering TS with master...
I20260927 15:12:20.995021 21842 heartbeater.cc:511] Master 127.17.136.62:35817 requested a full tablet report, sending...
I20260927 15:12:20.996033 21517 ts_manager.cc:194] Registered new tserver with Master: 622fbc48eff74860af8764b9edd27de7 (127.17.136.2:36729)
I20260927 15:12:20.996554 21517 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.136.2@KRBTEST.COM'} at 127.17.136.2:54303
WARNING: no policy specified for kudu/127.17.136.3@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.136.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.136.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790521920546562-17952-0/krb5kdc/kudu_127.17.136.3.keytab.
Entry for principal kudu/127.17.136.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790521920546562-17952-0/krb5kdc/kudu_127.17.136.3.keytab.
I20260927 15:12:21.014338 17952 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu
/tmp/dist-test-taskiFOyeW/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790521920546562-17952-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790521920546562-17952-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790521920546562-17952-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790521920546562-17952-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.136.3:0
--local_ip_for_outbound_sockets=127.17.136.3
--webserver_interface=127.17.136.3
--webserver_port=0
--tserver_master_addrs=127.17.136.62:35817
--keytab_file=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790521920546562-17952-0/krb5kdc/kudu_127.17.136.3.keytab
--principal=kudu/127.17.136.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.136.20:43759
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790521920546562-17952-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790521920546562-17952-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790521920546562-17952-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260927 15:12:21.121059 21847 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260927 15:12:21.121300 21847 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260927 15:12:21.121340 21847 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260927 15:12:21.125360 21847 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260927 15:12:21.125415 21847 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260927 15:12:21.125494 21847 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.136.3
I20260927 15:12:21.130558 21847 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.136.20:43759
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790521920546562-17952-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790521920546562-17952-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790521920546562-17952-0/krb5kdc/kudu_127.17.136.3.keytab
--principal=kudu/127.17.136.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.136.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790521920546562-17952-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.17.136.3
--webserver_port=0
--tserver_master_addrs=127.17.136.62:35817
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21847
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.136.3
--log_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790521920546562-17952-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 27 Sep 2026 14:27:13 UTC on ccycloud.quasar-psqrth.root.comops.site
build id 4676138
I20260927 15:12:21.131603 21847 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260927 15:12:21.132596 21847 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260927 15:12:21.141832 21855 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260927 15:12:21.141901 21853 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260927 15:12:21.141978 21852 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260927 15:12:21.142356 21847 server_base.cc:1034] running on GCE node
I20260927 15:12:21.142714 21847 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260927 15:12:21.143327 21847 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260927 15:12:21.144483 21847 hybrid_clock.cc:648] HybridClock initialized: now 1790521941144473 us; error 33 us; skew 500 ppm
Sep 27 15:12:21 dist-test-slave-5s2t krb5kdc[21472](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790521941, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.136.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260927 15:12:21.147060 21847 init.cc:377] Logged in from keytab as kudu/127.17.136.3@KRBTEST.COM (short username kudu)
I20260927 15:12:21.147876 21847 webserver.cc:460] Webserver started at http://127.17.136.3:35517/ using document root <none> and password file <none>
I20260927 15:12:21.148357 21847 fs_manager.cc:359] Metadata directory not provided
I20260927 15:12:21.148411 21847 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260927 15:12:21.148574 21847 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260927 15:12:21.150698 21847 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790521920546562-17952-0/minicluster-data/ts-2/data/instance:
uuid: "5b7e3e7fd4fa4a8c93dd559dab1adc6b"
format_stamp: "Formatted at 2026-09-27 15:12:21 on dist-test-slave-5s2t"
server_key: "9896601d40bf1e9a5004e7d0a4a2da8d"
server_key_iv: "2b498e99fb98deb47b0a31790b2d53a3"
server_key_version: "encryptionkey@0"
I20260927 15:12:21.151206 21847 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790521920546562-17952-0/minicluster-data/ts-2/wal/instance:
uuid: "5b7e3e7fd4fa4a8c93dd559dab1adc6b"
format_stamp: "Formatted at 2026-09-27 15:12:21 on dist-test-slave-5s2t"
server_key: "9896601d40bf1e9a5004e7d0a4a2da8d"
server_key_iv: "2b498e99fb98deb47b0a31790b2d53a3"
server_key_version: "encryptionkey@0"
I20260927 15:12:21.154753 21847 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.001s
I20260927 15:12:21.157088 21862 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260927 15:12:21.158284 21847 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260927 15:12:21.158382 21847 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790521920546562-17952-0/minicluster-data/ts-2/data,/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790521920546562-17952-0/minicluster-data/ts-2/wal
uuid: "5b7e3e7fd4fa4a8c93dd559dab1adc6b"
format_stamp: "Formatted at 2026-09-27 15:12:21 on dist-test-slave-5s2t"
server_key: "9896601d40bf1e9a5004e7d0a4a2da8d"
server_key_iv: "2b498e99fb98deb47b0a31790b2d53a3"
server_key_version: "encryptionkey@0"
I20260927 15:12:21.158469 21847 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790521920546562-17952-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790521920546562-17952-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790521920546562-17952-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260927 15:12:21.173262 21847 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260927 15:12:21.176070 21847 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260927 15:12:21.176236 21847 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260927 15:12:21.176779 21847 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260927 15:12:21.177546 21847 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260927 15:12:21.177589 21847 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260927 15:12:21.177640 21847 ts_tablet_manager.cc:610] Registered 0 tablets
I20260927 15:12:21.177666 21847 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260927 15:12:21.185771 21847 rpc_server.cc:307] RPC server started. Bound to: 127.17.136.3:44169
I20260927 15:12:21.185828 21975 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.136.3:44169 every 8 connection(s)
I20260927 15:12:21.186643 21847 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790521920546562-17952-0/minicluster-data/ts-2/data/info.pb
I20260927 15:12:21.189634 17952 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu as pid 21847
I20260927 15:12:21.189752 17952 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790521920546562-17952-0/minicluster-data/ts-2/wal/instance
I20260927 15:12:21.190054 17952 external_mini_cluster.cc:1428] Setting key b2bc4a376a9534b07a2ecdfa8e88f0a7
Sep 27 15:12:21 dist-test-slave-5s2t krb5kdc[21472](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790521941, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.136.3@KRBTEST.COM for kudu/127.17.136.62@KRBTEST.COM
I20260927 15:12:21.199318 21557 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:21.188383 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.136.3:43563 (local address 127.17.136.62:35817)
0927 15:12:21.188514 (+ 131us) server_negotiation.cc:206] Beginning negotiation
0927 15:12:21.188518 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0927 15:12:21.189311 (+ 793us) server_negotiation.cc:407] Connection header received
0927 15:12:21.190884 (+ 1573us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:12:21.190887 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:12:21.190941 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:12:21.191026 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0927 15:12:21.192185 (+ 1159us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:21.192709 (+ 524us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:21.193800 (+ 1091us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:21.194010 (+ 210us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:21.194099 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:21.196339 (+ 2240us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0927 15:12:21.196342 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0927 15:12:21.196344 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0927 15:12:21.196366 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0927 15:12:21.197712 (+ 1346us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:12:21.198120 (+ 408us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:12:21.198122 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:12:21.198124 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:12:21.198187 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:12:21.198440 (+ 253us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:12:21.198442 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:12:21.198443 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:12:21.198603 (+ 160us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0927 15:12:21.198672 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0927 15:12:21.199075 (+ 403us) server_negotiation.cc:299] Negotiation successful
0927 15:12:21.199169 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260927 15:12:21.200129 21978 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:21.188741 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.62:35817 (local address 127.17.136.3:43563)
0927 15:12:21.189164 (+ 423us) negotiation.cc:107] Waiting for socket to connect
0927 15:12:21.189206 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0927 15:12:21.190672 (+ 1466us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0927 15:12:21.191184 (+ 512us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0927 15:12:21.191192 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0927 15:12:21.191563 (+ 371us) client_negotiation.cc:189] Negotiated authn=SASL
0927 15:12:21.192058 (+ 495us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:12:21.192071 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:12:21.192819 (+ 748us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:12:21.192822 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:12:21.193691 (+ 869us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:12:21.193700 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:12:21.194135 (+ 435us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:12:21.194138 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:12:21.194306 (+ 168us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:21.194780 (+ 474us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0927 15:12:21.194795 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0927 15:12:21.196198 (+ 1403us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0927 15:12:21.197809 (+ 1611us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0927 15:12:21.197813 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0927 15:12:21.197824 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0927 15:12:21.198050 (+ 226us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0927 15:12:21.198246 (+ 196us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0927 15:12:21.198248 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0927 15:12:21.198250 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0927 15:12:21.198363 (+ 113us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0927 15:12:21.198670 (+ 307us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0927 15:12:21.198675 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0927 15:12:21.198887 (+ 212us) client_negotiation.cc:769] Sending connection context
0927 15:12:21.199034 (+ 147us) client_negotiation.cc:240] Negotiation successful
0927 15:12:21.199314 (+ 280us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":249,"thread_start_us":106,"threads_started":1}
I20260927 15:12:21.201174 21976 heartbeater.cc:347] Connected to a master server at 127.17.136.62:35817
I20260927 15:12:21.201370 21976 heartbeater.cc:464] Registering TS with master...
I20260927 15:12:21.201781 21976 heartbeater.cc:511] Master 127.17.136.62:35817 requested a full tablet report, sending...
I20260927 15:12:21.202697 21516 ts_manager.cc:194] Registered new tserver with Master: 5b7e3e7fd4fa4a8c93dd559dab1adc6b (127.17.136.3:44169)
I20260927 15:12:21.203404 21516 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.136.3@KRBTEST.COM'} at 127.17.136.3:43563
I20260927 15:12:21.203425 17952 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Sep 27 15:12:21 dist-test-slave-5s2t krb5kdc[21472](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790521941, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Sep 27 15:12:21 dist-test-slave-5s2t krb5kdc[21472](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790521941, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.136.1@KRBTEST.COM
I20260927 15:12:21.227188 21983 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:21.218593 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33180 (local address 127.17.136.1:44663)
0927 15:12:21.218912 (+ 319us) server_negotiation.cc:206] Beginning negotiation
0927 15:12:21.218923 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0927 15:12:21.218945 (+ 22us) server_negotiation.cc:407] Connection header received
0927 15:12:21.218994 (+ 49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:12:21.218999 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:12:21.219179 (+ 180us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:12:21.219338 (+ 159us) server_negotiation.cc:226] Negotiated authn=SASL
0927 15:12:21.219958 (+ 620us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:21.220710 (+ 752us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:21.221545 (+ 835us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:21.221900 (+ 355us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:21.221971 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:21.224186 (+ 2215us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0927 15:12:21.224196 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0927 15:12:21.224209 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0927 15:12:21.224232 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0927 15:12:21.225682 (+ 1450us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:12:21.226054 (+ 372us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:12:21.226058 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:12:21.226060 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:12:21.226135 (+ 75us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:12:21.226312 (+ 177us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:12:21.226314 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:12:21.226315 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:12:21.226550 (+ 235us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0927 15:12:21.226700 (+ 150us) server_negotiation.cc:1035] Waiting for connection context
0927 15:12:21.226864 (+ 164us) server_negotiation.cc:299] Negotiation successful
0927 15:12:21.226989 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":219,"thread_start_us":130,"threads_started":1}
Sep 27 15:12:21 dist-test-slave-5s2t krb5kdc[21472](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790521941, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.136.62@KRBTEST.COM
I20260927 15:12:21.236799 21557 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:21.229814 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54564 (local address 127.17.136.62:35817)
0927 15:12:21.229953 (+ 139us) server_negotiation.cc:206] Beginning negotiation
0927 15:12:21.229956 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0927 15:12:21.230009 (+ 53us) server_negotiation.cc:407] Connection header received
0927 15:12:21.230116 (+ 107us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:12:21.230118 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:12:21.230156 (+ 38us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:12:21.230215 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0927 15:12:21.230721 (+ 506us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:21.231233 (+ 512us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:21.231999 (+ 766us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:21.232199 (+ 200us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:21.232265 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:21.234375 (+ 2110us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0927 15:12:21.234378 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0927 15:12:21.234379 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0927 15:12:21.234402 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0927 15:12:21.235540 (+ 1138us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:12:21.235871 (+ 331us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:12:21.235873 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:12:21.235874 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:12:21.235934 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:12:21.236106 (+ 172us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:12:21.236108 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:12:21.236109 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:12:21.236288 (+ 179us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0927 15:12:21.236380 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0927 15:12:21.236568 (+ 188us) server_negotiation.cc:299] Negotiation successful
0927 15:12:21.236651 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
W20260927 15:12:21.237156 21516 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.TSHeartbeat from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:54564
I20260927 15:12:21.237700 17952 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu with pid 21579
I20260927 15:12:21.242364 17952 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu with pid 21713
I20260927 15:12:21.246728 17952 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu with pid 21847
I20260927 15:12:21.251008 17952 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu with pid 21485
2026-09-27T15:12:21Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizedSuperuser (1960 ms)
[ RUN ] SecurityITest.TestDisableWebUI
Loading random data
Initializing database '/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790521920546562-17952-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 27 15:12:21 dist-test-slave-5s2t krb5kdc[21988](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 27 15:12:21 dist-test-slave-5s2t krb5kdc[21988](info): set up 2 sockets
Sep 27 15:12:21 dist-test-slave-5s2t krb5kdc[21988](info): commencing operation
krb5kdc: starting...
W20260927 15:12:22.199066 17952 mini_kdc.cc:121] Time spent starting KDC: real 0.929s user 0.000s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790521920546562-17952-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790521920546562-17952-0/krb5kdc/test-user.keytab.
Sep 27 15:12:22 dist-test-slave-5s2t krb5kdc[21988](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790521942, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-27T15:12:22Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-27T15:12:22Z Disabled control of system clock
WARNING: no policy specified for kudu/127.17.136.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.136.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.136.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790521920546562-17952-0/krb5kdc/kudu_127.17.136.62.keytab.
Entry for principal kudu/127.17.136.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790521920546562-17952-0/krb5kdc/kudu_127.17.136.62.keytab.
I20260927 15:12:22.314029 17952 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu
/tmp/dist-test-taskiFOyeW/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790521920546562-17952-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790521920546562-17952-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790521920546562-17952-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790521920546562-17952-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.136.62:41315
--webserver_interface=127.17.136.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790521920546562-17952-0/krb5kdc/kudu_127.17.136.62.keytab
--principal=kudu/127.17.136.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.136.20:37169
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.136.62:41315
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790521920546562-17952-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790521920546562-17952-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790521920546562-17952-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260927 15:12:22.420563 22001 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260927 15:12:22.420812 22001 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260927 15:12:22.420854 22001 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260927 15:12:22.425714 22001 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260927 15:12:22.425784 22001 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260927 15:12:22.425810 22001 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260927 15:12:22.425832 22001 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260927 15:12:22.425907 22001 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260927 15:12:22.431406 22001 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.136.20:37169
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790521920546562-17952-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790521920546562-17952-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.17.136.62:41315
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790521920546562-17952-0/krb5kdc/kudu_127.17.136.62.keytab
--principal=kudu/127.17.136.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.136.62:41315
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790521920546562-17952-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.17.136.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22001
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790521920546562-17952-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 27 Sep 2026 14:27:13 UTC on ccycloud.quasar-psqrth.root.comops.site
build id 4676138
I20260927 15:12:22.432395 22001 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260927 15:12:22.433387 22001 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260927 15:12:22.443034 22007 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260927 15:12:22.443034 22009 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260927 15:12:22.443359 22001 server_base.cc:1034] running on GCE node
W20260927 15:12:22.444191 22006 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260927 15:12:22.444725 22001 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260927 15:12:22.445781 22001 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260927 15:12:22.446928 22001 hybrid_clock.cc:648] HybridClock initialized: now 1790521942446895 us; error 49 us; skew 500 ppm
Sep 27 15:12:22 dist-test-slave-5s2t krb5kdc[21988](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790521942, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.136.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260927 15:12:22.449530 22001 init.cc:377] Logged in from keytab as kudu/127.17.136.62@KRBTEST.COM (short username kudu)
I20260927 15:12:22.450358 22001 fs_manager.cc:359] Metadata directory not provided
I20260927 15:12:22.450444 22001 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260927 15:12:22.450681 22001 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260927 15:12:22.453372 22001 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790521920546562-17952-0/minicluster-data/master-0/data/instance:
uuid: "33eb74716c134894b7419a0cc059e9c7"
format_stamp: "Formatted at 2026-09-27 15:12:22 on dist-test-slave-5s2t"
server_key: "071e9d48186b5ce713beb09f07510c73"
server_key_iv: "d7b5774102a9bef918df5680b5baf8bc"
server_key_version: "encryptionkey@0"
I20260927 15:12:22.454030 22001 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790521920546562-17952-0/minicluster-data/master-0/wal/instance:
uuid: "33eb74716c134894b7419a0cc059e9c7"
format_stamp: "Formatted at 2026-09-27 15:12:22 on dist-test-slave-5s2t"
server_key: "071e9d48186b5ce713beb09f07510c73"
server_key_iv: "d7b5774102a9bef918df5680b5baf8bc"
server_key_version: "encryptionkey@0"
I20260927 15:12:22.458541 22001 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260927 15:12:22.461376 22015 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260927 15:12:22.462486 22001 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260927 15:12:22.462591 22001 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790521920546562-17952-0/minicluster-data/master-0/data,/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790521920546562-17952-0/minicluster-data/master-0/wal
uuid: "33eb74716c134894b7419a0cc059e9c7"
format_stamp: "Formatted at 2026-09-27 15:12:22 on dist-test-slave-5s2t"
server_key: "071e9d48186b5ce713beb09f07510c73"
server_key_iv: "d7b5774102a9bef918df5680b5baf8bc"
server_key_version: "encryptionkey@0"
I20260927 15:12:22.462666 22001 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790521920546562-17952-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790521920546562-17952-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790521920546562-17952-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260927 15:12:22.478808 22001 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260927 15:12:22.481714 22001 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260927 15:12:22.481850 22001 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260927 15:12:22.488147 22001 rpc_server.cc:307] RPC server started. Bound to: 127.17.136.62:41315
I20260927 15:12:22.488360 22067 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.136.62:41315 every 8 connection(s)
I20260927 15:12:22.488754 22001 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790521920546562-17952-0/minicluster-data/master-0/data/info.pb
I20260927 15:12:22.489832 17952 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu as pid 22001
I20260927 15:12:22.489935 17952 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790521920546562-17952-0/minicluster-data/master-0/wal/instance
I20260927 15:12:22.490195 17952 external_mini_cluster.cc:1428] Setting key 2d34b762324176cd39949ab52d7b2659
I20260927 15:12:22.491639 22068 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:12:22.497546 22068 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 33eb74716c134894b7419a0cc059e9c7: Bootstrap starting.
Sep 27 15:12:22 dist-test-slave-5s2t krb5kdc[21988](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790521942, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.136.62@KRBTEST.COM
I20260927 15:12:22.499872 22068 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 33eb74716c134894b7419a0cc059e9c7: Neither blocks nor log segments found. Creating new log.
I20260927 15:12:22.500597 22068 log.cc:824] T 00000000000000000000000000000000 P 33eb74716c134894b7419a0cc059e9c7: Log is configured to *not* fsync() on all Append() calls
I20260927 15:12:22.502581 22068 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 33eb74716c134894b7419a0cc059e9c7: No bootstrap required, opened a new log
I20260927 15:12:22.503336 22071 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:22.491501 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40358 (local address 127.17.136.62:41315)
0927 15:12:22.491880 (+ 379us) server_negotiation.cc:206] Beginning negotiation
0927 15:12:22.491895 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0927 15:12:22.491928 (+ 33us) server_negotiation.cc:407] Connection header received
0927 15:12:22.492549 (+ 621us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:12:22.492565 (+ 16us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:12:22.492868 (+ 303us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:12:22.493133 (+ 265us) server_negotiation.cc:226] Negotiated authn=SASL
0927 15:12:22.493962 (+ 829us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:22.494922 (+ 960us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:22.496037 (+ 1115us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:22.496470 (+ 433us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:22.496590 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:22.499156 (+ 2566us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0927 15:12:22.499160 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0927 15:12:22.499173 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0927 15:12:22.499199 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0927 15:12:22.500858 (+ 1659us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:12:22.501232 (+ 374us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:12:22.501238 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:12:22.501243 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:12:22.501352 (+ 109us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:12:22.501613 (+ 261us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:12:22.501615 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:12:22.501616 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:12:22.501960 (+ 344us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0927 15:12:22.502093 (+ 133us) server_negotiation.cc:1035] Waiting for connection context
0927 15:12:22.502345 (+ 252us) server_negotiation.cc:299] Negotiation successful
0927 15:12:22.502592 (+ 247us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":252,"thread_start_us":117,"threads_started":1}
I20260927 15:12:22.505826 22068 raft_consensus.cc:348] T 00000000000000000000000000000000 P 33eb74716c134894b7419a0cc059e9c7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "33eb74716c134894b7419a0cc059e9c7" member_type: VOTER last_known_addr { host: "127.17.136.62" port: 41315 } }
I20260927 15:12:22.506037 22068 raft_consensus.cc:374] T 00000000000000000000000000000000 P 33eb74716c134894b7419a0cc059e9c7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:12:22.506102 22068 raft_consensus.cc:729] T 00000000000000000000000000000000 P 33eb74716c134894b7419a0cc059e9c7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 33eb74716c134894b7419a0cc059e9c7, State: Initialized, Role: FOLLOWER
I20260927 15:12:22.506467 22068 consensus_queue.cc:260] T 00000000000000000000000000000000 P 33eb74716c134894b7419a0cc059e9c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "33eb74716c134894b7419a0cc059e9c7" member_type: VOTER last_known_addr { host: "127.17.136.62" port: 41315 } }
I20260927 15:12:22.506582 22068 raft_consensus.cc:388] T 00000000000000000000000000000000 P 33eb74716c134894b7419a0cc059e9c7 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260927 15:12:22.506641 22068 raft_consensus.cc:482] T 00000000000000000000000000000000 P 33eb74716c134894b7419a0cc059e9c7 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260927 15:12:22.506731 22068 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 33eb74716c134894b7419a0cc059e9c7 [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:12:22.507575 22068 raft_consensus.cc:504] T 00000000000000000000000000000000 P 33eb74716c134894b7419a0cc059e9c7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "33eb74716c134894b7419a0cc059e9c7" member_type: VOTER last_known_addr { host: "127.17.136.62" port: 41315 } }
I20260927 15:12:22.507860 22068 leader_election.cc:302] T 00000000000000000000000000000000 P 33eb74716c134894b7419a0cc059e9c7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 33eb74716c134894b7419a0cc059e9c7; no voters:
I20260927 15:12:22.508129 22068 leader_election.cc:288] T 00000000000000000000000000000000 P 33eb74716c134894b7419a0cc059e9c7 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260927 15:12:22.508214 22073 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 33eb74716c134894b7419a0cc059e9c7 [term 1 FOLLOWER]: Leader election won for term 1
I20260927 15:12:22.508451 22073 raft_consensus.cc:686] T 00000000000000000000000000000000 P 33eb74716c134894b7419a0cc059e9c7 [term 1 LEADER]: Becoming Leader. State: Replica: 33eb74716c134894b7419a0cc059e9c7, State: Running, Role: LEADER
I20260927 15:12:22.508718 22073 consensus_queue.cc:237] T 00000000000000000000000000000000 P 33eb74716c134894b7419a0cc059e9c7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "33eb74716c134894b7419a0cc059e9c7" member_type: VOTER last_known_addr { host: "127.17.136.62" port: 41315 } }
I20260927 15:12:22.509188 22068 sys_catalog.cc:564] T 00000000000000000000000000000000 P 33eb74716c134894b7419a0cc059e9c7 [sys.catalog]: configured and running, proceeding with master startup.
I20260927 15:12:22.510264 22075 sys_catalog.cc:455] T 00000000000000000000000000000000 P 33eb74716c134894b7419a0cc059e9c7 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 33eb74716c134894b7419a0cc059e9c7. Latest consensus state: current_term: 1 leader_uuid: "33eb74716c134894b7419a0cc059e9c7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "33eb74716c134894b7419a0cc059e9c7" member_type: VOTER last_known_addr { host: "127.17.136.62" port: 41315 } } }
I20260927 15:12:22.510277 22074 sys_catalog.cc:455] T 00000000000000000000000000000000 P 33eb74716c134894b7419a0cc059e9c7 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "33eb74716c134894b7419a0cc059e9c7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "33eb74716c134894b7419a0cc059e9c7" member_type: VOTER last_known_addr { host: "127.17.136.62" port: 41315 } } }
I20260927 15:12:22.510483 22075 sys_catalog.cc:458] T 00000000000000000000000000000000 P 33eb74716c134894b7419a0cc059e9c7 [sys.catalog]: This master's current role is: LEADER
I20260927 15:12:22.510516 22074 sys_catalog.cc:458] T 00000000000000000000000000000000 P 33eb74716c134894b7419a0cc059e9c7 [sys.catalog]: This master's current role is: LEADER
I20260927 15:12:22.511126 22084 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260927 15:12:22.513657 22084 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260927 15:12:22.518580 22084 catalog_manager.cc:1347] Generated new cluster ID: cec027e242684b3f8aebc370a8395327
I20260927 15:12:22.518632 22084 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260927 15:12:22.535662 22084 catalog_manager.cc:1370] Generated new certificate authority record
I20260927 15:12:22.536612 22084 catalog_manager.cc:1504] Loading token signing keys...
I20260927 15:12:22.542528 22084 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 33eb74716c134894b7419a0cc059e9c7: Generated new TSK 0
I20260927 15:12:22.543179 22084 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.17.136.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.136.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.136.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790521920546562-17952-0/krb5kdc/kudu_127.17.136.1.keytab.
Entry for principal kudu/127.17.136.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790521920546562-17952-0/krb5kdc/kudu_127.17.136.1.keytab.
I20260927 15:12:22.569921 17952 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu
/tmp/dist-test-taskiFOyeW/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790521920546562-17952-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790521920546562-17952-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790521920546562-17952-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790521920546562-17952-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.136.1:0
--local_ip_for_outbound_sockets=127.17.136.1
--webserver_interface=127.17.136.1
--webserver_port=0
--tserver_master_addrs=127.17.136.62:41315
--keytab_file=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790521920546562-17952-0/krb5kdc/kudu_127.17.136.1.keytab
--principal=kudu/127.17.136.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.136.20:37169
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790521920546562-17952-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790521920546562-17952-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790521920546562-17952-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260927 15:12:22.677297 22094 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260927 15:12:22.677527 22094 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260927 15:12:22.677582 22094 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260927 15:12:22.681537 22094 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260927 15:12:22.681588 22094 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260927 15:12:22.681655 22094 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.136.1
I20260927 15:12:22.686715 22094 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.136.20:37169
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790521920546562-17952-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790521920546562-17952-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790521920546562-17952-0/krb5kdc/kudu_127.17.136.1.keytab
--principal=kudu/127.17.136.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.136.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790521920546562-17952-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.17.136.1
--webserver_port=0
--tserver_master_addrs=127.17.136.62:41315
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22094
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.136.1
--log_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790521920546562-17952-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 27 Sep 2026 14:27:13 UTC on ccycloud.quasar-psqrth.root.comops.site
build id 4676138
I20260927 15:12:22.687729 22094 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260927 15:12:22.688690 22094 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260927 15:12:22.697539 22094 server_base.cc:1034] running on GCE node
W20260927 15:12:22.697506 22102 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260927 15:12:22.697506 22099 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260927 15:12:22.697525 22100 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260927 15:12:22.698055 22094 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260927 15:12:22.698642 22094 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260927 15:12:22.699813 22094 hybrid_clock.cc:648] HybridClock initialized: now 1790521942699784 us; error 39 us; skew 500 ppm
Sep 27 15:12:22 dist-test-slave-5s2t krb5kdc[21988](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790521942, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.136.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260927 15:12:22.702376 22094 init.cc:377] Logged in from keytab as kudu/127.17.136.1@KRBTEST.COM (short username kudu)
I20260927 15:12:22.703025 22094 fs_manager.cc:359] Metadata directory not provided
I20260927 15:12:22.703087 22094 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260927 15:12:22.703282 22094 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260927 15:12:22.705236 22094 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790521920546562-17952-0/minicluster-data/ts-0/data/instance:
uuid: "4bf915412447454792b3433efe45728a"
format_stamp: "Formatted at 2026-09-27 15:12:22 on dist-test-slave-5s2t"
server_key: "71122d7928a9a4fd33cc33e3de632dc7"
server_key_iv: "2fbab70db3dae26e75a163401f74fc7f"
server_key_version: "encryptionkey@0"
I20260927 15:12:22.705729 22094 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790521920546562-17952-0/minicluster-data/ts-0/wal/instance:
uuid: "4bf915412447454792b3433efe45728a"
format_stamp: "Formatted at 2026-09-27 15:12:22 on dist-test-slave-5s2t"
server_key: "71122d7928a9a4fd33cc33e3de632dc7"
server_key_iv: "2fbab70db3dae26e75a163401f74fc7f"
server_key_version: "encryptionkey@0"
I20260927 15:12:22.709108 22094 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260927 15:12:22.711426 22108 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260927 15:12:22.712610 22094 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260927 15:12:22.712713 22094 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790521920546562-17952-0/minicluster-data/ts-0/data,/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790521920546562-17952-0/minicluster-data/ts-0/wal
uuid: "4bf915412447454792b3433efe45728a"
format_stamp: "Formatted at 2026-09-27 15:12:22 on dist-test-slave-5s2t"
server_key: "71122d7928a9a4fd33cc33e3de632dc7"
server_key_iv: "2fbab70db3dae26e75a163401f74fc7f"
server_key_version: "encryptionkey@0"
I20260927 15:12:22.712800 22094 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790521920546562-17952-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790521920546562-17952-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790521920546562-17952-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260927 15:12:22.727329 22094 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260927 15:12:22.730010 22094 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260927 15:12:22.730165 22094 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260927 15:12:22.730695 22094 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260927 15:12:22.731498 22094 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260927 15:12:22.731544 22094 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260927 15:12:22.731596 22094 ts_tablet_manager.cc:610] Registered 0 tablets
I20260927 15:12:22.731633 22094 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260927 15:12:22.739372 22094 rpc_server.cc:307] RPC server started. Bound to: 127.17.136.1:44443
I20260927 15:12:22.739428 22221 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.136.1:44443 every 8 connection(s)
I20260927 15:12:22.739900 22094 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790521920546562-17952-0/minicluster-data/ts-0/data/info.pb
I20260927 15:12:22.745318 17952 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu as pid 22094
I20260927 15:12:22.745441 17952 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790521920546562-17952-0/minicluster-data/ts-0/wal/instance
I20260927 15:12:22.745723 17952 external_mini_cluster.cc:1428] Setting key 5b38075302838ed719e619c9f44907ed
Sep 27 15:12:22 dist-test-slave-5s2t krb5kdc[21988](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790521942, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.136.1@KRBTEST.COM for kudu/127.17.136.62@KRBTEST.COM
I20260927 15:12:22.753105 22071 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:22.741507 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.136.1:58493 (local address 127.17.136.62:41315)
0927 15:12:22.741635 (+ 128us) server_negotiation.cc:206] Beginning negotiation
0927 15:12:22.741638 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0927 15:12:22.742862 (+ 1224us) server_negotiation.cc:407] Connection header received
0927 15:12:22.743742 (+ 880us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:12:22.743744 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:12:22.743789 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:12:22.743858 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0927 15:12:22.744945 (+ 1087us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:22.745675 (+ 730us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:22.747107 (+ 1432us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:22.747439 (+ 332us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:22.747544 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:22.749854 (+ 2310us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0927 15:12:22.749857 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0927 15:12:22.749860 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0927 15:12:22.749882 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0927 15:12:22.751146 (+ 1264us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:12:22.751716 (+ 570us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:12:22.751718 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:12:22.751719 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:12:22.751786 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:12:22.752128 (+ 342us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:12:22.752130 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:12:22.752131 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:12:22.752281 (+ 150us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0927 15:12:22.752346 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0927 15:12:22.752893 (+ 547us) server_negotiation.cc:299] Negotiation successful
0927 15:12:22.752983 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260927 15:12:22.754215 22224 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:22.741964 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.62:41315 (local address 127.17.136.1:58493)
0927 15:12:22.742731 (+ 767us) negotiation.cc:107] Waiting for socket to connect
0927 15:12:22.742769 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0927 15:12:22.743575 (+ 806us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0927 15:12:22.744042 (+ 467us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0927 15:12:22.744049 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0927 15:12:22.744378 (+ 329us) client_negotiation.cc:189] Negotiated authn=SASL
0927 15:12:22.744832 (+ 454us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:12:22.744845 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:12:22.745834 (+ 989us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:12:22.745838 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:12:22.746976 (+ 1138us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:12:22.746989 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:12:22.747588 (+ 599us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:12:22.747592 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:12:22.747733 (+ 141us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:22.748306 (+ 573us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0927 15:12:22.748322 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0927 15:12:22.749709 (+ 1387us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0927 15:12:22.751269 (+ 1560us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0927 15:12:22.751275 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0927 15:12:22.751291 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0927 15:12:22.751628 (+ 337us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0927 15:12:22.751862 (+ 234us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0927 15:12:22.751866 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0927 15:12:22.751867 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0927 15:12:22.752049 (+ 182us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0927 15:12:22.752366 (+ 317us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0927 15:12:22.752372 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0927 15:12:22.752668 (+ 296us) client_negotiation.cc:769] Sending connection context
0927 15:12:22.752881 (+ 213us) client_negotiation.cc:240] Negotiation successful
0927 15:12:22.753197 (+ 316us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":268,"thread_start_us":121,"threads_started":1}
WARNING: no policy specified for kudu/127.17.136.2@KRBTEST.COM; defaulting to no policy
I20260927 15:12:22.755398 22222 heartbeater.cc:347] Connected to a master server at 127.17.136.62:41315
I20260927 15:12:22.755613 22222 heartbeater.cc:464] Registering TS with master...
I20260927 15:12:22.756029 22222 heartbeater.cc:511] Master 127.17.136.62:41315 requested a full tablet report, sending...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.136.2@KRBTEST.COM" created.
I20260927 15:12:22.757490 22032 ts_manager.cc:194] Registered new tserver with Master: 4bf915412447454792b3433efe45728a (127.17.136.1:44443)
I20260927 15:12:22.758630 22032 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.136.1@KRBTEST.COM'} at 127.17.136.1:58493
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.136.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790521920546562-17952-0/krb5kdc/kudu_127.17.136.2.keytab.
Entry for principal kudu/127.17.136.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790521920546562-17952-0/krb5kdc/kudu_127.17.136.2.keytab.
I20260927 15:12:22.773265 17952 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu
/tmp/dist-test-taskiFOyeW/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790521920546562-17952-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790521920546562-17952-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790521920546562-17952-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790521920546562-17952-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.136.2:0
--local_ip_for_outbound_sockets=127.17.136.2
--webserver_interface=127.17.136.2
--webserver_port=0
--tserver_master_addrs=127.17.136.62:41315
--keytab_file=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790521920546562-17952-0/krb5kdc/kudu_127.17.136.2.keytab
--principal=kudu/127.17.136.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.136.20:37169
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790521920546562-17952-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790521920546562-17952-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790521920546562-17952-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260927 15:12:22.876431 22227 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260927 15:12:22.876675 22227 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260927 15:12:22.876739 22227 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260927 15:12:22.881551 22227 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260927 15:12:22.881616 22227 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260927 15:12:22.881702 22227 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.136.2
I20260927 15:12:22.886905 22227 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.136.20:37169
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790521920546562-17952-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790521920546562-17952-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790521920546562-17952-0/krb5kdc/kudu_127.17.136.2.keytab
--principal=kudu/127.17.136.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.136.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790521920546562-17952-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.17.136.2
--webserver_port=0
--tserver_master_addrs=127.17.136.62:41315
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22227
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.136.2
--log_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790521920546562-17952-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 27 Sep 2026 14:27:13 UTC on ccycloud.quasar-psqrth.root.comops.site
build id 4676138
I20260927 15:12:22.887986 22227 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260927 15:12:22.888991 22227 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260927 15:12:22.898100 22235 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260927 15:12:22.898100 22232 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260927 15:12:22.898101 22233 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260927 15:12:22.898149 22227 server_base.cc:1034] running on GCE node
I20260927 15:12:22.898721 22227 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260927 15:12:22.899339 22227 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260927 15:12:22.900506 22227 hybrid_clock.cc:648] HybridClock initialized: now 1790521942900484 us; error 31 us; skew 500 ppm
Sep 27 15:12:22 dist-test-slave-5s2t krb5kdc[21988](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790521942, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.136.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260927 15:12:22.903077 22227 init.cc:377] Logged in from keytab as kudu/127.17.136.2@KRBTEST.COM (short username kudu)
I20260927 15:12:22.903767 22227 fs_manager.cc:359] Metadata directory not provided
I20260927 15:12:22.903826 22227 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260927 15:12:22.903982 22227 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260927 15:12:22.905917 22227 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790521920546562-17952-0/minicluster-data/ts-1/data/instance:
uuid: "f8d6197ead364d07bf500f11a4c9448c"
format_stamp: "Formatted at 2026-09-27 15:12:22 on dist-test-slave-5s2t"
server_key: "6b64362bd10cdec0e4963730606e0e7d"
server_key_iv: "ee968ce7707806066c340e991a7f626f"
server_key_version: "encryptionkey@0"
I20260927 15:12:22.906448 22227 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790521920546562-17952-0/minicluster-data/ts-1/wal/instance:
uuid: "f8d6197ead364d07bf500f11a4c9448c"
format_stamp: "Formatted at 2026-09-27 15:12:22 on dist-test-slave-5s2t"
server_key: "6b64362bd10cdec0e4963730606e0e7d"
server_key_iv: "ee968ce7707806066c340e991a7f626f"
server_key_version: "encryptionkey@0"
I20260927 15:12:22.910061 22227 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.000s sys 0.006s
I20260927 15:12:22.912364 22241 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260927 15:12:22.913533 22227 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260927 15:12:22.913645 22227 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790521920546562-17952-0/minicluster-data/ts-1/data,/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790521920546562-17952-0/minicluster-data/ts-1/wal
uuid: "f8d6197ead364d07bf500f11a4c9448c"
format_stamp: "Formatted at 2026-09-27 15:12:22 on dist-test-slave-5s2t"
server_key: "6b64362bd10cdec0e4963730606e0e7d"
server_key_iv: "ee968ce7707806066c340e991a7f626f"
server_key_version: "encryptionkey@0"
I20260927 15:12:22.913738 22227 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790521920546562-17952-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790521920546562-17952-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790521920546562-17952-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260927 15:12:22.954828 22227 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260927 15:12:22.957748 22227 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260927 15:12:22.957906 22227 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260927 15:12:22.958459 22227 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260927 15:12:22.959285 22227 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260927 15:12:22.959331 22227 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260927 15:12:22.959381 22227 ts_tablet_manager.cc:610] Registered 0 tablets
I20260927 15:12:22.959409 22227 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260927 15:12:22.967448 22227 rpc_server.cc:307] RPC server started. Bound to: 127.17.136.2:42281
I20260927 15:12:22.967497 22354 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.136.2:42281 every 8 connection(s)
I20260927 15:12:22.967979 22227 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790521920546562-17952-0/minicluster-data/ts-1/data/info.pb
I20260927 15:12:22.968787 17952 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu as pid 22227
I20260927 15:12:22.968884 17952 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790521920546562-17952-0/minicluster-data/ts-1/wal/instance
I20260927 15:12:22.969198 17952 external_mini_cluster.cc:1428] Setting key 414e1c01fb26f4eacebc1d1a4a442457
Sep 27 15:12:22 dist-test-slave-5s2t krb5kdc[21988](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790521942, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.136.2@KRBTEST.COM for kudu/127.17.136.62@KRBTEST.COM
WARNING: no policy specified for kudu/127.17.136.3@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.136.3@KRBTEST.COM" created.
I20260927 15:12:22.980789 22071 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:22.969792 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.136.2:58321 (local address 127.17.136.62:41315)
0927 15:12:22.969917 (+ 125us) server_negotiation.cc:206] Beginning negotiation
0927 15:12:22.969922 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0927 15:12:22.970634 (+ 712us) server_negotiation.cc:407] Connection header received
0927 15:12:22.971944 (+ 1310us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:12:22.971946 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:12:22.971989 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:12:22.972055 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0927 15:12:22.973412 (+ 1357us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:22.973920 (+ 508us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:22.974989 (+ 1069us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:22.975212 (+ 223us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:22.975326 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:22.977793 (+ 2467us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0927 15:12:22.977796 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0927 15:12:22.977798 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0927 15:12:22.977821 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0927 15:12:22.978980 (+ 1159us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:12:22.979453 (+ 473us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:12:22.979456 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:12:22.979457 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:12:22.979525 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:12:22.979786 (+ 261us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:12:22.979788 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:12:22.979789 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:12:22.979975 (+ 186us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0927 15:12:22.980067 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0927 15:12:22.980519 (+ 452us) server_negotiation.cc:299] Negotiation successful
0927 15:12:22.980633 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260927 15:12:22.981662 22357 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:22.970039 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.62:41315 (local address 127.17.136.2:58321)
0927 15:12:22.970480 (+ 441us) negotiation.cc:107] Waiting for socket to connect
0927 15:12:22.970540 (+ 60us) client_negotiation.cc:174] Beginning negotiation
0927 15:12:22.971710 (+ 1170us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0927 15:12:22.972231 (+ 521us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0927 15:12:22.972239 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0927 15:12:22.972709 (+ 470us) client_negotiation.cc:189] Negotiated authn=SASL
0927 15:12:22.973283 (+ 574us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:12:22.973297 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:12:22.974032 (+ 735us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:12:22.974035 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:12:22.974883 (+ 848us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:12:22.974891 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:12:22.975358 (+ 467us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:12:22.975362 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:12:22.975543 (+ 181us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:22.976059 (+ 516us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0927 15:12:22.976074 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0927 15:12:22.977642 (+ 1568us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0927 15:12:22.979077 (+ 1435us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0927 15:12:22.979082 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0927 15:12:22.979092 (+ 10us) client_negotiation.cc:760] calling sasl_client_step()
0927 15:12:22.979366 (+ 274us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0927 15:12:22.979587 (+ 221us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0927 15:12:22.979589 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0927 15:12:22.979591 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0927 15:12:22.979708 (+ 117us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0927 15:12:22.980078 (+ 370us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0927 15:12:22.980083 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0927 15:12:22.980292 (+ 209us) client_negotiation.cc:769] Sending connection context
0927 15:12:22.980449 (+ 157us) client_negotiation.cc:240] Negotiation successful
0927 15:12:22.980738 (+ 289us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":244,"thread_start_us":106,"threads_started":1}
I20260927 15:12:22.982700 22355 heartbeater.cc:347] Connected to a master server at 127.17.136.62:41315
I20260927 15:12:22.982908 22355 heartbeater.cc:464] Registering TS with master...
I20260927 15:12:22.983350 22355 heartbeater.cc:511] Master 127.17.136.62:41315 requested a full tablet report, sending...
I20260927 15:12:22.984395 22032 ts_manager.cc:194] Registered new tserver with Master: f8d6197ead364d07bf500f11a4c9448c (127.17.136.2:42281)
I20260927 15:12:22.984933 22032 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.136.2@KRBTEST.COM'} at 127.17.136.2:58321
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.136.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790521920546562-17952-0/krb5kdc/kudu_127.17.136.3.keytab.
Entry for principal kudu/127.17.136.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790521920546562-17952-0/krb5kdc/kudu_127.17.136.3.keytab.
I20260927 15:12:22.994035 17952 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu
/tmp/dist-test-taskiFOyeW/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790521920546562-17952-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790521920546562-17952-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790521920546562-17952-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790521920546562-17952-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.136.3:0
--local_ip_for_outbound_sockets=127.17.136.3
--webserver_interface=127.17.136.3
--webserver_port=0
--tserver_master_addrs=127.17.136.62:41315
--keytab_file=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790521920546562-17952-0/krb5kdc/kudu_127.17.136.3.keytab
--principal=kudu/127.17.136.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.136.20:37169
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790521920546562-17952-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790521920546562-17952-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790521920546562-17952-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260927 15:12:23.099758 22360 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260927 15:12:23.099994 22360 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260927 15:12:23.100036 22360 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260927 15:12:23.103972 22360 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260927 15:12:23.104023 22360 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260927 15:12:23.104084 22360 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.136.3
I20260927 15:12:23.109218 22360 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.136.20:37169
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790521920546562-17952-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790521920546562-17952-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790521920546562-17952-0/krb5kdc/kudu_127.17.136.3.keytab
--principal=kudu/127.17.136.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.136.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790521920546562-17952-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.17.136.3
--webserver_port=0
--tserver_master_addrs=127.17.136.62:41315
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22360
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.136.3
--log_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790521920546562-17952-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 27 Sep 2026 14:27:13 UTC on ccycloud.quasar-psqrth.root.comops.site
build id 4676138
I20260927 15:12:23.110246 22360 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260927 15:12:23.111268 22360 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260927 15:12:23.120106 22368 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260927 15:12:23.120141 22366 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260927 15:12:23.120079 22365 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260927 15:12:23.120407 22360 server_base.cc:1034] running on GCE node
I20260927 15:12:23.120815 22360 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260927 15:12:23.121414 22360 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260927 15:12:23.122574 22360 hybrid_clock.cc:648] HybridClock initialized: now 1790521943122552 us; error 31 us; skew 500 ppm
Sep 27 15:12:23 dist-test-slave-5s2t krb5kdc[21988](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790521943, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.136.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260927 15:12:23.125329 22360 init.cc:377] Logged in from keytab as kudu/127.17.136.3@KRBTEST.COM (short username kudu)
I20260927 15:12:23.126029 22360 fs_manager.cc:359] Metadata directory not provided
I20260927 15:12:23.126094 22360 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260927 15:12:23.126261 22360 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260927 15:12:23.128278 22360 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790521920546562-17952-0/minicluster-data/ts-2/data/instance:
uuid: "1bfb9dacf1d14c13ba3bd1d397de5e6f"
format_stamp: "Formatted at 2026-09-27 15:12:23 on dist-test-slave-5s2t"
server_key: "9c8b202e08684fae9405f560600ae2aa"
server_key_iv: "7b7783353964ac65495f0e32e97b9bd1"
server_key_version: "encryptionkey@0"
I20260927 15:12:23.128840 22360 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790521920546562-17952-0/minicluster-data/ts-2/wal/instance:
uuid: "1bfb9dacf1d14c13ba3bd1d397de5e6f"
format_stamp: "Formatted at 2026-09-27 15:12:23 on dist-test-slave-5s2t"
server_key: "9c8b202e08684fae9405f560600ae2aa"
server_key_iv: "7b7783353964ac65495f0e32e97b9bd1"
server_key_version: "encryptionkey@0"
I20260927 15:12:23.132328 22360 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.001s sys 0.004s
I20260927 15:12:23.134534 22374 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260927 15:12:23.135730 22360 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260927 15:12:23.135838 22360 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790521920546562-17952-0/minicluster-data/ts-2/data,/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790521920546562-17952-0/minicluster-data/ts-2/wal
uuid: "1bfb9dacf1d14c13ba3bd1d397de5e6f"
format_stamp: "Formatted at 2026-09-27 15:12:23 on dist-test-slave-5s2t"
server_key: "9c8b202e08684fae9405f560600ae2aa"
server_key_iv: "7b7783353964ac65495f0e32e97b9bd1"
server_key_version: "encryptionkey@0"
I20260927 15:12:23.135931 22360 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790521920546562-17952-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790521920546562-17952-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790521920546562-17952-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260927 15:12:23.148715 22360 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260927 15:12:23.151237 22360 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260927 15:12:23.151420 22360 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260927 15:12:23.151937 22360 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260927 15:12:23.152676 22360 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260927 15:12:23.152721 22360 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260927 15:12:23.152770 22360 ts_tablet_manager.cc:610] Registered 0 tablets
I20260927 15:12:23.152799 22360 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260927 15:12:23.160578 22360 rpc_server.cc:307] RPC server started. Bound to: 127.17.136.3:45285
I20260927 15:12:23.160599 22487 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.136.3:45285 every 8 connection(s)
I20260927 15:12:23.161115 22360 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790521920546562-17952-0/minicluster-data/ts-2/data/info.pb
I20260927 15:12:23.169198 17952 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu as pid 22360
I20260927 15:12:23.169298 17952 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790521920546562-17952-0/minicluster-data/ts-2/wal/instance
I20260927 15:12:23.169550 17952 external_mini_cluster.cc:1428] Setting key b6a10a0422426584be2fdf4a4a20c880
Sep 27 15:12:23 dist-test-slave-5s2t krb5kdc[21988](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790521943, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.136.3@KRBTEST.COM for kudu/127.17.136.62@KRBTEST.COM
I20260927 15:12:23.173622 22071 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:23.162674 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.136.3:47917 (local address 127.17.136.62:41315)
0927 15:12:23.162805 (+ 131us) server_negotiation.cc:206] Beginning negotiation
0927 15:12:23.162808 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0927 15:12:23.163587 (+ 779us) server_negotiation.cc:407] Connection header received
0927 15:12:23.164742 (+ 1155us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:12:23.164744 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:12:23.164788 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:12:23.164855 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0927 15:12:23.165955 (+ 1100us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:23.166519 (+ 564us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:23.167676 (+ 1157us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:23.167883 (+ 207us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:23.167955 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:23.170352 (+ 2397us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0927 15:12:23.170356 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0927 15:12:23.170359 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0927 15:12:23.170385 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0927 15:12:23.171866 (+ 1481us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:12:23.172409 (+ 543us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:12:23.172411 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:12:23.172413 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:12:23.172480 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:12:23.172733 (+ 253us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:12:23.172734 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:12:23.172735 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:12:23.172888 (+ 153us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0927 15:12:23.172992 (+ 104us) server_negotiation.cc:1035] Waiting for connection context
0927 15:12:23.173415 (+ 423us) server_negotiation.cc:299] Negotiation successful
0927 15:12:23.173510 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260927 15:12:23.174399 22490 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:23.163002 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.62:41315 (local address 127.17.136.3:47917)
0927 15:12:23.163443 (+ 441us) negotiation.cc:107] Waiting for socket to connect
0927 15:12:23.163483 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0927 15:12:23.164566 (+ 1083us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0927 15:12:23.165023 (+ 457us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0927 15:12:23.165030 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0927 15:12:23.165348 (+ 318us) client_negotiation.cc:189] Negotiated authn=SASL
0927 15:12:23.165833 (+ 485us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:12:23.165848 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:12:23.166619 (+ 771us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:12:23.166622 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:12:23.167575 (+ 953us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:12:23.167585 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:12:23.168013 (+ 428us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:12:23.168016 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:12:23.168148 (+ 132us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:23.168636 (+ 488us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0927 15:12:23.168651 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0927 15:12:23.170171 (+ 1520us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0927 15:12:23.172068 (+ 1897us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0927 15:12:23.172073 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0927 15:12:23.172085 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0927 15:12:23.172331 (+ 246us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0927 15:12:23.172540 (+ 209us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0927 15:12:23.172543 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0927 15:12:23.172544 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0927 15:12:23.172673 (+ 129us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0927 15:12:23.172986 (+ 313us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0927 15:12:23.172990 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0927 15:12:23.173216 (+ 226us) client_negotiation.cc:769] Sending connection context
0927 15:12:23.173360 (+ 144us) client_negotiation.cc:240] Negotiation successful
0927 15:12:23.173597 (+ 237us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":260,"thread_start_us":103,"threads_started":1}
I20260927 15:12:23.175434 22488 heartbeater.cc:347] Connected to a master server at 127.17.136.62:41315
I20260927 15:12:23.175629 22488 heartbeater.cc:464] Registering TS with master...
I20260927 15:12:23.176036 22488 heartbeater.cc:511] Master 127.17.136.62:41315 requested a full tablet report, sending...
I20260927 15:12:23.177044 22032 ts_manager.cc:194] Registered new tserver with Master: 1bfb9dacf1d14c13ba3bd1d397de5e6f (127.17.136.3:45285)
I20260927 15:12:23.177616 22032 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.136.3@KRBTEST.COM'} at 127.17.136.3:47917
I20260927 15:12:23.183094 17952 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260927 15:12:23.191568 22071 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:23.184985 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40372 (local address 127.17.136.62:41315)
0927 15:12:23.185097 (+ 112us) server_negotiation.cc:206] Beginning negotiation
0927 15:12:23.185101 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0927 15:12:23.185240 (+ 139us) server_negotiation.cc:407] Connection header received
0927 15:12:23.185336 (+ 96us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:12:23.185337 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:12:23.185373 (+ 36us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:12:23.185433 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0927 15:12:23.186065 (+ 632us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:23.186552 (+ 487us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:23.187459 (+ 907us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:23.187671 (+ 212us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:23.187743 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:23.188940 (+ 1197us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0927 15:12:23.188943 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0927 15:12:23.188945 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0927 15:12:23.188967 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0927 15:12:23.190210 (+ 1243us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:12:23.190561 (+ 351us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:12:23.190563 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:12:23.190564 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:12:23.190627 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:12:23.190830 (+ 203us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:12:23.190832 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:12:23.190833 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:12:23.191033 (+ 200us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0927 15:12:23.191126 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0927 15:12:23.191365 (+ 239us) server_negotiation.cc:299] Negotiation successful
0927 15:12:23.191451 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260927 15:12:23.194101 22032 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:40372:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:12:23.196974 22032 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:12:23.211238 22503 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:23.205724 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.1:44443 (local address 127.0.0.1:38192)
0927 15:12:23.206209 (+ 485us) negotiation.cc:107] Waiting for socket to connect
0927 15:12:23.206220 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0927 15:12:23.206290 (+ 70us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0927 15:12:23.206980 (+ 690us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0927 15:12:23.206983 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0927 15:12:23.206998 (+ 15us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0927 15:12:23.207052 (+ 54us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:12:23.207056 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:12:23.208476 (+ 1420us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:12:23.208479 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:12:23.209732 (+ 1253us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:12:23.209741 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:12:23.210827 (+ 1086us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:12:23.210830 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:12:23.210898 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:23.210915 (+ 17us) client_negotiation.cc:769] Sending connection context
0927 15:12:23.210954 (+ 39us) client_negotiation.cc:240] Negotiation successful
0927 15:12:23.211087 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":431,"mutex_wait_us":26,"thread_start_us":89,"threads_started":1}
I20260927 15:12:23.211467 22501 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:23.205292 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43256 (local address 127.17.136.3:45285)
0927 15:12:23.205760 (+ 468us) server_negotiation.cc:206] Beginning negotiation
0927 15:12:23.205772 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0927 15:12:23.206123 (+ 351us) server_negotiation.cc:407] Connection header received
0927 15:12:23.206204 (+ 81us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:12:23.206210 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:12:23.206425 (+ 215us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:12:23.206570 (+ 145us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0927 15:12:23.206956 (+ 386us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:23.208122 (+ 1166us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:23.209976 (+ 1854us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:23.210611 (+ 635us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:23.210710 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:23.211036 (+ 326us) server_negotiation.cc:1035] Waiting for connection context
0927 15:12:23.211094 (+ 58us) server_negotiation.cc:299] Negotiation successful
0927 15:12:23.211190 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":371,"thread_start_us":135,"threads_started":1}
I20260927 15:12:23.211498 22504 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:23.206097 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38192 (local address 127.17.136.1:44443)
0927 15:12:23.206503 (+ 406us) server_negotiation.cc:206] Beginning negotiation
0927 15:12:23.206513 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0927 15:12:23.206532 (+ 19us) server_negotiation.cc:407] Connection header received
0927 15:12:23.206595 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:12:23.206599 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:12:23.206753 (+ 154us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:12:23.206874 (+ 121us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0927 15:12:23.207143 (+ 269us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:23.208357 (+ 1214us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:23.209843 (+ 1486us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:23.210716 (+ 873us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:23.211074 (+ 358us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:23.211206 (+ 132us) server_negotiation.cc:1035] Waiting for connection context
0927 15:12:23.211273 (+ 67us) server_negotiation.cc:299] Negotiation successful
0927 15:12:23.211357 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":320,"thread_start_us":87,"threads_started":1}
I20260927 15:12:23.211887 22500 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:23.204986 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.3:45285 (local address 127.0.0.1:43256)
0927 15:12:23.205799 (+ 813us) negotiation.cc:107] Waiting for socket to connect
0927 15:12:23.205851 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0927 15:12:23.205991 (+ 140us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0927 15:12:23.206690 (+ 699us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0927 15:12:23.206696 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0927 15:12:23.206715 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0927 15:12:23.206859 (+ 144us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:12:23.206866 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:12:23.208249 (+ 1383us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:12:23.208252 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:12:23.209845 (+ 1593us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:12:23.209853 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:12:23.210724 (+ 871us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:12:23.210727 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:12:23.210831 (+ 104us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:23.210873 (+ 42us) client_negotiation.cc:769] Sending connection context
0927 15:12:23.210965 (+ 92us) client_negotiation.cc:240] Negotiation successful
0927 15:12:23.211761 (+ 796us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":631,"mutex_wait_us":144,"thread_start_us":75,"threads_started":1}
I20260927 15:12:23.212062 22499 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:23.205100 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.2:42281 (local address 127.0.0.1:57874)
0927 15:12:23.205882 (+ 782us) negotiation.cc:107] Waiting for socket to connect
0927 15:12:23.205894 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0927 15:12:23.205990 (+ 96us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0927 15:12:23.206750 (+ 760us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0927 15:12:23.206753 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0927 15:12:23.206765 (+ 12us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0927 15:12:23.206865 (+ 100us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:12:23.206870 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:12:23.209334 (+ 2464us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:12:23.209338 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:12:23.210406 (+ 1068us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:12:23.210416 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:12:23.211738 (+ 1322us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:12:23.211742 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:12:23.211827 (+ 85us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:23.211849 (+ 22us) client_negotiation.cc:769] Sending connection context
0927 15:12:23.211896 (+ 47us) client_negotiation.cc:240] Negotiation successful
0927 15:12:23.211956 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":727,"mutex_wait_us":21,"thread_start_us":87,"threads_started":1}
I20260927 15:12:23.214099 22156 tablet_service.cc:1467] Processing CreateTablet for tablet a4c47ad54af5461d91e576bffc53ae20 (DEFAULT_TABLE table=test-table [id=71b8e76ff8c34171a437fd1c2b07feb2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:12:23.214416 22422 tablet_service.cc:1467] Processing CreateTablet for tablet a4c47ad54af5461d91e576bffc53ae20 (DEFAULT_TABLE table=test-table [id=71b8e76ff8c34171a437fd1c2b07feb2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:12:23.215083 22502 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:23.205324 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57874 (local address 127.17.136.2:42281)
0927 15:12:23.205726 (+ 402us) server_negotiation.cc:206] Beginning negotiation
0927 15:12:23.205738 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0927 15:12:23.205979 (+ 241us) server_negotiation.cc:407] Connection header received
0927 15:12:23.206408 (+ 429us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:12:23.206413 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:12:23.206603 (+ 190us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:12:23.206772 (+ 169us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0927 15:12:23.208276 (+ 1504us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:23.209199 (+ 923us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:23.210532 (+ 1333us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:23.211334 (+ 802us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:23.214655 (+ 3321us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:23.214793 (+ 138us) server_negotiation.cc:1035] Waiting for connection context
0927 15:12:23.214845 (+ 52us) server_negotiation.cc:299] Negotiation successful
0927 15:12:23.214946 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":314,"thread_start_us":127,"threads_started":1}
I20260927 15:12:23.215118 22156 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a4c47ad54af5461d91e576bffc53ae20. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:12:23.215330 22422 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a4c47ad54af5461d91e576bffc53ae20. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:12:23.217768 22289 tablet_service.cc:1467] Processing CreateTablet for tablet a4c47ad54af5461d91e576bffc53ae20 (DEFAULT_TABLE table=test-table [id=71b8e76ff8c34171a437fd1c2b07feb2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:12:23.218755 22289 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a4c47ad54af5461d91e576bffc53ae20. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:12:23.221318 22505 tablet_bootstrap.cc:492] T a4c47ad54af5461d91e576bffc53ae20 P 1bfb9dacf1d14c13ba3bd1d397de5e6f: Bootstrap starting.
I20260927 15:12:23.223557 22506 tablet_bootstrap.cc:492] T a4c47ad54af5461d91e576bffc53ae20 P 4bf915412447454792b3433efe45728a: Bootstrap starting.
I20260927 15:12:23.223632 22505 tablet_bootstrap.cc:654] T a4c47ad54af5461d91e576bffc53ae20 P 1bfb9dacf1d14c13ba3bd1d397de5e6f: Neither blocks nor log segments found. Creating new log.
I20260927 15:12:23.224787 22507 tablet_bootstrap.cc:492] T a4c47ad54af5461d91e576bffc53ae20 P f8d6197ead364d07bf500f11a4c9448c: Bootstrap starting.
I20260927 15:12:23.224835 22505 log.cc:824] T a4c47ad54af5461d91e576bffc53ae20 P 1bfb9dacf1d14c13ba3bd1d397de5e6f: Log is configured to *not* fsync() on all Append() calls
I20260927 15:12:23.225603 22506 tablet_bootstrap.cc:654] T a4c47ad54af5461d91e576bffc53ae20 P 4bf915412447454792b3433efe45728a: Neither blocks nor log segments found. Creating new log.
I20260927 15:12:23.226644 22506 log.cc:824] T a4c47ad54af5461d91e576bffc53ae20 P 4bf915412447454792b3433efe45728a: Log is configured to *not* fsync() on all Append() calls
I20260927 15:12:23.226799 22507 tablet_bootstrap.cc:654] T a4c47ad54af5461d91e576bffc53ae20 P f8d6197ead364d07bf500f11a4c9448c: Neither blocks nor log segments found. Creating new log.
I20260927 15:12:23.227476 22505 tablet_bootstrap.cc:492] T a4c47ad54af5461d91e576bffc53ae20 P 1bfb9dacf1d14c13ba3bd1d397de5e6f: No bootstrap required, opened a new log
I20260927 15:12:23.227671 22505 ts_tablet_manager.cc:1397] T a4c47ad54af5461d91e576bffc53ae20 P 1bfb9dacf1d14c13ba3bd1d397de5e6f: Time spent bootstrapping tablet: real 0.007s user 0.005s sys 0.000s
I20260927 15:12:23.227909 22507 log.cc:824] T a4c47ad54af5461d91e576bffc53ae20 P f8d6197ead364d07bf500f11a4c9448c: Log is configured to *not* fsync() on all Append() calls
I20260927 15:12:23.228538 22506 tablet_bootstrap.cc:492] T a4c47ad54af5461d91e576bffc53ae20 P 4bf915412447454792b3433efe45728a: No bootstrap required, opened a new log
I20260927 15:12:23.228709 22506 ts_tablet_manager.cc:1397] T a4c47ad54af5461d91e576bffc53ae20 P 4bf915412447454792b3433efe45728a: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s
I20260927 15:12:23.229374 22507 tablet_bootstrap.cc:492] T a4c47ad54af5461d91e576bffc53ae20 P f8d6197ead364d07bf500f11a4c9448c: No bootstrap required, opened a new log
I20260927 15:12:23.229542 22507 ts_tablet_manager.cc:1397] T a4c47ad54af5461d91e576bffc53ae20 P f8d6197ead364d07bf500f11a4c9448c: Time spent bootstrapping tablet: real 0.005s user 0.001s sys 0.003s
I20260927 15:12:23.231402 22505 raft_consensus.cc:348] T a4c47ad54af5461d91e576bffc53ae20 P 1bfb9dacf1d14c13ba3bd1d397de5e6f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1bfb9dacf1d14c13ba3bd1d397de5e6f" member_type: VOTER last_known_addr { host: "127.17.136.3" port: 45285 } } peers { permanent_uuid: "f8d6197ead364d07bf500f11a4c9448c" member_type: VOTER last_known_addr { host: "127.17.136.2" port: 42281 } } peers { permanent_uuid: "4bf915412447454792b3433efe45728a" member_type: VOTER last_known_addr { host: "127.17.136.1" port: 44443 } }
I20260927 15:12:23.231696 22505 raft_consensus.cc:374] T a4c47ad54af5461d91e576bffc53ae20 P 1bfb9dacf1d14c13ba3bd1d397de5e6f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:12:23.231750 22505 raft_consensus.cc:729] T a4c47ad54af5461d91e576bffc53ae20 P 1bfb9dacf1d14c13ba3bd1d397de5e6f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1bfb9dacf1d14c13ba3bd1d397de5e6f, State: Initialized, Role: FOLLOWER
I20260927 15:12:23.232190 22505 consensus_queue.cc:260] T a4c47ad54af5461d91e576bffc53ae20 P 1bfb9dacf1d14c13ba3bd1d397de5e6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1bfb9dacf1d14c13ba3bd1d397de5e6f" member_type: VOTER last_known_addr { host: "127.17.136.3" port: 45285 } } peers { permanent_uuid: "f8d6197ead364d07bf500f11a4c9448c" member_type: VOTER last_known_addr { host: "127.17.136.2" port: 42281 } } peers { permanent_uuid: "4bf915412447454792b3433efe45728a" member_type: VOTER last_known_addr { host: "127.17.136.1" port: 44443 } }
I20260927 15:12:23.232263 22507 raft_consensus.cc:348] T a4c47ad54af5461d91e576bffc53ae20 P f8d6197ead364d07bf500f11a4c9448c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1bfb9dacf1d14c13ba3bd1d397de5e6f" member_type: VOTER last_known_addr { host: "127.17.136.3" port: 45285 } } peers { permanent_uuid: "f8d6197ead364d07bf500f11a4c9448c" member_type: VOTER last_known_addr { host: "127.17.136.2" port: 42281 } } peers { permanent_uuid: "4bf915412447454792b3433efe45728a" member_type: VOTER last_known_addr { host: "127.17.136.1" port: 44443 } }
I20260927 15:12:23.232322 22506 raft_consensus.cc:348] T a4c47ad54af5461d91e576bffc53ae20 P 4bf915412447454792b3433efe45728a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1bfb9dacf1d14c13ba3bd1d397de5e6f" member_type: VOTER last_known_addr { host: "127.17.136.3" port: 45285 } } peers { permanent_uuid: "f8d6197ead364d07bf500f11a4c9448c" member_type: VOTER last_known_addr { host: "127.17.136.2" port: 42281 } } peers { permanent_uuid: "4bf915412447454792b3433efe45728a" member_type: VOTER last_known_addr { host: "127.17.136.1" port: 44443 } }
I20260927 15:12:23.232513 22507 raft_consensus.cc:374] T a4c47ad54af5461d91e576bffc53ae20 P f8d6197ead364d07bf500f11a4c9448c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:12:23.232553 22506 raft_consensus.cc:374] T a4c47ad54af5461d91e576bffc53ae20 P 4bf915412447454792b3433efe45728a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:12:23.232564 22507 raft_consensus.cc:729] T a4c47ad54af5461d91e576bffc53ae20 P f8d6197ead364d07bf500f11a4c9448c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8d6197ead364d07bf500f11a4c9448c, State: Initialized, Role: FOLLOWER
I20260927 15:12:23.232599 22506 raft_consensus.cc:729] T a4c47ad54af5461d91e576bffc53ae20 P 4bf915412447454792b3433efe45728a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4bf915412447454792b3433efe45728a, State: Initialized, Role: FOLLOWER
I20260927 15:12:23.233031 22488 heartbeater.cc:503] Master 127.17.136.62:41315 was elected leader, sending a full tablet report...
I20260927 15:12:23.232995 22507 consensus_queue.cc:260] T a4c47ad54af5461d91e576bffc53ae20 P f8d6197ead364d07bf500f11a4c9448c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1bfb9dacf1d14c13ba3bd1d397de5e6f" member_type: VOTER last_known_addr { host: "127.17.136.3" port: 45285 } } peers { permanent_uuid: "f8d6197ead364d07bf500f11a4c9448c" member_type: VOTER last_known_addr { host: "127.17.136.2" port: 42281 } } peers { permanent_uuid: "4bf915412447454792b3433efe45728a" member_type: VOTER last_known_addr { host: "127.17.136.1" port: 44443 } }
I20260927 15:12:23.233809 22507 ts_tablet_manager.cc:1428] T a4c47ad54af5461d91e576bffc53ae20 P f8d6197ead364d07bf500f11a4c9448c: Time spent starting tablet: real 0.004s user 0.003s sys 0.002s
I20260927 15:12:23.234124 22355 heartbeater.cc:503] Master 127.17.136.62:41315 was elected leader, sending a full tablet report...
I20260927 15:12:23.234148 22505 ts_tablet_manager.cc:1428] T a4c47ad54af5461d91e576bffc53ae20 P 1bfb9dacf1d14c13ba3bd1d397de5e6f: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20260927 15:12:23.234809 22506 consensus_queue.cc:260] T a4c47ad54af5461d91e576bffc53ae20 P 4bf915412447454792b3433efe45728a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1bfb9dacf1d14c13ba3bd1d397de5e6f" member_type: VOTER last_known_addr { host: "127.17.136.3" port: 45285 } } peers { permanent_uuid: "f8d6197ead364d07bf500f11a4c9448c" member_type: VOTER last_known_addr { host: "127.17.136.2" port: 42281 } } peers { permanent_uuid: "4bf915412447454792b3433efe45728a" member_type: VOTER last_known_addr { host: "127.17.136.1" port: 44443 } }
I20260927 15:12:23.235651 22222 heartbeater.cc:503] Master 127.17.136.62:41315 was elected leader, sending a full tablet report...
I20260927 15:12:23.235678 22506 ts_tablet_manager.cc:1428] T a4c47ad54af5461d91e576bffc53ae20 P 4bf915412447454792b3433efe45728a: Time spent starting tablet: real 0.007s user 0.006s sys 0.000s
W20260927 15:12:23.240818 22223 tablet.cc:2369] T a4c47ad54af5461d91e576bffc53ae20 P 4bf915412447454792b3433efe45728a: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260927 15:12:23.278295 22512 raft_consensus.cc:482] T a4c47ad54af5461d91e576bffc53ae20 P f8d6197ead364d07bf500f11a4c9448c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:12:23.278514 22512 raft_consensus.cc:504] T a4c47ad54af5461d91e576bffc53ae20 P f8d6197ead364d07bf500f11a4c9448c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1bfb9dacf1d14c13ba3bd1d397de5e6f" member_type: VOTER last_known_addr { host: "127.17.136.3" port: 45285 } } peers { permanent_uuid: "f8d6197ead364d07bf500f11a4c9448c" member_type: VOTER last_known_addr { host: "127.17.136.2" port: 42281 } } peers { permanent_uuid: "4bf915412447454792b3433efe45728a" member_type: VOTER last_known_addr { host: "127.17.136.1" port: 44443 } }
I20260927 15:12:23.279693 22512 leader_election.cc:288] T a4c47ad54af5461d91e576bffc53ae20 P f8d6197ead364d07bf500f11a4c9448c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1bfb9dacf1d14c13ba3bd1d397de5e6f (127.17.136.3:45285), 4bf915412447454792b3433efe45728a (127.17.136.1:44443)
I20260927 15:12:23.284247 22501 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:23.280091 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.136.2:59891 (local address 127.17.136.3:45285)
0927 15:12:23.280222 (+ 131us) server_negotiation.cc:206] Beginning negotiation
0927 15:12:23.280234 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0927 15:12:23.280250 (+ 16us) server_negotiation.cc:407] Connection header received
0927 15:12:23.280299 (+ 49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:12:23.280302 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:12:23.280349 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:12:23.280435 (+ 86us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0927 15:12:23.280829 (+ 394us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:23.281550 (+ 721us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:23.283021 (+ 1471us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:23.283678 (+ 657us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:23.283800 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:23.283854 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0927 15:12:23.284051 (+ 197us) server_negotiation.cc:299] Negotiation successful
0927 15:12:23.284120 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260927 15:12:23.284238 22357 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:23.279967 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.3:45285 (local address 127.17.136.2:59891)
0927 15:12:23.280086 (+ 119us) negotiation.cc:107] Waiting for socket to connect
0927 15:12:23.280101 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0927 15:12:23.280196 (+ 95us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0927 15:12:23.280557 (+ 361us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0927 15:12:23.280560 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0927 15:12:23.280580 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0927 15:12:23.280698 (+ 118us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:12:23.280705 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:12:23.281642 (+ 937us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:12:23.281644 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:12:23.282885 (+ 1241us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:12:23.282896 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:12:23.283812 (+ 916us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:12:23.283815 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:12:23.283917 (+ 102us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:23.283943 (+ 26us) client_negotiation.cc:769] Sending connection context
0927 15:12:23.284016 (+ 73us) client_negotiation.cc:240] Negotiation successful
0927 15:12:23.284093 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":39,"mutex_wait_us":26}
I20260927 15:12:23.284344 22514 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:23.280224 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.1:44443 (local address 127.17.136.2:49513)
0927 15:12:23.280640 (+ 416us) negotiation.cc:107] Waiting for socket to connect
0927 15:12:23.280653 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0927 15:12:23.280749 (+ 96us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0927 15:12:23.280966 (+ 217us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0927 15:12:23.280968 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0927 15:12:23.280982 (+ 14us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0927 15:12:23.281080 (+ 98us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:12:23.281084 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:12:23.281899 (+ 815us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:12:23.281902 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:12:23.283052 (+ 1150us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:12:23.283059 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:12:23.283945 (+ 886us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:12:23.283948 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:12:23.284062 (+ 114us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:23.284080 (+ 18us) client_negotiation.cc:769] Sending connection context
0927 15:12:23.284141 (+ 61us) client_negotiation.cc:240] Negotiation successful
0927 15:12:23.284194 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":357,"mutex_wait_us":3,"thread_start_us":125,"threads_started":1}
I20260927 15:12:23.284343 22504 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:23.280457 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.136.2:49513 (local address 127.17.136.1:44443)
0927 15:12:23.280573 (+ 116us) server_negotiation.cc:206] Beginning negotiation
0927 15:12:23.280577 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0927 15:12:23.280738 (+ 161us) server_negotiation.cc:407] Connection header received
0927 15:12:23.280831 (+ 93us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:12:23.280834 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:12:23.280880 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:12:23.280950 (+ 70us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0927 15:12:23.281172 (+ 222us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:23.281798 (+ 626us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:23.283179 (+ 1381us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:23.283830 (+ 651us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:23.283936 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:23.283977 (+ 41us) server_negotiation.cc:1035] Waiting for connection context
0927 15:12:23.284168 (+ 191us) server_negotiation.cc:299] Negotiation successful
0927 15:12:23.284238 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260927 15:12:23.284968 22176 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a4c47ad54af5461d91e576bffc53ae20" candidate_uuid: "f8d6197ead364d07bf500f11a4c9448c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4bf915412447454792b3433efe45728a" is_pre_election: true
I20260927 15:12:23.285015 22442 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a4c47ad54af5461d91e576bffc53ae20" candidate_uuid: "f8d6197ead364d07bf500f11a4c9448c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1bfb9dacf1d14c13ba3bd1d397de5e6f" is_pre_election: true
I20260927 15:12:23.285305 22442 raft_consensus.cc:2454] T a4c47ad54af5461d91e576bffc53ae20 P 1bfb9dacf1d14c13ba3bd1d397de5e6f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f8d6197ead364d07bf500f11a4c9448c in term 0.
I20260927 15:12:23.285430 22176 raft_consensus.cc:2454] T a4c47ad54af5461d91e576bffc53ae20 P 4bf915412447454792b3433efe45728a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f8d6197ead364d07bf500f11a4c9448c in term 0.
I20260927 15:12:23.285806 22243 leader_election.cc:302] T a4c47ad54af5461d91e576bffc53ae20 P f8d6197ead364d07bf500f11a4c9448c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1bfb9dacf1d14c13ba3bd1d397de5e6f, f8d6197ead364d07bf500f11a4c9448c; no voters:
I20260927 15:12:23.286135 22512 raft_consensus.cc:2781] T a4c47ad54af5461d91e576bffc53ae20 P f8d6197ead364d07bf500f11a4c9448c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 15:12:23.286217 22512 raft_consensus.cc:482] T a4c47ad54af5461d91e576bffc53ae20 P f8d6197ead364d07bf500f11a4c9448c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 15:12:23.286247 22512 raft_consensus.cc:3037] T a4c47ad54af5461d91e576bffc53ae20 P f8d6197ead364d07bf500f11a4c9448c [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:12:23.287348 22512 raft_consensus.cc:504] T a4c47ad54af5461d91e576bffc53ae20 P f8d6197ead364d07bf500f11a4c9448c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1bfb9dacf1d14c13ba3bd1d397de5e6f" member_type: VOTER last_known_addr { host: "127.17.136.3" port: 45285 } } peers { permanent_uuid: "f8d6197ead364d07bf500f11a4c9448c" member_type: VOTER last_known_addr { host: "127.17.136.2" port: 42281 } } peers { permanent_uuid: "4bf915412447454792b3433efe45728a" member_type: VOTER last_known_addr { host: "127.17.136.1" port: 44443 } }
I20260927 15:12:23.287690 22512 leader_election.cc:288] T a4c47ad54af5461d91e576bffc53ae20 P f8d6197ead364d07bf500f11a4c9448c [CANDIDATE]: Term 1 election: Requested vote from peers 1bfb9dacf1d14c13ba3bd1d397de5e6f (127.17.136.3:45285), 4bf915412447454792b3433efe45728a (127.17.136.1:44443)
I20260927 15:12:23.288156 22442 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a4c47ad54af5461d91e576bffc53ae20" candidate_uuid: "f8d6197ead364d07bf500f11a4c9448c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1bfb9dacf1d14c13ba3bd1d397de5e6f"
I20260927 15:12:23.288210 22176 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a4c47ad54af5461d91e576bffc53ae20" candidate_uuid: "f8d6197ead364d07bf500f11a4c9448c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4bf915412447454792b3433efe45728a"
I20260927 15:12:23.288292 22442 raft_consensus.cc:3037] T a4c47ad54af5461d91e576bffc53ae20 P 1bfb9dacf1d14c13ba3bd1d397de5e6f [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:12:23.288316 22176 raft_consensus.cc:3037] T a4c47ad54af5461d91e576bffc53ae20 P 4bf915412447454792b3433efe45728a [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:12:23.289588 22442 raft_consensus.cc:2454] T a4c47ad54af5461d91e576bffc53ae20 P 1bfb9dacf1d14c13ba3bd1d397de5e6f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f8d6197ead364d07bf500f11a4c9448c in term 1.
I20260927 15:12:23.289588 22176 raft_consensus.cc:2454] T a4c47ad54af5461d91e576bffc53ae20 P 4bf915412447454792b3433efe45728a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f8d6197ead364d07bf500f11a4c9448c in term 1.
I20260927 15:12:23.289882 22243 leader_election.cc:302] T a4c47ad54af5461d91e576bffc53ae20 P f8d6197ead364d07bf500f11a4c9448c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4bf915412447454792b3433efe45728a, f8d6197ead364d07bf500f11a4c9448c; no voters:
I20260927 15:12:23.290040 22512 raft_consensus.cc:2781] T a4c47ad54af5461d91e576bffc53ae20 P f8d6197ead364d07bf500f11a4c9448c [term 1 FOLLOWER]: Leader election won for term 1
I20260927 15:12:23.290277 22512 raft_consensus.cc:686] T a4c47ad54af5461d91e576bffc53ae20 P f8d6197ead364d07bf500f11a4c9448c [term 1 LEADER]: Becoming Leader. State: Replica: f8d6197ead364d07bf500f11a4c9448c, State: Running, Role: LEADER
I20260927 15:12:23.290591 22512 consensus_queue.cc:237] T a4c47ad54af5461d91e576bffc53ae20 P f8d6197ead364d07bf500f11a4c9448c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1bfb9dacf1d14c13ba3bd1d397de5e6f" member_type: VOTER last_known_addr { host: "127.17.136.3" port: 45285 } } peers { permanent_uuid: "f8d6197ead364d07bf500f11a4c9448c" member_type: VOTER last_known_addr { host: "127.17.136.2" port: 42281 } } peers { permanent_uuid: "4bf915412447454792b3433efe45728a" member_type: VOTER last_known_addr { host: "127.17.136.1" port: 44443 } }
I20260927 15:12:23.293720 22032 catalog_manager.cc:5495] T a4c47ad54af5461d91e576bffc53ae20 P f8d6197ead364d07bf500f11a4c9448c reported cstate change: term changed from 0 to 1, leader changed from <none> to f8d6197ead364d07bf500f11a4c9448c (127.17.136.2). New cstate: current_term: 1 leader_uuid: "f8d6197ead364d07bf500f11a4c9448c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1bfb9dacf1d14c13ba3bd1d397de5e6f" member_type: VOTER last_known_addr { host: "127.17.136.3" port: 45285 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f8d6197ead364d07bf500f11a4c9448c" member_type: VOTER last_known_addr { host: "127.17.136.2" port: 42281 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4bf915412447454792b3433efe45728a" member_type: VOTER last_known_addr { host: "127.17.136.1" port: 44443 } health_report { overall_health: UNKNOWN } } }
I20260927 15:12:23.309276 22502 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:23.305780 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57882 (local address 127.17.136.2:42281)
0927 15:12:23.305911 (+ 131us) server_negotiation.cc:206] Beginning negotiation
0927 15:12:23.305916 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0927 15:12:23.305945 (+ 29us) server_negotiation.cc:407] Connection header received
0927 15:12:23.306049 (+ 104us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:12:23.306052 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:12:23.306107 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:12:23.306200 (+ 93us) server_negotiation.cc:226] Negotiated authn=TOKEN
0927 15:12:23.306444 (+ 244us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:23.306933 (+ 489us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:23.307838 (+ 905us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:23.308059 (+ 221us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:23.308143 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:23.308428 (+ 285us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0927 15:12:23.308891 (+ 463us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0927 15:12:23.309030 (+ 139us) server_negotiation.cc:1035] Waiting for connection context
0927 15:12:23.309062 (+ 32us) server_negotiation.cc:299] Negotiation successful
0927 15:12:23.309119 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260927 15:12:23.315369 22176 raft_consensus.cc:1261] T a4c47ad54af5461d91e576bffc53ae20 P 4bf915412447454792b3433efe45728a [term 1 FOLLOWER]: Refusing update from remote peer f8d6197ead364d07bf500f11a4c9448c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260927 15:12:23.315368 22442 raft_consensus.cc:1261] T a4c47ad54af5461d91e576bffc53ae20 P 1bfb9dacf1d14c13ba3bd1d397de5e6f [term 1 FOLLOWER]: Refusing update from remote peer f8d6197ead364d07bf500f11a4c9448c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260927 15:12:23.316090 22512 consensus_queue.cc:1035] T a4c47ad54af5461d91e576bffc53ae20 P f8d6197ead364d07bf500f11a4c9448c [LEADER]: Connected to new peer: Peer: permanent_uuid: "4bf915412447454792b3433efe45728a" member_type: VOTER last_known_addr { host: "127.17.136.1" port: 44443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260927 15:12:23.316267 22515 consensus_queue.cc:1035] T a4c47ad54af5461d91e576bffc53ae20 P f8d6197ead364d07bf500f11a4c9448c [LEADER]: Connected to new peer: Peer: permanent_uuid: "1bfb9dacf1d14c13ba3bd1d397de5e6f" member_type: VOTER last_known_addr { host: "127.17.136.3" port: 45285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260927 15:12:23.333981 22032 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:40372:
table { table_name: "test-table" } modify_external_catalogs: true
I20260927 15:12:23.334177 22032 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:40372:
table { table_name: "test-table" } modify_external_catalogs: true
I20260927 15:12:23.336488 22032 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 33eb74716c134894b7419a0cc059e9c7: Sending DeleteTablet for 3 replicas of tablet a4c47ad54af5461d91e576bffc53ae20
I20260927 15:12:23.337297 22156 tablet_service.cc:1514] Processing DeleteTablet for tablet a4c47ad54af5461d91e576bffc53ae20 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:12:23 UTC) from {username='kudu', principal='kudu/127.17.136.62@KRBTEST.COM'} at 127.0.0.1:38192
I20260927 15:12:23.337301 22422 tablet_service.cc:1514] Processing DeleteTablet for tablet a4c47ad54af5461d91e576bffc53ae20 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:12:23 UTC) from {username='kudu', principal='kudu/127.17.136.62@KRBTEST.COM'} at 127.0.0.1:43256
I20260927 15:12:23.337767 17952 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu with pid 22094
I20260927 15:12:23.337765 22289 tablet_service.cc:1514] Processing DeleteTablet for tablet a4c47ad54af5461d91e576bffc53ae20 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:12:23 UTC) from {username='kudu', principal='kudu/127.17.136.62@KRBTEST.COM'} at 127.0.0.1:57874
I20260927 15:12:23.338490 22528 tablet_replica.cc:330] T a4c47ad54af5461d91e576bffc53ae20 P 1bfb9dacf1d14c13ba3bd1d397de5e6f: stopping tablet replica
I20260927 15:12:23.338487 22529 tablet_replica.cc:330] T a4c47ad54af5461d91e576bffc53ae20 P f8d6197ead364d07bf500f11a4c9448c: stopping tablet replica
I20260927 15:12:23.338779 22528 raft_consensus.cc:2229] T a4c47ad54af5461d91e576bffc53ae20 P 1bfb9dacf1d14c13ba3bd1d397de5e6f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260927 15:12:23.338780 22529 raft_consensus.cc:2229] T a4c47ad54af5461d91e576bffc53ae20 P f8d6197ead364d07bf500f11a4c9448c [term 1 LEADER]: Raft consensus shutting down.
I20260927 15:12:23.339130 22528 raft_consensus.cc:2258] T a4c47ad54af5461d91e576bffc53ae20 P 1bfb9dacf1d14c13ba3bd1d397de5e6f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 15:12:23.339125 22529 raft_consensus.cc:2258] T a4c47ad54af5461d91e576bffc53ae20 P f8d6197ead364d07bf500f11a4c9448c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 15:12:23.340581 22529 ts_tablet_manager.cc:1905] T a4c47ad54af5461d91e576bffc53ae20 P f8d6197ead364d07bf500f11a4c9448c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:12:23.343201 22529 ts_tablet_manager.cc:1918] T a4c47ad54af5461d91e576bffc53ae20 P f8d6197ead364d07bf500f11a4c9448c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260927 15:12:23.343361 22529 log.cc:1196] T a4c47ad54af5461d91e576bffc53ae20 P f8d6197ead364d07bf500f11a4c9448c: Deleting WAL directory at /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790521920546562-17952-0/minicluster-data/ts-1/wal/wals/a4c47ad54af5461d91e576bffc53ae20
I20260927 15:12:23.343734 22528 ts_tablet_manager.cc:1905] T a4c47ad54af5461d91e576bffc53ae20 P 1bfb9dacf1d14c13ba3bd1d397de5e6f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:12:23.343768 22529 ts_tablet_manager.cc:1939] T a4c47ad54af5461d91e576bffc53ae20 P f8d6197ead364d07bf500f11a4c9448c: Deleting consensus metadata
I20260927 15:12:23.344930 22019 catalog_manager.cc:4841] TS f8d6197ead364d07bf500f11a4c9448c (127.17.136.2:42281): tablet a4c47ad54af5461d91e576bffc53ae20 (table test-table [id=71b8e76ff8c34171a437fd1c2b07feb2]) successfully deleted
I20260927 15:12:23.346159 22528 ts_tablet_manager.cc:1918] T a4c47ad54af5461d91e576bffc53ae20 P 1bfb9dacf1d14c13ba3bd1d397de5e6f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260927 15:12:23.346247 22528 log.cc:1196] T a4c47ad54af5461d91e576bffc53ae20 P 1bfb9dacf1d14c13ba3bd1d397de5e6f: Deleting WAL directory at /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790521920546562-17952-0/minicluster-data/ts-2/wal/wals/a4c47ad54af5461d91e576bffc53ae20
W20260927 15:12:23.346393 22017 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.17.136.1:44443 (error 108)
I20260927 15:12:23.346526 22528 ts_tablet_manager.cc:1939] T a4c47ad54af5461d91e576bffc53ae20 P 1bfb9dacf1d14c13ba3bd1d397de5e6f: Deleting consensus metadata
I20260927 15:12:23.347328 22499 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:23.347053 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.1:44443 (local address 127.0.0.1:38202)
0927 15:12:23.347167 (+ 114us) negotiation.cc:107] Waiting for socket to connect
0927 15:12:23.347229 (+ 62us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.136.1:44443: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":41}
I20260927 15:12:23.347422 17952 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu with pid 22227
W20260927 15:12:23.348838 22017 catalog_manager.cc:4584] TS 4bf915412447454792b3433efe45728a (127.17.136.1:44443): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet a4c47ad54af5461d91e576bffc53ae20: Network error: Client connection negotiation failed: client connection to 127.17.136.1:44443: connect: Connection refused (error 111)
I20260927 15:12:23.349041 22017 catalog_manager.cc:4841] TS 1bfb9dacf1d14c13ba3bd1d397de5e6f (127.17.136.3:45285): tablet a4c47ad54af5461d91e576bffc53ae20 (table test-table [id=71b8e76ff8c34171a437fd1c2b07feb2]) successfully deleted
I20260927 15:12:23.352259 17952 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu with pid 22360
I20260927 15:12:23.356499 17952 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu with pid 22001
2026-09-27T15:12:23Z chronyd exiting
[ OK ] SecurityITest.TestDisableWebUI (2105 ms)
[ RUN ] SecurityITest.TestDisableAuthenticationEncryption
2026-09-27T15:12:23Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-27T15:12:23Z Disabled control of system clock
I20260927 15:12:23.382881 17952 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu
/tmp/dist-test-taskiFOyeW/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790521920546562-17952-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790521920546562-17952-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790521920546562-17952-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790521920546562-17952-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.136.62:40869
--webserver_interface=127.17.136.62
--webserver_port=0
--builtin_ntp_servers=127.17.136.20:37313
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.136.62:40869
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260927 15:12:23.486163 22534 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260927 15:12:23.486413 22534 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260927 15:12:23.486449 22534 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260927 15:12:23.490393 22534 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260927 15:12:23.490453 22534 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260927 15:12:23.490466 22534 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260927 15:12:23.490481 22534 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260927 15:12:23.490501 22534 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260927 15:12:23.495070 22534 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.136.20:37313
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790521920546562-17952-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790521920546562-17952-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.17.136.62:40869
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.136.62:40869
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790521920546562-17952-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.17.136.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22534
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790521920546562-17952-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 27 Sep 2026 14:27:13 UTC on ccycloud.quasar-psqrth.root.comops.site
build id 4676138
I20260927 15:12:23.496104 22534 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260927 15:12:23.497352 22534 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260927 15:12:23.505268 22539 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260927 15:12:23.505242 22542 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260927 15:12:23.505426 22534 server_base.cc:1034] running on GCE node
W20260927 15:12:23.505259 22540 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260927 15:12:23.506067 22534 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260927 15:12:23.507151 22534 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260927 15:12:23.508313 22534 hybrid_clock.cc:648] HybridClock initialized: now 1790521943508293 us; error 31 us; skew 500 ppm
I20260927 15:12:23.510041 22534 webserver.cc:460] Webserver started at http://127.17.136.62:40755/ using document root <none> and password file <none>
I20260927 15:12:23.510536 22534 fs_manager.cc:359] Metadata directory not provided
I20260927 15:12:23.510589 22534 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260927 15:12:23.510748 22534 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260927 15:12:23.512677 22534 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790521920546562-17952-0/minicluster-data/master-0/data/instance:
uuid: "572fde2d97b14ac0bd774e3aa7ac6265"
format_stamp: "Formatted at 2026-09-27 15:12:23 on dist-test-slave-5s2t"
server_key: "bd86e9c290b39126bf656d3bdd41c281"
server_key_iv: "da46b0c8b172ad2e88cf8b4380433e8b"
server_key_version: "encryptionkey@0"
I20260927 15:12:23.513168 22534 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790521920546562-17952-0/minicluster-data/master-0/wal/instance:
uuid: "572fde2d97b14ac0bd774e3aa7ac6265"
format_stamp: "Formatted at 2026-09-27 15:12:23 on dist-test-slave-5s2t"
server_key: "bd86e9c290b39126bf656d3bdd41c281"
server_key_iv: "da46b0c8b172ad2e88cf8b4380433e8b"
server_key_version: "encryptionkey@0"
I20260927 15:12:23.516474 22534 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260927 15:12:23.518637 22548 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260927 15:12:23.519812 22534 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260927 15:12:23.519902 22534 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790521920546562-17952-0/minicluster-data/master-0/data,/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790521920546562-17952-0/minicluster-data/master-0/wal
uuid: "572fde2d97b14ac0bd774e3aa7ac6265"
format_stamp: "Formatted at 2026-09-27 15:12:23 on dist-test-slave-5s2t"
server_key: "bd86e9c290b39126bf656d3bdd41c281"
server_key_iv: "da46b0c8b172ad2e88cf8b4380433e8b"
server_key_version: "encryptionkey@0"
I20260927 15:12:23.520016 22534 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790521920546562-17952-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790521920546562-17952-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790521920546562-17952-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260927 15:12:23.524189 22534 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260927 15:12:23.524711 22534 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260927 15:12:23.524834 22534 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260927 15:12:23.530751 22534 rpc_server.cc:307] RPC server started. Bound to: 127.17.136.62:40869
I20260927 15:12:23.530761 22600 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.136.62:40869 every 8 connection(s)
I20260927 15:12:23.531633 22534 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790521920546562-17952-0/minicluster-data/master-0/data/info.pb
I20260927 15:12:23.534523 22601 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:12:23.537585 17952 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu as pid 22534
I20260927 15:12:23.537676 17952 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790521920546562-17952-0/minicluster-data/master-0/wal/instance
I20260927 15:12:23.537912 17952 external_mini_cluster.cc:1428] Setting key 97acc3e8ba99bb0c954f4711f76be8ab
I20260927 15:12:23.539923 22601 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 572fde2d97b14ac0bd774e3aa7ac6265: Bootstrap starting.
I20260927 15:12:23.542068 22601 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 572fde2d97b14ac0bd774e3aa7ac6265: Neither blocks nor log segments found. Creating new log.
I20260927 15:12:23.542795 22601 log.cc:824] T 00000000000000000000000000000000 P 572fde2d97b14ac0bd774e3aa7ac6265: Log is configured to *not* fsync() on all Append() calls
I20260927 15:12:23.543176 22604 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:23.539187 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36502 (local address 127.17.136.62:40869)
0927 15:12:23.539798 (+ 611us) server_negotiation.cc:206] Beginning negotiation
0927 15:12:23.539811 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0927 15:12:23.539845 (+ 34us) server_negotiation.cc:407] Connection header received
0927 15:12:23.540453 (+ 608us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:12:23.540469 (+ 16us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:12:23.540793 (+ 324us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:12:23.541096 (+ 303us) server_negotiation.cc:226] Negotiated authn=SASL
0927 15:12:23.541879 (+ 783us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0927 15:12:23.541886 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0927 15:12:23.541900 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0927 15:12:23.541914 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0927 15:12:23.541982 (+ 68us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0927 15:12:23.542006 (+ 24us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0927 15:12:23.542118 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0927 15:12:23.542247 (+ 129us) server_negotiation.cc:299] Negotiation successful
0927 15:12:23.542478 (+ 231us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":286,"thread_start_us":118,"threads_started":1}
I20260927 15:12:23.544674 22601 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 572fde2d97b14ac0bd774e3aa7ac6265: No bootstrap required, opened a new log
I20260927 15:12:23.548066 22601 raft_consensus.cc:348] T 00000000000000000000000000000000 P 572fde2d97b14ac0bd774e3aa7ac6265 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "572fde2d97b14ac0bd774e3aa7ac6265" member_type: VOTER last_known_addr { host: "127.17.136.62" port: 40869 } }
I20260927 15:12:23.548262 22601 raft_consensus.cc:374] T 00000000000000000000000000000000 P 572fde2d97b14ac0bd774e3aa7ac6265 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:12:23.548313 22601 raft_consensus.cc:729] T 00000000000000000000000000000000 P 572fde2d97b14ac0bd774e3aa7ac6265 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 572fde2d97b14ac0bd774e3aa7ac6265, State: Initialized, Role: FOLLOWER
I20260927 15:12:23.548696 22601 consensus_queue.cc:260] T 00000000000000000000000000000000 P 572fde2d97b14ac0bd774e3aa7ac6265 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "572fde2d97b14ac0bd774e3aa7ac6265" member_type: VOTER last_known_addr { host: "127.17.136.62" port: 40869 } }
I20260927 15:12:23.548817 22601 raft_consensus.cc:388] T 00000000000000000000000000000000 P 572fde2d97b14ac0bd774e3aa7ac6265 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260927 15:12:23.548877 22601 raft_consensus.cc:482] T 00000000000000000000000000000000 P 572fde2d97b14ac0bd774e3aa7ac6265 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260927 15:12:23.548964 22601 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 572fde2d97b14ac0bd774e3aa7ac6265 [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:12:23.549840 22601 raft_consensus.cc:504] T 00000000000000000000000000000000 P 572fde2d97b14ac0bd774e3aa7ac6265 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "572fde2d97b14ac0bd774e3aa7ac6265" member_type: VOTER last_known_addr { host: "127.17.136.62" port: 40869 } }
I20260927 15:12:23.550128 22601 leader_election.cc:302] T 00000000000000000000000000000000 P 572fde2d97b14ac0bd774e3aa7ac6265 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 572fde2d97b14ac0bd774e3aa7ac6265; no voters:
I20260927 15:12:23.550386 22601 leader_election.cc:288] T 00000000000000000000000000000000 P 572fde2d97b14ac0bd774e3aa7ac6265 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260927 15:12:23.550514 22606 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 572fde2d97b14ac0bd774e3aa7ac6265 [term 1 FOLLOWER]: Leader election won for term 1
I20260927 15:12:23.550706 22606 raft_consensus.cc:686] T 00000000000000000000000000000000 P 572fde2d97b14ac0bd774e3aa7ac6265 [term 1 LEADER]: Becoming Leader. State: Replica: 572fde2d97b14ac0bd774e3aa7ac6265, State: Running, Role: LEADER
I20260927 15:12:23.550961 22606 consensus_queue.cc:237] T 00000000000000000000000000000000 P 572fde2d97b14ac0bd774e3aa7ac6265 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "572fde2d97b14ac0bd774e3aa7ac6265" member_type: VOTER last_known_addr { host: "127.17.136.62" port: 40869 } }
I20260927 15:12:23.551476 22601 sys_catalog.cc:564] T 00000000000000000000000000000000 P 572fde2d97b14ac0bd774e3aa7ac6265 [sys.catalog]: configured and running, proceeding with master startup.
I20260927 15:12:23.552484 22607 sys_catalog.cc:455] T 00000000000000000000000000000000 P 572fde2d97b14ac0bd774e3aa7ac6265 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "572fde2d97b14ac0bd774e3aa7ac6265" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "572fde2d97b14ac0bd774e3aa7ac6265" member_type: VOTER last_known_addr { host: "127.17.136.62" port: 40869 } } }
I20260927 15:12:23.552615 22607 sys_catalog.cc:458] T 00000000000000000000000000000000 P 572fde2d97b14ac0bd774e3aa7ac6265 [sys.catalog]: This master's current role is: LEADER
I20260927 15:12:23.552492 22608 sys_catalog.cc:455] T 00000000000000000000000000000000 P 572fde2d97b14ac0bd774e3aa7ac6265 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 572fde2d97b14ac0bd774e3aa7ac6265. Latest consensus state: current_term: 1 leader_uuid: "572fde2d97b14ac0bd774e3aa7ac6265" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "572fde2d97b14ac0bd774e3aa7ac6265" member_type: VOTER last_known_addr { host: "127.17.136.62" port: 40869 } } }
I20260927 15:12:23.552892 22608 sys_catalog.cc:458] T 00000000000000000000000000000000 P 572fde2d97b14ac0bd774e3aa7ac6265 [sys.catalog]: This master's current role is: LEADER
I20260927 15:12:23.552963 22615 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260927 15:12:23.555716 22615 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260927 15:12:23.560348 22615 catalog_manager.cc:1347] Generated new cluster ID: f31d023bdcb846b7b5de09884ec8c27d
I20260927 15:12:23.560403 22615 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260927 15:12:23.576462 22615 catalog_manager.cc:1370] Generated new certificate authority record
I20260927 15:12:23.576730 22615 catalog_manager.cc:1504] Loading token signing keys...
I20260927 15:12:23.586139 22615 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 572fde2d97b14ac0bd774e3aa7ac6265: Generated new TSK 0
I20260927 15:12:23.586818 22615 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260927 15:12:23.602166 17952 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu
/tmp/dist-test-taskiFOyeW/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790521920546562-17952-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790521920546562-17952-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790521920546562-17952-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790521920546562-17952-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.136.1:0
--local_ip_for_outbound_sockets=127.17.136.1
--webserver_interface=127.17.136.1
--webserver_port=0
--tserver_master_addrs=127.17.136.62:40869
--builtin_ntp_servers=127.17.136.20:37313
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260927 15:12:23.706704 22625 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260927 15:12:23.706940 22625 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260927 15:12:23.706983 22625 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260927 15:12:23.710917 22625 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260927 15:12:23.710968 22625 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260927 15:12:23.711023 22625 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.136.1
I20260927 15:12:23.715636 22625 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.136.20:37313
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790521920546562-17952-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790521920546562-17952-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.136.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790521920546562-17952-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.17.136.1
--webserver_port=0
--tserver_master_addrs=127.17.136.62:40869
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22625
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.136.1
--log_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790521920546562-17952-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 27 Sep 2026 14:27:13 UTC on ccycloud.quasar-psqrth.root.comops.site
build id 4676138
I20260927 15:12:23.716595 22625 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260927 15:12:23.717900 22625 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260927 15:12:23.726658 22631 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260927 15:12:23.726696 22625 server_base.cc:1034] running on GCE node
W20260927 15:12:23.726727 22630 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260927 15:12:23.726768 22633 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260927 15:12:23.727268 22625 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260927 15:12:23.727847 22625 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260927 15:12:23.729002 22625 hybrid_clock.cc:648] HybridClock initialized: now 1790521943728988 us; error 37 us; skew 500 ppm
I20260927 15:12:23.730614 22625 webserver.cc:460] Webserver started at http://127.17.136.1:38443/ using document root <none> and password file <none>
I20260927 15:12:23.731125 22625 fs_manager.cc:359] Metadata directory not provided
I20260927 15:12:23.731189 22625 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260927 15:12:23.731402 22625 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260927 15:12:23.733289 22625 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790521920546562-17952-0/minicluster-data/ts-0/data/instance:
uuid: "f724b075f26b4c2eab27c2c47f90f0c3"
format_stamp: "Formatted at 2026-09-27 15:12:23 on dist-test-slave-5s2t"
server_key: "7ec08f6d6489c0c53d65128bdf5acb2d"
server_key_iv: "ab69d5746b955bddc9eb3d133f70bd97"
server_key_version: "encryptionkey@0"
I20260927 15:12:23.733786 22625 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790521920546562-17952-0/minicluster-data/ts-0/wal/instance:
uuid: "f724b075f26b4c2eab27c2c47f90f0c3"
format_stamp: "Formatted at 2026-09-27 15:12:23 on dist-test-slave-5s2t"
server_key: "7ec08f6d6489c0c53d65128bdf5acb2d"
server_key_iv: "ab69d5746b955bddc9eb3d133f70bd97"
server_key_version: "encryptionkey@0"
I20260927 15:12:23.737164 22625 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260927 15:12:23.739423 22639 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260927 15:12:23.740532 22625 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260927 15:12:23.740628 22625 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790521920546562-17952-0/minicluster-data/ts-0/data,/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790521920546562-17952-0/minicluster-data/ts-0/wal
uuid: "f724b075f26b4c2eab27c2c47f90f0c3"
format_stamp: "Formatted at 2026-09-27 15:12:23 on dist-test-slave-5s2t"
server_key: "7ec08f6d6489c0c53d65128bdf5acb2d"
server_key_iv: "ab69d5746b955bddc9eb3d133f70bd97"
server_key_version: "encryptionkey@0"
I20260927 15:12:23.740720 22625 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790521920546562-17952-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790521920546562-17952-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790521920546562-17952-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260927 15:12:23.744995 22625 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260927 15:12:23.745537 22625 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260927 15:12:23.745680 22625 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260927 15:12:23.746161 22625 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260927 15:12:23.747004 22625 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260927 15:12:23.747049 22625 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260927 15:12:23.747095 22625 ts_tablet_manager.cc:610] Registered 0 tablets
I20260927 15:12:23.747124 22625 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260927 15:12:23.754957 22625 rpc_server.cc:307] RPC server started. Bound to: 127.17.136.1:44009
I20260927 15:12:23.755003 22752 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.136.1:44009 every 8 connection(s)
I20260927 15:12:23.755801 22625 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790521920546562-17952-0/minicluster-data/ts-0/data/info.pb
I20260927 15:12:23.757454 17952 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu as pid 22625
I20260927 15:12:23.757591 17952 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790521920546562-17952-0/minicluster-data/ts-0/wal/instance
I20260927 15:12:23.757825 17952 external_mini_cluster.cc:1428] Setting key 54eaa5474ea3eaef174f38a1f570e107
I20260927 15:12:23.759570 17952 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu
/tmp/dist-test-taskiFOyeW/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790521920546562-17952-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790521920546562-17952-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790521920546562-17952-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790521920546562-17952-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.136.2:0
--local_ip_for_outbound_sockets=127.17.136.2
--webserver_interface=127.17.136.2
--webserver_port=0
--tserver_master_addrs=127.17.136.62:40869
--builtin_ntp_servers=127.17.136.20:37313
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
I20260927 15:12:23.761580 22604 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:23.757379 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.136.1:46795 (local address 127.17.136.62:40869)
0927 15:12:23.757526 (+ 147us) server_negotiation.cc:206] Beginning negotiation
0927 15:12:23.757531 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0927 15:12:23.758650 (+ 1119us) server_negotiation.cc:407] Connection header received
0927 15:12:23.760022 (+ 1372us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:12:23.760026 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:12:23.760063 (+ 37us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:12:23.760148 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0927 15:12:23.761104 (+ 956us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0927 15:12:23.761108 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0927 15:12:23.761111 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0927 15:12:23.761123 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0927 15:12:23.761146 (+ 23us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0927 15:12:23.761156 (+ 10us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0927 15:12:23.761242 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0927 15:12:23.761402 (+ 160us) server_negotiation.cc:299] Negotiation successful
0927 15:12:23.761453 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260927 15:12:23.762455 22755 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:23.757828 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.62:40869 (local address 127.17.136.1:46795)
0927 15:12:23.758509 (+ 681us) negotiation.cc:107] Waiting for socket to connect
0927 15:12:23.758556 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0927 15:12:23.759788 (+ 1232us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0927 15:12:23.760269 (+ 481us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0927 15:12:23.760275 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0927 15:12:23.760359 (+ 84us) client_negotiation.cc:189] Negotiated authn=SASL
0927 15:12:23.760851 (+ 492us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0927 15:12:23.760853 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0927 15:12:23.760891 (+ 38us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0927 15:12:23.760958 (+ 67us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0927 15:12:23.761265 (+ 307us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0927 15:12:23.761273 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0927 15:12:23.761278 (+ 5us) client_negotiation.cc:769] Sending connection context
0927 15:12:23.761427 (+ 149us) client_negotiation.cc:240] Negotiation successful
0927 15:12:23.761607 (+ 180us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":249,"thread_start_us":99,"threads_started":1}
I20260927 15:12:23.763584 22753 heartbeater.cc:347] Connected to a master server at 127.17.136.62:40869
I20260927 15:12:23.763784 22753 heartbeater.cc:464] Registering TS with master...
I20260927 15:12:23.764175 22753 heartbeater.cc:511] Master 127.17.136.62:40869 requested a full tablet report, sending...
I20260927 15:12:23.765683 22565 ts_manager.cc:194] Registered new tserver with Master: f724b075f26b4c2eab27c2c47f90f0c3 (127.17.136.1:44009)
W20260927 15:12:23.865566 22756 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260927 15:12:23.865808 22756 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260927 15:12:23.865846 22756 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260927 15:12:23.869761 22756 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260927 15:12:23.869810 22756 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260927 15:12:23.869863 22756 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.136.2
I20260927 15:12:23.874480 22756 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.136.20:37313
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790521920546562-17952-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790521920546562-17952-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.136.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790521920546562-17952-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.17.136.2
--webserver_port=0
--tserver_master_addrs=127.17.136.62:40869
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22756
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.136.2
--log_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790521920546562-17952-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 27 Sep 2026 14:27:13 UTC on ccycloud.quasar-psqrth.root.comops.site
build id 4676138
I20260927 15:12:23.875563 22756 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260927 15:12:23.876844 22756 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260927 15:12:23.886653 22764 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260927 15:12:23.886641 22762 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260927 15:12:23.886684 22761 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260927 15:12:23.886910 22756 server_base.cc:1034] running on GCE node
I20260927 15:12:23.887383 22756 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260927 15:12:23.888024 22756 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260927 15:12:23.889175 22756 hybrid_clock.cc:648] HybridClock initialized: now 1790521943889146 us; error 54 us; skew 500 ppm
I20260927 15:12:23.890926 22756 webserver.cc:460] Webserver started at http://127.17.136.2:39357/ using document root <none> and password file <none>
I20260927 15:12:23.891541 22756 fs_manager.cc:359] Metadata directory not provided
I20260927 15:12:23.891621 22756 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260927 15:12:23.891829 22756 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260927 15:12:23.893826 22756 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790521920546562-17952-0/minicluster-data/ts-1/data/instance:
uuid: "92d00fc463e0472bbb68f8b45b2d34eb"
format_stamp: "Formatted at 2026-09-27 15:12:23 on dist-test-slave-5s2t"
server_key: "54ef5abadce24326de08b2111966d32c"
server_key_iv: "d3a64cbaded4c39e2e3085c57abeb70a"
server_key_version: "encryptionkey@0"
I20260927 15:12:23.894356 22756 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790521920546562-17952-0/minicluster-data/ts-1/wal/instance:
uuid: "92d00fc463e0472bbb68f8b45b2d34eb"
format_stamp: "Formatted at 2026-09-27 15:12:23 on dist-test-slave-5s2t"
server_key: "54ef5abadce24326de08b2111966d32c"
server_key_iv: "d3a64cbaded4c39e2e3085c57abeb70a"
server_key_version: "encryptionkey@0"
I20260927 15:12:23.897869 22756 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.006s sys 0.000s
I20260927 15:12:23.900269 22770 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260927 15:12:23.901463 22756 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260927 15:12:23.901579 22756 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790521920546562-17952-0/minicluster-data/ts-1/data,/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790521920546562-17952-0/minicluster-data/ts-1/wal
uuid: "92d00fc463e0472bbb68f8b45b2d34eb"
format_stamp: "Formatted at 2026-09-27 15:12:23 on dist-test-slave-5s2t"
server_key: "54ef5abadce24326de08b2111966d32c"
server_key_iv: "d3a64cbaded4c39e2e3085c57abeb70a"
server_key_version: "encryptionkey@0"
I20260927 15:12:23.901674 22756 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790521920546562-17952-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790521920546562-17952-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790521920546562-17952-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260927 15:12:23.905974 22756 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260927 15:12:23.906548 22756 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260927 15:12:23.906695 22756 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260927 15:12:23.907204 22756 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260927 15:12:23.908089 22756 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260927 15:12:23.908133 22756 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260927 15:12:23.908181 22756 ts_tablet_manager.cc:610] Registered 0 tablets
I20260927 15:12:23.908209 22756 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260927 15:12:23.915868 22756 rpc_server.cc:307] RPC server started. Bound to: 127.17.136.2:37737
I20260927 15:12:23.915916 22883 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.136.2:37737 every 8 connection(s)
I20260927 15:12:23.916777 22756 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790521920546562-17952-0/minicluster-data/ts-1/data/info.pb
I20260927 15:12:23.922509 22604 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:23.918538 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.136.2:49091 (local address 127.17.136.62:40869)
0927 15:12:23.918671 (+ 133us) server_negotiation.cc:206] Beginning negotiation
0927 15:12:23.918674 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0927 15:12:23.919733 (+ 1059us) server_negotiation.cc:407] Connection header received
0927 15:12:23.920966 (+ 1233us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:12:23.920969 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:12:23.921019 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:12:23.921092 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0927 15:12:23.922077 (+ 985us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0927 15:12:23.922081 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0927 15:12:23.922084 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0927 15:12:23.922096 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0927 15:12:23.922115 (+ 19us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0927 15:12:23.922123 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0927 15:12:23.922198 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0927 15:12:23.922334 (+ 136us) server_negotiation.cc:299] Negotiation successful
0927 15:12:23.922378 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260927 15:12:23.923417 22886 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:23.918935 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.62:40869 (local address 127.17.136.2:49091)
0927 15:12:23.919600 (+ 665us) negotiation.cc:107] Waiting for socket to connect
0927 15:12:23.919639 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0927 15:12:23.920774 (+ 1135us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0927 15:12:23.921255 (+ 481us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0927 15:12:23.921262 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0927 15:12:23.921349 (+ 87us) client_negotiation.cc:189] Negotiated authn=SASL
0927 15:12:23.921839 (+ 490us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0927 15:12:23.921841 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0927 15:12:23.921879 (+ 38us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0927 15:12:23.921945 (+ 66us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0927 15:12:23.922188 (+ 243us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0927 15:12:23.922216 (+ 28us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0927 15:12:23.922223 (+ 7us) client_negotiation.cc:769] Sending connection context
0927 15:12:23.922369 (+ 146us) client_negotiation.cc:240] Negotiation successful
0927 15:12:23.922613 (+ 244us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":231,"thread_start_us":92,"threads_started":1}
I20260927 15:12:23.924435 22884 heartbeater.cc:347] Connected to a master server at 127.17.136.62:40869
I20260927 15:12:23.924633 22884 heartbeater.cc:464] Registering TS with master...
I20260927 15:12:23.924995 22884 heartbeater.cc:511] Master 127.17.136.62:40869 requested a full tablet report, sending...
I20260927 15:12:23.925951 22565 ts_manager.cc:194] Registered new tserver with Master: 92d00fc463e0472bbb68f8b45b2d34eb (127.17.136.2:37737)
I20260927 15:12:23.926405 17952 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu as pid 22756
I20260927 15:12:23.926539 17952 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790521920546562-17952-0/minicluster-data/ts-1/wal/instance
I20260927 15:12:23.926838 17952 external_mini_cluster.cc:1428] Setting key 7ec57090f6c8690cf422983b334cf906
I20260927 15:12:23.928539 17952 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu
/tmp/dist-test-taskiFOyeW/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790521920546562-17952-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790521920546562-17952-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790521920546562-17952-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790521920546562-17952-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.136.3:0
--local_ip_for_outbound_sockets=127.17.136.3
--webserver_interface=127.17.136.3
--webserver_port=0
--tserver_master_addrs=127.17.136.62:40869
--builtin_ntp_servers=127.17.136.20:37313
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260927 15:12:24.033818 22887 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260927 15:12:24.034066 22887 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260927 15:12:24.034106 22887 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260927 15:12:24.038060 22887 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260927 15:12:24.038115 22887 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260927 15:12:24.038169 22887 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.136.3
I20260927 15:12:24.042919 22887 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.136.20:37313
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790521920546562-17952-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790521920546562-17952-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.136.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790521920546562-17952-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.17.136.3
--webserver_port=0
--tserver_master_addrs=127.17.136.62:40869
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22887
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.136.3
--log_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790521920546562-17952-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 27 Sep 2026 14:27:13 UTC on ccycloud.quasar-psqrth.root.comops.site
build id 4676138
I20260927 15:12:24.044049 22887 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260927 15:12:24.045423 22887 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260927 15:12:24.054834 22895 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260927 15:12:24.055027 22887 server_base.cc:1034] running on GCE node
W20260927 15:12:24.054844 22893 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260927 15:12:24.054883 22892 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260927 15:12:24.055486 22887 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260927 15:12:24.056063 22887 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260927 15:12:24.057225 22887 hybrid_clock.cc:648] HybridClock initialized: now 1790521944057206 us; error 30 us; skew 500 ppm
I20260927 15:12:24.058955 22887 webserver.cc:460] Webserver started at http://127.17.136.3:42019/ using document root <none> and password file <none>
I20260927 15:12:24.059540 22887 fs_manager.cc:359] Metadata directory not provided
I20260927 15:12:24.059607 22887 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260927 15:12:24.059793 22887 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260927 15:12:24.061729 22887 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790521920546562-17952-0/minicluster-data/ts-2/data/instance:
uuid: "89c0bbbf981e4e009dccfad3d538d7c3"
format_stamp: "Formatted at 2026-09-27 15:12:24 on dist-test-slave-5s2t"
server_key: "a449c593dab7bb9003be05784045aef7"
server_key_iv: "5b68636a72b2571abbfda16bc37c2285"
server_key_version: "encryptionkey@0"
I20260927 15:12:24.062247 22887 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790521920546562-17952-0/minicluster-data/ts-2/wal/instance:
uuid: "89c0bbbf981e4e009dccfad3d538d7c3"
format_stamp: "Formatted at 2026-09-27 15:12:24 on dist-test-slave-5s2t"
server_key: "a449c593dab7bb9003be05784045aef7"
server_key_iv: "5b68636a72b2571abbfda16bc37c2285"
server_key_version: "encryptionkey@0"
I20260927 15:12:24.065658 22887 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260927 15:12:24.068120 22901 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260927 15:12:24.069309 22887 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260927 15:12:24.069415 22887 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790521920546562-17952-0/minicluster-data/ts-2/data,/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790521920546562-17952-0/minicluster-data/ts-2/wal
uuid: "89c0bbbf981e4e009dccfad3d538d7c3"
format_stamp: "Formatted at 2026-09-27 15:12:24 on dist-test-slave-5s2t"
server_key: "a449c593dab7bb9003be05784045aef7"
server_key_iv: "5b68636a72b2571abbfda16bc37c2285"
server_key_version: "encryptionkey@0"
I20260927 15:12:24.069511 22887 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790521920546562-17952-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790521920546562-17952-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790521920546562-17952-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260927 15:12:24.073859 22887 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260927 15:12:24.074411 22887 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260927 15:12:24.074554 22887 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260927 15:12:24.075038 22887 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260927 15:12:24.075896 22887 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260927 15:12:24.075940 22887 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260927 15:12:24.075987 22887 ts_tablet_manager.cc:610] Registered 0 tablets
I20260927 15:12:24.076020 22887 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260927 15:12:24.084012 22887 rpc_server.cc:307] RPC server started. Bound to: 127.17.136.3:41415
I20260927 15:12:24.084028 23014 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.136.3:41415 every 8 connection(s)
I20260927 15:12:24.084801 22887 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790521920546562-17952-0/minicluster-data/ts-2/data/info.pb
I20260927 15:12:24.090497 22604 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:24.086537 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.136.3:38995 (local address 127.17.136.62:40869)
0927 15:12:24.086649 (+ 112us) server_negotiation.cc:206] Beginning negotiation
0927 15:12:24.086653 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0927 15:12:24.087770 (+ 1117us) server_negotiation.cc:407] Connection header received
0927 15:12:24.088996 (+ 1226us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:12:24.088999 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:12:24.089045 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:12:24.089119 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0927 15:12:24.090091 (+ 972us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0927 15:12:24.090095 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0927 15:12:24.090098 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0927 15:12:24.090108 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0927 15:12:24.090128 (+ 20us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0927 15:12:24.090136 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0927 15:12:24.090211 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0927 15:12:24.090323 (+ 112us) server_negotiation.cc:299] Negotiation successful
0927 15:12:24.090363 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260927 15:12:24.091279 23017 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:24.086955 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.62:40869 (local address 127.17.136.3:38995)
0927 15:12:24.087631 (+ 676us) negotiation.cc:107] Waiting for socket to connect
0927 15:12:24.087670 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0927 15:12:24.088795 (+ 1125us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0927 15:12:24.089276 (+ 481us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0927 15:12:24.089283 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0927 15:12:24.089366 (+ 83us) client_negotiation.cc:189] Negotiated authn=SASL
0927 15:12:24.089850 (+ 484us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0927 15:12:24.089851 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0927 15:12:24.089898 (+ 47us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0927 15:12:24.089961 (+ 63us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0927 15:12:24.090201 (+ 240us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0927 15:12:24.090208 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0927 15:12:24.090213 (+ 5us) client_negotiation.cc:769] Sending connection context
0927 15:12:24.090354 (+ 141us) client_negotiation.cc:240] Negotiation successful
0927 15:12:24.090575 (+ 221us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":259,"thread_start_us":104,"threads_started":1}
I20260927 15:12:24.092285 23015 heartbeater.cc:347] Connected to a master server at 127.17.136.62:40869
I20260927 15:12:24.092492 23015 heartbeater.cc:464] Registering TS with master...
I20260927 15:12:24.092845 23015 heartbeater.cc:511] Master 127.17.136.62:40869 requested a full tablet report, sending...
I20260927 15:12:24.093770 22565 ts_manager.cc:194] Registered new tserver with Master: 89c0bbbf981e4e009dccfad3d538d7c3 (127.17.136.3:41415)
I20260927 15:12:24.093966 17952 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu as pid 22887
I20260927 15:12:24.094079 17952 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790521920546562-17952-0/minicluster-data/ts-2/wal/instance
I20260927 15:12:24.094439 17952 external_mini_cluster.cc:1428] Setting key 8e63efb9f09d91ba29942f526a6f84dd
I20260927 15:12:24.096333 17952 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260927 15:12:24.099291 22604 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:24.098024 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36504 (local address 127.17.136.62:40869)
0927 15:12:24.098114 (+ 90us) server_negotiation.cc:206] Beginning negotiation
0927 15:12:24.098117 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0927 15:12:24.098313 (+ 196us) server_negotiation.cc:407] Connection header received
0927 15:12:24.098396 (+ 83us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:12:24.098398 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:12:24.098440 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:12:24.098499 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0927 15:12:24.099006 (+ 507us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0927 15:12:24.099009 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0927 15:12:24.099011 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0927 15:12:24.099020 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0927 15:12:24.099036 (+ 16us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0927 15:12:24.099042 (+ 6us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0927 15:12:24.099109 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0927 15:12:24.099151 (+ 42us) server_negotiation.cc:299] Negotiation successful
0927 15:12:24.099180 (+ 29us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260927 15:12:24.101655 22565 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:36504:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:12:24.104638 22565 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:12:24.115330 23031 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:24.113245 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41628 (local address 127.17.136.1:44009)
0927 15:12:24.113900 (+ 655us) server_negotiation.cc:206] Beginning negotiation
0927 15:12:24.113910 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0927 15:12:24.113931 (+ 21us) server_negotiation.cc:407] Connection header received
0927 15:12:24.113978 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:12:24.113983 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:12:24.114150 (+ 167us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:12:24.114279 (+ 129us) server_negotiation.cc:226] Negotiated authn=SASL
0927 15:12:24.114866 (+ 587us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0927 15:12:24.114871 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0927 15:12:24.114879 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0927 15:12:24.114889 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0927 15:12:24.114920 (+ 31us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0927 15:12:24.114940 (+ 20us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0927 15:12:24.115034 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0927 15:12:24.115103 (+ 69us) server_negotiation.cc:299] Negotiation successful
0927 15:12:24.115174 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":561,"thread_start_us":107,"threads_started":1}
I20260927 15:12:24.115319 23027 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:24.112279 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.3:41415 (local address 127.0.0.1:56900)
0927 15:12:24.112976 (+ 697us) negotiation.cc:107] Waiting for socket to connect
0927 15:12:24.112990 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0927 15:12:24.113065 (+ 75us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0927 15:12:24.113692 (+ 627us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0927 15:12:24.113698 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0927 15:12:24.113774 (+ 76us) client_negotiation.cc:189] Negotiated authn=SASL
0927 15:12:24.114283 (+ 509us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0927 15:12:24.114284 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0927 15:12:24.114304 (+ 20us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0927 15:12:24.114370 (+ 66us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0927 15:12:24.114990 (+ 620us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0927 15:12:24.114993 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0927 15:12:24.114996 (+ 3us) client_negotiation.cc:769] Sending connection context
0927 15:12:24.115062 (+ 66us) client_negotiation.cc:240] Negotiation successful
0927 15:12:24.115128 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":635,"thread_start_us":87,"threads_started":1}
I20260927 15:12:24.115434 23028 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:24.112310 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57884 (local address 127.17.136.2:37737)
0927 15:12:24.112609 (+ 299us) server_negotiation.cc:206] Beginning negotiation
0927 15:12:24.112620 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0927 15:12:24.112978 (+ 358us) server_negotiation.cc:407] Connection header received
0927 15:12:24.113035 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:12:24.113040 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:12:24.113231 (+ 191us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:12:24.113363 (+ 132us) server_negotiation.cc:226] Negotiated authn=SASL
0927 15:12:24.114756 (+ 1393us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0927 15:12:24.114762 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0927 15:12:24.114774 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0927 15:12:24.114786 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0927 15:12:24.114828 (+ 42us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0927 15:12:24.114862 (+ 34us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0927 15:12:24.114963 (+ 101us) server_negotiation.cc:1035] Waiting for connection context
0927 15:12:24.115208 (+ 245us) server_negotiation.cc:299] Negotiation successful
0927 15:12:24.115306 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":195,"thread_start_us":91,"threads_started":1}
I20260927 15:12:24.115629 23030 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:24.112898 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56900 (local address 127.17.136.3:41415)
0927 15:12:24.113271 (+ 373us) server_negotiation.cc:206] Beginning negotiation
0927 15:12:24.113282 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0927 15:12:24.113304 (+ 22us) server_negotiation.cc:407] Connection header received
0927 15:12:24.113351 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:12:24.113356 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:12:24.113540 (+ 184us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:12:24.114013 (+ 473us) server_negotiation.cc:226] Negotiated authn=SASL
0927 15:12:24.114836 (+ 823us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0927 15:12:24.114839 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0927 15:12:24.114847 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0927 15:12:24.114853 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0927 15:12:24.114880 (+ 27us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0927 15:12:24.114893 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0927 15:12:24.115393 (+ 500us) server_negotiation.cc:1035] Waiting for connection context
0927 15:12:24.115446 (+ 53us) server_negotiation.cc:299] Negotiation successful
0927 15:12:24.115504 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":281,"thread_start_us":96,"threads_started":1}
I20260927 15:12:24.116045 23026 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:24.112202 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.2:37737 (local address 127.0.0.1:57884)
0927 15:12:24.112745 (+ 543us) negotiation.cc:107] Waiting for socket to connect
0927 15:12:24.112789 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0927 15:12:24.112880 (+ 91us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0927 15:12:24.114019 (+ 1139us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0927 15:12:24.114022 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0927 15:12:24.114035 (+ 13us) client_negotiation.cc:189] Negotiated authn=SASL
0927 15:12:24.114466 (+ 431us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0927 15:12:24.114467 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0927 15:12:24.114477 (+ 10us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0927 15:12:24.114513 (+ 36us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0927 15:12:24.114964 (+ 451us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0927 15:12:24.114973 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0927 15:12:24.114979 (+ 6us) client_negotiation.cc:769] Sending connection context
0927 15:12:24.115075 (+ 96us) client_negotiation.cc:240] Negotiation successful
0927 15:12:24.115128 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":391,"thread_start_us":58,"threads_started":1}
I20260927 15:12:24.115312 23029 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:24.112864 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.1:44009 (local address 127.0.0.1:41628)
0927 15:12:24.113603 (+ 739us) negotiation.cc:107] Waiting for socket to connect
0927 15:12:24.113616 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0927 15:12:24.113684 (+ 68us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0927 15:12:24.114270 (+ 586us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0927 15:12:24.114272 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0927 15:12:24.114286 (+ 14us) client_negotiation.cc:189] Negotiated authn=SASL
0927 15:12:24.114626 (+ 340us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0927 15:12:24.114628 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0927 15:12:24.114635 (+ 7us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0927 15:12:24.114652 (+ 17us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0927 15:12:24.115018 (+ 366us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0927 15:12:24.115021 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0927 15:12:24.115024 (+ 3us) client_negotiation.cc:769] Sending connection context
0927 15:12:24.115093 (+ 69us) client_negotiation.cc:240] Negotiation successful
0927 15:12:24.115138 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":679,"mutex_wait_us":5,"thread_start_us":83,"threads_started":1}
I20260927 15:12:24.118408 22687 tablet_service.cc:1467] Processing CreateTablet for tablet 82b5738cb8e243c5be5a7baf7d147248 (DEFAULT_TABLE table=test-table [id=575ceb0aa22c4168901ed6690ba50119]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:12:24.118288 22949 tablet_service.cc:1467] Processing CreateTablet for tablet 82b5738cb8e243c5be5a7baf7d147248 (DEFAULT_TABLE table=test-table [id=575ceb0aa22c4168901ed6690ba50119]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:12:24.119239 22687 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 82b5738cb8e243c5be5a7baf7d147248. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:12:24.119297 22949 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 82b5738cb8e243c5be5a7baf7d147248. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:12:24.119113 22818 tablet_service.cc:1467] Processing CreateTablet for tablet 82b5738cb8e243c5be5a7baf7d147248 (DEFAULT_TABLE table=test-table [id=575ceb0aa22c4168901ed6690ba50119]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:12:24.119993 22818 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 82b5738cb8e243c5be5a7baf7d147248. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:12:24.125015 23032 tablet_bootstrap.cc:492] T 82b5738cb8e243c5be5a7baf7d147248 P f724b075f26b4c2eab27c2c47f90f0c3: Bootstrap starting.
I20260927 15:12:24.126586 23034 tablet_bootstrap.cc:492] T 82b5738cb8e243c5be5a7baf7d147248 P 89c0bbbf981e4e009dccfad3d538d7c3: Bootstrap starting.
I20260927 15:12:24.127058 23032 tablet_bootstrap.cc:654] T 82b5738cb8e243c5be5a7baf7d147248 P f724b075f26b4c2eab27c2c47f90f0c3: Neither blocks nor log segments found. Creating new log.
I20260927 15:12:24.127548 23033 tablet_bootstrap.cc:492] T 82b5738cb8e243c5be5a7baf7d147248 P 92d00fc463e0472bbb68f8b45b2d34eb: Bootstrap starting.
I20260927 15:12:24.127785 23032 log.cc:824] T 82b5738cb8e243c5be5a7baf7d147248 P f724b075f26b4c2eab27c2c47f90f0c3: Log is configured to *not* fsync() on all Append() calls
I20260927 15:12:24.128512 23034 tablet_bootstrap.cc:654] T 82b5738cb8e243c5be5a7baf7d147248 P 89c0bbbf981e4e009dccfad3d538d7c3: Neither blocks nor log segments found. Creating new log.
I20260927 15:12:24.129281 23034 log.cc:824] T 82b5738cb8e243c5be5a7baf7d147248 P 89c0bbbf981e4e009dccfad3d538d7c3: Log is configured to *not* fsync() on all Append() calls
I20260927 15:12:24.129592 23033 tablet_bootstrap.cc:654] T 82b5738cb8e243c5be5a7baf7d147248 P 92d00fc463e0472bbb68f8b45b2d34eb: Neither blocks nor log segments found. Creating new log.
I20260927 15:12:24.129719 23032 tablet_bootstrap.cc:492] T 82b5738cb8e243c5be5a7baf7d147248 P f724b075f26b4c2eab27c2c47f90f0c3: No bootstrap required, opened a new log
I20260927 15:12:24.129902 23032 ts_tablet_manager.cc:1397] T 82b5738cb8e243c5be5a7baf7d147248 P f724b075f26b4c2eab27c2c47f90f0c3: Time spent bootstrapping tablet: real 0.005s user 0.003s sys 0.000s
I20260927 15:12:24.130252 23033 log.cc:824] T 82b5738cb8e243c5be5a7baf7d147248 P 92d00fc463e0472bbb68f8b45b2d34eb: Log is configured to *not* fsync() on all Append() calls
I20260927 15:12:24.131107 23034 tablet_bootstrap.cc:492] T 82b5738cb8e243c5be5a7baf7d147248 P 89c0bbbf981e4e009dccfad3d538d7c3: No bootstrap required, opened a new log
I20260927 15:12:24.131289 23034 ts_tablet_manager.cc:1397] T 82b5738cb8e243c5be5a7baf7d147248 P 89c0bbbf981e4e009dccfad3d538d7c3: Time spent bootstrapping tablet: real 0.005s user 0.005s sys 0.000s
I20260927 15:12:24.131771 23033 tablet_bootstrap.cc:492] T 82b5738cb8e243c5be5a7baf7d147248 P 92d00fc463e0472bbb68f8b45b2d34eb: No bootstrap required, opened a new log
I20260927 15:12:24.131963 23033 ts_tablet_manager.cc:1397] T 82b5738cb8e243c5be5a7baf7d147248 P 92d00fc463e0472bbb68f8b45b2d34eb: Time spent bootstrapping tablet: real 0.005s user 0.003s sys 0.001s
I20260927 15:12:24.134644 23032 raft_consensus.cc:348] T 82b5738cb8e243c5be5a7baf7d147248 P f724b075f26b4c2eab27c2c47f90f0c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d00fc463e0472bbb68f8b45b2d34eb" member_type: VOTER last_known_addr { host: "127.17.136.2" port: 37737 } } peers { permanent_uuid: "89c0bbbf981e4e009dccfad3d538d7c3" member_type: VOTER last_known_addr { host: "127.17.136.3" port: 41415 } } peers { permanent_uuid: "f724b075f26b4c2eab27c2c47f90f0c3" member_type: VOTER last_known_addr { host: "127.17.136.1" port: 44009 } }
I20260927 15:12:24.134899 23032 raft_consensus.cc:374] T 82b5738cb8e243c5be5a7baf7d147248 P f724b075f26b4c2eab27c2c47f90f0c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:12:24.134951 23032 raft_consensus.cc:729] T 82b5738cb8e243c5be5a7baf7d147248 P f724b075f26b4c2eab27c2c47f90f0c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f724b075f26b4c2eab27c2c47f90f0c3, State: Initialized, Role: FOLLOWER
I20260927 15:12:24.135111 23033 raft_consensus.cc:348] T 82b5738cb8e243c5be5a7baf7d147248 P 92d00fc463e0472bbb68f8b45b2d34eb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d00fc463e0472bbb68f8b45b2d34eb" member_type: VOTER last_known_addr { host: "127.17.136.2" port: 37737 } } peers { permanent_uuid: "89c0bbbf981e4e009dccfad3d538d7c3" member_type: VOTER last_known_addr { host: "127.17.136.3" port: 41415 } } peers { permanent_uuid: "f724b075f26b4c2eab27c2c47f90f0c3" member_type: VOTER last_known_addr { host: "127.17.136.1" port: 44009 } }
I20260927 15:12:24.135353 23033 raft_consensus.cc:374] T 82b5738cb8e243c5be5a7baf7d147248 P 92d00fc463e0472bbb68f8b45b2d34eb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:12:24.135413 23033 raft_consensus.cc:729] T 82b5738cb8e243c5be5a7baf7d147248 P 92d00fc463e0472bbb68f8b45b2d34eb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92d00fc463e0472bbb68f8b45b2d34eb, State: Initialized, Role: FOLLOWER
I20260927 15:12:24.135406 23032 consensus_queue.cc:260] T 82b5738cb8e243c5be5a7baf7d147248 P f724b075f26b4c2eab27c2c47f90f0c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d00fc463e0472bbb68f8b45b2d34eb" member_type: VOTER last_known_addr { host: "127.17.136.2" port: 37737 } } peers { permanent_uuid: "89c0bbbf981e4e009dccfad3d538d7c3" member_type: VOTER last_known_addr { host: "127.17.136.3" port: 41415 } } peers { permanent_uuid: "f724b075f26b4c2eab27c2c47f90f0c3" member_type: VOTER last_known_addr { host: "127.17.136.1" port: 44009 } }
I20260927 15:12:24.135349 23034 raft_consensus.cc:348] T 82b5738cb8e243c5be5a7baf7d147248 P 89c0bbbf981e4e009dccfad3d538d7c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d00fc463e0472bbb68f8b45b2d34eb" member_type: VOTER last_known_addr { host: "127.17.136.2" port: 37737 } } peers { permanent_uuid: "89c0bbbf981e4e009dccfad3d538d7c3" member_type: VOTER last_known_addr { host: "127.17.136.3" port: 41415 } } peers { permanent_uuid: "f724b075f26b4c2eab27c2c47f90f0c3" member_type: VOTER last_known_addr { host: "127.17.136.1" port: 44009 } }
I20260927 15:12:24.135571 23034 raft_consensus.cc:374] T 82b5738cb8e243c5be5a7baf7d147248 P 89c0bbbf981e4e009dccfad3d538d7c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:12:24.135623 23034 raft_consensus.cc:729] T 82b5738cb8e243c5be5a7baf7d147248 P 89c0bbbf981e4e009dccfad3d538d7c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89c0bbbf981e4e009dccfad3d538d7c3, State: Initialized, Role: FOLLOWER
I20260927 15:12:24.135852 23033 consensus_queue.cc:260] T 82b5738cb8e243c5be5a7baf7d147248 P 92d00fc463e0472bbb68f8b45b2d34eb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d00fc463e0472bbb68f8b45b2d34eb" member_type: VOTER last_known_addr { host: "127.17.136.2" port: 37737 } } peers { permanent_uuid: "89c0bbbf981e4e009dccfad3d538d7c3" member_type: VOTER last_known_addr { host: "127.17.136.3" port: 41415 } } peers { permanent_uuid: "f724b075f26b4c2eab27c2c47f90f0c3" member_type: VOTER last_known_addr { host: "127.17.136.1" port: 44009 } }
I20260927 15:12:24.136039 22753 heartbeater.cc:503] Master 127.17.136.62:40869 was elected leader, sending a full tablet report...
I20260927 15:12:24.136031 23034 consensus_queue.cc:260] T 82b5738cb8e243c5be5a7baf7d147248 P 89c0bbbf981e4e009dccfad3d538d7c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d00fc463e0472bbb68f8b45b2d34eb" member_type: VOTER last_known_addr { host: "127.17.136.2" port: 37737 } } peers { permanent_uuid: "89c0bbbf981e4e009dccfad3d538d7c3" member_type: VOTER last_known_addr { host: "127.17.136.3" port: 41415 } } peers { permanent_uuid: "f724b075f26b4c2eab27c2c47f90f0c3" member_type: VOTER last_known_addr { host: "127.17.136.1" port: 44009 } }
I20260927 15:12:24.136371 23032 ts_tablet_manager.cc:1428] T 82b5738cb8e243c5be5a7baf7d147248 P f724b075f26b4c2eab27c2c47f90f0c3: Time spent starting tablet: real 0.006s user 0.007s sys 0.000s
I20260927 15:12:24.136701 23033 ts_tablet_manager.cc:1428] T 82b5738cb8e243c5be5a7baf7d147248 P 92d00fc463e0472bbb68f8b45b2d34eb: Time spent starting tablet: real 0.005s user 0.001s sys 0.004s
I20260927 15:12:24.136814 23034 ts_tablet_manager.cc:1428] T 82b5738cb8e243c5be5a7baf7d147248 P 89c0bbbf981e4e009dccfad3d538d7c3: Time spent starting tablet: real 0.005s user 0.005s sys 0.000s
I20260927 15:12:24.137019 22884 heartbeater.cc:503] Master 127.17.136.62:40869 was elected leader, sending a full tablet report...
I20260927 15:12:24.137276 23015 heartbeater.cc:503] Master 127.17.136.62:40869 was elected leader, sending a full tablet report...
W20260927 15:12:24.167732 22885 tablet.cc:2369] T 82b5738cb8e243c5be5a7baf7d147248 P 92d00fc463e0472bbb68f8b45b2d34eb: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260927 15:12:24.256762 22754 tablet.cc:2369] T 82b5738cb8e243c5be5a7baf7d147248 P f724b075f26b4c2eab27c2c47f90f0c3: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260927 15:12:24.261736 23039 raft_consensus.cc:482] T 82b5738cb8e243c5be5a7baf7d147248 P 92d00fc463e0472bbb68f8b45b2d34eb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:12:24.261950 23039 raft_consensus.cc:504] T 82b5738cb8e243c5be5a7baf7d147248 P 92d00fc463e0472bbb68f8b45b2d34eb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d00fc463e0472bbb68f8b45b2d34eb" member_type: VOTER last_known_addr { host: "127.17.136.2" port: 37737 } } peers { permanent_uuid: "89c0bbbf981e4e009dccfad3d538d7c3" member_type: VOTER last_known_addr { host: "127.17.136.3" port: 41415 } } peers { permanent_uuid: "f724b075f26b4c2eab27c2c47f90f0c3" member_type: VOTER last_known_addr { host: "127.17.136.1" port: 44009 } }
I20260927 15:12:24.263003 23039 leader_election.cc:288] T 82b5738cb8e243c5be5a7baf7d147248 P 92d00fc463e0472bbb68f8b45b2d34eb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 89c0bbbf981e4e009dccfad3d538d7c3 (127.17.136.3:41415), f724b075f26b4c2eab27c2c47f90f0c3 (127.17.136.1:44009)
I20260927 15:12:24.264560 22886 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:24.263175 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.3:41415 (local address 127.17.136.2:45837)
0927 15:12:24.263315 (+ 140us) negotiation.cc:107] Waiting for socket to connect
0927 15:12:24.263330 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0927 15:12:24.263411 (+ 81us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0927 15:12:24.263687 (+ 276us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0927 15:12:24.263690 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0927 15:12:24.263705 (+ 15us) client_negotiation.cc:189] Negotiated authn=SASL
0927 15:12:24.264120 (+ 415us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0927 15:12:24.264122 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0927 15:12:24.264133 (+ 11us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0927 15:12:24.264162 (+ 29us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0927 15:12:24.264387 (+ 225us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0927 15:12:24.264389 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0927 15:12:24.264391 (+ 2us) client_negotiation.cc:769] Sending connection context
0927 15:12:24.264441 (+ 50us) client_negotiation.cc:240] Negotiation successful
0927 15:12:24.264469 (+ 28us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":46}
I20260927 15:12:24.264592 23030 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:24.263383 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.136.2:45837 (local address 127.17.136.3:41415)
0927 15:12:24.263511 (+ 128us) server_negotiation.cc:206] Beginning negotiation
0927 15:12:24.263515 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0927 15:12:24.263525 (+ 10us) server_negotiation.cc:407] Connection header received
0927 15:12:24.263557 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:12:24.263559 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:12:24.263588 (+ 29us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:12:24.263651 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0927 15:12:24.264266 (+ 615us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0927 15:12:24.264270 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0927 15:12:24.264273 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0927 15:12:24.264286 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0927 15:12:24.264306 (+ 20us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0927 15:12:24.264316 (+ 10us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0927 15:12:24.264405 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0927 15:12:24.264442 (+ 37us) server_negotiation.cc:299] Negotiation successful
0927 15:12:24.264474 (+ 32us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260927 15:12:24.265079 23031 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:24.263338 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.136.2:43419 (local address 127.17.136.1:44009)
0927 15:12:24.263448 (+ 110us) server_negotiation.cc:206] Beginning negotiation
0927 15:12:24.263453 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0927 15:12:24.263655 (+ 202us) server_negotiation.cc:407] Connection header received
0927 15:12:24.263749 (+ 94us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:12:24.263753 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:12:24.263784 (+ 31us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:12:24.263842 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0927 15:12:24.264710 (+ 868us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0927 15:12:24.264714 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0927 15:12:24.264716 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0927 15:12:24.264729 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0927 15:12:24.264750 (+ 21us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0927 15:12:24.264760 (+ 10us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0927 15:12:24.264840 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0927 15:12:24.264959 (+ 119us) server_negotiation.cc:299] Negotiation successful
0927 15:12:24.264992 (+ 33us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260927 15:12:24.265090 23041 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:24.263226 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.1:44009 (local address 127.17.136.2:43419)
0927 15:12:24.263570 (+ 344us) negotiation.cc:107] Waiting for socket to connect
0927 15:12:24.263580 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0927 15:12:24.263661 (+ 81us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0927 15:12:24.263866 (+ 205us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0927 15:12:24.263868 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0927 15:12:24.263882 (+ 14us) client_negotiation.cc:189] Negotiated authn=SASL
0927 15:12:24.264283 (+ 401us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0927 15:12:24.264285 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0927 15:12:24.264295 (+ 10us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0927 15:12:24.264317 (+ 22us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0927 15:12:24.264845 (+ 528us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0927 15:12:24.264849 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0927 15:12:24.264852 (+ 3us) client_negotiation.cc:769] Sending connection context
0927 15:12:24.264921 (+ 69us) client_negotiation.cc:240] Negotiation successful
0927 15:12:24.264953 (+ 32us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":294,"thread_start_us":102,"threads_started":1}
I20260927 15:12:24.265275 22969 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82b5738cb8e243c5be5a7baf7d147248" candidate_uuid: "92d00fc463e0472bbb68f8b45b2d34eb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89c0bbbf981e4e009dccfad3d538d7c3" is_pre_election: true
I20260927 15:12:24.265556 22969 raft_consensus.cc:2454] T 82b5738cb8e243c5be5a7baf7d147248 P 89c0bbbf981e4e009dccfad3d538d7c3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92d00fc463e0472bbb68f8b45b2d34eb in term 0.
I20260927 15:12:24.265635 22707 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82b5738cb8e243c5be5a7baf7d147248" candidate_uuid: "92d00fc463e0472bbb68f8b45b2d34eb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f724b075f26b4c2eab27c2c47f90f0c3" is_pre_election: true
I20260927 15:12:24.265887 22707 raft_consensus.cc:2454] T 82b5738cb8e243c5be5a7baf7d147248 P f724b075f26b4c2eab27c2c47f90f0c3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92d00fc463e0472bbb68f8b45b2d34eb in term 0.
I20260927 15:12:24.265957 22771 leader_election.cc:302] T 82b5738cb8e243c5be5a7baf7d147248 P 92d00fc463e0472bbb68f8b45b2d34eb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89c0bbbf981e4e009dccfad3d538d7c3, 92d00fc463e0472bbb68f8b45b2d34eb; no voters:
I20260927 15:12:24.266222 23039 raft_consensus.cc:2781] T 82b5738cb8e243c5be5a7baf7d147248 P 92d00fc463e0472bbb68f8b45b2d34eb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 15:12:24.266307 23039 raft_consensus.cc:482] T 82b5738cb8e243c5be5a7baf7d147248 P 92d00fc463e0472bbb68f8b45b2d34eb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 15:12:24.266355 23039 raft_consensus.cc:3037] T 82b5738cb8e243c5be5a7baf7d147248 P 92d00fc463e0472bbb68f8b45b2d34eb [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:12:24.267362 23039 raft_consensus.cc:504] T 82b5738cb8e243c5be5a7baf7d147248 P 92d00fc463e0472bbb68f8b45b2d34eb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d00fc463e0472bbb68f8b45b2d34eb" member_type: VOTER last_known_addr { host: "127.17.136.2" port: 37737 } } peers { permanent_uuid: "89c0bbbf981e4e009dccfad3d538d7c3" member_type: VOTER last_known_addr { host: "127.17.136.3" port: 41415 } } peers { permanent_uuid: "f724b075f26b4c2eab27c2c47f90f0c3" member_type: VOTER last_known_addr { host: "127.17.136.1" port: 44009 } }
I20260927 15:12:24.267645 23039 leader_election.cc:288] T 82b5738cb8e243c5be5a7baf7d147248 P 92d00fc463e0472bbb68f8b45b2d34eb [CANDIDATE]: Term 1 election: Requested vote from peers 89c0bbbf981e4e009dccfad3d538d7c3 (127.17.136.3:41415), f724b075f26b4c2eab27c2c47f90f0c3 (127.17.136.1:44009)
I20260927 15:12:24.267954 22707 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82b5738cb8e243c5be5a7baf7d147248" candidate_uuid: "92d00fc463e0472bbb68f8b45b2d34eb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f724b075f26b4c2eab27c2c47f90f0c3"
I20260927 15:12:24.267952 22969 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82b5738cb8e243c5be5a7baf7d147248" candidate_uuid: "92d00fc463e0472bbb68f8b45b2d34eb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89c0bbbf981e4e009dccfad3d538d7c3"
I20260927 15:12:24.268065 22707 raft_consensus.cc:3037] T 82b5738cb8e243c5be5a7baf7d147248 P f724b075f26b4c2eab27c2c47f90f0c3 [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:12:24.268065 22969 raft_consensus.cc:3037] T 82b5738cb8e243c5be5a7baf7d147248 P 89c0bbbf981e4e009dccfad3d538d7c3 [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:12:24.269232 22707 raft_consensus.cc:2454] T 82b5738cb8e243c5be5a7baf7d147248 P f724b075f26b4c2eab27c2c47f90f0c3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92d00fc463e0472bbb68f8b45b2d34eb in term 1.
I20260927 15:12:24.269232 22969 raft_consensus.cc:2454] T 82b5738cb8e243c5be5a7baf7d147248 P 89c0bbbf981e4e009dccfad3d538d7c3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92d00fc463e0472bbb68f8b45b2d34eb in term 1.
I20260927 15:12:24.269503 22773 leader_election.cc:302] T 82b5738cb8e243c5be5a7baf7d147248 P 92d00fc463e0472bbb68f8b45b2d34eb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 92d00fc463e0472bbb68f8b45b2d34eb, f724b075f26b4c2eab27c2c47f90f0c3; no voters:
I20260927 15:12:24.269682 23039 raft_consensus.cc:2781] T 82b5738cb8e243c5be5a7baf7d147248 P 92d00fc463e0472bbb68f8b45b2d34eb [term 1 FOLLOWER]: Leader election won for term 1
I20260927 15:12:24.269860 23039 raft_consensus.cc:686] T 82b5738cb8e243c5be5a7baf7d147248 P 92d00fc463e0472bbb68f8b45b2d34eb [term 1 LEADER]: Becoming Leader. State: Replica: 92d00fc463e0472bbb68f8b45b2d34eb, State: Running, Role: LEADER
I20260927 15:12:24.270171 23039 consensus_queue.cc:237] T 82b5738cb8e243c5be5a7baf7d147248 P 92d00fc463e0472bbb68f8b45b2d34eb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d00fc463e0472bbb68f8b45b2d34eb" member_type: VOTER last_known_addr { host: "127.17.136.2" port: 37737 } } peers { permanent_uuid: "89c0bbbf981e4e009dccfad3d538d7c3" member_type: VOTER last_known_addr { host: "127.17.136.3" port: 41415 } } peers { permanent_uuid: "f724b075f26b4c2eab27c2c47f90f0c3" member_type: VOTER last_known_addr { host: "127.17.136.1" port: 44009 } }
I20260927 15:12:24.273029 22565 catalog_manager.cc:5495] T 82b5738cb8e243c5be5a7baf7d147248 P 92d00fc463e0472bbb68f8b45b2d34eb reported cstate change: term changed from 0 to 1, leader changed from <none> to 92d00fc463e0472bbb68f8b45b2d34eb (127.17.136.2). New cstate: current_term: 1 leader_uuid: "92d00fc463e0472bbb68f8b45b2d34eb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d00fc463e0472bbb68f8b45b2d34eb" member_type: VOTER last_known_addr { host: "127.17.136.2" port: 37737 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "89c0bbbf981e4e009dccfad3d538d7c3" member_type: VOTER last_known_addr { host: "127.17.136.3" port: 41415 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f724b075f26b4c2eab27c2c47f90f0c3" member_type: VOTER last_known_addr { host: "127.17.136.1" port: 44009 } health_report { overall_health: UNKNOWN } } }
I20260927 15:12:24.303141 23028 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:24.301731 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57896 (local address 127.17.136.2:37737)
0927 15:12:24.301851 (+ 120us) server_negotiation.cc:206] Beginning negotiation
0927 15:12:24.301855 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0927 15:12:24.301869 (+ 14us) server_negotiation.cc:407] Connection header received
0927 15:12:24.301946 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:12:24.301948 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:12:24.302008 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:12:24.302080 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0927 15:12:24.302737 (+ 657us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0927 15:12:24.302742 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0927 15:12:24.302744 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0927 15:12:24.302757 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0927 15:12:24.302776 (+ 19us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0927 15:12:24.302784 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0927 15:12:24.302858 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0927 15:12:24.302937 (+ 79us) server_negotiation.cc:299] Negotiation successful
0927 15:12:24.302977 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260927 15:12:24.308725 22707 raft_consensus.cc:1261] T 82b5738cb8e243c5be5a7baf7d147248 P f724b075f26b4c2eab27c2c47f90f0c3 [term 1 FOLLOWER]: Refusing update from remote peer 92d00fc463e0472bbb68f8b45b2d34eb: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260927 15:12:24.308725 22969 raft_consensus.cc:1261] T 82b5738cb8e243c5be5a7baf7d147248 P 89c0bbbf981e4e009dccfad3d538d7c3 [term 1 FOLLOWER]: Refusing update from remote peer 92d00fc463e0472bbb68f8b45b2d34eb: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260927 15:12:24.309379 23042 consensus_queue.cc:1035] T 82b5738cb8e243c5be5a7baf7d147248 P 92d00fc463e0472bbb68f8b45b2d34eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "f724b075f26b4c2eab27c2c47f90f0c3" member_type: VOTER last_known_addr { host: "127.17.136.1" port: 44009 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260927 15:12:24.309543 23039 consensus_queue.cc:1035] T 82b5738cb8e243c5be5a7baf7d147248 P 92d00fc463e0472bbb68f8b45b2d34eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "89c0bbbf981e4e009dccfad3d538d7c3" member_type: VOTER last_known_addr { host: "127.17.136.3" port: 41415 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260927 15:12:24.316864 23046 mvcc.cc:205] Tried to move back new op lower bound from 7333977883881889792 to 7333977883732783104. Current Snapshot: MvccSnapshot[applied={T|T < 7333977883881889792}]
I20260927 15:12:24.318140 23047 mvcc.cc:205] Tried to move back new op lower bound from 7333977883881889792 to 7333977883732783104. Current Snapshot: MvccSnapshot[applied={T|T < 7333977883881889792}]
I20260927 15:12:24.326747 22565 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:36504:
table { table_name: "test-table" } modify_external_catalogs: true
I20260927 15:12:24.326915 22565 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:36504:
table { table_name: "test-table" } modify_external_catalogs: true
I20260927 15:12:24.329242 22565 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 572fde2d97b14ac0bd774e3aa7ac6265: Sending DeleteTablet for 3 replicas of tablet 82b5738cb8e243c5be5a7baf7d147248
I20260927 15:12:24.329954 22818 tablet_service.cc:1514] Processing DeleteTablet for tablet 82b5738cb8e243c5be5a7baf7d147248 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:12:24 UTC) from {username='slave'} at 127.0.0.1:57884
I20260927 15:12:24.330363 17952 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu with pid 22625
I20260927 15:12:24.330466 22949 tablet_service.cc:1514] Processing DeleteTablet for tablet 82b5738cb8e243c5be5a7baf7d147248 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:12:24 UTC) from {username='slave'} at 127.0.0.1:56900
I20260927 15:12:24.332193 23055 tablet_replica.cc:330] T 82b5738cb8e243c5be5a7baf7d147248 P 89c0bbbf981e4e009dccfad3d538d7c3: stopping tablet replica
I20260927 15:12:24.332568 23055 raft_consensus.cc:2229] T 82b5738cb8e243c5be5a7baf7d147248 P 89c0bbbf981e4e009dccfad3d538d7c3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260927 15:12:24.332935 23055 raft_consensus.cc:2258] T 82b5738cb8e243c5be5a7baf7d147248 P 89c0bbbf981e4e009dccfad3d538d7c3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 15:12:24.334522 23055 ts_tablet_manager.cc:1905] T 82b5738cb8e243c5be5a7baf7d147248 P 89c0bbbf981e4e009dccfad3d538d7c3: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260927 15:12:24.335183 22551 connection.cc:535] client connection to 127.17.136.1:44009 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260927 15:12:24.335353 22551 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260927 15:12:24.335424 23054 tablet_replica.cc:330] T 82b5738cb8e243c5be5a7baf7d147248 P 92d00fc463e0472bbb68f8b45b2d34eb: stopping tablet replica
I20260927 15:12:24.335726 23054 raft_consensus.cc:2229] T 82b5738cb8e243c5be5a7baf7d147248 P 92d00fc463e0472bbb68f8b45b2d34eb [term 1 LEADER]: Raft consensus shutting down.
I20260927 15:12:24.336133 23054 raft_consensus.cc:2258] T 82b5738cb8e243c5be5a7baf7d147248 P 92d00fc463e0472bbb68f8b45b2d34eb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 15:12:24.336433 17952 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu with pid 22756
I20260927 15:12:24.336517 23029 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:24.336247 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.1:44009 (local address 127.0.0.1:41644)
0927 15:12:24.336362 (+ 115us) negotiation.cc:107] Waiting for socket to connect
0927 15:12:24.336435 (+ 73us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.136.1:44009: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":30}
W20260927 15:12:24.337059 22551 catalog_manager.cc:4584] TS f724b075f26b4c2eab27c2c47f90f0c3 (127.17.136.1:44009): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 82b5738cb8e243c5be5a7baf7d147248: Network error: Client connection negotiation failed: client connection to 127.17.136.1:44009: connect: Connection refused (error 111)
I20260927 15:12:24.337880 23055 ts_tablet_manager.cc:1918] T 82b5738cb8e243c5be5a7baf7d147248 P 89c0bbbf981e4e009dccfad3d538d7c3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260927 15:12:24.337956 23055 log.cc:1196] T 82b5738cb8e243c5be5a7baf7d147248 P 89c0bbbf981e4e009dccfad3d538d7c3: Deleting WAL directory at /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790521920546562-17952-0/minicluster-data/ts-2/wal/wals/82b5738cb8e243c5be5a7baf7d147248
I20260927 15:12:24.338155 23055 ts_tablet_manager.cc:1939] T 82b5738cb8e243c5be5a7baf7d147248 P 89c0bbbf981e4e009dccfad3d538d7c3: Deleting consensus metadata
I20260927 15:12:24.339133 22549 catalog_manager.cc:4841] TS 89c0bbbf981e4e009dccfad3d538d7c3 (127.17.136.3:41415): tablet 82b5738cb8e243c5be5a7baf7d147248 (table test-table [id=575ceb0aa22c4168901ed6690ba50119]) successfully deleted
I20260927 15:12:24.341601 17952 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu with pid 22887
I20260927 15:12:24.341717 23029 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:24.341482 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.2:37737 (local address 127.0.0.1:57908)
0927 15:12:24.341595 (+ 113us) negotiation.cc:107] Waiting for socket to connect
0927 15:12:24.341642 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.136.2:37737: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":42}
I20260927 15:12:24.346314 17952 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu with pid 22534
2026-09-27T15:12:24Z chronyd exiting
[ OK ] SecurityITest.TestDisableAuthenticationEncryption (990 ms)
[ RUN ] SecurityITest.TestJwtMiniCluster
I20260927 15:12:24.366705 17952 mini_oidc.cc:152] Starting JWKS server
I20260927 15:12:24.368755 17952 webserver.cc:460] Webserver started at https://127.0.0.1:41821/ using document root <none> and password file <none>
I20260927 15:12:24.368930 17952 mini_oidc.cc:189] Starting OIDC Discovery server
I20260927 15:12:24.369199 17952 webserver.cc:460] Webserver started at http://127.0.0.1:34023/ using document root <none> and password file <none>
2026-09-27T15:12:24Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-27T15:12:24Z Disabled control of system clock
I20260927 15:12:24.377557 17952 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu
/tmp/dist-test-taskiFOyeW/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1790521920546562-17952-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1790521920546562-17952-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1790521920546562-17952-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1790521920546562-17952-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.136.62:37071
--webserver_interface=127.17.136.62
--webserver_port=0
--builtin_ntp_servers=127.17.136.20:44925
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.136.62:37071
--enable_jwt_token_auth=true
--jwks_url=https://localhost:41821/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1790521920546562-17952-0/testchainca.cert with env {}
W20260927 15:12:24.483884 23062 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260927 15:12:24.484141 23062 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260927 15:12:24.484195 23062 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260927 15:12:24.488098 23062 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260927 15:12:24.488149 23062 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260927 15:12:24.488171 23062 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260927 15:12:24.488190 23062 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260927 15:12:24.488210 23062 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260927 15:12:24.488240 23062 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260927 15:12:24.488260 23062 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:41821/jwks.json
I20260927 15:12:24.493362 23062 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.136.20:44925
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1790521920546562-17952-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1790521920546562-17952-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.17.136.62:37071
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.136.62:37071
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:41821/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1790521920546562-17952-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.17.136.62
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1790521920546562-17952-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23062
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1790521920546562-17952-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 27 Sep 2026 14:27:13 UTC on ccycloud.quasar-psqrth.root.comops.site
build id 4676138
I20260927 15:12:24.494331 23062 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260927 15:12:24.495278 23062 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260927 15:12:24.502991 23068 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260927 15:12:24.503055 23062 server_base.cc:1034] running on GCE node
W20260927 15:12:24.502977 23067 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260927 15:12:24.502978 23070 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260927 15:12:24.503906 23062 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260927 15:12:24.504923 23062 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260927 15:12:24.506084 23062 hybrid_clock.cc:648] HybridClock initialized: now 1790521944506058 us; error 35 us; skew 500 ppm
I20260927 15:12:24.507769 23062 webserver.cc:460] Webserver started at http://127.17.136.62:43965/ using document root <none> and password file <none>
I20260927 15:12:24.508306 23062 fs_manager.cc:359] Metadata directory not provided
I20260927 15:12:24.508363 23062 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260927 15:12:24.508534 23062 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260927 15:12:24.510407 23062 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1790521920546562-17952-0/minicluster-data/master-0/data/instance:
uuid: "b2b7b836f96e4ab5bc2ffecddd461f91"
format_stamp: "Formatted at 2026-09-27 15:12:24 on dist-test-slave-5s2t"
server_key: "f81bc5ad0f20802fa7ce3c875526dd81"
server_key_iv: "1d1e4d90a04e06878950e501d93716ce"
server_key_version: "encryptionkey@0"
I20260927 15:12:24.510895 23062 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1790521920546562-17952-0/minicluster-data/master-0/wal/instance:
uuid: "b2b7b836f96e4ab5bc2ffecddd461f91"
format_stamp: "Formatted at 2026-09-27 15:12:24 on dist-test-slave-5s2t"
server_key: "f81bc5ad0f20802fa7ce3c875526dd81"
server_key_iv: "1d1e4d90a04e06878950e501d93716ce"
server_key_version: "encryptionkey@0"
I20260927 15:12:24.514240 23062 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.006s sys 0.000s
I20260927 15:12:24.516435 23076 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260927 15:12:24.517565 23062 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260927 15:12:24.517663 23062 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1790521920546562-17952-0/minicluster-data/master-0/data,/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1790521920546562-17952-0/minicluster-data/master-0/wal
uuid: "b2b7b836f96e4ab5bc2ffecddd461f91"
format_stamp: "Formatted at 2026-09-27 15:12:24 on dist-test-slave-5s2t"
server_key: "f81bc5ad0f20802fa7ce3c875526dd81"
server_key_iv: "1d1e4d90a04e06878950e501d93716ce"
server_key_version: "encryptionkey@0"
I20260927 15:12:24.517756 23062 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1790521920546562-17952-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1790521920546562-17952-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1790521920546562-17952-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260927 15:12:24.527943 23062 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260927 15:12:24.528549 23062 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260927 15:12:24.528707 23062 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260927 15:12:24.534751 23062 rpc_server.cc:307] RPC server started. Bound to: 127.17.136.62:37071
I20260927 15:12:24.534767 23128 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.136.62:37071 every 8 connection(s)
I20260927 15:12:24.535614 23062 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1790521920546562-17952-0/minicluster-data/master-0/data/info.pb
I20260927 15:12:24.538636 23129 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:12:24.542165 17952 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu as pid 23062
I20260927 15:12:24.542299 17952 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1790521920546562-17952-0/minicluster-data/master-0/wal/instance
I20260927 15:12:24.542626 17952 external_mini_cluster.cc:1428] Setting key d231ef87250aaa058de416ad7f0cf7ab
I20260927 15:12:24.544426 23129 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b2b7b836f96e4ab5bc2ffecddd461f91: Bootstrap starting.
I20260927 15:12:24.546730 23129 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b2b7b836f96e4ab5bc2ffecddd461f91: Neither blocks nor log segments found. Creating new log.
I20260927 15:12:24.547524 23129 log.cc:824] T 00000000000000000000000000000000 P b2b7b836f96e4ab5bc2ffecddd461f91: Log is configured to *not* fsync() on all Append() calls
I20260927 15:12:24.549569 23129 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b2b7b836f96e4ab5bc2ffecddd461f91: No bootstrap required, opened a new log
I20260927 15:12:24.551323 23132 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:24.543919 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55020 (local address 127.17.136.62:37071)
0927 15:12:24.544473 (+ 554us) server_negotiation.cc:206] Beginning negotiation
0927 15:12:24.544505 (+ 32us) server_negotiation.cc:399] Waiting for connection header
0927 15:12:24.544550 (+ 45us) server_negotiation.cc:407] Connection header received
0927 15:12:24.545216 (+ 666us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:12:24.545233 (+ 17us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:12:24.545613 (+ 380us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:12:24.545874 (+ 261us) server_negotiation.cc:226] Negotiated authn=SASL
0927 15:12:24.546246 (+ 372us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:24.547210 (+ 964us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:24.548307 (+ 1097us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:24.548769 (+ 462us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:24.548877 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:24.549716 (+ 839us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0927 15:12:24.549722 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0927 15:12:24.549733 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0927 15:12:24.550091 (+ 358us) server_negotiation.cc:922] calling sasl_server_start()
0927 15:12:24.550141 (+ 50us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0927 15:12:24.550159 (+ 18us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0927 15:12:24.550229 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0927 15:12:24.550385 (+ 156us) server_negotiation.cc:299] Negotiation successful
0927 15:12:24.550629 (+ 244us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":241,"thread_start_us":94,"threads_started":1}
I20260927 15:12:24.553408 23129 raft_consensus.cc:348] T 00000000000000000000000000000000 P b2b7b836f96e4ab5bc2ffecddd461f91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b2b7b836f96e4ab5bc2ffecddd461f91" member_type: VOTER last_known_addr { host: "127.17.136.62" port: 37071 } }
I20260927 15:12:24.553637 23129 raft_consensus.cc:374] T 00000000000000000000000000000000 P b2b7b836f96e4ab5bc2ffecddd461f91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:12:24.553696 23129 raft_consensus.cc:729] T 00000000000000000000000000000000 P b2b7b836f96e4ab5bc2ffecddd461f91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2b7b836f96e4ab5bc2ffecddd461f91, State: Initialized, Role: FOLLOWER
I20260927 15:12:24.554050 17952 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260927 15:12:24.554136 23129 consensus_queue.cc:260] T 00000000000000000000000000000000 P b2b7b836f96e4ab5bc2ffecddd461f91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b2b7b836f96e4ab5bc2ffecddd461f91" member_type: VOTER last_known_addr { host: "127.17.136.62" port: 37071 } }
I20260927 15:12:24.554289 23129 raft_consensus.cc:388] T 00000000000000000000000000000000 P b2b7b836f96e4ab5bc2ffecddd461f91 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260927 15:12:24.554364 23129 raft_consensus.cc:482] T 00000000000000000000000000000000 P b2b7b836f96e4ab5bc2ffecddd461f91 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260927 15:12:24.554466 23129 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b2b7b836f96e4ab5bc2ffecddd461f91 [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:12:24.555518 23129 raft_consensus.cc:504] T 00000000000000000000000000000000 P b2b7b836f96e4ab5bc2ffecddd461f91 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b2b7b836f96e4ab5bc2ffecddd461f91" member_type: VOTER last_known_addr { host: "127.17.136.62" port: 37071 } }
I20260927 15:12:24.555871 23129 leader_election.cc:302] T 00000000000000000000000000000000 P b2b7b836f96e4ab5bc2ffecddd461f91 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b2b7b836f96e4ab5bc2ffecddd461f91; no voters:
I20260927 15:12:24.556125 23129 leader_election.cc:288] T 00000000000000000000000000000000 P b2b7b836f96e4ab5bc2ffecddd461f91 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260927 15:12:24.556216 23134 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b2b7b836f96e4ab5bc2ffecddd461f91 [term 1 FOLLOWER]: Leader election won for term 1
I20260927 15:12:24.556416 23134 raft_consensus.cc:686] T 00000000000000000000000000000000 P b2b7b836f96e4ab5bc2ffecddd461f91 [term 1 LEADER]: Becoming Leader. State: Replica: b2b7b836f96e4ab5bc2ffecddd461f91, State: Running, Role: LEADER
I20260927 15:12:24.556707 23134 consensus_queue.cc:237] T 00000000000000000000000000000000 P b2b7b836f96e4ab5bc2ffecddd461f91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b2b7b836f96e4ab5bc2ffecddd461f91" member_type: VOTER last_known_addr { host: "127.17.136.62" port: 37071 } }
I20260927 15:12:24.557210 23129 sys_catalog.cc:564] T 00000000000000000000000000000000 P b2b7b836f96e4ab5bc2ffecddd461f91 [sys.catalog]: configured and running, proceeding with master startup.
I20260927 15:12:24.558178 23135 sys_catalog.cc:455] T 00000000000000000000000000000000 P b2b7b836f96e4ab5bc2ffecddd461f91 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "b2b7b836f96e4ab5bc2ffecddd461f91" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b2b7b836f96e4ab5bc2ffecddd461f91" member_type: VOTER last_known_addr { host: "127.17.136.62" port: 37071 } } }
I20260927 15:12:24.558333 23135 sys_catalog.cc:458] T 00000000000000000000000000000000 P b2b7b836f96e4ab5bc2ffecddd461f91 [sys.catalog]: This master's current role is: LEADER
I20260927 15:12:24.558177 23136 sys_catalog.cc:455] T 00000000000000000000000000000000 P b2b7b836f96e4ab5bc2ffecddd461f91 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b2b7b836f96e4ab5bc2ffecddd461f91. Latest consensus state: current_term: 1 leader_uuid: "b2b7b836f96e4ab5bc2ffecddd461f91" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b2b7b836f96e4ab5bc2ffecddd461f91" member_type: VOTER last_known_addr { host: "127.17.136.62" port: 37071 } } }
I20260927 15:12:24.558419 23136 sys_catalog.cc:458] T 00000000000000000000000000000000 P b2b7b836f96e4ab5bc2ffecddd461f91 [sys.catalog]: This master's current role is: LEADER
I20260927 15:12:24.558667 23143 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260927 15:12:24.561329 23143 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260927 15:12:24.566316 23143 catalog_manager.cc:1347] Generated new cluster ID: 30fc628b787a4450bc2a999aa9f3b3ff
I20260927 15:12:24.566363 23143 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260927 15:12:24.578778 23143 catalog_manager.cc:1370] Generated new certificate authority record
I20260927 15:12:24.579630 23143 catalog_manager.cc:1504] Loading token signing keys...
I20260927 15:12:24.590062 23143 catalog_manager.cc:5868] T 00000000000000000000000000000000 P b2b7b836f96e4ab5bc2ffecddd461f91: Generated new TSK 0
I20260927 15:12:24.590682 23143 catalog_manager.cc:1514] Initializing in-progress tserver states...
E20260927 15:12:24.623282 23159 webserver.cc:533] Webserver: sslize failed: error:14094415:SSL routines:ssl3_read_bytes:sslv3 alert certificate expired
E20260927 15:12:24.623390 23159 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
I20260927 15:12:24.623828 23132 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:24.599994 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55030 (local address 127.17.136.62:37071)
0927 15:12:24.600109 (+ 115us) server_negotiation.cc:206] Beginning negotiation
0927 15:12:24.600113 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0927 15:12:24.600306 (+ 193us) server_negotiation.cc:407] Connection header received
0927 15:12:24.600511 (+ 205us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:12:24.600513 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:12:24.600556 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:12:24.600632 (+ 76us) server_negotiation.cc:226] Negotiated authn=JWT
0927 15:12:24.600901 (+ 269us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:24.601404 (+ 503us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:24.602570 (+ 1166us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:24.602799 (+ 229us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:24.602872 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:24.603197 (+ 325us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0927 15:12:24.623413 (+ 20216us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:41821/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
0927 15:12:24.623691 (+ 278us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:55030: Failed to load JWKS: Error downloading JWKS from 'https://localhost:41821/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Metrics: {"server-negotiator.queue_time_us":45}
W20260927 15:12:24.623914 23132 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:55030: Failed to load JWKS: Error downloading JWKS from 'https://localhost:41821/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
W20260927 15:12:24.624948 23158 negotiation.cc:337] Failed RPC negotiation. Trace:
0927 15:12:24.599923 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.62:37071 (local address 127.0.0.1:55030)
0927 15:12:24.600228 (+ 305us) negotiation.cc:107] Waiting for socket to connect
0927 15:12:24.600243 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0927 15:12:24.600366 (+ 123us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0927 15:12:24.600662 (+ 296us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0927 15:12:24.600665 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0927 15:12:24.600673 (+ 8us) client_negotiation.cc:189] Negotiated authn=JWT
0927 15:12:24.600798 (+ 125us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:12:24.600804 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:12:24.601494 (+ 690us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:12:24.601498 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:12:24.602466 (+ 968us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:12:24.602476 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:12:24.602900 (+ 424us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:12:24.602904 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:12:24.602995 (+ 91us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:24.603048 (+ 53us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0927 15:12:24.623638 (+ 20590us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:41821/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
0927 15:12:24.623870 (+ 232us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.17.136.62:37071: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:41821/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Metrics: {"client-negotiator.queue_time_us":187,"thread_start_us":96,"threads_started":1}
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/integration-tests/security-itest.cc:597: Failure
Failed
Bad status: Runtime error: Could not connect to the cluster: Client connection negotiation failed: client connection to 127.17.136.62:37071: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:41821/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Google Test trace:
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/integration-tests/security-itest.cc:593: Valid JWT
I20260927 15:12:24.625617 17952 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu with pid 23062
2026-09-27T15:12:24Z chronyd exiting
I20260927 15:12:24.661725 17952 test_util.cc:175] -----------------------------------------------
I20260927 15:12:24.661799 17952 test_util.cc:176] Had fatal failures, leaving test files at /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1790521920546562-17952-0
[ FAILED ] SecurityITest.TestJwtMiniCluster (296 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithInvalidCert
I20260927 15:12:24.662736 17952 mini_oidc.cc:152] Starting JWKS server
I20260927 15:12:24.663570 17952 webserver.cc:460] Webserver started at https://127.0.0.1:38771/ using document root <none> and password file <none>
I20260927 15:12:24.663652 17952 mini_oidc.cc:189] Starting OIDC Discovery server
I20260927 15:12:24.663889 17952 webserver.cc:460] Webserver started at http://127.0.0.1:46137/ using document root <none> and password file <none>
2026-09-27T15:12:24Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-27T15:12:24Z Disabled control of system clock
I20260927 15:12:24.671857 17952 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu
/tmp/dist-test-taskiFOyeW/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1790521920546562-17952-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1790521920546562-17952-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1790521920546562-17952-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1790521920546562-17952-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.136.62:46483
--webserver_interface=127.17.136.62
--webserver_port=0
--builtin_ntp_servers=127.17.136.20:37513
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.136.62:46483
--enable_jwt_token_auth=true
--jwks_url=https://localhost:38771/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1790521920546562-17952-0/testchainca.cert with env {}
W20260927 15:12:24.774103 23165 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260927 15:12:24.774331 23165 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260927 15:12:24.774366 23165 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260927 15:12:24.778308 23165 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260927 15:12:24.778359 23165 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260927 15:12:24.778373 23165 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260927 15:12:24.778388 23165 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260927 15:12:24.778401 23165 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260927 15:12:24.778416 23165 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260927 15:12:24.778434 23165 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:38771/jwks.json
I20260927 15:12:24.783574 23165 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.136.20:37513
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1790521920546562-17952-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1790521920546562-17952-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.17.136.62:46483
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.136.62:46483
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:38771/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1790521920546562-17952-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.17.136.62
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1790521920546562-17952-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23165
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1790521920546562-17952-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 27 Sep 2026 14:27:13 UTC on ccycloud.quasar-psqrth.root.comops.site
build id 4676138
I20260927 15:12:24.784554 23165 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260927 15:12:24.785514 23165 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260927 15:12:24.793836 23170 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260927 15:12:24.793934 23165 server_base.cc:1034] running on GCE node
W20260927 15:12:24.793853 23173 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260927 15:12:24.793836 23171 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260927 15:12:24.794621 23165 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260927 15:12:24.795761 23165 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260927 15:12:24.796962 23165 hybrid_clock.cc:648] HybridClock initialized: now 1790521944796944 us; error 30 us; skew 500 ppm
I20260927 15:12:24.798751 23165 webserver.cc:460] Webserver started at http://127.17.136.62:37795/ using document root <none> and password file <none>
I20260927 15:12:24.799338 23165 fs_manager.cc:359] Metadata directory not provided
I20260927 15:12:24.799409 23165 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260927 15:12:24.799609 23165 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260927 15:12:24.801659 23165 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1790521920546562-17952-0/minicluster-data/master-0/data/instance:
uuid: "30ba0b8336f748b294e3e7da8a4d515e"
format_stamp: "Formatted at 2026-09-27 15:12:24 on dist-test-slave-5s2t"
server_key: "e6bca593e2e2002cca907aec4ac4e2c4"
server_key_iv: "a44dd680012c48247bf9deae541a86d9"
server_key_version: "encryptionkey@0"
I20260927 15:12:24.802181 23165 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1790521920546562-17952-0/minicluster-data/master-0/wal/instance:
uuid: "30ba0b8336f748b294e3e7da8a4d515e"
format_stamp: "Formatted at 2026-09-27 15:12:24 on dist-test-slave-5s2t"
server_key: "e6bca593e2e2002cca907aec4ac4e2c4"
server_key_iv: "a44dd680012c48247bf9deae541a86d9"
server_key_version: "encryptionkey@0"
I20260927 15:12:24.805775 23165 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.004s
I20260927 15:12:24.808269 23179 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260927 15:12:24.809608 23165 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260927 15:12:24.809723 23165 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1790521920546562-17952-0/minicluster-data/master-0/data,/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1790521920546562-17952-0/minicluster-data/master-0/wal
uuid: "30ba0b8336f748b294e3e7da8a4d515e"
format_stamp: "Formatted at 2026-09-27 15:12:24 on dist-test-slave-5s2t"
server_key: "e6bca593e2e2002cca907aec4ac4e2c4"
server_key_iv: "a44dd680012c48247bf9deae541a86d9"
server_key_version: "encryptionkey@0"
I20260927 15:12:24.809818 23165 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1790521920546562-17952-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1790521920546562-17952-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1790521920546562-17952-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260927 15:12:24.828608 23165 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260927 15:12:24.829303 23165 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260927 15:12:24.829475 23165 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260927 15:12:24.835851 23165 rpc_server.cc:307] RPC server started. Bound to: 127.17.136.62:46483
I20260927 15:12:24.835861 23231 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.136.62:46483 every 8 connection(s)
I20260927 15:12:24.836789 23165 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1790521920546562-17952-0/minicluster-data/master-0/data/info.pb
I20260927 15:12:24.839850 23232 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:12:24.845171 23232 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 30ba0b8336f748b294e3e7da8a4d515e: Bootstrap starting.
I20260927 15:12:24.846704 17952 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu as pid 23165
I20260927 15:12:24.846808 17952 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1790521920546562-17952-0/minicluster-data/master-0/wal/instance
I20260927 15:12:24.847064 17952 external_mini_cluster.cc:1428] Setting key cc968fb9c8c82a06e0ba50c660eec8ee
I20260927 15:12:24.847610 23232 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 30ba0b8336f748b294e3e7da8a4d515e: Neither blocks nor log segments found. Creating new log.
I20260927 15:12:24.848376 23232 log.cc:824] T 00000000000000000000000000000000 P 30ba0b8336f748b294e3e7da8a4d515e: Log is configured to *not* fsync() on all Append() calls
I20260927 15:12:24.850565 23232 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 30ba0b8336f748b294e3e7da8a4d515e: No bootstrap required, opened a new log
I20260927 15:12:24.854568 23232 raft_consensus.cc:348] T 00000000000000000000000000000000 P 30ba0b8336f748b294e3e7da8a4d515e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "30ba0b8336f748b294e3e7da8a4d515e" member_type: VOTER last_known_addr { host: "127.17.136.62" port: 46483 } }
I20260927 15:12:24.854811 23232 raft_consensus.cc:374] T 00000000000000000000000000000000 P 30ba0b8336f748b294e3e7da8a4d515e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:12:24.854868 23232 raft_consensus.cc:729] T 00000000000000000000000000000000 P 30ba0b8336f748b294e3e7da8a4d515e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 30ba0b8336f748b294e3e7da8a4d515e, State: Initialized, Role: FOLLOWER
I20260927 15:12:24.855345 23232 consensus_queue.cc:260] T 00000000000000000000000000000000 P 30ba0b8336f748b294e3e7da8a4d515e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "30ba0b8336f748b294e3e7da8a4d515e" member_type: VOTER last_known_addr { host: "127.17.136.62" port: 46483 } }
I20260927 15:12:24.855511 23232 raft_consensus.cc:388] T 00000000000000000000000000000000 P 30ba0b8336f748b294e3e7da8a4d515e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260927 15:12:24.855584 23232 raft_consensus.cc:482] T 00000000000000000000000000000000 P 30ba0b8336f748b294e3e7da8a4d515e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260927 15:12:24.855682 23232 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 30ba0b8336f748b294e3e7da8a4d515e [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:12:24.856530 23232 raft_consensus.cc:504] T 00000000000000000000000000000000 P 30ba0b8336f748b294e3e7da8a4d515e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "30ba0b8336f748b294e3e7da8a4d515e" member_type: VOTER last_known_addr { host: "127.17.136.62" port: 46483 } }
I20260927 15:12:24.856724 23235 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:24.848088 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49112 (local address 127.17.136.62:46483)
0927 15:12:24.848783 (+ 695us) server_negotiation.cc:206] Beginning negotiation
0927 15:12:24.848800 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0927 15:12:24.848834 (+ 34us) server_negotiation.cc:407] Connection header received
0927 15:12:24.849552 (+ 718us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:12:24.849574 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:12:24.849985 (+ 411us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:12:24.850342 (+ 357us) server_negotiation.cc:226] Negotiated authn=SASL
0927 15:12:24.850763 (+ 421us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:24.852252 (+ 1489us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:24.853170 (+ 918us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:24.853878 (+ 708us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:24.854039 (+ 161us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:24.854745 (+ 706us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0927 15:12:24.854751 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0927 15:12:24.854765 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0927 15:12:24.855278 (+ 513us) server_negotiation.cc:922] calling sasl_server_start()
0927 15:12:24.855343 (+ 65us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0927 15:12:24.855369 (+ 26us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0927 15:12:24.855460 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0927 15:12:24.855608 (+ 148us) server_negotiation.cc:299] Negotiation successful
0927 15:12:24.855870 (+ 262us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":289,"thread_start_us":115,"threads_started":1}
I20260927 15:12:24.856840 23232 leader_election.cc:302] T 00000000000000000000000000000000 P 30ba0b8336f748b294e3e7da8a4d515e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 30ba0b8336f748b294e3e7da8a4d515e; no voters:
I20260927 15:12:24.857153 23232 leader_election.cc:288] T 00000000000000000000000000000000 P 30ba0b8336f748b294e3e7da8a4d515e [CANDIDATE]: Term 1 election: Requested vote from peers
I20260927 15:12:24.857241 23237 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 30ba0b8336f748b294e3e7da8a4d515e [term 1 FOLLOWER]: Leader election won for term 1
I20260927 15:12:24.857396 23237 raft_consensus.cc:686] T 00000000000000000000000000000000 P 30ba0b8336f748b294e3e7da8a4d515e [term 1 LEADER]: Becoming Leader. State: Replica: 30ba0b8336f748b294e3e7da8a4d515e, State: Running, Role: LEADER
I20260927 15:12:24.857678 23237 consensus_queue.cc:237] T 00000000000000000000000000000000 P 30ba0b8336f748b294e3e7da8a4d515e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "30ba0b8336f748b294e3e7da8a4d515e" member_type: VOTER last_known_addr { host: "127.17.136.62" port: 46483 } }
I20260927 15:12:24.858398 23232 sys_catalog.cc:564] T 00000000000000000000000000000000 P 30ba0b8336f748b294e3e7da8a4d515e [sys.catalog]: configured and running, proceeding with master startup.
I20260927 15:12:24.859211 23239 sys_catalog.cc:455] T 00000000000000000000000000000000 P 30ba0b8336f748b294e3e7da8a4d515e [sys.catalog]: SysCatalogTable state changed. Reason: New leader 30ba0b8336f748b294e3e7da8a4d515e. Latest consensus state: current_term: 1 leader_uuid: "30ba0b8336f748b294e3e7da8a4d515e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "30ba0b8336f748b294e3e7da8a4d515e" member_type: VOTER last_known_addr { host: "127.17.136.62" port: 46483 } } }
I20260927 15:12:24.859416 23239 sys_catalog.cc:458] T 00000000000000000000000000000000 P 30ba0b8336f748b294e3e7da8a4d515e [sys.catalog]: This master's current role is: LEADER
I20260927 15:12:24.859524 17952 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260927 15:12:24.860569 23238 sys_catalog.cc:455] T 00000000000000000000000000000000 P 30ba0b8336f748b294e3e7da8a4d515e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "30ba0b8336f748b294e3e7da8a4d515e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "30ba0b8336f748b294e3e7da8a4d515e" member_type: VOTER last_known_addr { host: "127.17.136.62" port: 46483 } } }
I20260927 15:12:24.861085 23238 sys_catalog.cc:458] T 00000000000000000000000000000000 P 30ba0b8336f748b294e3e7da8a4d515e [sys.catalog]: This master's current role is: LEADER
W20260927 15:12:24.863104 23252 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 30ba0b8336f748b294e3e7da8a4d515e: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260927 15:12:24.863166 23252 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260927 15:12:24.863291 23246 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260927 15:12:24.863994 23246 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260927 15:12:24.869149 23246 catalog_manager.cc:1347] Generated new cluster ID: 97b075b21a7443d39c90c887b90a7dcf
I20260927 15:12:24.869217 23246 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260927 15:12:24.906328 23246 catalog_manager.cc:1370] Generated new certificate authority record
I20260927 15:12:24.907335 23246 catalog_manager.cc:1504] Loading token signing keys...
I20260927 15:12:24.912042 23246 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 30ba0b8336f748b294e3e7da8a4d515e: Generated new TSK 0
I20260927 15:12:24.912685 23246 catalog_manager.cc:1514] Initializing in-progress tserver states...
E20260927 15:12:24.938438 23262 webserver.cc:533] Webserver: sslize failed: error:14094418:SSL routines:ssl3_read_bytes:tlsv1 alert unknown ca
E20260927 15:12:24.938522 23262 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
I20260927 15:12:24.939150 23235 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:24.923357 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49118 (local address 127.17.136.62:46483)
0927 15:12:24.923470 (+ 113us) server_negotiation.cc:206] Beginning negotiation
0927 15:12:24.923474 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0927 15:12:24.923663 (+ 189us) server_negotiation.cc:407] Connection header received
0927 15:12:24.923815 (+ 152us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:12:24.923818 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:12:24.923861 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:12:24.923949 (+ 88us) server_negotiation.cc:226] Negotiated authn=JWT
0927 15:12:24.924186 (+ 237us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:24.924713 (+ 527us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:24.925655 (+ 942us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:24.925988 (+ 333us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:24.926094 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:24.926398 (+ 304us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0927 15:12:24.938769 (+ 12371us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:38771/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
0927 15:12:24.939016 (+ 247us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:49118: Failed to load JWKS: Error downloading JWKS from 'https://localhost:38771/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
Metrics: {"server-negotiator.queue_time_us":39}
W20260927 15:12:24.939217 23235 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:49118: Failed to load JWKS: Error downloading JWKS from 'https://localhost:38771/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
W20260927 15:12:24.939224 23261 negotiation.cc:337] Failed RPC negotiation. Trace:
0927 15:12:24.923304 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.62:46483 (local address 127.0.0.1:49118)
0927 15:12:24.923579 (+ 275us) negotiation.cc:107] Waiting for socket to connect
0927 15:12:24.923591 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0927 15:12:24.923696 (+ 105us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0927 15:12:24.923965 (+ 269us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0927 15:12:24.923968 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0927 15:12:24.923976 (+ 8us) client_negotiation.cc:189] Negotiated authn=JWT
0927 15:12:24.924080 (+ 104us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:12:24.924085 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:12:24.924811 (+ 726us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:12:24.924815 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:12:24.925490 (+ 675us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:12:24.925498 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:12:24.926117 (+ 619us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:12:24.926121 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:12:24.926213 (+ 92us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:24.926237 (+ 24us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0927 15:12:24.938931 (+ 12694us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:38771/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
0927 15:12:24.939075 (+ 144us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.17.136.62:46483: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:38771/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
Metrics: {"client-negotiator.queue_time_us":191,"thread_start_us":95,"threads_started":1}
I20260927 15:12:24.939612 17952 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu with pid 23165
2026-09-27T15:12:24Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithInvalidCert (314 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithUntrustedCert
I20260927 15:12:24.977691 17952 mini_oidc.cc:152] Starting JWKS server
I20260927 15:12:24.978494 17952 webserver.cc:460] Webserver started at https://127.0.0.1:38699/ using document root <none> and password file <none>
I20260927 15:12:24.978574 17952 mini_oidc.cc:189] Starting OIDC Discovery server
I20260927 15:12:24.978788 17952 webserver.cc:460] Webserver started at http://127.0.0.1:32925/ using document root <none> and password file <none>
2026-09-27T15:12:24Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-27T15:12:24Z Disabled control of system clock
I20260927 15:12:24.986604 17952 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu
/tmp/dist-test-taskiFOyeW/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1790521920546562-17952-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1790521920546562-17952-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1790521920546562-17952-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1790521920546562-17952-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.136.62:37267
--webserver_interface=127.17.136.62
--webserver_port=0
--builtin_ntp_servers=127.17.136.20:34545
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.136.62:37267
--enable_jwt_token_auth=true
--jwks_url=https://localhost:38699/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {}
W20260927 15:12:25.091877 23268 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260927 15:12:25.092146 23268 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260927 15:12:25.092196 23268 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260927 15:12:25.096078 23268 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260927 15:12:25.096129 23268 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260927 15:12:25.096150 23268 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260927 15:12:25.096171 23268 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260927 15:12:25.096200 23268 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260927 15:12:25.096222 23268 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260927 15:12:25.096248 23268 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:38699/jwks.json
I20260927 15:12:25.100839 23268 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.136.20:34545
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1790521920546562-17952-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1790521920546562-17952-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.17.136.62:37267
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.136.62:37267
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:38699/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1790521920546562-17952-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.17.136.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23268
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1790521920546562-17952-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 27 Sep 2026 14:27:13 UTC on ccycloud.quasar-psqrth.root.comops.site
build id 4676138
I20260927 15:12:25.101825 23268 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260927 15:12:25.103137 23268 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260927 15:12:25.111085 23273 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260927 15:12:25.111158 23268 server_base.cc:1034] running on GCE node
W20260927 15:12:25.111106 23276 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260927 15:12:25.111096 23274 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260927 15:12:25.111953 23268 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260927 15:12:25.112953 23268 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260927 15:12:25.114120 23268 hybrid_clock.cc:648] HybridClock initialized: now 1790521945114104 us; error 28 us; skew 500 ppm
I20260927 15:12:25.115890 23268 webserver.cc:460] Webserver started at http://127.17.136.62:43241/ using document root <none> and password file <none>
I20260927 15:12:25.116418 23268 fs_manager.cc:359] Metadata directory not provided
I20260927 15:12:25.116482 23268 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260927 15:12:25.116663 23268 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260927 15:12:25.118637 23268 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1790521920546562-17952-0/minicluster-data/master-0/data/instance:
uuid: "686ed0f2cc8844fca88a73eac05d4524"
format_stamp: "Formatted at 2026-09-27 15:12:25 on dist-test-slave-5s2t"
server_key: "8695772803ce7333af9eeeab59827a14"
server_key_iv: "2a2285958707d904d75ea1e9bcb8c954"
server_key_version: "encryptionkey@0"
I20260927 15:12:25.119150 23268 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1790521920546562-17952-0/minicluster-data/master-0/wal/instance:
uuid: "686ed0f2cc8844fca88a73eac05d4524"
format_stamp: "Formatted at 2026-09-27 15:12:25 on dist-test-slave-5s2t"
server_key: "8695772803ce7333af9eeeab59827a14"
server_key_iv: "2a2285958707d904d75ea1e9bcb8c954"
server_key_version: "encryptionkey@0"
I20260927 15:12:25.122591 23268 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.000s
I20260927 15:12:25.124924 23282 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260927 15:12:25.126091 23268 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.000s sys 0.001s
I20260927 15:12:25.126197 23268 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1790521920546562-17952-0/minicluster-data/master-0/data,/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1790521920546562-17952-0/minicluster-data/master-0/wal
uuid: "686ed0f2cc8844fca88a73eac05d4524"
format_stamp: "Formatted at 2026-09-27 15:12:25 on dist-test-slave-5s2t"
server_key: "8695772803ce7333af9eeeab59827a14"
server_key_iv: "2a2285958707d904d75ea1e9bcb8c954"
server_key_version: "encryptionkey@0"
I20260927 15:12:25.126289 23268 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1790521920546562-17952-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1790521920546562-17952-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1790521920546562-17952-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260927 15:12:25.144795 23268 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260927 15:12:25.145414 23268 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260927 15:12:25.145573 23268 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260927 15:12:25.151921 23268 rpc_server.cc:307] RPC server started. Bound to: 127.17.136.62:37267
I20260927 15:12:25.151973 23334 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.136.62:37267 every 8 connection(s)
I20260927 15:12:25.152803 23268 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1790521920546562-17952-0/minicluster-data/master-0/data/info.pb
I20260927 15:12:25.155526 23335 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:12:25.160778 23335 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 686ed0f2cc8844fca88a73eac05d4524: Bootstrap starting.
I20260927 15:12:25.161320 17952 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu as pid 23268
I20260927 15:12:25.161432 17952 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1790521920546562-17952-0/minicluster-data/master-0/wal/instance
I20260927 15:12:25.161698 17952 external_mini_cluster.cc:1428] Setting key acbf5d0229e4591985b4c48173a8503e
I20260927 15:12:25.163475 23335 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 686ed0f2cc8844fca88a73eac05d4524: Neither blocks nor log segments found. Creating new log.
I20260927 15:12:25.164160 23335 log.cc:824] T 00000000000000000000000000000000 P 686ed0f2cc8844fca88a73eac05d4524: Log is configured to *not* fsync() on all Append() calls
I20260927 15:12:25.166069 23335 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 686ed0f2cc8844fca88a73eac05d4524: No bootstrap required, opened a new log
I20260927 15:12:25.169503 23335 raft_consensus.cc:348] T 00000000000000000000000000000000 P 686ed0f2cc8844fca88a73eac05d4524 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "686ed0f2cc8844fca88a73eac05d4524" member_type: VOTER last_known_addr { host: "127.17.136.62" port: 37267 } }
I20260927 15:12:25.169755 23335 raft_consensus.cc:374] T 00000000000000000000000000000000 P 686ed0f2cc8844fca88a73eac05d4524 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:12:25.169811 23335 raft_consensus.cc:729] T 00000000000000000000000000000000 P 686ed0f2cc8844fca88a73eac05d4524 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 686ed0f2cc8844fca88a73eac05d4524, State: Initialized, Role: FOLLOWER
I20260927 15:12:25.170226 23335 consensus_queue.cc:260] T 00000000000000000000000000000000 P 686ed0f2cc8844fca88a73eac05d4524 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "686ed0f2cc8844fca88a73eac05d4524" member_type: VOTER last_known_addr { host: "127.17.136.62" port: 37267 } }
I20260927 15:12:25.170339 23335 raft_consensus.cc:388] T 00000000000000000000000000000000 P 686ed0f2cc8844fca88a73eac05d4524 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260927 15:12:25.170405 23335 raft_consensus.cc:482] T 00000000000000000000000000000000 P 686ed0f2cc8844fca88a73eac05d4524 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260927 15:12:25.170495 23335 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 686ed0f2cc8844fca88a73eac05d4524 [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:12:25.170518 23338 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:25.162924 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54670 (local address 127.17.136.62:37267)
0927 15:12:25.163618 (+ 694us) server_negotiation.cc:206] Beginning negotiation
0927 15:12:25.163633 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0927 15:12:25.163669 (+ 36us) server_negotiation.cc:407] Connection header received
0927 15:12:25.164304 (+ 635us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:12:25.164323 (+ 19us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:12:25.164801 (+ 478us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:12:25.165171 (+ 370us) server_negotiation.cc:226] Negotiated authn=SASL
0927 15:12:25.165578 (+ 407us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:25.166548 (+ 970us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:25.167408 (+ 860us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:25.167879 (+ 471us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:25.168028 (+ 149us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:25.168810 (+ 782us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0927 15:12:25.168814 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0927 15:12:25.168826 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0927 15:12:25.169198 (+ 372us) server_negotiation.cc:922] calling sasl_server_start()
0927 15:12:25.169250 (+ 52us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0927 15:12:25.169269 (+ 19us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0927 15:12:25.169349 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0927 15:12:25.169477 (+ 128us) server_negotiation.cc:299] Negotiation successful
0927 15:12:25.169717 (+ 240us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":288,"thread_start_us":130,"threads_started":1}
I20260927 15:12:25.171329 23335 raft_consensus.cc:504] T 00000000000000000000000000000000 P 686ed0f2cc8844fca88a73eac05d4524 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "686ed0f2cc8844fca88a73eac05d4524" member_type: VOTER last_known_addr { host: "127.17.136.62" port: 37267 } }
I20260927 15:12:25.171651 23335 leader_election.cc:302] T 00000000000000000000000000000000 P 686ed0f2cc8844fca88a73eac05d4524 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 686ed0f2cc8844fca88a73eac05d4524; no voters:
I20260927 15:12:25.171921 23335 leader_election.cc:288] T 00000000000000000000000000000000 P 686ed0f2cc8844fca88a73eac05d4524 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260927 15:12:25.171994 23340 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 686ed0f2cc8844fca88a73eac05d4524 [term 1 FOLLOWER]: Leader election won for term 1
I20260927 15:12:25.172154 23340 raft_consensus.cc:686] T 00000000000000000000000000000000 P 686ed0f2cc8844fca88a73eac05d4524 [term 1 LEADER]: Becoming Leader. State: Replica: 686ed0f2cc8844fca88a73eac05d4524, State: Running, Role: LEADER
I20260927 15:12:25.172422 23340 consensus_queue.cc:237] T 00000000000000000000000000000000 P 686ed0f2cc8844fca88a73eac05d4524 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "686ed0f2cc8844fca88a73eac05d4524" member_type: VOTER last_known_addr { host: "127.17.136.62" port: 37267 } }
I20260927 15:12:25.173045 17952 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260927 15:12:25.173090 23335 sys_catalog.cc:564] T 00000000000000000000000000000000 P 686ed0f2cc8844fca88a73eac05d4524 [sys.catalog]: configured and running, proceeding with master startup.
I20260927 15:12:25.173520 23341 sys_catalog.cc:455] T 00000000000000000000000000000000 P 686ed0f2cc8844fca88a73eac05d4524 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 686ed0f2cc8844fca88a73eac05d4524. Latest consensus state: current_term: 1 leader_uuid: "686ed0f2cc8844fca88a73eac05d4524" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "686ed0f2cc8844fca88a73eac05d4524" member_type: VOTER last_known_addr { host: "127.17.136.62" port: 37267 } } }
I20260927 15:12:25.173641 23341 sys_catalog.cc:458] T 00000000000000000000000000000000 P 686ed0f2cc8844fca88a73eac05d4524 [sys.catalog]: This master's current role is: LEADER
I20260927 15:12:25.173951 23342 sys_catalog.cc:455] T 00000000000000000000000000000000 P 686ed0f2cc8844fca88a73eac05d4524 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "686ed0f2cc8844fca88a73eac05d4524" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "686ed0f2cc8844fca88a73eac05d4524" member_type: VOTER last_known_addr { host: "127.17.136.62" port: 37267 } } }
I20260927 15:12:25.174050 23342 sys_catalog.cc:458] T 00000000000000000000000000000000 P 686ed0f2cc8844fca88a73eac05d4524 [sys.catalog]: This master's current role is: LEADER
W20260927 15:12:25.177266 23355 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 686ed0f2cc8844fca88a73eac05d4524: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260927 15:12:25.177326 23355 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260927 15:12:25.177379 23344 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260927 15:12:25.178025 23344 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260927 15:12:25.182582 23344 catalog_manager.cc:1347] Generated new cluster ID: 19f61cfc4b6e4f4cb4dc522ace1ee97b
I20260927 15:12:25.182638 23344 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260927 15:12:25.202431 23344 catalog_manager.cc:1370] Generated new certificate authority record
I20260927 15:12:25.203716 23344 catalog_manager.cc:1504] Loading token signing keys...
I20260927 15:12:25.215934 23344 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 686ed0f2cc8844fca88a73eac05d4524: Generated new TSK 0
I20260927 15:12:25.216755 23344 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260927 15:12:25.229180 23338 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:25.224453 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54674 (local address 127.17.136.62:37267)
0927 15:12:25.224574 (+ 121us) server_negotiation.cc:206] Beginning negotiation
0927 15:12:25.224579 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0927 15:12:25.224741 (+ 162us) server_negotiation.cc:407] Connection header received
0927 15:12:25.224904 (+ 163us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:12:25.224906 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:12:25.224950 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:12:25.225027 (+ 77us) server_negotiation.cc:226] Negotiated authn=JWT
0927 15:12:25.225233 (+ 206us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:25.225755 (+ 522us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:25.227044 (+ 1289us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:25.227291 (+ 247us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:25.227377 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:25.227668 (+ 291us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0927 15:12:25.228783 (+ 1115us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:38699/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
0927 15:12:25.229053 (+ 270us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:54674: Failed to load JWKS: Error downloading JWKS from 'https://localhost:38699/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
Metrics: {"server-negotiator.queue_time_us":45}
W20260927 15:12:25.229239 23338 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:54674: Failed to load JWKS: Error downloading JWKS from 'https://localhost:38699/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
W20260927 15:12:25.229254 23364 negotiation.cc:337] Failed RPC negotiation. Trace:
0927 15:12:25.224345 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.62:37267 (local address 127.0.0.1:54674)
0927 15:12:25.224653 (+ 308us) negotiation.cc:107] Waiting for socket to connect
0927 15:12:25.224675 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0927 15:12:25.224784 (+ 109us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0927 15:12:25.225040 (+ 256us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0927 15:12:25.225043 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0927 15:12:25.225055 (+ 12us) client_negotiation.cc:189] Negotiated authn=JWT
0927 15:12:25.225153 (+ 98us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:12:25.225158 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:12:25.225851 (+ 693us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:12:25.225855 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:12:25.226846 (+ 991us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:12:25.226856 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:12:25.227406 (+ 550us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:12:25.227410 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:12:25.227500 (+ 90us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:25.227527 (+ 27us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0927 15:12:25.228975 (+ 1448us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:38699/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
0927 15:12:25.229108 (+ 133us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.17.136.62:37267: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:38699/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
Metrics: {"client-negotiator.queue_time_us":229,"thread_start_us":94,"threads_started":1}
I20260927 15:12:25.230000 17952 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu with pid 23268
E20260927 15:12:25.242060 23365 webserver.cc:533] Webserver: sslize failed:
E20260927 15:12:25.242129 23365 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
2026-09-27T15:12:25Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithUntrustedCert (291 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS
2026-09-27T15:12:25Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-27T15:12:25Z Disabled control of system clock
I20260927 15:12:25.276736 17952 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu
/tmp/dist-test-taskiFOyeW/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1790521920546562-17952-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1790521920546562-17952-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1790521920546562-17952-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1790521920546562-17952-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.136.62:33231
--webserver_interface=127.17.136.62
--webserver_port=0
--builtin_ntp_servers=127.17.136.20:33973
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.136.62:33231
--enable_jwt_token_auth=true
--jwks_url=default.url
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1790521920546562-17952-0/testchainca.cert with env {}
W20260927 15:12:25.378846 23369 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260927 15:12:25.379107 23369 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260927 15:12:25.379161 23369 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260927 15:12:25.383034 23369 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260927 15:12:25.383085 23369 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260927 15:12:25.383108 23369 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260927 15:12:25.383129 23369 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260927 15:12:25.383155 23369 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260927 15:12:25.383183 23369 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260927 15:12:25.383204 23369 flags.cc:425] Enabled experimental flag: --jwks_url=default.url
I20260927 15:12:25.388340 23369 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.136.20:33973
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1790521920546562-17952-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1790521920546562-17952-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.17.136.62:33231
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.136.62:33231
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=default.url
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1790521920546562-17952-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.17.136.62
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1790521920546562-17952-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23369
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1790521920546562-17952-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 27 Sep 2026 14:27:13 UTC on ccycloud.quasar-psqrth.root.comops.site
build id 4676138
I20260927 15:12:25.389340 23369 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260927 15:12:25.390281 23369 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260927 15:12:25.398125 23375 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260927 15:12:25.398133 23374 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260927 15:12:25.398226 23377 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260927 15:12:25.398307 23369 server_base.cc:1034] running on GCE node
I20260927 15:12:25.398955 23369 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260927 15:12:25.400014 23369 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260927 15:12:25.401163 23369 hybrid_clock.cc:648] HybridClock initialized: now 1790521945401143 us; error 32 us; skew 500 ppm
I20260927 15:12:25.402843 23369 webserver.cc:460] Webserver started at http://127.17.136.62:36461/ using document root <none> and password file <none>
I20260927 15:12:25.403431 23369 fs_manager.cc:359] Metadata directory not provided
I20260927 15:12:25.403491 23369 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260927 15:12:25.403674 23369 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260927 15:12:25.405583 23369 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1790521920546562-17952-0/minicluster-data/master-0/data/instance:
uuid: "89a2b393616f499d87b9d207b8a1cc3c"
format_stamp: "Formatted at 2026-09-27 15:12:25 on dist-test-slave-5s2t"
server_key: "d4d6c091ef8e0767d6a2ebeb1c4943c5"
server_key_iv: "1f410a538cd47c8a67c2ceed022213d6"
server_key_version: "encryptionkey@0"
I20260927 15:12:25.406085 23369 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1790521920546562-17952-0/minicluster-data/master-0/wal/instance:
uuid: "89a2b393616f499d87b9d207b8a1cc3c"
format_stamp: "Formatted at 2026-09-27 15:12:25 on dist-test-slave-5s2t"
server_key: "d4d6c091ef8e0767d6a2ebeb1c4943c5"
server_key_iv: "1f410a538cd47c8a67c2ceed022213d6"
server_key_version: "encryptionkey@0"
I20260927 15:12:25.409489 23369 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.003s
I20260927 15:12:25.411805 23383 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260927 15:12:25.412974 23369 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260927 15:12:25.413084 23369 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1790521920546562-17952-0/minicluster-data/master-0/data,/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1790521920546562-17952-0/minicluster-data/master-0/wal
uuid: "89a2b393616f499d87b9d207b8a1cc3c"
format_stamp: "Formatted at 2026-09-27 15:12:25 on dist-test-slave-5s2t"
server_key: "d4d6c091ef8e0767d6a2ebeb1c4943c5"
server_key_iv: "1f410a538cd47c8a67c2ceed022213d6"
server_key_version: "encryptionkey@0"
I20260927 15:12:25.413173 23369 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1790521920546562-17952-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1790521920546562-17952-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1790521920546562-17952-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260927 15:12:25.428337 23369 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260927 15:12:25.428985 23369 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260927 15:12:25.429145 23369 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260927 15:12:25.435343 23369 rpc_server.cc:307] RPC server started. Bound to: 127.17.136.62:33231
I20260927 15:12:25.435359 23435 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.136.62:33231 every 8 connection(s)
I20260927 15:12:25.436210 23369 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1790521920546562-17952-0/minicluster-data/master-0/data/info.pb
I20260927 15:12:25.439031 23436 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:12:25.441380 17952 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu as pid 23369
I20260927 15:12:25.441494 17952 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1790521920546562-17952-0/minicluster-data/master-0/wal/instance
I20260927 15:12:25.441727 17952 external_mini_cluster.cc:1428] Setting key fefceabbc5a42d4dfc88c1c1366369ef
I20260927 15:12:25.444440 23436 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 89a2b393616f499d87b9d207b8a1cc3c: Bootstrap starting.
I20260927 15:12:25.446624 23436 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 89a2b393616f499d87b9d207b8a1cc3c: Neither blocks nor log segments found. Creating new log.
I20260927 15:12:25.447293 23436 log.cc:824] T 00000000000000000000000000000000 P 89a2b393616f499d87b9d207b8a1cc3c: Log is configured to *not* fsync() on all Append() calls
I20260927 15:12:25.448948 23436 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 89a2b393616f499d87b9d207b8a1cc3c: No bootstrap required, opened a new log
I20260927 15:12:25.449990 23439 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:25.442907 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47370 (local address 127.17.136.62:33231)
0927 15:12:25.443531 (+ 624us) server_negotiation.cc:206] Beginning negotiation
0927 15:12:25.443546 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0927 15:12:25.443581 (+ 35us) server_negotiation.cc:407] Connection header received
0927 15:12:25.444156 (+ 575us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:12:25.444171 (+ 15us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:12:25.444555 (+ 384us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:12:25.444854 (+ 299us) server_negotiation.cc:226] Negotiated authn=SASL
0927 15:12:25.445241 (+ 387us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:25.446194 (+ 953us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:25.447037 (+ 843us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:25.447563 (+ 526us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:25.447695 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:25.448445 (+ 750us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0927 15:12:25.448450 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0927 15:12:25.448462 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0927 15:12:25.448814 (+ 352us) server_negotiation.cc:922] calling sasl_server_start()
0927 15:12:25.448869 (+ 55us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0927 15:12:25.448887 (+ 18us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0927 15:12:25.448971 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0927 15:12:25.449099 (+ 128us) server_negotiation.cc:299] Negotiation successful
0927 15:12:25.449332 (+ 233us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":240,"thread_start_us":102,"threads_started":1}
I20260927 15:12:25.452598 17952 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260927 15:12:25.452682 23436 raft_consensus.cc:348] T 00000000000000000000000000000000 P 89a2b393616f499d87b9d207b8a1cc3c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "89a2b393616f499d87b9d207b8a1cc3c" member_type: VOTER last_known_addr { host: "127.17.136.62" port: 33231 } }
I20260927 15:12:25.452883 23436 raft_consensus.cc:374] T 00000000000000000000000000000000 P 89a2b393616f499d87b9d207b8a1cc3c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:12:25.452934 23436 raft_consensus.cc:729] T 00000000000000000000000000000000 P 89a2b393616f499d87b9d207b8a1cc3c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89a2b393616f499d87b9d207b8a1cc3c, State: Initialized, Role: FOLLOWER
I20260927 15:12:25.453320 23436 consensus_queue.cc:260] T 00000000000000000000000000000000 P 89a2b393616f499d87b9d207b8a1cc3c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "89a2b393616f499d87b9d207b8a1cc3c" member_type: VOTER last_known_addr { host: "127.17.136.62" port: 33231 } }
I20260927 15:12:25.453455 23436 raft_consensus.cc:388] T 00000000000000000000000000000000 P 89a2b393616f499d87b9d207b8a1cc3c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260927 15:12:25.453533 23436 raft_consensus.cc:482] T 00000000000000000000000000000000 P 89a2b393616f499d87b9d207b8a1cc3c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260927 15:12:25.453627 23436 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 89a2b393616f499d87b9d207b8a1cc3c [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:12:25.454463 23436 raft_consensus.cc:504] T 00000000000000000000000000000000 P 89a2b393616f499d87b9d207b8a1cc3c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "89a2b393616f499d87b9d207b8a1cc3c" member_type: VOTER last_known_addr { host: "127.17.136.62" port: 33231 } }
I20260927 15:12:25.454766 23436 leader_election.cc:302] T 00000000000000000000000000000000 P 89a2b393616f499d87b9d207b8a1cc3c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 89a2b393616f499d87b9d207b8a1cc3c; no voters:
I20260927 15:12:25.455027 23436 leader_election.cc:288] T 00000000000000000000000000000000 P 89a2b393616f499d87b9d207b8a1cc3c [CANDIDATE]: Term 1 election: Requested vote from peers
I20260927 15:12:25.455121 23441 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 89a2b393616f499d87b9d207b8a1cc3c [term 1 FOLLOWER]: Leader election won for term 1
I20260927 15:12:25.455354 23441 raft_consensus.cc:686] T 00000000000000000000000000000000 P 89a2b393616f499d87b9d207b8a1cc3c [term 1 LEADER]: Becoming Leader. State: Replica: 89a2b393616f499d87b9d207b8a1cc3c, State: Running, Role: LEADER
I20260927 15:12:25.455624 23441 consensus_queue.cc:237] T 00000000000000000000000000000000 P 89a2b393616f499d87b9d207b8a1cc3c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "89a2b393616f499d87b9d207b8a1cc3c" member_type: VOTER last_known_addr { host: "127.17.136.62" port: 33231 } }
I20260927 15:12:25.456096 23436 sys_catalog.cc:564] T 00000000000000000000000000000000 P 89a2b393616f499d87b9d207b8a1cc3c [sys.catalog]: configured and running, proceeding with master startup.
I20260927 15:12:25.457039 23443 sys_catalog.cc:455] T 00000000000000000000000000000000 P 89a2b393616f499d87b9d207b8a1cc3c [sys.catalog]: SysCatalogTable state changed. Reason: New leader 89a2b393616f499d87b9d207b8a1cc3c. Latest consensus state: current_term: 1 leader_uuid: "89a2b393616f499d87b9d207b8a1cc3c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "89a2b393616f499d87b9d207b8a1cc3c" member_type: VOTER last_known_addr { host: "127.17.136.62" port: 33231 } } }
I20260927 15:12:25.457155 23443 sys_catalog.cc:458] T 00000000000000000000000000000000 P 89a2b393616f499d87b9d207b8a1cc3c [sys.catalog]: This master's current role is: LEADER
I20260927 15:12:25.457425 23442 sys_catalog.cc:455] T 00000000000000000000000000000000 P 89a2b393616f499d87b9d207b8a1cc3c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "89a2b393616f499d87b9d207b8a1cc3c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "89a2b393616f499d87b9d207b8a1cc3c" member_type: VOTER last_known_addr { host: "127.17.136.62" port: 33231 } } }
I20260927 15:12:25.457520 23442 sys_catalog.cc:458] T 00000000000000000000000000000000 P 89a2b393616f499d87b9d207b8a1cc3c [sys.catalog]: This master's current role is: LEADER
I20260927 15:12:25.457582 23450 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260927 15:12:25.460048 23450 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260927 15:12:25.464920 23450 catalog_manager.cc:1347] Generated new cluster ID: af4720efb3be48b59e2f6fc88ad599f4
I20260927 15:12:25.465003 23450 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260927 15:12:25.471071 23450 catalog_manager.cc:1370] Generated new certificate authority record
I20260927 15:12:25.472193 23450 catalog_manager.cc:1504] Loading token signing keys...
I20260927 15:12:25.484512 23450 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 89a2b393616f499d87b9d207b8a1cc3c: Generated new TSK 0
I20260927 15:12:25.485307 23450 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260927 15:12:25.523066 23439 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:25.499119 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47384 (local address 127.17.136.62:33231)
0927 15:12:25.499266 (+ 147us) server_negotiation.cc:206] Beginning negotiation
0927 15:12:25.499271 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0927 15:12:25.499418 (+ 147us) server_negotiation.cc:407] Connection header received
0927 15:12:25.499560 (+ 142us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:12:25.499562 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:12:25.499605 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:12:25.499685 (+ 80us) server_negotiation.cc:226] Negotiated authn=JWT
0927 15:12:25.499900 (+ 215us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:25.500437 (+ 537us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:25.501629 (+ 1192us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:25.501843 (+ 214us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:25.501948 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:25.502216 (+ 268us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0927 15:12:25.522679 (+ 20463us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
0927 15:12:25.522948 (+ 269us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:47384: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
Metrics: {"server-negotiator.queue_time_us":49}
W20260927 15:12:25.523134 23439 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:47384: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
W20260927 15:12:25.523316 23465 negotiation.cc:337] Failed RPC negotiation. Trace:
0927 15:12:25.499026 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.62:33231 (local address 127.0.0.1:47384)
0927 15:12:25.499336 (+ 310us) negotiation.cc:107] Waiting for socket to connect
0927 15:12:25.499350 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0927 15:12:25.499456 (+ 106us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0927 15:12:25.499698 (+ 242us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0927 15:12:25.499701 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0927 15:12:25.499709 (+ 8us) client_negotiation.cc:189] Negotiated authn=JWT
0927 15:12:25.499814 (+ 105us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:12:25.499821 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:12:25.500526 (+ 705us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:12:25.500530 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:12:25.501511 (+ 981us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:12:25.501521 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:12:25.501944 (+ 423us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:12:25.501948 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:12:25.502047 (+ 99us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:25.502073 (+ 26us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0927 15:12:25.522903 (+ 20830us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
0927 15:12:25.523110 (+ 207us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.17.136.62:33231: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
Metrics: {"client-negotiator.queue_time_us":228,"thread_start_us":97,"threads_started":1}
I20260927 15:12:25.523833 17952 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu with pid 23369
2026-09-27T15:12:25Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS (272 ms)
[ RUN ] SecurityITest.TestWorldReadableKeytab
[ OK ] SecurityITest.TestWorldReadableKeytab (115 ms)
[ RUN ] SecurityITest.TestWorldReadablePrivateKey
[ OK ] SecurityITest.TestWorldReadablePrivateKey (115 ms)
[ RUN ] SecurityITest.TestCorruptKerberosCC
Loading random data
Initializing database '/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790521920546562-17952-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 27 15:12:25 dist-test-slave-5s2t krb5kdc[23477](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 27 15:12:25 dist-test-slave-5s2t krb5kdc[23477](info): set up 2 sockets
Sep 27 15:12:25 dist-test-slave-5s2t krb5kdc[23477](info): commencing operation
krb5kdc: starting...
W20260927 15:12:26.719486 17952 mini_kdc.cc:121] Time spent starting KDC: real 0.946s user 0.000s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790521920546562-17952-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790521920546562-17952-0/krb5kdc/test-user.keytab.
Sep 27 15:12:26 dist-test-slave-5s2t krb5kdc[23477](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790521946, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-27T15:12:26Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-27T15:12:26Z Disabled control of system clock
WARNING: no policy specified for kudu/127.17.136.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.136.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.136.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790521920546562-17952-0/krb5kdc/kudu_127.17.136.62.keytab.
Entry for principal kudu/127.17.136.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790521920546562-17952-0/krb5kdc/kudu_127.17.136.62.keytab.
I20260927 15:12:26.837934 17952 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu
/tmp/dist-test-taskiFOyeW/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790521920546562-17952-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790521920546562-17952-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790521920546562-17952-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790521920546562-17952-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.136.62:39281
--webserver_interface=127.17.136.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790521920546562-17952-0/krb5kdc/kudu_127.17.136.62.keytab
--principal=kudu/127.17.136.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.136.20:45559
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.136.62:39281
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790521920546562-17952-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790521920546562-17952-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790521920546562-17952-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260927 15:12:26.949769 23490 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260927 15:12:26.950047 23490 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260927 15:12:26.950102 23490 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260927 15:12:26.954131 23490 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260927 15:12:26.954190 23490 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260927 15:12:26.954216 23490 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260927 15:12:26.954239 23490 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260927 15:12:26.954268 23490 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260927 15:12:26.959607 23490 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.136.20:45559
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790521920546562-17952-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790521920546562-17952-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.17.136.62:39281
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790521920546562-17952-0/krb5kdc/kudu_127.17.136.62.keytab
--principal=kudu/127.17.136.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.136.62:39281
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790521920546562-17952-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.17.136.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23490
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790521920546562-17952-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 27 Sep 2026 14:27:13 UTC on ccycloud.quasar-psqrth.root.comops.site
build id 4676138
I20260927 15:12:26.960753 23490 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260927 15:12:26.961786 23490 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260927 15:12:26.969875 23495 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260927 15:12:26.969895 23496 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260927 15:12:26.969890 23498 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260927 15:12:26.970220 23490 server_base.cc:1034] running on GCE node
I20260927 15:12:26.970767 23490 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260927 15:12:26.971846 23490 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260927 15:12:26.972995 23490 hybrid_clock.cc:648] HybridClock initialized: now 1790521946972975 us; error 38 us; skew 500 ppm
Sep 27 15:12:26 dist-test-slave-5s2t krb5kdc[23477](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790521946, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.136.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260927 15:12:26.975652 23490 init.cc:377] Logged in from keytab as kudu/127.17.136.62@KRBTEST.COM (short username kudu)
I20260927 15:12:26.976444 23490 webserver.cc:460] Webserver started at http://127.17.136.62:42103/ using document root <none> and password file <none>
I20260927 15:12:26.976953 23490 fs_manager.cc:359] Metadata directory not provided
I20260927 15:12:26.977056 23490 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260927 15:12:26.977248 23490 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260927 15:12:26.979162 23490 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790521920546562-17952-0/minicluster-data/master-0/data/instance:
uuid: "6daf71f190154915a541e7c247688493"
format_stamp: "Formatted at 2026-09-27 15:12:26 on dist-test-slave-5s2t"
server_key: "a4d066eb44d1562cfefc6693ba10ecff"
server_key_iv: "b8752496a93cfebb8a92ea921258a819"
server_key_version: "encryptionkey@0"
I20260927 15:12:26.979702 23490 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790521920546562-17952-0/minicluster-data/master-0/wal/instance:
uuid: "6daf71f190154915a541e7c247688493"
format_stamp: "Formatted at 2026-09-27 15:12:26 on dist-test-slave-5s2t"
server_key: "a4d066eb44d1562cfefc6693ba10ecff"
server_key_iv: "b8752496a93cfebb8a92ea921258a819"
server_key_version: "encryptionkey@0"
I20260927 15:12:26.983434 23490 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.000s
I20260927 15:12:26.985716 23505 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260927 15:12:26.986881 23490 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260927 15:12:26.986991 23490 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790521920546562-17952-0/minicluster-data/master-0/data,/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790521920546562-17952-0/minicluster-data/master-0/wal
uuid: "6daf71f190154915a541e7c247688493"
format_stamp: "Formatted at 2026-09-27 15:12:26 on dist-test-slave-5s2t"
server_key: "a4d066eb44d1562cfefc6693ba10ecff"
server_key_iv: "b8752496a93cfebb8a92ea921258a819"
server_key_version: "encryptionkey@0"
I20260927 15:12:26.987102 23490 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790521920546562-17952-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790521920546562-17952-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790521920546562-17952-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260927 15:12:27.019766 23490 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260927 15:12:27.022603 23490 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260927 15:12:27.022787 23490 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260927 15:12:27.029585 23490 rpc_server.cc:307] RPC server started. Bound to: 127.17.136.62:39281
I20260927 15:12:27.029601 23557 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.136.62:39281 every 8 connection(s)
I20260927 15:12:27.030578 23490 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790521920546562-17952-0/minicluster-data/master-0/data/info.pb
I20260927 15:12:27.033357 23558 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:12:27.033819 17952 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu as pid 23490
I20260927 15:12:27.033923 17952 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790521920546562-17952-0/minicluster-data/master-0/wal/instance
I20260927 15:12:27.034515 17952 external_mini_cluster.cc:1428] Setting key 8efa4cc16efb7c06d4d64cb9903ac6d5
I20260927 15:12:27.039937 23558 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6daf71f190154915a541e7c247688493: Bootstrap starting.
I20260927 15:12:27.042390 23558 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 6daf71f190154915a541e7c247688493: Neither blocks nor log segments found. Creating new log.
I20260927 15:12:27.043151 23558 log.cc:824] T 00000000000000000000000000000000 P 6daf71f190154915a541e7c247688493: Log is configured to *not* fsync() on all Append() calls
Sep 27 15:12:27 dist-test-slave-5s2t krb5kdc[23477](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790521946, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.136.62@KRBTEST.COM
I20260927 15:12:27.045096 23558 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6daf71f190154915a541e7c247688493: No bootstrap required, opened a new log
I20260927 15:12:27.048485 23558 raft_consensus.cc:348] T 00000000000000000000000000000000 P 6daf71f190154915a541e7c247688493 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6daf71f190154915a541e7c247688493" member_type: VOTER last_known_addr { host: "127.17.136.62" port: 39281 } }
I20260927 15:12:27.048727 23558 raft_consensus.cc:374] T 00000000000000000000000000000000 P 6daf71f190154915a541e7c247688493 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:12:27.048782 23558 raft_consensus.cc:729] T 00000000000000000000000000000000 P 6daf71f190154915a541e7c247688493 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6daf71f190154915a541e7c247688493, State: Initialized, Role: FOLLOWER
I20260927 15:12:27.049055 23561 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:27.036136 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39688 (local address 127.17.136.62:39281)
0927 15:12:27.036558 (+ 422us) server_negotiation.cc:206] Beginning negotiation
0927 15:12:27.036577 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0927 15:12:27.036622 (+ 45us) server_negotiation.cc:407] Connection header received
0927 15:12:27.037409 (+ 787us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:12:27.037433 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:12:27.037856 (+ 423us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:12:27.038234 (+ 378us) server_negotiation.cc:226] Negotiated authn=SASL
0927 15:12:27.039008 (+ 774us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:27.040396 (+ 1388us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:27.041341 (+ 945us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:27.042009 (+ 668us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:27.042165 (+ 156us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:27.044681 (+ 2516us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0927 15:12:27.044686 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0927 15:12:27.044699 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0927 15:12:27.044724 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0927 15:12:27.046231 (+ 1507us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:12:27.046621 (+ 390us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:12:27.046626 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:12:27.046630 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:12:27.046735 (+ 105us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:12:27.046970 (+ 235us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:12:27.046973 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:12:27.046975 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:12:27.047396 (+ 421us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0927 15:12:27.047583 (+ 187us) server_negotiation.cc:1035] Waiting for connection context
0927 15:12:27.047904 (+ 321us) server_negotiation.cc:299] Negotiation successful
0927 15:12:27.048177 (+ 273us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":256,"thread_start_us":108,"threads_started":1}
I20260927 15:12:27.049291 23558 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6daf71f190154915a541e7c247688493 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6daf71f190154915a541e7c247688493" member_type: VOTER last_known_addr { host: "127.17.136.62" port: 39281 } }
I20260927 15:12:27.049438 23558 raft_consensus.cc:388] T 00000000000000000000000000000000 P 6daf71f190154915a541e7c247688493 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260927 15:12:27.049499 23558 raft_consensus.cc:482] T 00000000000000000000000000000000 P 6daf71f190154915a541e7c247688493 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260927 15:12:27.049588 23558 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 6daf71f190154915a541e7c247688493 [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:12:27.050531 23558 raft_consensus.cc:504] T 00000000000000000000000000000000 P 6daf71f190154915a541e7c247688493 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6daf71f190154915a541e7c247688493" member_type: VOTER last_known_addr { host: "127.17.136.62" port: 39281 } }
I20260927 15:12:27.050835 23558 leader_election.cc:302] T 00000000000000000000000000000000 P 6daf71f190154915a541e7c247688493 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 6daf71f190154915a541e7c247688493; no voters:
I20260927 15:12:27.051144 23558 leader_election.cc:288] T 00000000000000000000000000000000 P 6daf71f190154915a541e7c247688493 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260927 15:12:27.051283 23563 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 6daf71f190154915a541e7c247688493 [term 1 FOLLOWER]: Leader election won for term 1
I20260927 15:12:27.051481 23563 raft_consensus.cc:686] T 00000000000000000000000000000000 P 6daf71f190154915a541e7c247688493 [term 1 LEADER]: Becoming Leader. State: Replica: 6daf71f190154915a541e7c247688493, State: Running, Role: LEADER
I20260927 15:12:27.051769 23563 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6daf71f190154915a541e7c247688493 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6daf71f190154915a541e7c247688493" member_type: VOTER last_known_addr { host: "127.17.136.62" port: 39281 } }
I20260927 15:12:27.052306 23558 sys_catalog.cc:564] T 00000000000000000000000000000000 P 6daf71f190154915a541e7c247688493 [sys.catalog]: configured and running, proceeding with master startup.
I20260927 15:12:27.053275 23565 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6daf71f190154915a541e7c247688493 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6daf71f190154915a541e7c247688493. Latest consensus state: current_term: 1 leader_uuid: "6daf71f190154915a541e7c247688493" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6daf71f190154915a541e7c247688493" member_type: VOTER last_known_addr { host: "127.17.136.62" port: 39281 } } }
I20260927 15:12:27.053395 23565 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6daf71f190154915a541e7c247688493 [sys.catalog]: This master's current role is: LEADER
I20260927 15:12:27.053685 23564 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6daf71f190154915a541e7c247688493 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "6daf71f190154915a541e7c247688493" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6daf71f190154915a541e7c247688493" member_type: VOTER last_known_addr { host: "127.17.136.62" port: 39281 } } }
I20260927 15:12:27.053788 23564 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6daf71f190154915a541e7c247688493 [sys.catalog]: This master's current role is: LEADER
I20260927 15:12:27.053874 23572 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260927 15:12:27.056927 23572 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260927 15:12:27.063444 23572 catalog_manager.cc:1347] Generated new cluster ID: 3443055e64e648acac3108ed98bb8f32
I20260927 15:12:27.063530 23572 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260927 15:12:27.086138 23572 catalog_manager.cc:1370] Generated new certificate authority record
I20260927 15:12:27.087086 23572 catalog_manager.cc:1504] Loading token signing keys...
I20260927 15:12:27.096264 23572 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 6daf71f190154915a541e7c247688493: Generated new TSK 0
I20260927 15:12:27.096935 23572 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.17.136.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.136.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.136.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790521920546562-17952-0/krb5kdc/kudu_127.17.136.1.keytab.
Entry for principal kudu/127.17.136.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790521920546562-17952-0/krb5kdc/kudu_127.17.136.1.keytab.
I20260927 15:12:27.134351 17952 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu
/tmp/dist-test-taskiFOyeW/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790521920546562-17952-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790521920546562-17952-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790521920546562-17952-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790521920546562-17952-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.136.1:0
--local_ip_for_outbound_sockets=127.17.136.1
--webserver_interface=127.17.136.1
--webserver_port=0
--tserver_master_addrs=127.17.136.62:39281
--keytab_file=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790521920546562-17952-0/krb5kdc/kudu_127.17.136.1.keytab
--principal=kudu/127.17.136.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.136.20:45559
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790521920546562-17952-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790521920546562-17952-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790521920546562-17952-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260927 15:12:27.243933 23584 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260927 15:12:27.244189 23584 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260927 15:12:27.244228 23584 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260927 15:12:27.248215 23584 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260927 15:12:27.248270 23584 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260927 15:12:27.248337 23584 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.136.1
I20260927 15:12:27.253592 23584 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.136.20:45559
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790521920546562-17952-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790521920546562-17952-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790521920546562-17952-0/krb5kdc/kudu_127.17.136.1.keytab
--principal=kudu/127.17.136.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.136.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790521920546562-17952-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.17.136.1
--webserver_port=0
--tserver_master_addrs=127.17.136.62:39281
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23584
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.136.1
--log_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790521920546562-17952-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 27 Sep 2026 14:27:13 UTC on ccycloud.quasar-psqrth.root.comops.site
build id 4676138
I20260927 15:12:27.254582 23584 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260927 15:12:27.255580 23584 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260927 15:12:27.264788 23589 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260927 15:12:27.264863 23584 server_base.cc:1034] running on GCE node
W20260927 15:12:27.264816 23590 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260927 15:12:27.264773 23592 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260927 15:12:27.265322 23584 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260927 15:12:27.265899 23584 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260927 15:12:27.267050 23584 hybrid_clock.cc:648] HybridClock initialized: now 1790521947267028 us; error 33 us; skew 500 ppm
Sep 27 15:12:27 dist-test-slave-5s2t krb5kdc[23477](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790521947, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.136.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260927 15:12:27.269663 23584 init.cc:377] Logged in from keytab as kudu/127.17.136.1@KRBTEST.COM (short username kudu)
I20260927 15:12:27.270535 23584 webserver.cc:460] Webserver started at http://127.17.136.1:42303/ using document root <none> and password file <none>
I20260927 15:12:27.271059 23584 fs_manager.cc:359] Metadata directory not provided
I20260927 15:12:27.271119 23584 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260927 15:12:27.271332 23584 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260927 15:12:27.273269 23584 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790521920546562-17952-0/minicluster-data/ts-0/data/instance:
uuid: "89308f22f9f5426d8981b8cff871829b"
format_stamp: "Formatted at 2026-09-27 15:12:27 on dist-test-slave-5s2t"
server_key: "5024a456c33b63fc2c4ca5d1ad6dadf7"
server_key_iv: "035b78acfd43a506cb27c98dec4d85ff"
server_key_version: "encryptionkey@0"
I20260927 15:12:27.273777 23584 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790521920546562-17952-0/minicluster-data/ts-0/wal/instance:
uuid: "89308f22f9f5426d8981b8cff871829b"
format_stamp: "Formatted at 2026-09-27 15:12:27 on dist-test-slave-5s2t"
server_key: "5024a456c33b63fc2c4ca5d1ad6dadf7"
server_key_iv: "035b78acfd43a506cb27c98dec4d85ff"
server_key_version: "encryptionkey@0"
I20260927 15:12:27.277575 23584 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.003s
I20260927 15:12:27.279798 23599 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260927 15:12:27.280927 23584 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260927 15:12:27.281035 23584 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790521920546562-17952-0/minicluster-data/ts-0/data,/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790521920546562-17952-0/minicluster-data/ts-0/wal
uuid: "89308f22f9f5426d8981b8cff871829b"
format_stamp: "Formatted at 2026-09-27 15:12:27 on dist-test-slave-5s2t"
server_key: "5024a456c33b63fc2c4ca5d1ad6dadf7"
server_key_iv: "035b78acfd43a506cb27c98dec4d85ff"
server_key_version: "encryptionkey@0"
I20260927 15:12:27.281119 23584 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790521920546562-17952-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790521920546562-17952-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790521920546562-17952-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260927 15:12:27.309978 23584 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260927 15:12:27.313187 23584 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260927 15:12:27.313364 23584 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260927 15:12:27.313942 23584 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260927 15:12:27.314744 23584 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260927 15:12:27.314800 23584 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260927 15:12:27.314857 23584 ts_tablet_manager.cc:610] Registered 0 tablets
I20260927 15:12:27.314884 23584 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260927 15:12:27.322979 23584 rpc_server.cc:307] RPC server started. Bound to: 127.17.136.1:38783
I20260927 15:12:27.323019 23712 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.136.1:38783 every 8 connection(s)
I20260927 15:12:27.323897 23584 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790521920546562-17952-0/minicluster-data/ts-0/data/info.pb
I20260927 15:12:27.330483 17952 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu as pid 23584
I20260927 15:12:27.330626 17952 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790521920546562-17952-0/minicluster-data/ts-0/wal/instance
I20260927 15:12:27.330919 17952 external_mini_cluster.cc:1428] Setting key 7a0e8e7ce91149d606668ffb874787dd
Sep 27 15:12:27 dist-test-slave-5s2t krb5kdc[23477](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790521947, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.136.1@KRBTEST.COM for kudu/127.17.136.62@KRBTEST.COM
I20260927 15:12:27.337181 23561 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:27.325603 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.136.1:33263 (local address 127.17.136.62:39281)
0927 15:12:27.325752 (+ 149us) server_negotiation.cc:206] Beginning negotiation
0927 15:12:27.325757 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0927 15:12:27.326556 (+ 799us) server_negotiation.cc:407] Connection header received
0927 15:12:27.327823 (+ 1267us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:12:27.327825 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:12:27.327871 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:12:27.327940 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0927 15:12:27.329048 (+ 1108us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:27.329582 (+ 534us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:27.331057 (+ 1475us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:27.331314 (+ 257us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:27.331394 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:27.333928 (+ 2534us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0927 15:12:27.333932 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0927 15:12:27.333934 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0927 15:12:27.333965 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0927 15:12:27.335237 (+ 1272us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:12:27.335778 (+ 541us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:12:27.335781 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:12:27.335783 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:12:27.335861 (+ 78us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:12:27.336196 (+ 335us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:12:27.336198 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:12:27.336199 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:12:27.336352 (+ 153us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0927 15:12:27.336419 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0927 15:12:27.336966 (+ 547us) server_negotiation.cc:299] Negotiation successful
0927 15:12:27.337068 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260927 15:12:27.338300 23715 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:27.325998 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.62:39281 (local address 127.17.136.1:33263)
0927 15:12:27.326409 (+ 411us) negotiation.cc:107] Waiting for socket to connect
0927 15:12:27.326455 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0927 15:12:27.327646 (+ 1191us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0927 15:12:27.328122 (+ 476us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0927 15:12:27.328129 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0927 15:12:27.328471 (+ 342us) client_negotiation.cc:189] Negotiated authn=SASL
0927 15:12:27.328943 (+ 472us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:12:27.328955 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:12:27.329681 (+ 726us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:12:27.329683 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:12:27.330953 (+ 1270us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:12:27.330963 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:12:27.331481 (+ 518us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:12:27.331485 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:12:27.331646 (+ 161us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:27.332229 (+ 583us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0927 15:12:27.332248 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0927 15:12:27.333778 (+ 1530us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0927 15:12:27.335363 (+ 1585us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0927 15:12:27.335368 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0927 15:12:27.335383 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0927 15:12:27.335687 (+ 304us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0927 15:12:27.335938 (+ 251us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0927 15:12:27.335940 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0927 15:12:27.335942 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0927 15:12:27.336119 (+ 177us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0927 15:12:27.336433 (+ 314us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0927 15:12:27.336439 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0927 15:12:27.336731 (+ 292us) client_negotiation.cc:769] Sending connection context
0927 15:12:27.336938 (+ 207us) client_negotiation.cc:240] Negotiation successful
0927 15:12:27.337272 (+ 334us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":229,"thread_start_us":93,"threads_started":1}
I20260927 15:12:27.339833 23713 heartbeater.cc:347] Connected to a master server at 127.17.136.62:39281
I20260927 15:12:27.340090 23713 heartbeater.cc:464] Registering TS with master...
I20260927 15:12:27.340662 23713 heartbeater.cc:511] Master 127.17.136.62:39281 requested a full tablet report, sending...
WARNING: no policy specified for kudu/127.17.136.2@KRBTEST.COM; defaulting to no policy
I20260927 15:12:27.342269 23520 ts_manager.cc:194] Registered new tserver with Master: 89308f22f9f5426d8981b8cff871829b (127.17.136.1:38783)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.136.2@KRBTEST.COM" created.
I20260927 15:12:27.343466 23520 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.136.1@KRBTEST.COM'} at 127.17.136.1:33263
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.136.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790521920546562-17952-0/krb5kdc/kudu_127.17.136.2.keytab.
Entry for principal kudu/127.17.136.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790521920546562-17952-0/krb5kdc/kudu_127.17.136.2.keytab.
I20260927 15:12:27.356240 17952 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu
/tmp/dist-test-taskiFOyeW/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790521920546562-17952-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790521920546562-17952-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790521920546562-17952-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790521920546562-17952-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.136.2:0
--local_ip_for_outbound_sockets=127.17.136.2
--webserver_interface=127.17.136.2
--webserver_port=0
--tserver_master_addrs=127.17.136.62:39281
--keytab_file=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790521920546562-17952-0/krb5kdc/kudu_127.17.136.2.keytab
--principal=kudu/127.17.136.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.136.20:45559
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790521920546562-17952-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790521920546562-17952-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790521920546562-17952-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260927 15:12:27.462826 23718 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260927 15:12:27.463054 23718 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260927 15:12:27.463092 23718 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260927 15:12:27.466970 23718 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260927 15:12:27.467024 23718 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260927 15:12:27.467090 23718 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.136.2
I20260927 15:12:27.472211 23718 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.136.20:45559
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790521920546562-17952-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790521920546562-17952-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790521920546562-17952-0/krb5kdc/kudu_127.17.136.2.keytab
--principal=kudu/127.17.136.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.136.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790521920546562-17952-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.17.136.2
--webserver_port=0
--tserver_master_addrs=127.17.136.62:39281
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23718
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.136.2
--log_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790521920546562-17952-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 27 Sep 2026 14:27:13 UTC on ccycloud.quasar-psqrth.root.comops.site
build id 4676138
I20260927 15:12:27.473225 23718 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260927 15:12:27.474210 23718 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260927 15:12:27.483220 23726 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260927 15:12:27.483237 23724 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260927 15:12:27.483309 23723 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260927 15:12:27.483558 23718 server_base.cc:1034] running on GCE node
I20260927 15:12:27.483902 23718 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260927 15:12:27.484489 23718 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260927 15:12:27.485643 23718 hybrid_clock.cc:648] HybridClock initialized: now 1790521947485607 us; error 46 us; skew 500 ppm
Sep 27 15:12:27 dist-test-slave-5s2t krb5kdc[23477](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790521947, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.136.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260927 15:12:27.488173 23718 init.cc:377] Logged in from keytab as kudu/127.17.136.2@KRBTEST.COM (short username kudu)
I20260927 15:12:27.488996 23718 webserver.cc:460] Webserver started at http://127.17.136.2:44459/ using document root <none> and password file <none>
I20260927 15:12:27.489502 23718 fs_manager.cc:359] Metadata directory not provided
I20260927 15:12:27.489564 23718 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260927 15:12:27.489753 23718 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260927 15:12:27.491783 23718 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790521920546562-17952-0/minicluster-data/ts-1/data/instance:
uuid: "f5671e61b81b427294964eec8f9e1534"
format_stamp: "Formatted at 2026-09-27 15:12:27 on dist-test-slave-5s2t"
server_key: "660c4799e8f6a558ff1d610d4799e628"
server_key_iv: "c141d09865329bfd8dd869c173d3e4bd"
server_key_version: "encryptionkey@0"
I20260927 15:12:27.492309 23718 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790521920546562-17952-0/minicluster-data/ts-1/wal/instance:
uuid: "f5671e61b81b427294964eec8f9e1534"
format_stamp: "Formatted at 2026-09-27 15:12:27 on dist-test-slave-5s2t"
server_key: "660c4799e8f6a558ff1d610d4799e628"
server_key_iv: "c141d09865329bfd8dd869c173d3e4bd"
server_key_version: "encryptionkey@0"
I20260927 15:12:27.495826 23718 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.000s
I20260927 15:12:27.498070 23733 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260927 15:12:27.499814 23718 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260927 15:12:27.500022 23718 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790521920546562-17952-0/minicluster-data/ts-1/data,/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790521920546562-17952-0/minicluster-data/ts-1/wal
uuid: "f5671e61b81b427294964eec8f9e1534"
format_stamp: "Formatted at 2026-09-27 15:12:27 on dist-test-slave-5s2t"
server_key: "660c4799e8f6a558ff1d610d4799e628"
server_key_iv: "c141d09865329bfd8dd869c173d3e4bd"
server_key_version: "encryptionkey@0"
I20260927 15:12:27.500236 23718 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790521920546562-17952-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790521920546562-17952-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790521920546562-17952-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260927 15:12:27.514590 23718 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260927 15:12:27.517269 23718 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260927 15:12:27.517434 23718 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260927 15:12:27.517985 23718 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260927 15:12:27.518756 23718 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260927 15:12:27.518800 23718 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260927 15:12:27.518850 23718 ts_tablet_manager.cc:610] Registered 0 tablets
I20260927 15:12:27.518875 23718 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260927 15:12:27.527078 23718 rpc_server.cc:307] RPC server started. Bound to: 127.17.136.2:32837
I20260927 15:12:27.527122 23846 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.136.2:32837 every 8 connection(s)
I20260927 15:12:27.527967 23718 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790521920546562-17952-0/minicluster-data/ts-1/data/info.pb
I20260927 15:12:27.531669 17952 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu as pid 23718
I20260927 15:12:27.531777 17952 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790521920546562-17952-0/minicluster-data/ts-1/wal/instance
I20260927 15:12:27.532056 17952 external_mini_cluster.cc:1428] Setting key 4c266db3c2dc8f72d5374b276db3cc02
Sep 27 15:12:27 dist-test-slave-5s2t krb5kdc[23477](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790521947, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.136.2@KRBTEST.COM for kudu/127.17.136.62@KRBTEST.COM
WARNING: no policy specified for kudu/127.17.136.3@KRBTEST.COM; defaulting to no policy
I20260927 15:12:27.541044 23561 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:27.529727 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.136.2:51113 (local address 127.17.136.62:39281)
0927 15:12:27.529863 (+ 136us) server_negotiation.cc:206] Beginning negotiation
0927 15:12:27.529867 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0927 15:12:27.530739 (+ 872us) server_negotiation.cc:407] Connection header received
0927 15:12:27.532203 (+ 1464us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:12:27.532207 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:12:27.532261 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:12:27.532332 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0927 15:12:27.533571 (+ 1239us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:27.534091 (+ 520us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:27.535214 (+ 1123us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:27.535487 (+ 273us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:27.535575 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:27.537826 (+ 2251us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0927 15:12:27.537829 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0927 15:12:27.537831 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0927 15:12:27.537853 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0927 15:12:27.539182 (+ 1329us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:12:27.539664 (+ 482us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:12:27.539667 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:12:27.539669 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:12:27.539738 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:12:27.540039 (+ 301us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:12:27.540042 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:12:27.540044 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:12:27.540212 (+ 168us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0927 15:12:27.540291 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0927 15:12:27.540759 (+ 468us) server_negotiation.cc:299] Negotiation successful
0927 15:12:27.540875 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260927 15:12:27.541836 23849 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:27.530104 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.62:39281 (local address 127.17.136.2:51113)
0927 15:12:27.530544 (+ 440us) negotiation.cc:107] Waiting for socket to connect
0927 15:12:27.530585 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0927 15:12:27.532002 (+ 1417us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0927 15:12:27.532495 (+ 493us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0927 15:12:27.532502 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0927 15:12:27.532912 (+ 410us) client_negotiation.cc:189] Negotiated authn=SASL
0927 15:12:27.533445 (+ 533us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:12:27.533458 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:12:27.534201 (+ 743us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:12:27.534203 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:12:27.535105 (+ 902us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:12:27.535114 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:12:27.535618 (+ 504us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:12:27.535622 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:12:27.535780 (+ 158us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:27.536328 (+ 548us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0927 15:12:27.536343 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0927 15:12:27.537682 (+ 1339us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0927 15:12:27.539303 (+ 1621us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0927 15:12:27.539309 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0927 15:12:27.539324 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0927 15:12:27.539570 (+ 246us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0927 15:12:27.539815 (+ 245us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0927 15:12:27.539819 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0927 15:12:27.539821 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0927 15:12:27.539956 (+ 135us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0927 15:12:27.540302 (+ 346us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0927 15:12:27.540309 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0927 15:12:27.540543 (+ 234us) client_negotiation.cc:769] Sending connection context
0927 15:12:27.540702 (+ 159us) client_negotiation.cc:240] Negotiation successful
0927 15:12:27.541003 (+ 301us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":243,"thread_start_us":111,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.136.3@KRBTEST.COM" created.
I20260927 15:12:27.543318 23847 heartbeater.cc:347] Connected to a master server at 127.17.136.62:39281
I20260927 15:12:27.543534 23847 heartbeater.cc:464] Registering TS with master...
I20260927 15:12:27.543972 23847 heartbeater.cc:511] Master 127.17.136.62:39281 requested a full tablet report, sending...
I20260927 15:12:27.544922 23520 ts_manager.cc:194] Registered new tserver with Master: f5671e61b81b427294964eec8f9e1534 (127.17.136.2:32837)
I20260927 15:12:27.545451 23520 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.136.2@KRBTEST.COM'} at 127.17.136.2:51113
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.136.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790521920546562-17952-0/krb5kdc/kudu_127.17.136.3.keytab.
Entry for principal kudu/127.17.136.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790521920546562-17952-0/krb5kdc/kudu_127.17.136.3.keytab.
I20260927 15:12:27.557350 17952 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu
/tmp/dist-test-taskiFOyeW/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790521920546562-17952-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790521920546562-17952-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790521920546562-17952-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790521920546562-17952-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.136.3:0
--local_ip_for_outbound_sockets=127.17.136.3
--webserver_interface=127.17.136.3
--webserver_port=0
--tserver_master_addrs=127.17.136.62:39281
--keytab_file=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790521920546562-17952-0/krb5kdc/kudu_127.17.136.3.keytab
--principal=kudu/127.17.136.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.136.20:45559
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790521920546562-17952-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790521920546562-17952-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790521920546562-17952-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260927 15:12:27.665371 23852 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260927 15:12:27.665620 23852 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260927 15:12:27.665666 23852 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260927 15:12:27.669590 23852 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260927 15:12:27.669646 23852 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260927 15:12:27.669714 23852 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.136.3
I20260927 15:12:27.674855 23852 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.136.20:45559
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790521920546562-17952-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790521920546562-17952-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790521920546562-17952-0/krb5kdc/kudu_127.17.136.3.keytab
--principal=kudu/127.17.136.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.136.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790521920546562-17952-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.17.136.3
--webserver_port=0
--tserver_master_addrs=127.17.136.62:39281
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23852
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.136.3
--log_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790521920546562-17952-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 27 Sep 2026 14:27:13 UTC on ccycloud.quasar-psqrth.root.comops.site
build id 4676138
I20260927 15:12:27.675863 23852 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260927 15:12:27.676838 23852 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260927 15:12:27.685997 23857 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260927 15:12:27.686004 23858 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260927 15:12:27.686048 23860 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260927 15:12:27.686242 23852 server_base.cc:1034] running on GCE node
I20260927 15:12:27.686584 23852 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260927 15:12:27.687155 23852 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260927 15:12:27.688297 23852 hybrid_clock.cc:648] HybridClock initialized: now 1790521947688270 us; error 39 us; skew 500 ppm
Sep 27 15:12:27 dist-test-slave-5s2t krb5kdc[23477](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790521947, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.136.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260927 15:12:27.690809 23852 init.cc:377] Logged in from keytab as kudu/127.17.136.3@KRBTEST.COM (short username kudu)
I20260927 15:12:27.691655 23852 webserver.cc:460] Webserver started at http://127.17.136.3:33433/ using document root <none> and password file <none>
I20260927 15:12:27.692183 23852 fs_manager.cc:359] Metadata directory not provided
I20260927 15:12:27.692243 23852 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260927 15:12:27.692421 23852 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260927 15:12:27.694360 23852 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790521920546562-17952-0/minicluster-data/ts-2/data/instance:
uuid: "9ce08de8cea849bdb532852a9c0ce544"
format_stamp: "Formatted at 2026-09-27 15:12:27 on dist-test-slave-5s2t"
server_key: "421a0e720065f3ea659ce0518067be24"
server_key_iv: "16c3fd60e4098a7ff9b66329502007d9"
server_key_version: "encryptionkey@0"
I20260927 15:12:27.694852 23852 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790521920546562-17952-0/minicluster-data/ts-2/wal/instance:
uuid: "9ce08de8cea849bdb532852a9c0ce544"
format_stamp: "Formatted at 2026-09-27 15:12:27 on dist-test-slave-5s2t"
server_key: "421a0e720065f3ea659ce0518067be24"
server_key_iv: "16c3fd60e4098a7ff9b66329502007d9"
server_key_version: "encryptionkey@0"
I20260927 15:12:27.698220 23852 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.006s sys 0.000s
I20260927 15:12:27.700420 23867 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260927 15:12:27.701519 23852 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260927 15:12:27.701617 23852 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790521920546562-17952-0/minicluster-data/ts-2/data,/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790521920546562-17952-0/minicluster-data/ts-2/wal
uuid: "9ce08de8cea849bdb532852a9c0ce544"
format_stamp: "Formatted at 2026-09-27 15:12:27 on dist-test-slave-5s2t"
server_key: "421a0e720065f3ea659ce0518067be24"
server_key_iv: "16c3fd60e4098a7ff9b66329502007d9"
server_key_version: "encryptionkey@0"
I20260927 15:12:27.701700 23852 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790521920546562-17952-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790521920546562-17952-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790521920546562-17952-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260927 15:12:27.735095 23852 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260927 15:12:27.737731 23852 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260927 15:12:27.737903 23852 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260927 15:12:27.738476 23852 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260927 15:12:27.739269 23852 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260927 15:12:27.739313 23852 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260927 15:12:27.739364 23852 ts_tablet_manager.cc:610] Registered 0 tablets
I20260927 15:12:27.739393 23852 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260927 15:12:27.747414 23852 rpc_server.cc:307] RPC server started. Bound to: 127.17.136.3:37223
I20260927 15:12:27.747445 23980 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.136.3:37223 every 8 connection(s)
I20260927 15:12:27.748253 23852 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790521920546562-17952-0/minicluster-data/ts-2/data/info.pb
I20260927 15:12:27.752676 17952 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu as pid 23852
I20260927 15:12:27.752784 17952 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790521920546562-17952-0/minicluster-data/ts-2/wal/instance
I20260927 15:12:27.753041 17952 external_mini_cluster.cc:1428] Setting key 683024582a4fd9c04fb6ca7baa4d940e
Sep 27 15:12:27 dist-test-slave-5s2t krb5kdc[23477](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790521947, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.136.3@KRBTEST.COM for kudu/127.17.136.62@KRBTEST.COM
I20260927 15:12:27.760931 23561 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:27.749912 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.136.3:54237 (local address 127.17.136.62:39281)
0927 15:12:27.750064 (+ 152us) server_negotiation.cc:206] Beginning negotiation
0927 15:12:27.750069 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0927 15:12:27.750902 (+ 833us) server_negotiation.cc:407] Connection header received
0927 15:12:27.752206 (+ 1304us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:12:27.752209 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:12:27.752253 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:12:27.752322 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0927 15:12:27.753620 (+ 1298us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:27.754289 (+ 669us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:27.755599 (+ 1310us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:27.755803 (+ 204us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:27.755874 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:27.758101 (+ 2227us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0927 15:12:27.758104 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0927 15:12:27.758106 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0927 15:12:27.758127 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0927 15:12:27.759202 (+ 1075us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:12:27.759640 (+ 438us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:12:27.759642 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:12:27.759643 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:12:27.759708 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:12:27.759964 (+ 256us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:12:27.759966 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:12:27.759967 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:12:27.760137 (+ 170us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0927 15:12:27.760210 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0927 15:12:27.760731 (+ 521us) server_negotiation.cc:299] Negotiation successful
0927 15:12:27.760817 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260927 15:12:27.761822 23983 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:27.750338 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.62:39281 (local address 127.17.136.3:54237)
0927 15:12:27.750759 (+ 421us) negotiation.cc:107] Waiting for socket to connect
0927 15:12:27.750802 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0927 15:12:27.752030 (+ 1228us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0927 15:12:27.752499 (+ 469us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0927 15:12:27.752508 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0927 15:12:27.752907 (+ 399us) client_negotiation.cc:189] Negotiated authn=SASL
0927 15:12:27.753474 (+ 567us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:12:27.753512 (+ 38us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:12:27.754403 (+ 891us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:12:27.754407 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:12:27.755494 (+ 1087us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:12:27.755503 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:12:27.755904 (+ 401us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:12:27.755906 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:12:27.756056 (+ 150us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:27.756599 (+ 543us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0927 15:12:27.756614 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0927 15:12:27.757950 (+ 1336us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0927 15:12:27.759312 (+ 1362us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0927 15:12:27.759317 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0927 15:12:27.759329 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0927 15:12:27.759563 (+ 234us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0927 15:12:27.759768 (+ 205us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0927 15:12:27.759770 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0927 15:12:27.759771 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0927 15:12:27.759891 (+ 120us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0927 15:12:27.760271 (+ 380us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0927 15:12:27.760277 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0927 15:12:27.760527 (+ 250us) client_negotiation.cc:769] Sending connection context
0927 15:12:27.760705 (+ 178us) client_negotiation.cc:240] Negotiation successful
0927 15:12:27.761026 (+ 321us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":240,"thread_start_us":103,"threads_started":1}
I20260927 15:12:27.762883 23981 heartbeater.cc:347] Connected to a master server at 127.17.136.62:39281
I20260927 15:12:27.763096 23981 heartbeater.cc:464] Registering TS with master...
I20260927 15:12:27.763581 23981 heartbeater.cc:511] Master 127.17.136.62:39281 requested a full tablet report, sending...
I20260927 15:12:27.764513 23520 ts_manager.cc:194] Registered new tserver with Master: 9ce08de8cea849bdb532852a9c0ce544 (127.17.136.3:37223)
I20260927 15:12:27.765020 23520 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.136.3@KRBTEST.COM'} at 127.17.136.3:54237
I20260927 15:12:27.766633 17952 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal test-admin with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790521920546562-17952-0/krb5kdc/test-admin.keytab.
Entry for principal test-admin with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790521920546562-17952-0/krb5kdc/test-admin.keytab.
Sep 27 15:12:27 dist-test-slave-5s2t krb5kdc[23477](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790521947, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260927 15:12:27.781539 17952 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
W20260927 15:12:27.784112 23988 negotiation.cc:337] Failed RPC negotiation. Trace:
0927 15:12:27.782915 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59210 (local address 127.17.136.1:38783)
0927 15:12:27.783188 (+ 273us) server_negotiation.cc:206] Beginning negotiation
0927 15:12:27.783201 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0927 15:12:27.783225 (+ 24us) server_negotiation.cc:407] Connection header received
0927 15:12:27.783310 (+ 85us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:12:27.783316 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:12:27.783511 (+ 195us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:12:27.783628 (+ 117us) server_negotiation.cc:226] Negotiated authn=SASL
0927 15:12:27.783977 (+ 349us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:59210: BlockingRecv error: recv got EOF from 127.0.0.1:59210 (error 108)
Metrics: {"server-negotiator.queue_time_us":179,"thread_start_us":100,"threads_started":1}
W20260927 15:12:27.784267 17952 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790521920546562-17952-0/krb5kdc/krb5cc' of type FILE
Sep 27 15:12:27 dist-test-slave-5s2t krb5kdc[23477](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790521947, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260927 15:12:27.785223 17952 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Sep 27 15:12:27 dist-test-slave-5s2t krb5kdc[23477](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790521947, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260927 15:12:27.786156 17952 init.cc:295] Successfully reacquired a new kerberos TGT
Sep 27 15:12:27 dist-test-slave-5s2t krb5kdc[23477](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790521947, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.136.1@KRBTEST.COM
I20260927 15:12:27.795115 23988 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:27.787021 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59226 (local address 127.17.136.1:38783)
0927 15:12:27.787139 (+ 118us) server_negotiation.cc:206] Beginning negotiation
0927 15:12:27.787142 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0927 15:12:27.787192 (+ 50us) server_negotiation.cc:407] Connection header received
0927 15:12:27.787320 (+ 128us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:12:27.787323 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:12:27.787367 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:12:27.787427 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0927 15:12:27.787912 (+ 485us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:27.788683 (+ 771us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:27.789459 (+ 776us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:27.789832 (+ 373us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:27.789919 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:27.792141 (+ 2222us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0927 15:12:27.792152 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0927 15:12:27.792166 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0927 15:12:27.792189 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0927 15:12:27.793499 (+ 1310us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:12:27.793888 (+ 389us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:12:27.793895 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:12:27.793896 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:12:27.793970 (+ 74us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:12:27.794210 (+ 240us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:12:27.794213 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:12:27.794215 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:12:27.794452 (+ 237us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0927 15:12:27.794642 (+ 190us) server_negotiation.cc:1035] Waiting for connection context
0927 15:12:27.794836 (+ 194us) server_negotiation.cc:299] Negotiation successful
0927 15:12:27.794988 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
W20260927 15:12:27.798506 23988 negotiation.cc:337] Failed RPC negotiation. Trace:
0927 15:12:27.797652 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59228 (local address 127.17.136.1:38783)
0927 15:12:27.797743 (+ 91us) server_negotiation.cc:206] Beginning negotiation
0927 15:12:27.797746 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0927 15:12:27.797914 (+ 168us) server_negotiation.cc:407] Connection header received
0927 15:12:27.798021 (+ 107us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:12:27.798023 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:12:27.798058 (+ 35us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:12:27.798111 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0927 15:12:27.798426 (+ 315us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:59228: BlockingRecv error: recv got EOF from 127.0.0.1:59228 (error 108)
Metrics: {"server-negotiator.queue_time_us":32}
W20260927 15:12:27.798626 17952 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790521920546562-17952-0/krb5kdc/krb5cc' of type FILE
Sep 27 15:12:27 dist-test-slave-5s2t krb5kdc[23477](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790521947, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260927 15:12:27.799526 17952 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Sep 27 15:12:27 dist-test-slave-5s2t krb5kdc[23477](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790521947, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260927 15:12:27.800246 17952 init.cc:295] Successfully reacquired a new kerberos TGT
Sep 27 15:12:27 dist-test-slave-5s2t krb5kdc[23477](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790521947, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.136.1@KRBTEST.COM
I20260927 15:12:27.807811 23988 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:27.800937 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59238 (local address 127.17.136.1:38783)
0927 15:12:27.801066 (+ 129us) server_negotiation.cc:206] Beginning negotiation
0927 15:12:27.801070 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0927 15:12:27.801164 (+ 94us) server_negotiation.cc:407] Connection header received
0927 15:12:27.801240 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:12:27.801242 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:12:27.801273 (+ 31us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:12:27.801331 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0927 15:12:27.801704 (+ 373us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:27.802198 (+ 494us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:27.802888 (+ 690us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:27.803094 (+ 206us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:27.803164 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:27.805141 (+ 1977us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0927 15:12:27.805144 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0927 15:12:27.805146 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0927 15:12:27.805165 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0927 15:12:27.806402 (+ 1237us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:12:27.806773 (+ 371us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:12:27.806776 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:12:27.806777 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:12:27.806866 (+ 89us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:12:27.807105 (+ 239us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:12:27.807107 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:12:27.807108 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:12:27.807302 (+ 194us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0927 15:12:27.807408 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0927 15:12:27.807569 (+ 161us) server_negotiation.cc:299] Negotiation successful
0927 15:12:27.807660 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
W20260927 15:12:27.810010 23988 negotiation.cc:337] Failed RPC negotiation. Trace:
0927 15:12:27.809294 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59244 (local address 127.17.136.1:38783)
0927 15:12:27.809404 (+ 110us) server_negotiation.cc:206] Beginning negotiation
0927 15:12:27.809418 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0927 15:12:27.809458 (+ 40us) server_negotiation.cc:407] Connection header received
0927 15:12:27.809549 (+ 91us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:12:27.809551 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:12:27.809583 (+ 32us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:12:27.809642 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0927 15:12:27.809925 (+ 283us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:59244: BlockingRecv error: recv got EOF from 127.0.0.1:59244 (error 108)
Metrics: {"server-negotiator.queue_time_us":45}
W20260927 15:12:27.810153 17952 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790521920546562-17952-0/krb5kdc/krb5cc' of type FILE
Sep 27 15:12:27 dist-test-slave-5s2t krb5kdc[23477](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790521947, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260927 15:12:27.811012 17952 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Sep 27 15:12:27 dist-test-slave-5s2t krb5kdc[23477](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790521947, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260927 15:12:27.811830 17952 init.cc:295] Successfully reacquired a new kerberos TGT
Sep 27 15:12:27 dist-test-slave-5s2t krb5kdc[23477](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790521947, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.136.1@KRBTEST.COM
I20260927 15:12:27.819185 23988 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:27.812535 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59252 (local address 127.17.136.1:38783)
0927 15:12:27.812642 (+ 107us) server_negotiation.cc:206] Beginning negotiation
0927 15:12:27.812646 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0927 15:12:27.812714 (+ 68us) server_negotiation.cc:407] Connection header received
0927 15:12:27.812824 (+ 110us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:12:27.812827 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:12:27.812862 (+ 35us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:12:27.812923 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0927 15:12:27.813363 (+ 440us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:27.813837 (+ 474us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:27.814588 (+ 751us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:27.814800 (+ 212us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:27.814878 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:27.816871 (+ 1993us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0927 15:12:27.816874 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0927 15:12:27.816876 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0927 15:12:27.816895 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0927 15:12:27.818005 (+ 1110us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:12:27.818345 (+ 340us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:12:27.818347 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:12:27.818348 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:12:27.818414 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:12:27.818605 (+ 191us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:12:27.818607 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:12:27.818608 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:12:27.818740 (+ 132us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0927 15:12:27.818832 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0927 15:12:27.819007 (+ 175us) server_negotiation.cc:299] Negotiation successful
0927 15:12:27.819086 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260927 15:12:27.820227 17952 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu with pid 23584
I20260927 15:12:27.825336 17952 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu with pid 23718
I20260927 15:12:27.832248 17952 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu with pid 23852
I20260927 15:12:27.840528 17952 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu with pid 23490
2026-09-27T15:12:27Z chronyd exiting
[ OK ] SecurityITest.TestCorruptKerberosCC (2088 ms)
[ RUN ] SecurityITest.TestNonDefaultPrincipalMultipleMaster
Loading random data
Initializing database '/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790521920546562-17952-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 27 15:12:27 dist-test-slave-5s2t krb5kdc[24001](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 27 15:12:27 dist-test-slave-5s2t krb5kdc[24001](info): set up 2 sockets
Sep 27 15:12:27 dist-test-slave-5s2t krb5kdc[24001](info): commencing operation
krb5kdc: starting...
W20260927 15:12:28.799235 17952 mini_kdc.cc:121] Time spent starting KDC: real 0.937s user 0.002s sys 0.003s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790521920546562-17952-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790521920546562-17952-0/krb5kdc/test-user.keytab.
Sep 27 15:12:28 dist-test-slave-5s2t krb5kdc[24001](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790521948, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-27T15:12:28Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-27T15:12:28Z Disabled control of system clock
WARNING: no policy specified for oryx/127.17.136.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.17.136.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.17.136.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790521920546562-17952-0/krb5kdc/oryx_127.17.136.62.keytab.
Entry for principal oryx/127.17.136.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790521920546562-17952-0/krb5kdc/oryx_127.17.136.62.keytab.
I20260927 15:12:28.909970 17952 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu
/tmp/dist-test-taskiFOyeW/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790521920546562-17952-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790521920546562-17952-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790521920546562-17952-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790521920546562-17952-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.136.62:33401
--webserver_interface=127.17.136.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790521920546562-17952-0/krb5kdc/oryx_127.17.136.62.keytab
--principal=oryx/127.17.136.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.136.20:43561
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.136.62:33401
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790521920546562-17952-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790521920546562-17952-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790521920546562-17952-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260927 15:12:29.014169 24014 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260927 15:12:29.014458 24014 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260927 15:12:29.014499 24014 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260927 15:12:29.018360 24014 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260927 15:12:29.018407 24014 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260927 15:12:29.018431 24014 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260927 15:12:29.018446 24014 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260927 15:12:29.018462 24014 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260927 15:12:29.023540 24014 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.136.20:43561
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790521920546562-17952-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790521920546562-17952-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.17.136.62:33401
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790521920546562-17952-0/krb5kdc/oryx_127.17.136.62.keytab
--principal=oryx/127.17.136.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.136.62:33401
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790521920546562-17952-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.17.136.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24014
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790521920546562-17952-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 27 Sep 2026 14:27:13 UTC on ccycloud.quasar-psqrth.root.comops.site
build id 4676138
I20260927 15:12:29.024559 24014 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260927 15:12:29.025539 24014 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260927 15:12:29.033561 24014 server_base.cc:1034] running on GCE node
W20260927 15:12:29.033599 24019 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260927 15:12:29.033703 24022 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260927 15:12:29.033599 24020 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260927 15:12:29.034287 24014 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260927 15:12:29.035386 24014 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260927 15:12:29.036544 24014 hybrid_clock.cc:648] HybridClock initialized: now 1790521949036523 us; error 39 us; skew 500 ppm
Sep 27 15:12:29 dist-test-slave-5s2t krb5kdc[24001](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790521949, etypes {rep=17 tkt=17 ses=17}, oryx/127.17.136.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260927 15:12:29.039131 24014 init.cc:377] Logged in from keytab as oryx/127.17.136.62@KRBTEST.COM (short username oryx)
I20260927 15:12:29.039945 24014 webserver.cc:460] Webserver started at http://127.17.136.62:35253/ using document root <none> and password file <none>
I20260927 15:12:29.040511 24014 fs_manager.cc:359] Metadata directory not provided
I20260927 15:12:29.040570 24014 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260927 15:12:29.040748 24014 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260927 15:12:29.042708 24014 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790521920546562-17952-0/minicluster-data/master-0/data/instance:
uuid: "5d94e22c8fa74c10a9732bb2af78fb98"
format_stamp: "Formatted at 2026-09-27 15:12:29 on dist-test-slave-5s2t"
server_key: "bda37c873dc134d72570b7bb3178e7c2"
server_key_iv: "2a70393bee1b58166354655c18411cc2"
server_key_version: "encryptionkey@0"
I20260927 15:12:29.043236 24014 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790521920546562-17952-0/minicluster-data/master-0/wal/instance:
uuid: "5d94e22c8fa74c10a9732bb2af78fb98"
format_stamp: "Formatted at 2026-09-27 15:12:29 on dist-test-slave-5s2t"
server_key: "bda37c873dc134d72570b7bb3178e7c2"
server_key_iv: "2a70393bee1b58166354655c18411cc2"
server_key_version: "encryptionkey@0"
I20260927 15:12:29.046754 24014 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.000s sys 0.003s
I20260927 15:12:29.049101 24029 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260927 15:12:29.050285 24014 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260927 15:12:29.050403 24014 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790521920546562-17952-0/minicluster-data/master-0/data,/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790521920546562-17952-0/minicluster-data/master-0/wal
uuid: "5d94e22c8fa74c10a9732bb2af78fb98"
format_stamp: "Formatted at 2026-09-27 15:12:29 on dist-test-slave-5s2t"
server_key: "bda37c873dc134d72570b7bb3178e7c2"
server_key_iv: "2a70393bee1b58166354655c18411cc2"
server_key_version: "encryptionkey@0"
I20260927 15:12:29.050488 24014 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790521920546562-17952-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790521920546562-17952-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790521920546562-17952-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260927 15:12:29.072628 24014 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260927 15:12:29.075549 24014 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260927 15:12:29.075713 24014 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260927 15:12:29.081966 24014 rpc_server.cc:307] RPC server started. Bound to: 127.17.136.62:33401
I20260927 15:12:29.082248 24081 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.136.62:33401 every 8 connection(s)
I20260927 15:12:29.082859 24014 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790521920546562-17952-0/minicluster-data/master-0/data/info.pb
I20260927 15:12:29.085434 17952 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu as pid 24014
I20260927 15:12:29.085561 17952 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790521920546562-17952-0/minicluster-data/master-0/wal/instance
I20260927 15:12:29.085668 24082 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:12:29.085846 17952 external_mini_cluster.cc:1428] Setting key 978956ad17eb1efd0f5a9d911b52cde8
I20260927 15:12:29.092867 24082 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5d94e22c8fa74c10a9732bb2af78fb98: Bootstrap starting.
Sep 27 15:12:29 dist-test-slave-5s2t krb5kdc[24001](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790521948, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.17.136.62@KRBTEST.COM
I20260927 15:12:29.095166 24082 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 5d94e22c8fa74c10a9732bb2af78fb98: Neither blocks nor log segments found. Creating new log.
I20260927 15:12:29.096091 24082 log.cc:824] T 00000000000000000000000000000000 P 5d94e22c8fa74c10a9732bb2af78fb98: Log is configured to *not* fsync() on all Append() calls
I20260927 15:12:29.098196 24082 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5d94e22c8fa74c10a9732bb2af78fb98: No bootstrap required, opened a new log
I20260927 15:12:29.099781 24085 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:29.087138 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37028 (local address 127.17.136.62:33401)
0927 15:12:29.087553 (+ 415us) server_negotiation.cc:206] Beginning negotiation
0927 15:12:29.087574 (+ 21us) server_negotiation.cc:399] Waiting for connection header
0927 15:12:29.087619 (+ 45us) server_negotiation.cc:407] Connection header received
0927 15:12:29.088375 (+ 756us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:12:29.088397 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:12:29.088809 (+ 412us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:12:29.089189 (+ 380us) server_negotiation.cc:226] Negotiated authn=SASL
0927 15:12:29.089774 (+ 585us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:29.091179 (+ 1405us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:29.092028 (+ 849us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:29.092698 (+ 670us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:29.092871 (+ 173us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:29.094998 (+ 2127us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0927 15:12:29.095006 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0927 15:12:29.095020 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0927 15:12:29.095053 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0927 15:12:29.096855 (+ 1802us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:12:29.097249 (+ 394us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:12:29.097255 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:12:29.097260 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:12:29.097440 (+ 180us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:12:29.097662 (+ 222us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:12:29.097665 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:12:29.097667 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:12:29.098158 (+ 491us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0927 15:12:29.098353 (+ 195us) server_negotiation.cc:1035] Waiting for connection context
0927 15:12:29.098565 (+ 212us) server_negotiation.cc:299] Negotiation successful
0927 15:12:29.098848 (+ 283us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":276,"thread_start_us":134,"threads_started":1}
I20260927 15:12:29.102298 24082 raft_consensus.cc:348] T 00000000000000000000000000000000 P 5d94e22c8fa74c10a9732bb2af78fb98 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5d94e22c8fa74c10a9732bb2af78fb98" member_type: VOTER last_known_addr { host: "127.17.136.62" port: 33401 } }
I20260927 15:12:29.102510 24082 raft_consensus.cc:374] T 00000000000000000000000000000000 P 5d94e22c8fa74c10a9732bb2af78fb98 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:12:29.102563 24082 raft_consensus.cc:729] T 00000000000000000000000000000000 P 5d94e22c8fa74c10a9732bb2af78fb98 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d94e22c8fa74c10a9732bb2af78fb98, State: Initialized, Role: FOLLOWER
I20260927 15:12:29.102933 24082 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5d94e22c8fa74c10a9732bb2af78fb98 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5d94e22c8fa74c10a9732bb2af78fb98" member_type: VOTER last_known_addr { host: "127.17.136.62" port: 33401 } }
I20260927 15:12:29.103052 24082 raft_consensus.cc:388] T 00000000000000000000000000000000 P 5d94e22c8fa74c10a9732bb2af78fb98 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260927 15:12:29.103117 24082 raft_consensus.cc:482] T 00000000000000000000000000000000 P 5d94e22c8fa74c10a9732bb2af78fb98 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260927 15:12:29.103212 24082 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 5d94e22c8fa74c10a9732bb2af78fb98 [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:12:29.104198 24082 raft_consensus.cc:504] T 00000000000000000000000000000000 P 5d94e22c8fa74c10a9732bb2af78fb98 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5d94e22c8fa74c10a9732bb2af78fb98" member_type: VOTER last_known_addr { host: "127.17.136.62" port: 33401 } }
I20260927 15:12:29.104497 24082 leader_election.cc:302] T 00000000000000000000000000000000 P 5d94e22c8fa74c10a9732bb2af78fb98 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 5d94e22c8fa74c10a9732bb2af78fb98; no voters:
I20260927 15:12:29.104754 24082 leader_election.cc:288] T 00000000000000000000000000000000 P 5d94e22c8fa74c10a9732bb2af78fb98 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260927 15:12:29.104848 24087 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 5d94e22c8fa74c10a9732bb2af78fb98 [term 1 FOLLOWER]: Leader election won for term 1
I20260927 15:12:29.105073 24087 raft_consensus.cc:686] T 00000000000000000000000000000000 P 5d94e22c8fa74c10a9732bb2af78fb98 [term 1 LEADER]: Becoming Leader. State: Replica: 5d94e22c8fa74c10a9732bb2af78fb98, State: Running, Role: LEADER
I20260927 15:12:29.105360 24087 consensus_queue.cc:237] T 00000000000000000000000000000000 P 5d94e22c8fa74c10a9732bb2af78fb98 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5d94e22c8fa74c10a9732bb2af78fb98" member_type: VOTER last_known_addr { host: "127.17.136.62" port: 33401 } }
I20260927 15:12:29.105939 24082 sys_catalog.cc:564] T 00000000000000000000000000000000 P 5d94e22c8fa74c10a9732bb2af78fb98 [sys.catalog]: configured and running, proceeding with master startup.
I20260927 15:12:29.106383 24088 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5d94e22c8fa74c10a9732bb2af78fb98 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5d94e22c8fa74c10a9732bb2af78fb98. Latest consensus state: current_term: 1 leader_uuid: "5d94e22c8fa74c10a9732bb2af78fb98" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5d94e22c8fa74c10a9732bb2af78fb98" member_type: VOTER last_known_addr { host: "127.17.136.62" port: 33401 } } }
I20260927 15:12:29.106504 24088 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5d94e22c8fa74c10a9732bb2af78fb98 [sys.catalog]: This master's current role is: LEADER
I20260927 15:12:29.106769 24089 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5d94e22c8fa74c10a9732bb2af78fb98 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "5d94e22c8fa74c10a9732bb2af78fb98" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5d94e22c8fa74c10a9732bb2af78fb98" member_type: VOTER last_known_addr { host: "127.17.136.62" port: 33401 } } }
I20260927 15:12:29.106856 24089 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5d94e22c8fa74c10a9732bb2af78fb98 [sys.catalog]: This master's current role is: LEADER
I20260927 15:12:29.106962 24091 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260927 15:12:29.110248 24091 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260927 15:12:29.115868 24091 catalog_manager.cc:1347] Generated new cluster ID: cf487426c0ca458e8b8e643e352d17ca
I20260927 15:12:29.115921 24091 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260927 15:12:29.139394 24091 catalog_manager.cc:1370] Generated new certificate authority record
I20260927 15:12:29.140288 24091 catalog_manager.cc:1504] Loading token signing keys...
I20260927 15:12:29.146770 24091 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 5d94e22c8fa74c10a9732bb2af78fb98: Generated new TSK 0
I20260927 15:12:29.147655 24091 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for oryx/127.17.136.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.17.136.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.17.136.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790521920546562-17952-0/krb5kdc/oryx_127.17.136.1.keytab.
Entry for principal oryx/127.17.136.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790521920546562-17952-0/krb5kdc/oryx_127.17.136.1.keytab.
I20260927 15:12:29.173959 17952 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu
/tmp/dist-test-taskiFOyeW/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790521920546562-17952-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790521920546562-17952-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790521920546562-17952-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790521920546562-17952-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.136.1:0
--local_ip_for_outbound_sockets=127.17.136.1
--webserver_interface=127.17.136.1
--webserver_port=0
--tserver_master_addrs=127.17.136.62:33401
--keytab_file=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790521920546562-17952-0/krb5kdc/oryx_127.17.136.1.keytab
--principal=oryx/127.17.136.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.136.20:43561
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790521920546562-17952-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790521920546562-17952-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790521920546562-17952-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260927 15:12:29.277981 24108 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260927 15:12:29.278227 24108 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260927 15:12:29.278281 24108 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260927 15:12:29.282646 24108 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260927 15:12:29.282701 24108 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260927 15:12:29.282757 24108 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.136.1
I20260927 15:12:29.287771 24108 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.136.20:43561
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790521920546562-17952-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790521920546562-17952-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790521920546562-17952-0/krb5kdc/oryx_127.17.136.1.keytab
--principal=oryx/127.17.136.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.136.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790521920546562-17952-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.17.136.1
--webserver_port=0
--tserver_master_addrs=127.17.136.62:33401
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24108
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.136.1
--log_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790521920546562-17952-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 27 Sep 2026 14:27:13 UTC on ccycloud.quasar-psqrth.root.comops.site
build id 4676138
I20260927 15:12:29.288692 24108 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260927 15:12:29.289598 24108 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260927 15:12:29.298511 24113 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260927 15:12:29.298660 24108 server_base.cc:1034] running on GCE node
W20260927 15:12:29.298512 24116 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260927 15:12:29.298831 24114 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260927 15:12:29.299160 24108 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260927 15:12:29.299750 24108 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260927 15:12:29.300890 24108 hybrid_clock.cc:648] HybridClock initialized: now 1790521949300875 us; error 27 us; skew 500 ppm
Sep 27 15:12:29 dist-test-slave-5s2t krb5kdc[24001](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790521949, etypes {rep=17 tkt=17 ses=17}, oryx/127.17.136.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260927 15:12:29.303371 24108 init.cc:377] Logged in from keytab as oryx/127.17.136.1@KRBTEST.COM (short username oryx)
I20260927 15:12:29.304169 24108 webserver.cc:460] Webserver started at http://127.17.136.1:37655/ using document root <none> and password file <none>
I20260927 15:12:29.304674 24108 fs_manager.cc:359] Metadata directory not provided
I20260927 15:12:29.304734 24108 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260927 15:12:29.304910 24108 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260927 15:12:29.306862 24108 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790521920546562-17952-0/minicluster-data/ts-0/data/instance:
uuid: "45aed58e7be84f1c93e2ca9ab659462e"
format_stamp: "Formatted at 2026-09-27 15:12:29 on dist-test-slave-5s2t"
server_key: "aab7424c1bcb8694ed67ae517b3be18f"
server_key_iv: "ae4edd45711dcdaf1a888818986af797"
server_key_version: "encryptionkey@0"
I20260927 15:12:29.307417 24108 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790521920546562-17952-0/minicluster-data/ts-0/wal/instance:
uuid: "45aed58e7be84f1c93e2ca9ab659462e"
format_stamp: "Formatted at 2026-09-27 15:12:29 on dist-test-slave-5s2t"
server_key: "aab7424c1bcb8694ed67ae517b3be18f"
server_key_iv: "ae4edd45711dcdaf1a888818986af797"
server_key_version: "encryptionkey@0"
I20260927 15:12:29.310832 24108 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.000s
I20260927 15:12:29.313177 24123 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260927 15:12:29.314364 24108 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260927 15:12:29.314463 24108 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790521920546562-17952-0/minicluster-data/ts-0/data,/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790521920546562-17952-0/minicluster-data/ts-0/wal
uuid: "45aed58e7be84f1c93e2ca9ab659462e"
format_stamp: "Formatted at 2026-09-27 15:12:29 on dist-test-slave-5s2t"
server_key: "aab7424c1bcb8694ed67ae517b3be18f"
server_key_iv: "ae4edd45711dcdaf1a888818986af797"
server_key_version: "encryptionkey@0"
I20260927 15:12:29.314565 24108 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790521920546562-17952-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790521920546562-17952-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790521920546562-17952-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260927 15:12:29.326969 24108 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260927 15:12:29.329586 24108 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260927 15:12:29.329741 24108 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260927 15:12:29.330247 24108 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260927 15:12:29.330977 24108 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260927 15:12:29.331022 24108 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260927 15:12:29.331069 24108 ts_tablet_manager.cc:610] Registered 0 tablets
I20260927 15:12:29.331097 24108 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260927 15:12:29.339013 24108 rpc_server.cc:307] RPC server started. Bound to: 127.17.136.1:41807
I20260927 15:12:29.339030 24236 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.136.1:41807 every 8 connection(s)
I20260927 15:12:29.339864 24108 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790521920546562-17952-0/minicluster-data/ts-0/data/info.pb
Sep 27 15:12:29 dist-test-slave-5s2t krb5kdc[24001](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790521949, etypes {rep=17 tkt=17 ses=17}, oryx/127.17.136.1@KRBTEST.COM for oryx/127.17.136.62@KRBTEST.COM
I20260927 15:12:29.349666 17952 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu as pid 24108
I20260927 15:12:29.349787 17952 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790521920546562-17952-0/minicluster-data/ts-0/wal/instance
I20260927 15:12:29.350080 17952 external_mini_cluster.cc:1428] Setting key 809d686631e1acbec74d847b5111cba5
I20260927 15:12:29.352123 24085 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:29.341488 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.136.1:37231 (local address 127.17.136.62:33401)
0927 15:12:29.341640 (+ 152us) server_negotiation.cc:206] Beginning negotiation
0927 15:12:29.341643 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0927 15:12:29.342572 (+ 929us) server_negotiation.cc:407] Connection header received
0927 15:12:29.343416 (+ 844us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:12:29.343419 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:12:29.343466 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:12:29.343538 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0927 15:12:29.344611 (+ 1073us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:29.345138 (+ 527us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:29.346171 (+ 1033us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:29.346379 (+ 208us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:29.346443 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:29.348729 (+ 2286us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0927 15:12:29.348732 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0927 15:12:29.348734 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0927 15:12:29.348757 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0927 15:12:29.350067 (+ 1310us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:12:29.350634 (+ 567us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:12:29.350637 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:12:29.350640 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:12:29.350713 (+ 73us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:12:29.351030 (+ 317us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:12:29.351033 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:12:29.351034 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:12:29.351228 (+ 194us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0927 15:12:29.351334 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0927 15:12:29.351905 (+ 571us) server_negotiation.cc:299] Negotiation successful
0927 15:12:29.352010 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260927 15:12:29.353296 24239 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:29.341814 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.62:33401 (local address 127.17.136.1:37231)
0927 15:12:29.342441 (+ 627us) negotiation.cc:107] Waiting for socket to connect
0927 15:12:29.342481 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0927 15:12:29.343192 (+ 711us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0927 15:12:29.343681 (+ 489us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0927 15:12:29.343687 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0927 15:12:29.344026 (+ 339us) client_negotiation.cc:189] Negotiated authn=SASL
0927 15:12:29.344500 (+ 474us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:12:29.344513 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:12:29.345220 (+ 707us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:12:29.345222 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:12:29.346084 (+ 862us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:12:29.346093 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:12:29.346495 (+ 402us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:12:29.346498 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:12:29.346634 (+ 136us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:29.347191 (+ 557us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0927 15:12:29.347209 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0927 15:12:29.348583 (+ 1374us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0927 15:12:29.350196 (+ 1613us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0927 15:12:29.350202 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0927 15:12:29.350217 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0927 15:12:29.350527 (+ 310us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0927 15:12:29.350790 (+ 263us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0927 15:12:29.350793 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0927 15:12:29.350794 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0927 15:12:29.350946 (+ 152us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0927 15:12:29.351340 (+ 394us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0927 15:12:29.351346 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0927 15:12:29.351651 (+ 305us) client_negotiation.cc:769] Sending connection context
0927 15:12:29.351897 (+ 246us) client_negotiation.cc:240] Negotiation successful
0927 15:12:29.352220 (+ 323us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":429,"thread_start_us":108,"threads_started":1}
I20260927 15:12:29.354465 24237 heartbeater.cc:347] Connected to a master server at 127.17.136.62:33401
I20260927 15:12:29.354710 24237 heartbeater.cc:464] Registering TS with master...
I20260927 15:12:29.355172 24237 heartbeater.cc:511] Master 127.17.136.62:33401 requested a full tablet report, sending...
I20260927 15:12:29.356685 24044 ts_manager.cc:194] Registered new tserver with Master: 45aed58e7be84f1c93e2ca9ab659462e (127.17.136.1:41807)
I20260927 15:12:29.357784 24044 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.17.136.1@KRBTEST.COM'} at 127.17.136.1:37231
WARNING: no policy specified for oryx/127.17.136.2@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.17.136.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.17.136.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790521920546562-17952-0/krb5kdc/oryx_127.17.136.2.keytab.
Entry for principal oryx/127.17.136.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790521920546562-17952-0/krb5kdc/oryx_127.17.136.2.keytab.
I20260927 15:12:29.374132 17952 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu
/tmp/dist-test-taskiFOyeW/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790521920546562-17952-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790521920546562-17952-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790521920546562-17952-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790521920546562-17952-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.136.2:0
--local_ip_for_outbound_sockets=127.17.136.2
--webserver_interface=127.17.136.2
--webserver_port=0
--tserver_master_addrs=127.17.136.62:33401
--keytab_file=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790521920546562-17952-0/krb5kdc/oryx_127.17.136.2.keytab
--principal=oryx/127.17.136.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.136.20:43561
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790521920546562-17952-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790521920546562-17952-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790521920546562-17952-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260927 15:12:29.481997 24242 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260927 15:12:29.482250 24242 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260927 15:12:29.482292 24242 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260927 15:12:29.486245 24242 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260927 15:12:29.486301 24242 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260927 15:12:29.486368 24242 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.136.2
I20260927 15:12:29.491477 24242 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.136.20:43561
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790521920546562-17952-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790521920546562-17952-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790521920546562-17952-0/krb5kdc/oryx_127.17.136.2.keytab
--principal=oryx/127.17.136.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.136.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790521920546562-17952-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.17.136.2
--webserver_port=0
--tserver_master_addrs=127.17.136.62:33401
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24242
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.136.2
--log_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790521920546562-17952-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 27 Sep 2026 14:27:13 UTC on ccycloud.quasar-psqrth.root.comops.site
build id 4676138
I20260927 15:12:29.492435 24242 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260927 15:12:29.493444 24242 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260927 15:12:29.502439 24248 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260927 15:12:29.502439 24247 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260927 15:12:29.502548 24250 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260927 15:12:29.502542 24242 server_base.cc:1034] running on GCE node
I20260927 15:12:29.503103 24242 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260927 15:12:29.503739 24242 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260927 15:12:29.504915 24242 hybrid_clock.cc:648] HybridClock initialized: now 1790521949504889 us; error 39 us; skew 500 ppm
Sep 27 15:12:29 dist-test-slave-5s2t krb5kdc[24001](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790521949, etypes {rep=17 tkt=17 ses=17}, oryx/127.17.136.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260927 15:12:29.507776 24242 init.cc:377] Logged in from keytab as oryx/127.17.136.2@KRBTEST.COM (short username oryx)
I20260927 15:12:29.508673 24242 webserver.cc:460] Webserver started at http://127.17.136.2:38913/ using document root <none> and password file <none>
I20260927 15:12:29.509200 24242 fs_manager.cc:359] Metadata directory not provided
I20260927 15:12:29.509268 24242 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260927 15:12:29.509477 24242 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260927 15:12:29.511602 24242 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790521920546562-17952-0/minicluster-data/ts-1/data/instance:
uuid: "bce84efcd7394877943020b62471f259"
format_stamp: "Formatted at 2026-09-27 15:12:29 on dist-test-slave-5s2t"
server_key: "076b1dba3a0d5b641d6f9ed6539fc47d"
server_key_iv: "3094d9a6cbf8b20abba1f6e1ac0eb6fb"
server_key_version: "encryptionkey@0"
I20260927 15:12:29.512154 24242 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790521920546562-17952-0/minicluster-data/ts-1/wal/instance:
uuid: "bce84efcd7394877943020b62471f259"
format_stamp: "Formatted at 2026-09-27 15:12:29 on dist-test-slave-5s2t"
server_key: "076b1dba3a0d5b641d6f9ed6539fc47d"
server_key_iv: "3094d9a6cbf8b20abba1f6e1ac0eb6fb"
server_key_version: "encryptionkey@0"
I20260927 15:12:29.515883 24242 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.000s
I20260927 15:12:29.518215 24257 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260927 15:12:29.519475 24242 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260927 15:12:29.519564 24242 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790521920546562-17952-0/minicluster-data/ts-1/data,/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790521920546562-17952-0/minicluster-data/ts-1/wal
uuid: "bce84efcd7394877943020b62471f259"
format_stamp: "Formatted at 2026-09-27 15:12:29 on dist-test-slave-5s2t"
server_key: "076b1dba3a0d5b641d6f9ed6539fc47d"
server_key_iv: "3094d9a6cbf8b20abba1f6e1ac0eb6fb"
server_key_version: "encryptionkey@0"
I20260927 15:12:29.519644 24242 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790521920546562-17952-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790521920546562-17952-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790521920546562-17952-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260927 15:12:29.538089 24242 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260927 15:12:29.540904 24242 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260927 15:12:29.541054 24242 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260927 15:12:29.541594 24242 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260927 15:12:29.542369 24242 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260927 15:12:29.542414 24242 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260927 15:12:29.542454 24242 ts_tablet_manager.cc:610] Registered 0 tablets
I20260927 15:12:29.542472 24242 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260927 15:12:29.550523 24242 rpc_server.cc:307] RPC server started. Bound to: 127.17.136.2:42827
I20260927 15:12:29.550551 24370 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.136.2:42827 every 8 connection(s)
I20260927 15:12:29.551419 24242 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790521920546562-17952-0/minicluster-data/ts-1/data/info.pb
Sep 27 15:12:29 dist-test-slave-5s2t krb5kdc[24001](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790521949, etypes {rep=17 tkt=17 ses=17}, oryx/127.17.136.2@KRBTEST.COM for oryx/127.17.136.62@KRBTEST.COM
I20260927 15:12:29.560899 17952 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu as pid 24242
I20260927 15:12:29.561034 17952 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790521920546562-17952-0/minicluster-data/ts-1/wal/instance
I20260927 15:12:29.561350 17952 external_mini_cluster.cc:1428] Setting key 2d4137901027714e3745b4fc79b5ee57
I20260927 15:12:29.564401 24085 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:29.553158 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.136.2:38475 (local address 127.17.136.62:33401)
0927 15:12:29.553276 (+ 118us) server_negotiation.cc:206] Beginning negotiation
0927 15:12:29.553280 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0927 15:12:29.554084 (+ 804us) server_negotiation.cc:407] Connection header received
0927 15:12:29.555440 (+ 1356us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:12:29.555443 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:12:29.555488 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:12:29.555557 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0927 15:12:29.556647 (+ 1090us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:29.557219 (+ 572us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:29.558307 (+ 1088us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:29.558554 (+ 247us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:29.558646 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:29.560881 (+ 2235us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0927 15:12:29.560885 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0927 15:12:29.560888 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0927 15:12:29.560917 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0927 15:12:29.562389 (+ 1472us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:12:29.562930 (+ 541us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:12:29.562934 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:12:29.562936 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:12:29.563029 (+ 93us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:12:29.563342 (+ 313us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:12:29.563345 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:12:29.563347 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:12:29.563567 (+ 220us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0927 15:12:29.563666 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0927 15:12:29.564136 (+ 470us) server_negotiation.cc:299] Negotiation successful
0927 15:12:29.564249 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260927 15:12:29.565312 24373 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:29.553524 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.62:33401 (local address 127.17.136.2:38475)
0927 15:12:29.553932 (+ 408us) negotiation.cc:107] Waiting for socket to connect
0927 15:12:29.554003 (+ 71us) client_negotiation.cc:174] Beginning negotiation
0927 15:12:29.555223 (+ 1220us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0927 15:12:29.555691 (+ 468us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0927 15:12:29.555698 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0927 15:12:29.556041 (+ 343us) client_negotiation.cc:189] Negotiated authn=SASL
0927 15:12:29.556500 (+ 459us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:12:29.556513 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:12:29.557322 (+ 809us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:12:29.557325 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:12:29.558194 (+ 869us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:12:29.558203 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:12:29.558675 (+ 472us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:12:29.558677 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:12:29.558805 (+ 128us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:29.559348 (+ 543us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0927 15:12:29.559363 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0927 15:12:29.560726 (+ 1363us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0927 15:12:29.562506 (+ 1780us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0927 15:12:29.562512 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0927 15:12:29.562526 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0927 15:12:29.562836 (+ 310us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0927 15:12:29.563114 (+ 278us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0927 15:12:29.563116 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0927 15:12:29.563117 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0927 15:12:29.563233 (+ 116us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0927 15:12:29.563660 (+ 427us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0927 15:12:29.563664 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0927 15:12:29.563868 (+ 204us) client_negotiation.cc:769] Sending connection context
0927 15:12:29.564008 (+ 140us) client_negotiation.cc:240] Negotiation successful
0927 15:12:29.564231 (+ 223us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":226,"thread_start_us":101,"threads_started":1}
I20260927 15:12:29.566339 24371 heartbeater.cc:347] Connected to a master server at 127.17.136.62:33401
I20260927 15:12:29.566543 24371 heartbeater.cc:464] Registering TS with master...
I20260927 15:12:29.567010 24371 heartbeater.cc:511] Master 127.17.136.62:33401 requested a full tablet report, sending...
I20260927 15:12:29.567973 24044 ts_manager.cc:194] Registered new tserver with Master: bce84efcd7394877943020b62471f259 (127.17.136.2:42827)
I20260927 15:12:29.568691 24044 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.17.136.2@KRBTEST.COM'} at 127.17.136.2:38475
WARNING: no policy specified for oryx/127.17.136.3@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.17.136.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.17.136.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790521920546562-17952-0/krb5kdc/oryx_127.17.136.3.keytab.
Entry for principal oryx/127.17.136.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790521920546562-17952-0/krb5kdc/oryx_127.17.136.3.keytab.
I20260927 15:12:29.586297 17952 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu
/tmp/dist-test-taskiFOyeW/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790521920546562-17952-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790521920546562-17952-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790521920546562-17952-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790521920546562-17952-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.136.3:0
--local_ip_for_outbound_sockets=127.17.136.3
--webserver_interface=127.17.136.3
--webserver_port=0
--tserver_master_addrs=127.17.136.62:33401
--keytab_file=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790521920546562-17952-0/krb5kdc/oryx_127.17.136.3.keytab
--principal=oryx/127.17.136.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.136.20:43561
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790521920546562-17952-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790521920546562-17952-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790521920546562-17952-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260927 15:12:29.690555 24376 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260927 15:12:29.690791 24376 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260927 15:12:29.690830 24376 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260927 15:12:29.694651 24376 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260927 15:12:29.694700 24376 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260927 15:12:29.694752 24376 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.136.3
I20260927 15:12:29.699924 24376 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.136.20:43561
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790521920546562-17952-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790521920546562-17952-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790521920546562-17952-0/krb5kdc/oryx_127.17.136.3.keytab
--principal=oryx/127.17.136.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.136.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790521920546562-17952-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.17.136.3
--webserver_port=0
--tserver_master_addrs=127.17.136.62:33401
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24376
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.136.3
--log_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790521920546562-17952-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 27 Sep 2026 14:27:13 UTC on ccycloud.quasar-psqrth.root.comops.site
build id 4676138
I20260927 15:12:29.700817 24376 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260927 15:12:29.701699 24376 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260927 15:12:29.710712 24384 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260927 15:12:29.710706 24382 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260927 15:12:29.710706 24381 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260927 15:12:29.711155 24376 server_base.cc:1034] running on GCE node
I20260927 15:12:29.711557 24376 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260927 15:12:29.712196 24376 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260927 15:12:29.713361 24376 hybrid_clock.cc:648] HybridClock initialized: now 1790521949713341 us; error 31 us; skew 500 ppm
Sep 27 15:12:29 dist-test-slave-5s2t krb5kdc[24001](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790521949, etypes {rep=17 tkt=17 ses=17}, oryx/127.17.136.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260927 15:12:29.716051 24376 init.cc:377] Logged in from keytab as oryx/127.17.136.3@KRBTEST.COM (short username oryx)
I20260927 15:12:29.716837 24376 webserver.cc:460] Webserver started at http://127.17.136.3:46765/ using document root <none> and password file <none>
I20260927 15:12:29.717368 24376 fs_manager.cc:359] Metadata directory not provided
I20260927 15:12:29.717463 24376 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260927 15:12:29.717645 24376 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260927 15:12:29.719622 24376 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790521920546562-17952-0/minicluster-data/ts-2/data/instance:
uuid: "e94ed22dcc4f4c828fb3714f2d327a6e"
format_stamp: "Formatted at 2026-09-27 15:12:29 on dist-test-slave-5s2t"
server_key: "902ca46ab19775f64670060e17276ea0"
server_key_iv: "337cc017a73307105fb07f3250053c89"
server_key_version: "encryptionkey@0"
I20260927 15:12:29.720103 24376 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790521920546562-17952-0/minicluster-data/ts-2/wal/instance:
uuid: "e94ed22dcc4f4c828fb3714f2d327a6e"
format_stamp: "Formatted at 2026-09-27 15:12:29 on dist-test-slave-5s2t"
server_key: "902ca46ab19775f64670060e17276ea0"
server_key_iv: "337cc017a73307105fb07f3250053c89"
server_key_version: "encryptionkey@0"
I20260927 15:12:29.723709 24376 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.000s
I20260927 15:12:29.725891 24391 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260927 15:12:29.727051 24376 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260927 15:12:29.727150 24376 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790521920546562-17952-0/minicluster-data/ts-2/data,/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790521920546562-17952-0/minicluster-data/ts-2/wal
uuid: "e94ed22dcc4f4c828fb3714f2d327a6e"
format_stamp: "Formatted at 2026-09-27 15:12:29 on dist-test-slave-5s2t"
server_key: "902ca46ab19775f64670060e17276ea0"
server_key_iv: "337cc017a73307105fb07f3250053c89"
server_key_version: "encryptionkey@0"
I20260927 15:12:29.727236 24376 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790521920546562-17952-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790521920546562-17952-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790521920546562-17952-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260927 15:12:29.742025 24376 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260927 15:12:29.744542 24376 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260927 15:12:29.744699 24376 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260927 15:12:29.745201 24376 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260927 15:12:29.745946 24376 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260927 15:12:29.745992 24376 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260927 15:12:29.746042 24376 ts_tablet_manager.cc:610] Registered 0 tablets
I20260927 15:12:29.746070 24376 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260927 15:12:29.754158 24376 rpc_server.cc:307] RPC server started. Bound to: 127.17.136.3:33145
I20260927 15:12:29.754226 24504 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.136.3:33145 every 8 connection(s)
I20260927 15:12:29.754997 24376 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790521920546562-17952-0/minicluster-data/ts-2/data/info.pb
I20260927 15:12:29.761715 17952 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu as pid 24376
I20260927 15:12:29.761821 17952 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790521920546562-17952-0/minicluster-data/ts-2/wal/instance
I20260927 15:12:29.762073 17952 external_mini_cluster.cc:1428] Setting key ba068e409bbd5fdc6c5a2c243d0d448a
Sep 27 15:12:29 dist-test-slave-5s2t krb5kdc[24001](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790521949, etypes {rep=17 tkt=17 ses=17}, oryx/127.17.136.3@KRBTEST.COM for oryx/127.17.136.62@KRBTEST.COM
I20260927 15:12:29.768000 24085 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:29.756790 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.136.3:56417 (local address 127.17.136.62:33401)
0927 15:12:29.756971 (+ 181us) server_negotiation.cc:206] Beginning negotiation
0927 15:12:29.756975 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0927 15:12:29.757761 (+ 786us) server_negotiation.cc:407] Connection header received
0927 15:12:29.759077 (+ 1316us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:12:29.759080 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:12:29.759137 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:12:29.759210 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0927 15:12:29.760366 (+ 1156us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:29.760878 (+ 512us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:29.762254 (+ 1376us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:29.762531 (+ 277us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:29.762616 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:29.765035 (+ 2419us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0927 15:12:29.765038 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0927 15:12:29.765040 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0927 15:12:29.765063 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0927 15:12:29.766337 (+ 1274us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:12:29.766744 (+ 407us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:12:29.766746 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:12:29.766747 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:12:29.766813 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:12:29.767096 (+ 283us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:12:29.767098 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:12:29.767099 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:12:29.767276 (+ 177us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0927 15:12:29.767359 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0927 15:12:29.767763 (+ 404us) server_negotiation.cc:299] Negotiation successful
0927 15:12:29.767886 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":89}
I20260927 15:12:29.768707 24507 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:29.757130 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.62:33401 (local address 127.17.136.3:56417)
0927 15:12:29.757613 (+ 483us) negotiation.cc:107] Waiting for socket to connect
0927 15:12:29.757653 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0927 15:12:29.758847 (+ 1194us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0927 15:12:29.759399 (+ 552us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0927 15:12:29.759405 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0927 15:12:29.759744 (+ 339us) client_negotiation.cc:189] Negotiated authn=SASL
0927 15:12:29.760209 (+ 465us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:12:29.760223 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:12:29.760992 (+ 769us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:12:29.760995 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:12:29.762089 (+ 1094us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:12:29.762100 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:12:29.762670 (+ 570us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:12:29.762675 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:12:29.762837 (+ 162us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:29.763484 (+ 647us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0927 15:12:29.763499 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0927 15:12:29.764887 (+ 1388us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0927 15:12:29.766438 (+ 1551us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0927 15:12:29.766442 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0927 15:12:29.766453 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0927 15:12:29.766672 (+ 219us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0927 15:12:29.766907 (+ 235us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0927 15:12:29.766909 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0927 15:12:29.766910 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0927 15:12:29.767035 (+ 125us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0927 15:12:29.767359 (+ 324us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0927 15:12:29.767363 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0927 15:12:29.767573 (+ 210us) client_negotiation.cc:769] Sending connection context
0927 15:12:29.767715 (+ 142us) client_negotiation.cc:240] Negotiation successful
0927 15:12:29.767972 (+ 257us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":295,"thread_start_us":124,"threads_started":1}
I20260927 15:12:29.769665 24505 heartbeater.cc:347] Connected to a master server at 127.17.136.62:33401
I20260927 15:12:29.769866 24505 heartbeater.cc:464] Registering TS with master...
I20260927 15:12:29.770299 24505 heartbeater.cc:511] Master 127.17.136.62:33401 requested a full tablet report, sending...
I20260927 15:12:29.771224 24044 ts_manager.cc:194] Registered new tserver with Master: e94ed22dcc4f4c828fb3714f2d327a6e (127.17.136.3:33145)
I20260927 15:12:29.771864 24044 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.17.136.3@KRBTEST.COM'} at 127.17.136.3:56417
I20260927 15:12:29.775594 17952 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
WARNING: no policy specified for oryx/127.17.136.61@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.17.136.61@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.17.136.61 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790521920546562-17952-0/krb5kdc/oryx_127.17.136.61.keytab.
Entry for principal oryx/127.17.136.61 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790521920546562-17952-0/krb5kdc/oryx_127.17.136.61.keytab.
I20260927 15:12:29.800274 17952 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu
/tmp/dist-test-taskiFOyeW/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790521920546562-17952-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790521920546562-17952-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790521920546562-17952-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790521920546562-17952-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.136.61:42371
--webserver_interface=127.17.136.61
--webserver_port=0
--keytab_file=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790521920546562-17952-0/krb5kdc/oryx_127.17.136.61.keytab
--principal=oryx/127.17.136.61
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.136.20:43561
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.136.62:33401,127.17.136.61:42371
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790521920546562-17952-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790521920546562-17952-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790521920546562-17952-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260927 15:12:29.908777 24510 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260927 15:12:29.909126 24510 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260927 15:12:29.909192 24510 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260927 15:12:29.913914 24510 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260927 15:12:29.913983 24510 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260927 15:12:29.914002 24510 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260927 15:12:29.914017 24510 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260927 15:12:29.914036 24510 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260927 15:12:29.919548 24510 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.136.20:43561
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790521920546562-17952-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790521920546562-17952-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.17.136.62:33401,127.17.136.61:42371
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790521920546562-17952-0/krb5kdc/oryx_127.17.136.61.keytab
--principal=oryx/127.17.136.61
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.136.61:42371
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790521920546562-17952-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.17.136.61
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24510
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790521920546562-17952-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 27 Sep 2026 14:27:13 UTC on ccycloud.quasar-psqrth.root.comops.site
build id 4676138
W20260927 15:12:29.919763 24510 master_options.cc:55] Only 2 masters are specified by master_addresses_flag ('127.17.136.62:33401,127.17.136.61:42371'), but minimum of 3 are required to tolerate failures of any one master. It is recommended to use at least 3 masters.
I20260927 15:12:29.920629 24510 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260927 15:12:29.921625 24510 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260927 15:12:29.929720 24518 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260927 15:12:29.929720 24515 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260927 15:12:29.929798 24516 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260927 15:12:29.929906 24510 server_base.cc:1034] running on GCE node
I20260927 15:12:29.930542 24510 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260927 15:12:29.931660 24510 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260927 15:12:29.932811 24510 hybrid_clock.cc:648] HybridClock initialized: now 1790521949932791 us; error 37 us; skew 500 ppm
Sep 27 15:12:29 dist-test-slave-5s2t krb5kdc[24001](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790521949, etypes {rep=17 tkt=17 ses=17}, oryx/127.17.136.61@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260927 15:12:29.935402 24510 init.cc:377] Logged in from keytab as oryx/127.17.136.61@KRBTEST.COM (short username oryx)
I20260927 15:12:29.936223 24510 webserver.cc:460] Webserver started at http://127.17.136.61:34771/ using document root <none> and password file <none>
I20260927 15:12:29.936728 24510 fs_manager.cc:359] Metadata directory not provided
I20260927 15:12:29.936789 24510 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260927 15:12:29.936990 24510 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260927 15:12:29.938928 24510 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790521920546562-17952-0/minicluster-data/master-1/data/instance:
uuid: "cc335ec49c7b46d8b3bfc44fc1f32579"
format_stamp: "Formatted at 2026-09-27 15:12:29 on dist-test-slave-5s2t"
server_key: "95368602acaf2b73d4ff3580d3f70b33"
server_key_iv: "079240350a60573f7380b434bb54bf83"
server_key_version: "encryptionkey@0"
I20260927 15:12:29.939459 24510 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790521920546562-17952-0/minicluster-data/master-1/wal/instance:
uuid: "cc335ec49c7b46d8b3bfc44fc1f32579"
format_stamp: "Formatted at 2026-09-27 15:12:29 on dist-test-slave-5s2t"
server_key: "95368602acaf2b73d4ff3580d3f70b33"
server_key_iv: "079240350a60573f7380b434bb54bf83"
server_key_version: "encryptionkey@0"
I20260927 15:12:29.942790 24510 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.001s
I20260927 15:12:29.945072 24525 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260927 15:12:29.946255 24510 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260927 15:12:29.946357 24510 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790521920546562-17952-0/minicluster-data/master-1/data,/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790521920546562-17952-0/minicluster-data/master-1/wal
uuid: "cc335ec49c7b46d8b3bfc44fc1f32579"
format_stamp: "Formatted at 2026-09-27 15:12:29 on dist-test-slave-5s2t"
server_key: "95368602acaf2b73d4ff3580d3f70b33"
server_key_iv: "079240350a60573f7380b434bb54bf83"
server_key_version: "encryptionkey@0"
I20260927 15:12:29.946442 24510 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790521920546562-17952-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790521920546562-17952-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790521920546562-17952-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260927 15:12:29.964011 24510 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260927 15:12:29.966780 24510 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260927 15:12:29.966945 24510 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260927 15:12:29.973253 24510 rpc_server.cc:307] RPC server started. Bound to: 127.17.136.61:42371
I20260927 15:12:29.973505 24577 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.136.61:42371 every 8 connection(s)
I20260927 15:12:29.974148 24510 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790521920546562-17952-0/minicluster-data/master-1/data/info.pb
I20260927 15:12:29.975602 17952 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu as pid 24510
I20260927 15:12:29.976913 24578 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:12:29.981240 24578 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.17.136.62" port: 33401 } has no permanent_uuid. Determining permanent_uuid...
Sep 27 15:12:29 dist-test-slave-5s2t krb5kdc[24001](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790521948, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.17.136.61@KRBTEST.COM
Sep 27 15:12:29 dist-test-slave-5s2t krb5kdc[24001](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790521949, etypes {rep=17 tkt=17 ses=17}, oryx/127.17.136.61@KRBTEST.COM for oryx/127.17.136.62@KRBTEST.COM
I20260927 15:12:29.989807 24581 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:29.976991 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35510 (local address 127.17.136.61:42371)
0927 15:12:29.977391 (+ 400us) server_negotiation.cc:206] Beginning negotiation
0927 15:12:29.977408 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0927 15:12:29.977448 (+ 40us) server_negotiation.cc:407] Connection header received
0927 15:12:29.978253 (+ 805us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:12:29.978275 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:12:29.978673 (+ 398us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:12:29.979022 (+ 349us) server_negotiation.cc:226] Negotiated authn=SASL
0927 15:12:29.979639 (+ 617us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:29.981066 (+ 1427us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:29.981903 (+ 837us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:29.982537 (+ 634us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:29.982659 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:29.985570 (+ 2911us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0927 15:12:29.985574 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0927 15:12:29.985583 (+ 9us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0927 15:12:29.985607 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0927 15:12:29.987342 (+ 1735us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:12:29.987715 (+ 373us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:12:29.987720 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:12:29.987725 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:12:29.987825 (+ 100us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:12:29.988085 (+ 260us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:12:29.988088 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:12:29.988090 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:12:29.988438 (+ 348us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0927 15:12:29.988601 (+ 163us) server_negotiation.cc:1035] Waiting for connection context
0927 15:12:29.988882 (+ 281us) server_negotiation.cc:299] Negotiation successful
0927 15:12:29.989127 (+ 245us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":264,"thread_start_us":107,"threads_started":1}
I20260927 15:12:29.991039 24085 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:29.982941 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39644 (local address 127.17.136.62:33401)
0927 15:12:29.983084 (+ 143us) server_negotiation.cc:206] Beginning negotiation
0927 15:12:29.983088 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0927 15:12:29.983383 (+ 295us) server_negotiation.cc:407] Connection header received
0927 15:12:29.983505 (+ 122us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:12:29.983508 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:12:29.983551 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:12:29.983623 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0927 15:12:29.984237 (+ 614us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:29.984971 (+ 734us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:29.985984 (+ 1013us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:29.986203 (+ 219us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:29.986288 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:29.988246 (+ 1958us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0927 15:12:29.988250 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0927 15:12:29.988252 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0927 15:12:29.988275 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0927 15:12:29.989507 (+ 1232us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:12:29.989891 (+ 384us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:12:29.989894 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:12:29.989896 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:12:29.989976 (+ 80us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:12:29.990220 (+ 244us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:12:29.990223 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:12:29.990225 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:12:29.990423 (+ 198us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0927 15:12:29.990506 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0927 15:12:29.990787 (+ 281us) server_negotiation.cc:299] Negotiation successful
0927 15:12:29.990887 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260927 15:12:29.991053 24582 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:29.982903 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.62:33401 (local address 127.0.0.1:39644)
0927 15:12:29.983230 (+ 327us) negotiation.cc:107] Waiting for socket to connect
0927 15:12:29.983306 (+ 76us) client_negotiation.cc:174] Beginning negotiation
0927 15:12:29.983427 (+ 121us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0927 15:12:29.983665 (+ 238us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0927 15:12:29.983671 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0927 15:12:29.984006 (+ 335us) client_negotiation.cc:189] Negotiated authn=SASL
0927 15:12:29.984124 (+ 118us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:12:29.984129 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:12:29.985108 (+ 979us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:12:29.985111 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:12:29.985873 (+ 762us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:12:29.985881 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:12:29.986302 (+ 421us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:12:29.986305 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:12:29.986404 (+ 99us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:29.986793 (+ 389us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0927 15:12:29.986803 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0927 15:12:29.988121 (+ 1318us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0927 15:12:29.989601 (+ 1480us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0927 15:12:29.989609 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0927 15:12:29.989614 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0927 15:12:29.989807 (+ 193us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0927 15:12:29.990068 (+ 261us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0927 15:12:29.990070 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0927 15:12:29.990071 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0927 15:12:29.990139 (+ 68us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0927 15:12:29.990518 (+ 379us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0927 15:12:29.990525 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0927 15:12:29.990616 (+ 91us) client_negotiation.cc:769] Sending connection context
0927 15:12:29.990724 (+ 108us) client_negotiation.cc:240] Negotiation successful
0927 15:12:29.990882 (+ 158us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":161,"thread_start_us":69,"threads_started":1}
I20260927 15:12:29.992120 24578 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.17.136.61" port: 42371 } has no permanent_uuid. Determining permanent_uuid...
Sep 27 15:12:29 dist-test-slave-5s2t krb5kdc[24001](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790521949, etypes {rep=17 tkt=17 ses=17}, oryx/127.17.136.61@KRBTEST.COM for oryx/127.17.136.61@KRBTEST.COM
I20260927 15:12:29.999199 24582 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:29.992513 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.61:42371 (local address 127.0.0.1:35522)
0927 15:12:29.992636 (+ 123us) negotiation.cc:107] Waiting for socket to connect
0927 15:12:29.992647 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0927 15:12:29.992709 (+ 62us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0927 15:12:29.992912 (+ 203us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0927 15:12:29.992915 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0927 15:12:29.993036 (+ 121us) client_negotiation.cc:189] Negotiated authn=SASL
0927 15:12:29.993120 (+ 84us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:12:29.993125 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:12:29.994210 (+ 1085us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:12:29.994212 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:12:29.994744 (+ 532us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:12:29.994752 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:12:29.995123 (+ 371us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:12:29.995126 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:12:29.995195 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:29.995600 (+ 405us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0927 15:12:29.995611 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0927 15:12:29.996678 (+ 1067us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0927 15:12:29.998034 (+ 1356us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0927 15:12:29.998036 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0927 15:12:29.998038 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0927 15:12:29.998213 (+ 175us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0927 15:12:29.998414 (+ 201us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0927 15:12:29.998416 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0927 15:12:29.998418 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0927 15:12:29.998482 (+ 64us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0927 15:12:29.998772 (+ 290us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0927 15:12:29.998774 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0927 15:12:29.998846 (+ 72us) client_negotiation.cc:769] Sending connection context
0927 15:12:29.998967 (+ 121us) client_negotiation.cc:240] Negotiation successful
0927 15:12:29.999068 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":58}
I20260927 15:12:29.999233 24581 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:29.992619 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35522 (local address 127.17.136.61:42371)
0927 15:12:29.992695 (+ 76us) server_negotiation.cc:206] Beginning negotiation
0927 15:12:29.992698 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0927 15:12:29.992709 (+ 11us) server_negotiation.cc:407] Connection header received
0927 15:12:29.992764 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:12:29.992766 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:12:29.992796 (+ 30us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:12:29.992852 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0927 15:12:29.993205 (+ 353us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:29.994103 (+ 898us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:29.994826 (+ 723us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:29.995038 (+ 212us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:29.995101 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:29.996791 (+ 1690us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0927 15:12:29.996794 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0927 15:12:29.996796 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0927 15:12:29.996815 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0927 15:12:29.997933 (+ 1118us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:12:29.998286 (+ 353us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:12:29.998288 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:12:29.998289 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:12:29.998346 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:12:29.998539 (+ 193us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:12:29.998541 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:12:29.998542 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:12:29.998679 (+ 137us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0927 15:12:29.998743 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0927 15:12:29.999015 (+ 272us) server_negotiation.cc:299] Negotiation successful
0927 15:12:29.999117 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":15,"server-negotiator.queue_time_us":22}
I20260927 15:12:30.001987 24578 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cc335ec49c7b46d8b3bfc44fc1f32579: Bootstrap starting.
I20260927 15:12:30.004207 24578 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P cc335ec49c7b46d8b3bfc44fc1f32579: Neither blocks nor log segments found. Creating new log.
I20260927 15:12:30.004861 24578 log.cc:824] T 00000000000000000000000000000000 P cc335ec49c7b46d8b3bfc44fc1f32579: Log is configured to *not* fsync() on all Append() calls
I20260927 15:12:30.006733 24578 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cc335ec49c7b46d8b3bfc44fc1f32579: No bootstrap required, opened a new log
I20260927 15:12:30.009625 24578 raft_consensus.cc:348] T 00000000000000000000000000000000 P cc335ec49c7b46d8b3bfc44fc1f32579 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d94e22c8fa74c10a9732bb2af78fb98" member_type: VOTER last_known_addr { host: "127.17.136.62" port: 33401 } } peers { permanent_uuid: "cc335ec49c7b46d8b3bfc44fc1f32579" member_type: VOTER last_known_addr { host: "127.17.136.61" port: 42371 } }
I20260927 15:12:30.009810 24578 raft_consensus.cc:374] T 00000000000000000000000000000000 P cc335ec49c7b46d8b3bfc44fc1f32579 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:12:30.009855 24578 raft_consensus.cc:729] T 00000000000000000000000000000000 P cc335ec49c7b46d8b3bfc44fc1f32579 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cc335ec49c7b46d8b3bfc44fc1f32579, State: Initialized, Role: FOLLOWER
I20260927 15:12:30.010213 24578 consensus_queue.cc:260] T 00000000000000000000000000000000 P cc335ec49c7b46d8b3bfc44fc1f32579 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d94e22c8fa74c10a9732bb2af78fb98" member_type: VOTER last_known_addr { host: "127.17.136.62" port: 33401 } } peers { permanent_uuid: "cc335ec49c7b46d8b3bfc44fc1f32579" member_type: VOTER last_known_addr { host: "127.17.136.61" port: 42371 } }
I20260927 15:12:30.010646 24584 sys_catalog.cc:455] T 00000000000000000000000000000000 P cc335ec49c7b46d8b3bfc44fc1f32579 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d94e22c8fa74c10a9732bb2af78fb98" member_type: VOTER last_known_addr { host: "127.17.136.62" port: 33401 } } peers { permanent_uuid: "cc335ec49c7b46d8b3bfc44fc1f32579" member_type: VOTER last_known_addr { host: "127.17.136.61" port: 42371 } } }
I20260927 15:12:30.010768 24584 sys_catalog.cc:458] T 00000000000000000000000000000000 P cc335ec49c7b46d8b3bfc44fc1f32579 [sys.catalog]: This master's current role is: FOLLOWER
I20260927 15:12:30.011341 24578 sys_catalog.cc:564] T 00000000000000000000000000000000 P cc335ec49c7b46d8b3bfc44fc1f32579 [sys.catalog]: configured and running, proceeding with master startup.
W20260927 15:12:30.015614 24595 catalog_manager.cc:1558] T 00000000000000000000000000000000 P cc335ec49c7b46d8b3bfc44fc1f32579: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260927 15:12:30.015693 24595 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260927 15:12:30.016984 24510 master_runner.cc:428] Detected that this master cc335ec49c7b46d8b3bfc44fc1f32579 is joining an existing cluster
I20260927 15:12:30.017031 24510 master_runner.cc:432] Initiating AddMaster RPC to add 127.17.136.61:42371
I20260927 15:12:30.027098 24601 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:30.018940 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.62:33401 (local address 127.0.0.1:39650)
0927 15:12:30.019413 (+ 473us) negotiation.cc:107] Waiting for socket to connect
0927 15:12:30.019426 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0927 15:12:30.019517 (+ 91us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0927 15:12:30.019797 (+ 280us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0927 15:12:30.019800 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0927 15:12:30.019996 (+ 196us) client_negotiation.cc:189] Negotiated authn=SASL
0927 15:12:30.020129 (+ 133us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:12:30.020135 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:12:30.020940 (+ 805us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:12:30.020942 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:12:30.021772 (+ 830us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:12:30.021779 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:12:30.022176 (+ 397us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:12:30.022180 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:12:30.022257 (+ 77us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:30.022736 (+ 479us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0927 15:12:30.022749 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0927 15:12:30.023181 (+ 432us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0927 15:12:30.025074 (+ 1893us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0927 15:12:30.025077 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0927 15:12:30.025080 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0927 15:12:30.025383 (+ 303us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0927 15:12:30.026012 (+ 629us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0927 15:12:30.026015 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0927 15:12:30.026017 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0927 15:12:30.026107 (+ 90us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0927 15:12:30.026552 (+ 445us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0927 15:12:30.026555 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0927 15:12:30.026645 (+ 90us) client_negotiation.cc:769] Sending connection context
0927 15:12:30.026742 (+ 97us) client_negotiation.cc:240] Negotiation successful
0927 15:12:30.026877 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":395,"mutex_wait_us":2,"thread_start_us":87,"threads_started":1}
I20260927 15:12:30.027119 24085 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:30.019003 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39650 (local address 127.17.136.62:33401)
0927 15:12:30.019107 (+ 104us) server_negotiation.cc:206] Beginning negotiation
0927 15:12:30.019110 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0927 15:12:30.019501 (+ 391us) server_negotiation.cc:407] Connection header received
0927 15:12:30.019592 (+ 91us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:12:30.019595 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:12:30.019637 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:12:30.019704 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0927 15:12:30.020247 (+ 543us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:30.020817 (+ 570us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:30.021869 (+ 1052us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:30.022077 (+ 208us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:30.022159 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:30.023347 (+ 1188us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0927 15:12:30.023351 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0927 15:12:30.023354 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0927 15:12:30.023380 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0927 15:12:30.024978 (+ 1598us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:12:30.025758 (+ 780us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:12:30.025763 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:12:30.025765 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:12:30.025882 (+ 117us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:12:30.026202 (+ 320us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:12:30.026205 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:12:30.026207 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:12:30.026455 (+ 248us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0927 15:12:30.026569 (+ 114us) server_negotiation.cc:1035] Waiting for connection context
0927 15:12:30.026818 (+ 249us) server_negotiation.cc:299] Negotiation successful
0927 15:12:30.026949 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260927 15:12:30.027542 24581 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:30.019646 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35524 (local address 127.17.136.61:42371)
0927 15:12:30.019749 (+ 103us) server_negotiation.cc:206] Beginning negotiation
0927 15:12:30.019752 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0927 15:12:30.019931 (+ 179us) server_negotiation.cc:407] Connection header received
0927 15:12:30.020080 (+ 149us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:12:30.020083 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:12:30.020122 (+ 39us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:12:30.020197 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0927 15:12:30.020718 (+ 521us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:30.021395 (+ 677us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:30.022558 (+ 1163us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:30.022846 (+ 288us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:30.022962 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:30.024197 (+ 1235us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0927 15:12:30.024200 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0927 15:12:30.024203 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0927 15:12:30.024227 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0927 15:12:30.026172 (+ 1945us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:12:30.026494 (+ 322us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:12:30.026497 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:12:30.026499 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:12:30.026569 (+ 70us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:12:30.026798 (+ 229us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:12:30.026801 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:12:30.026802 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:12:30.026964 (+ 162us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0927 15:12:30.027026 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0927 15:12:30.027326 (+ 300us) server_negotiation.cc:299] Negotiation successful
0927 15:12:30.027424 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260927 15:12:30.027905 24602 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:30.019401 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.61:42371 (local address 127.0.0.1:35524)
0927 15:12:30.019835 (+ 434us) negotiation.cc:107] Waiting for socket to connect
0927 15:12:30.019851 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0927 15:12:30.019960 (+ 109us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0927 15:12:30.020243 (+ 283us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0927 15:12:30.020246 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0927 15:12:30.020466 (+ 220us) client_negotiation.cc:189] Negotiated authn=SASL
0927 15:12:30.020600 (+ 134us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:12:30.020609 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:12:30.021512 (+ 903us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:12:30.021517 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:12:30.022443 (+ 926us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:12:30.022456 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:12:30.023015 (+ 559us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:12:30.023020 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:12:30.023118 (+ 98us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:30.023611 (+ 493us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0927 15:12:30.023628 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0927 15:12:30.024058 (+ 430us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0927 15:12:30.026246 (+ 2188us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0927 15:12:30.026249 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0927 15:12:30.026251 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0927 15:12:30.026413 (+ 162us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0927 15:12:30.026649 (+ 236us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0927 15:12:30.026651 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0927 15:12:30.026653 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0927 15:12:30.026723 (+ 70us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0927 15:12:30.027075 (+ 352us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0927 15:12:30.027078 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0927 15:12:30.027151 (+ 73us) client_negotiation.cc:769] Sending connection context
0927 15:12:30.027643 (+ 492us) client_negotiation.cc:240] Negotiation successful
0927 15:12:30.027753 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":358,"mutex_wait_us":53,"thread_start_us":84,"threads_started":1}
Sep 27 15:12:30 dist-test-slave-5s2t krb5kdc[24001](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790521949, etypes {rep=17 tkt=17 ses=17}, oryx/127.17.136.62@KRBTEST.COM for oryx/127.17.136.61@KRBTEST.COM
I20260927 15:12:30.040789 24581 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:30.031978 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35532 (local address 127.17.136.61:42371)
0927 15:12:30.032093 (+ 115us) server_negotiation.cc:206] Beginning negotiation
0927 15:12:30.032098 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0927 15:12:30.032455 (+ 357us) server_negotiation.cc:407] Connection header received
0927 15:12:30.032650 (+ 195us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:12:30.032653 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:12:30.032704 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:12:30.032766 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0927 15:12:30.033549 (+ 783us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:30.034018 (+ 469us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:30.035211 (+ 1193us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:30.035439 (+ 228us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:30.035511 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:30.037849 (+ 2338us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0927 15:12:30.037852 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0927 15:12:30.037854 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0927 15:12:30.037875 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0927 15:12:30.039071 (+ 1196us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:12:30.039642 (+ 571us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:12:30.039645 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:12:30.039646 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:12:30.039713 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:12:30.039987 (+ 274us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:12:30.039989 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:12:30.039990 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:12:30.040158 (+ 168us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0927 15:12:30.040228 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0927 15:12:30.040588 (+ 360us) server_negotiation.cc:299] Negotiation successful
0927 15:12:30.040673 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260927 15:12:30.041036 24603 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:30.031942 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.61:42371 (local address 127.0.0.1:35532)
0927 15:12:30.032307 (+ 365us) negotiation.cc:107] Waiting for socket to connect
0927 15:12:30.032376 (+ 69us) client_negotiation.cc:174] Beginning negotiation
0927 15:12:30.032519 (+ 143us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0927 15:12:30.032817 (+ 298us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0927 15:12:30.032823 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0927 15:12:30.033286 (+ 463us) client_negotiation.cc:189] Negotiated authn=SASL
0927 15:12:30.033443 (+ 157us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:12:30.033453 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:12:30.034108 (+ 655us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:12:30.034112 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:12:30.035107 (+ 995us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:12:30.035118 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:12:30.035537 (+ 419us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:12:30.035542 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:12:30.035658 (+ 116us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:30.036146 (+ 488us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0927 15:12:30.036163 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0927 15:12:30.037725 (+ 1562us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0927 15:12:30.039167 (+ 1442us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0927 15:12:30.039176 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0927 15:12:30.039183 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0927 15:12:30.039542 (+ 359us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0927 15:12:30.039790 (+ 248us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0927 15:12:30.039794 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0927 15:12:30.039796 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0927 15:12:30.039897 (+ 101us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0927 15:12:30.040248 (+ 351us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0927 15:12:30.040255 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0927 15:12:30.040397 (+ 142us) client_negotiation.cc:769] Sending connection context
0927 15:12:30.040552 (+ 155us) client_negotiation.cc:240] Negotiation successful
0927 15:12:30.040753 (+ 201us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":183,"thread_start_us":94,"threads_started":1}
I20260927 15:12:30.042464 24044 catalog_manager.cc:6979] Initiating ChangeConfig request to add master 127.17.136.61:42371: tablet_id: "00000000000000000000000000000000"
type: ADD_PEER
server {
permanent_uuid: "cc335ec49c7b46d8b3bfc44fc1f32579"
member_type: NON_VOTER
last_known_addr {
host: "127.17.136.61"
port: 42371
}
attrs {
promote: true
}
}
dest_uuid: "5d94e22c8fa74c10a9732bb2af78fb98"
cas_config_opid_index: -1
I20260927 15:12:30.043085 24044 consensus_queue.cc:237] T 00000000000000000000000000000000 P 5d94e22c8fa74c10a9732bb2af78fb98 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "5d94e22c8fa74c10a9732bb2af78fb98" member_type: VOTER last_known_addr { host: "127.17.136.62" port: 33401 } } peers { permanent_uuid: "cc335ec49c7b46d8b3bfc44fc1f32579" member_type: NON_VOTER last_known_addr { host: "127.17.136.61" port: 42371 } attrs { promote: true } }
I20260927 15:12:30.044772 24604 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 5d94e22c8fa74c10a9732bb2af78fb98 [term 1 LEADER]: Committing config change with OpId 1.5: config changed from index -1 to 5, NON_VOTER cc335ec49c7b46d8b3bfc44fc1f32579 (127.17.136.61) added. New config: { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "5d94e22c8fa74c10a9732bb2af78fb98" member_type: VOTER last_known_addr { host: "127.17.136.62" port: 33401 } } peers { permanent_uuid: "cc335ec49c7b46d8b3bfc44fc1f32579" member_type: NON_VOTER last_known_addr { host: "127.17.136.61" port: 42371 } attrs { promote: true } } }
I20260927 15:12:30.045369 24552 raft_consensus.cc:3037] T 00000000000000000000000000000000 P cc335ec49c7b46d8b3bfc44fc1f32579 [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:12:30.046355 24604 catalog_manager.cc:6983] Successfully completed master ChangeConfig request to add master 127.17.136.61:42371
I20260927 15:12:30.046558 24604 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5d94e22c8fa74c10a9732bb2af78fb98 [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "5d94e22c8fa74c10a9732bb2af78fb98" committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "5d94e22c8fa74c10a9732bb2af78fb98" member_type: VOTER last_known_addr { host: "127.17.136.62" port: 33401 } } peers { permanent_uuid: "cc335ec49c7b46d8b3bfc44fc1f32579" member_type: NON_VOTER last_known_addr { host: "127.17.136.61" port: 42371 } attrs { promote: true } } }
I20260927 15:12:30.046617 24552 raft_consensus.cc:1261] T 00000000000000000000000000000000 P cc335ec49c7b46d8b3bfc44fc1f32579 [term 1 FOLLOWER]: Refusing update from remote peer 5d94e22c8fa74c10a9732bb2af78fb98: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20260927 15:12:30.046638 24604 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5d94e22c8fa74c10a9732bb2af78fb98 [sys.catalog]: This master's current role is: LEADER
I20260927 15:12:30.047395 24510 master.cc:537] Master@127.17.136.61:42371 shutting down...
I20260927 15:12:30.047761 24606 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 5d94e22c8fa74c10a9732bb2af78fb98 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc335ec49c7b46d8b3bfc44fc1f32579" member_type: NON_VOTER last_known_addr { host: "127.17.136.61" port: 42371 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 0, Time since last communication: 0.000s
W20260927 15:12:30.049507 24031 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master
W20260927 15:12:30.050484 24031 consensus_peers.cc:487] T 00000000000000000000000000000000 P 5d94e22c8fa74c10a9732bb2af78fb98 -> Peer cc335ec49c7b46d8b3bfc44fc1f32579 (127.17.136.61:42371): Couldn't send request to peer cc335ec49c7b46d8b3bfc44fc1f32579. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master. This is attempt 1: this message will repeat every 5th retry.
I20260927 15:12:30.051904 24510 raft_consensus.cc:2229] T 00000000000000000000000000000000 P cc335ec49c7b46d8b3bfc44fc1f32579 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260927 15:12:30.052152 24510 raft_consensus.cc:2258] T 00000000000000000000000000000000 P cc335ec49c7b46d8b3bfc44fc1f32579 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 15:12:30.052246 24510 tablet_replica.cc:330] T 00000000000000000000000000000000 P cc335ec49c7b46d8b3bfc44fc1f32579: stopping tablet replica
WARNING: no policy specified for oryx/127.17.136.60@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.17.136.60@KRBTEST.COM" created.
I20260927 15:12:30.056710 24510 master.cc:552] Master@127.17.136.61:42371 shutdown complete.
I20260927 15:12:30.056782 24510 master_runner.cc:305] Clearing existing system tablet
I20260927 15:12:30.056998 24510 fs_manager.cc:359] Metadata directory not provided
I20260927 15:12:30.057042 24510 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260927 15:12:30.057987 24510 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260927 15:12:30.058676 24611 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260927 15:12:30.058861 24510 fs_report.cc:383] FS layout report
--------------------
wal directory:
metadata directory:
1 data directories: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790521920546562-17952-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260927 15:12:30.058985 24510 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260927 15:12:30.059022 24510 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790521920546562-17952-0/minicluster-data/master-1/data,/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790521920546562-17952-0/minicluster-data/master-1/wal
uuid: "cc335ec49c7b46d8b3bfc44fc1f32579"
format_stamp: "Formatted at 2026-09-27 15:12:29 on dist-test-slave-5s2t"
server_key: "95368602acaf2b73d4ff3580d3f70b33"
server_key_iv: "079240350a60573f7380b434bb54bf83"
server_key_version: "encryptionkey@0"
I20260927 15:12:30.060612 24510 ts_tablet_manager.cc:1905] T 00000000000000000000000000000000 P cc335ec49c7b46d8b3bfc44fc1f32579: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:12:30.062407 24510 ts_tablet_manager.cc:1918] T 00000000000000000000000000000000 P cc335ec49c7b46d8b3bfc44fc1f32579: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId unknown
I20260927 15:12:30.062479 24510 log.cc:1196] T 00000000000000000000000000000000 P cc335ec49c7b46d8b3bfc44fc1f32579: Deleting WAL directory at /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790521920546562-17952-0/minicluster-data/master-1/wal/wals/00000000000000000000000000000000
I20260927 15:12:30.062676 24510 ts_tablet_manager.cc:1939] T 00000000000000000000000000000000 P cc335ec49c7b46d8b3bfc44fc1f32579: Deleting consensus metadata
I20260927 15:12:30.062922 24510 master_runner.cc:315] Copying system tablet from 127.17.136.62:33401
I20260927 15:12:30.063915 24510 tablet_copy_client.cc:316] T 00000000000000000000000000000000 P cc335ec49c7b46d8b3bfc44fc1f32579: tablet copy: Beginning tablet copy session from remote peer at address 127.17.136.62:33401
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.17.136.60 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790521920546562-17952-0/krb5kdc/oryx_127.17.136.60.keytab.
Entry for principal oryx/127.17.136.60 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790521920546562-17952-0/krb5kdc/oryx_127.17.136.60.keytab.
I20260927 15:12:30.071954 17952 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu
/tmp/dist-test-taskiFOyeW/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790521920546562-17952-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790521920546562-17952-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790521920546562-17952-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790521920546562-17952-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.136.60:40351
--webserver_interface=127.17.136.60
--webserver_port=0
--keytab_file=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790521920546562-17952-0/krb5kdc/oryx_127.17.136.60.keytab
--principal=oryx/127.17.136.60
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.136.20:43561
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.136.62:33401,127.17.136.61:42371,127.17.136.60:40351
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790521920546562-17952-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790521920546562-17952-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790521920546562-17952-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260927 15:12:30.072669 24085 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:30.064463 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39666 (local address 127.17.136.62:33401)
0927 15:12:30.064589 (+ 126us) server_negotiation.cc:206] Beginning negotiation
0927 15:12:30.064593 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0927 15:12:30.064721 (+ 128us) server_negotiation.cc:407] Connection header received
0927 15:12:30.064859 (+ 138us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:12:30.064861 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:12:30.064901 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:12:30.064964 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0927 15:12:30.065831 (+ 867us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:30.066421 (+ 590us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:30.067604 (+ 1183us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:30.067836 (+ 232us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:30.067914 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:30.069062 (+ 1148us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0927 15:12:30.069066 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0927 15:12:30.069069 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0927 15:12:30.069099 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0927 15:12:30.070694 (+ 1595us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:12:30.071126 (+ 432us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:12:30.071129 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:12:30.071131 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:12:30.071223 (+ 92us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:12:30.071650 (+ 427us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:12:30.071654 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:12:30.071656 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:12:30.071889 (+ 233us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0927 15:12:30.071973 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0927 15:12:30.072355 (+ 382us) server_negotiation.cc:299] Negotiation successful
0927 15:12:30.072484 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260927 15:12:30.073380 24617 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:30.064356 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.62:33401 (local address 127.0.0.1:39666)
0927 15:12:30.064624 (+ 268us) negotiation.cc:107] Waiting for socket to connect
0927 15:12:30.064641 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0927 15:12:30.064765 (+ 124us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0927 15:12:30.065052 (+ 287us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0927 15:12:30.065055 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0927 15:12:30.065271 (+ 216us) client_negotiation.cc:189] Negotiated authn=SASL
0927 15:12:30.065396 (+ 125us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:12:30.065405 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:12:30.066522 (+ 1117us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:12:30.066527 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:12:30.067491 (+ 964us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:12:30.067503 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:12:30.067938 (+ 435us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:12:30.067942 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:12:30.068035 (+ 93us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:30.068494 (+ 459us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0927 15:12:30.068511 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0927 15:12:30.068915 (+ 404us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0927 15:12:30.070800 (+ 1885us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0927 15:12:30.070803 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0927 15:12:30.070804 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0927 15:12:30.071020 (+ 216us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0927 15:12:30.071416 (+ 396us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0927 15:12:30.071419 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0927 15:12:30.071422 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0927 15:12:30.071521 (+ 99us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0927 15:12:30.072050 (+ 529us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0927 15:12:30.072053 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0927 15:12:30.072154 (+ 101us) client_negotiation.cc:769] Sending connection context
0927 15:12:30.072835 (+ 681us) client_negotiation.cc:240] Negotiation successful
0927 15:12:30.072996 (+ 161us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":185,"thread_start_us":93,"threads_started":1}
I20260927 15:12:30.073987 24066 tablet_copy_service.cc:140] P 5d94e22c8fa74c10a9732bb2af78fb98: Received BeginTabletCopySession request for tablet 00000000000000000000000000000000 from peer cc335ec49c7b46d8b3bfc44fc1f32579 ({username='oryx', principal='oryx/127.17.136.61@KRBTEST.COM'} at 127.0.0.1:39666)
I20260927 15:12:30.074175 24066 tablet_copy_service.cc:161] P 5d94e22c8fa74c10a9732bb2af78fb98: Beginning new tablet copy session on tablet 00000000000000000000000000000000 from peer cc335ec49c7b46d8b3bfc44fc1f32579 at {username='oryx', principal='oryx/127.17.136.61@KRBTEST.COM'} at 127.0.0.1:39666: session id = cc335ec49c7b46d8b3bfc44fc1f32579-00000000000000000000000000000000
I20260927 15:12:30.075621 24066 tablet_copy_source_session.cc:205] T 00000000000000000000000000000000 P 5d94e22c8fa74c10a9732bb2af78fb98: Tablet Copy: opened 0 blocks and 1 log segments
I20260927 15:12:30.077000 24510 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total
I20260927 15:12:30.078810 24510 tablet_copy_client.cc:791] T 00000000000000000000000000000000 P cc335ec49c7b46d8b3bfc44fc1f32579: tablet copy: Starting download of 0 data blocks...
I20260927 15:12:30.078970 24510 tablet_copy_client.cc:655] T 00000000000000000000000000000000 P cc335ec49c7b46d8b3bfc44fc1f32579: tablet copy: Starting download of 1 WAL segments...
I20260927 15:12:30.080399 24510 tablet_copy_client.cc:531] T 00000000000000000000000000000000 P cc335ec49c7b46d8b3bfc44fc1f32579: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260927 15:12:30.081748 24066 tablet_copy_service.cc:342] P 5d94e22c8fa74c10a9732bb2af78fb98: Request end of tablet copy session cc335ec49c7b46d8b3bfc44fc1f32579-00000000000000000000000000000000 received from {username='oryx', principal='oryx/127.17.136.61@KRBTEST.COM'} at 127.0.0.1:39666
I20260927 15:12:30.081861 24066 tablet_copy_service.cc:433] P 5d94e22c8fa74c10a9732bb2af78fb98: ending tablet copy session cc335ec49c7b46d8b3bfc44fc1f32579-00000000000000000000000000000000 on tablet 00000000000000000000000000000000 with peer cc335ec49c7b46d8b3bfc44fc1f32579
I20260927 15:12:30.093132 24510 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260927 15:12:30.096302 24620 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260927 15:12:30.098299 24510 server_base.cc:1034] running on GCE node
W20260927 15:12:30.098374 24619 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260927 15:12:30.099373 24622 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260927 15:12:30.099587 24510 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260927 15:12:30.099843 24510 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260927 15:12:30.100957 24510 hybrid_clock.cc:648] HybridClock initialized: now 1790521950100951 us; error 24 us; skew 500 ppm
Sep 27 15:12:30 dist-test-slave-5s2t krb5kdc[24001](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790521950, etypes {rep=17 tkt=17 ses=17}, oryx/127.17.136.61@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260927 15:12:30.102221 24510 init.cc:377] Logged in from keytab as oryx/127.17.136.61@KRBTEST.COM (short username oryx)
I20260927 15:12:30.102613 24510 webserver.cc:460] Webserver started at http://127.17.136.61:35381/ using document root <none> and password file <none>
I20260927 15:12:30.102782 24510 fs_manager.cc:359] Metadata directory not provided
I20260927 15:12:30.102814 24510 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260927 15:12:30.103865 24510 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260927 15:12:30.104652 24629 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260927 15:12:30.104851 24510 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260927 15:12:30.104918 24510 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790521920546562-17952-0/minicluster-data/master-1/data,/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790521920546562-17952-0/minicluster-data/master-1/wal
uuid: "cc335ec49c7b46d8b3bfc44fc1f32579"
format_stamp: "Formatted at 2026-09-27 15:12:29 on dist-test-slave-5s2t"
server_key: "95368602acaf2b73d4ff3580d3f70b33"
server_key_iv: "079240350a60573f7380b434bb54bf83"
server_key_version: "encryptionkey@0"
I20260927 15:12:30.104992 24510 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790521920546562-17952-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790521920546562-17952-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790521920546562-17952-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260927 15:12:30.127496 24510 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260927 15:12:30.129197 24510 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260927 15:12:30.133580 24510 rpc_server.cc:307] RPC server started. Bound to: 127.17.136.61:42371
I20260927 15:12:30.134084 24510 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790521920546562-17952-0/minicluster-data/master-1/data/info.pb
I20260927 15:12:30.135485 24682 sys_catalog.cc:263] Verifying existing consensus state
I20260927 15:12:30.136214 24682 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cc335ec49c7b46d8b3bfc44fc1f32579: Bootstrap starting.
I20260927 15:12:30.139398 24681 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.136.61:42371 every 8 connection(s)
I20260927 15:12:30.143648 24682 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cc335ec49c7b46d8b3bfc44fc1f32579: Bootstrap replayed 1/1 log segments. Stats: ops{read=5 overwritten=0 applied=5 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260927 15:12:30.143886 24682 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cc335ec49c7b46d8b3bfc44fc1f32579: Bootstrap complete.
I20260927 15:12:30.144316 24682 raft_consensus.cc:348] T 00000000000000000000000000000000 P cc335ec49c7b46d8b3bfc44fc1f32579 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "5d94e22c8fa74c10a9732bb2af78fb98" member_type: VOTER last_known_addr { host: "127.17.136.62" port: 33401 } } peers { permanent_uuid: "cc335ec49c7b46d8b3bfc44fc1f32579" member_type: NON_VOTER last_known_addr { host: "127.17.136.61" port: 42371 } attrs { promote: true } }
I20260927 15:12:30.144419 24682 raft_consensus.cc:729] T 00000000000000000000000000000000 P cc335ec49c7b46d8b3bfc44fc1f32579 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: cc335ec49c7b46d8b3bfc44fc1f32579, State: Initialized, Role: LEARNER
I20260927 15:12:30.144534 24682 consensus_queue.cc:260] T 00000000000000000000000000000000 P cc335ec49c7b46d8b3bfc44fc1f32579 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 5, Last appended: 1.5, Last appended by leader: 5, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "5d94e22c8fa74c10a9732bb2af78fb98" member_type: VOTER last_known_addr { host: "127.17.136.62" port: 33401 } } peers { permanent_uuid: "cc335ec49c7b46d8b3bfc44fc1f32579" member_type: NON_VOTER last_known_addr { host: "127.17.136.61" port: 42371 } attrs { promote: true } }
I20260927 15:12:30.144819 24685 sys_catalog.cc:455] T 00000000000000000000000000000000 P cc335ec49c7b46d8b3bfc44fc1f32579 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "5d94e22c8fa74c10a9732bb2af78fb98" member_type: VOTER last_known_addr { host: "127.17.136.62" port: 33401 } } peers { permanent_uuid: "cc335ec49c7b46d8b3bfc44fc1f32579" member_type: NON_VOTER last_known_addr { host: "127.17.136.61" port: 42371 } attrs { promote: true } } }
I20260927 15:12:30.144950 24682 sys_catalog.cc:564] T 00000000000000000000000000000000 P cc335ec49c7b46d8b3bfc44fc1f32579 [sys.catalog]: configured and running, proceeding with master startup.
I20260927 15:12:30.145007 24685 sys_catalog.cc:458] T 00000000000000000000000000000000 P cc335ec49c7b46d8b3bfc44fc1f32579 [sys.catalog]: This master's current role is: LEARNER
I20260927 15:12:30.147850 24696 catalog_manager.cc:1259] Loaded cluster ID: cf487426c0ca458e8b8e643e352d17ca
I20260927 15:12:30.147892 24696 catalog_manager.cc:1552] T 00000000000000000000000000000000 P cc335ec49c7b46d8b3bfc44fc1f32579: loading cluster ID for follower catalog manager: success
I20260927 15:12:30.149319 24696 catalog_manager.cc:1574] T 00000000000000000000000000000000 P cc335ec49c7b46d8b3bfc44fc1f32579: acquiring CA information for follower catalog manager: success
I20260927 15:12:30.150326 24696 catalog_manager.cc:1602] T 00000000000000000000000000000000 P cc335ec49c7b46d8b3bfc44fc1f32579: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
W20260927 15:12:30.220880 24618 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260927 15:12:30.221127 24618 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260927 15:12:30.221174 24618 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260927 15:12:30.225180 24618 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260927 15:12:30.225232 24618 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260927 15:12:30.225250 24618 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260927 15:12:30.225270 24618 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260927 15:12:30.225297 24618 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260927 15:12:30.230548 24618 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.136.20:43561
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790521920546562-17952-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790521920546562-17952-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.17.136.62:33401,127.17.136.61:42371,127.17.136.60:40351
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790521920546562-17952-0/krb5kdc/oryx_127.17.136.60.keytab
--principal=oryx/127.17.136.60
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.136.60:40351
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790521920546562-17952-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.17.136.60
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24618
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790521920546562-17952-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 27 Sep 2026 14:27:13 UTC on ccycloud.quasar-psqrth.root.comops.site
build id 4676138
I20260927 15:12:30.231673 24618 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260927 15:12:30.232651 24618 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260927 15:12:30.240622 24704 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260927 15:12:30.240651 24702 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260927 15:12:30.240617 24701 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260927 15:12:30.240947 24618 server_base.cc:1034] running on GCE node
I20260927 15:12:30.241499 24618 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260927 15:12:30.242498 24618 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260927 15:12:30.243645 24618 hybrid_clock.cc:648] HybridClock initialized: now 1790521950243625 us; error 31 us; skew 500 ppm
Sep 27 15:12:30 dist-test-slave-5s2t krb5kdc[24001](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790521950, etypes {rep=17 tkt=17 ses=17}, oryx/127.17.136.60@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260927 15:12:30.246361 24618 init.cc:377] Logged in from keytab as oryx/127.17.136.60@KRBTEST.COM (short username oryx)
I20260927 15:12:30.247189 24618 webserver.cc:460] Webserver started at http://127.17.136.60:41599/ using document root <none> and password file <none>
I20260927 15:12:30.247715 24618 fs_manager.cc:359] Metadata directory not provided
I20260927 15:12:30.247778 24618 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260927 15:12:30.247952 24618 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260927 15:12:30.249859 24618 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790521920546562-17952-0/minicluster-data/master-2/data/instance:
uuid: "3b1c4bd139bf4929b313361ea24d3eab"
format_stamp: "Formatted at 2026-09-27 15:12:30 on dist-test-slave-5s2t"
server_key: "2be256d4a3bac1c76e0932980b9e3d62"
server_key_iv: "d9ea8ca056be58d3f08261612f35d717"
server_key_version: "encryptionkey@0"
I20260927 15:12:30.250355 24618 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790521920546562-17952-0/minicluster-data/master-2/wal/instance:
uuid: "3b1c4bd139bf4929b313361ea24d3eab"
format_stamp: "Formatted at 2026-09-27 15:12:30 on dist-test-slave-5s2t"
server_key: "2be256d4a3bac1c76e0932980b9e3d62"
server_key_iv: "d9ea8ca056be58d3f08261612f35d717"
server_key_version: "encryptionkey@0"
I20260927 15:12:30.253818 24618 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.004s
I20260927 15:12:30.256130 24711 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260927 15:12:30.257290 24618 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260927 15:12:30.257396 24618 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790521920546562-17952-0/minicluster-data/master-2/data,/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790521920546562-17952-0/minicluster-data/master-2/wal
uuid: "3b1c4bd139bf4929b313361ea24d3eab"
format_stamp: "Formatted at 2026-09-27 15:12:30 on dist-test-slave-5s2t"
server_key: "2be256d4a3bac1c76e0932980b9e3d62"
server_key_iv: "d9ea8ca056be58d3f08261612f35d717"
server_key_version: "encryptionkey@0"
I20260927 15:12:30.257493 24618 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790521920546562-17952-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790521920546562-17952-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790521920546562-17952-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260927 15:12:30.269501 24618 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260927 15:12:30.272392 24618 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260927 15:12:30.272571 24618 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260927 15:12:30.279367 24618 rpc_server.cc:307] RPC server started. Bound to: 127.17.136.60:40351
I20260927 15:12:30.279625 24763 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.136.60:40351 every 8 connection(s)
I20260927 15:12:30.280335 24618 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790521920546562-17952-0/minicluster-data/master-2/data/info.pb
I20260927 15:12:30.282963 24764 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:12:30.286502 24764 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.17.136.62" port: 33401 } has no permanent_uuid. Determining permanent_uuid...
I20260927 15:12:30.288851 17952 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu as pid 24618
Sep 27 15:12:30 dist-test-slave-5s2t krb5kdc[24001](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790521950, etypes {rep=17 tkt=17 ses=17}, oryx/127.17.136.60@KRBTEST.COM for oryx/127.17.136.62@KRBTEST.COM
Sep 27 15:12:30 dist-test-slave-5s2t krb5kdc[24001](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790521948, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.17.136.60@KRBTEST.COM
I20260927 15:12:30.300119 24085 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:30.288247 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39674 (local address 127.17.136.62:33401)
0927 15:12:30.288401 (+ 154us) server_negotiation.cc:206] Beginning negotiation
0927 15:12:30.288406 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0927 15:12:30.289172 (+ 766us) server_negotiation.cc:407] Connection header received
0927 15:12:30.290182 (+ 1010us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:12:30.290185 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:12:30.290231 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:12:30.290321 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0927 15:12:30.291308 (+ 987us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:30.292112 (+ 804us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:30.293405 (+ 1293us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:30.293734 (+ 329us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:30.293834 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:30.296639 (+ 2805us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0927 15:12:30.296643 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0927 15:12:30.296646 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0927 15:12:30.296674 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0927 15:12:30.298075 (+ 1401us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:12:30.298582 (+ 507us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:12:30.298584 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:12:30.298585 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:12:30.298647 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:12:30.298989 (+ 342us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:12:30.298992 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:12:30.298994 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:12:30.299179 (+ 185us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0927 15:12:30.299284 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0927 15:12:30.299848 (+ 564us) server_negotiation.cc:299] Negotiation successful
0927 15:12:30.299966 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260927 15:12:30.301355 24767 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:30.289571 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56166 (local address 127.17.136.60:40351)
0927 15:12:30.289821 (+ 250us) server_negotiation.cc:206] Beginning negotiation
0927 15:12:30.289828 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0927 15:12:30.289859 (+ 31us) server_negotiation.cc:407] Connection header received
0927 15:12:30.290007 (+ 148us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:12:30.290020 (+ 13us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:12:30.290213 (+ 193us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:12:30.290371 (+ 158us) server_negotiation.cc:226] Negotiated authn=SASL
0927 15:12:30.291140 (+ 769us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:30.292363 (+ 1223us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:30.293432 (+ 1069us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:30.293970 (+ 538us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:30.294066 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:30.297017 (+ 2951us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0927 15:12:30.297024 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0927 15:12:30.297037 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0927 15:12:30.297061 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0927 15:12:30.298714 (+ 1653us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:12:30.299082 (+ 368us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:12:30.299087 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:12:30.299088 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:12:30.299154 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:12:30.299412 (+ 258us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:12:30.299415 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:12:30.299416 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:12:30.299666 (+ 250us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0927 15:12:30.299860 (+ 194us) server_negotiation.cc:1035] Waiting for connection context
0927 15:12:30.300025 (+ 165us) server_negotiation.cc:299] Negotiation successful
0927 15:12:30.300402 (+ 377us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":1,"server-negotiator.queue_time_us":161,"thread_start_us":83,"threads_started":1}
I20260927 15:12:30.301365 24766 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:30.288548 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.62:33401 (local address 127.0.0.1:39674)
0927 15:12:30.289019 (+ 471us) negotiation.cc:107] Waiting for socket to connect
0927 15:12:30.289068 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0927 15:12:30.290008 (+ 940us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0927 15:12:30.290367 (+ 359us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0927 15:12:30.290372 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0927 15:12:30.290785 (+ 413us) client_negotiation.cc:189] Negotiated authn=SASL
0927 15:12:30.291176 (+ 391us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:12:30.291189 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:12:30.292217 (+ 1028us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:12:30.292220 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:12:30.293300 (+ 1080us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:12:30.293309 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:12:30.293927 (+ 618us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:12:30.293931 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:12:30.294073 (+ 142us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:30.294803 (+ 730us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0927 15:12:30.294872 (+ 69us) client_negotiation.cc:656] calling sasl_client_start()
0927 15:12:30.296496 (+ 1624us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0927 15:12:30.298171 (+ 1675us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0927 15:12:30.298178 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0927 15:12:30.298187 (+ 9us) client_negotiation.cc:760] calling sasl_client_step()
0927 15:12:30.298499 (+ 312us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0927 15:12:30.298714 (+ 215us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0927 15:12:30.298717 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0927 15:12:30.298719 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0927 15:12:30.298886 (+ 167us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0927 15:12:30.299300 (+ 414us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0927 15:12:30.299307 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0927 15:12:30.299584 (+ 277us) client_negotiation.cc:769] Sending connection context
0927 15:12:30.300320 (+ 736us) client_negotiation.cc:240] Negotiation successful
0927 15:12:30.300476 (+ 156us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":260,"mutex_wait_us":54,"spinlock_wait_cycles":768,"thread_start_us":102,"threads_started":1}
I20260927 15:12:30.303267 24764 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.17.136.61" port: 42371 } has no permanent_uuid. Determining permanent_uuid...
Sep 27 15:12:30 dist-test-slave-5s2t krb5kdc[24001](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790521950, etypes {rep=17 tkt=17 ses=17}, oryx/127.17.136.60@KRBTEST.COM for oryx/127.17.136.61@KRBTEST.COM
I20260927 15:12:30.311098 24766 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:30.303672 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.61:42371 (local address 127.0.0.1:35544)
0927 15:12:30.304013 (+ 341us) negotiation.cc:107] Waiting for socket to connect
0927 15:12:30.304024 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0927 15:12:30.304078 (+ 54us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0927 15:12:30.304260 (+ 182us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0927 15:12:30.304262 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0927 15:12:30.304373 (+ 111us) client_negotiation.cc:189] Negotiated authn=SASL
0927 15:12:30.304452 (+ 79us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:12:30.304456 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:12:30.305406 (+ 950us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:12:30.305409 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:12:30.305920 (+ 511us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:12:30.305927 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:12:30.306384 (+ 457us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:12:30.306388 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:12:30.306481 (+ 93us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:30.306802 (+ 321us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0927 15:12:30.306812 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0927 15:12:30.308022 (+ 1210us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0927 15:12:30.309727 (+ 1705us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0927 15:12:30.309731 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0927 15:12:30.309733 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0927 15:12:30.309925 (+ 192us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0927 15:12:30.310182 (+ 257us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0927 15:12:30.310185 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0927 15:12:30.310187 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0927 15:12:30.310267 (+ 80us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0927 15:12:30.310621 (+ 354us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0927 15:12:30.310624 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0927 15:12:30.310716 (+ 92us) client_negotiation.cc:769] Sending connection context
0927 15:12:30.310806 (+ 90us) client_negotiation.cc:240] Negotiation successful
0927 15:12:30.310934 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":281}
I20260927 15:12:30.311153 24768 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:30.303799 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35544 (local address 127.17.136.61:42371)
0927 15:12:30.304044 (+ 245us) server_negotiation.cc:206] Beginning negotiation
0927 15:12:30.304054 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0927 15:12:30.304066 (+ 12us) server_negotiation.cc:407] Connection header received
0927 15:12:30.304137 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:12:30.304139 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:12:30.304176 (+ 37us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:12:30.304247 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0927 15:12:30.304541 (+ 294us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:30.305312 (+ 771us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:30.306008 (+ 696us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:30.306283 (+ 275us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:30.306362 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:30.308167 (+ 1805us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0927 15:12:30.308170 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0927 15:12:30.308172 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0927 15:12:30.308221 (+ 49us) server_negotiation.cc:922] calling sasl_server_start()
0927 15:12:30.309622 (+ 1401us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:12:30.310015 (+ 393us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:12:30.310019 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:12:30.310021 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:12:30.310100 (+ 79us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:12:30.310347 (+ 247us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:12:30.310351 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:12:30.310352 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:12:30.310531 (+ 179us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0927 15:12:30.310622 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0927 15:12:30.310875 (+ 253us) server_negotiation.cc:299] Negotiation successful
0927 15:12:30.310990 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":180,"thread_start_us":101,"threads_started":1}
I20260927 15:12:30.311879 24764 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.17.136.60" port: 40351 } has no permanent_uuid. Determining permanent_uuid...
Sep 27 15:12:30 dist-test-slave-5s2t krb5kdc[24001](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790521950, etypes {rep=17 tkt=17 ses=17}, oryx/127.17.136.60@KRBTEST.COM for oryx/127.17.136.60@KRBTEST.COM
I20260927 15:12:30.319626 24766 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:30.312270 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.60:40351 (local address 127.0.0.1:56168)
0927 15:12:30.312373 (+ 103us) negotiation.cc:107] Waiting for socket to connect
0927 15:12:30.312386 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0927 15:12:30.312460 (+ 74us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0927 15:12:30.312655 (+ 195us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0927 15:12:30.312658 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0927 15:12:30.312801 (+ 143us) client_negotiation.cc:189] Negotiated authn=SASL
0927 15:12:30.312866 (+ 65us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:12:30.312871 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:12:30.313581 (+ 710us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:12:30.313585 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:12:30.314174 (+ 589us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:12:30.314183 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:12:30.314606 (+ 423us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:12:30.314609 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:12:30.314731 (+ 122us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:30.315116 (+ 385us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0927 15:12:30.315129 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0927 15:12:30.316485 (+ 1356us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0927 15:12:30.317989 (+ 1504us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0927 15:12:30.317993 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0927 15:12:30.317995 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0927 15:12:30.318271 (+ 276us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0927 15:12:30.318552 (+ 281us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0927 15:12:30.318555 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0927 15:12:30.318557 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0927 15:12:30.318644 (+ 87us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0927 15:12:30.319037 (+ 393us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0927 15:12:30.319040 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0927 15:12:30.319132 (+ 92us) client_negotiation.cc:769] Sending connection context
0927 15:12:30.319237 (+ 105us) client_negotiation.cc:240] Negotiation successful
0927 15:12:30.319404 (+ 167us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":39,"mutex_wait_us":31}
I20260927 15:12:30.319641 24767 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:30.312366 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56168 (local address 127.17.136.60:40351)
0927 15:12:30.312460 (+ 94us) server_negotiation.cc:206] Beginning negotiation
0927 15:12:30.312464 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0927 15:12:30.312478 (+ 14us) server_negotiation.cc:407] Connection header received
0927 15:12:30.312534 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:12:30.312537 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:12:30.312573 (+ 36us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:12:30.312637 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0927 15:12:30.312984 (+ 347us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:30.313471 (+ 487us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:30.314297 (+ 826us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:30.314521 (+ 224us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:30.314602 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:30.316609 (+ 2007us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0927 15:12:30.316614 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0927 15:12:30.316616 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0927 15:12:30.316640 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0927 15:12:30.317859 (+ 1219us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:12:30.318376 (+ 517us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:12:30.318380 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:12:30.318381 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:12:30.318451 (+ 70us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:12:30.318722 (+ 271us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:12:30.318725 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:12:30.318727 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:12:30.318900 (+ 173us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0927 15:12:30.318981 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0927 15:12:30.319318 (+ 337us) server_negotiation.cc:299] Negotiation successful
0927 15:12:30.319481 (+ 163us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":54,"server-negotiator.queue_time_us":36}
I20260927 15:12:30.324188 24764 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3b1c4bd139bf4929b313361ea24d3eab: Bootstrap starting.
I20260927 15:12:30.326310 24764 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3b1c4bd139bf4929b313361ea24d3eab: Neither blocks nor log segments found. Creating new log.
I20260927 15:12:30.326937 24764 log.cc:824] T 00000000000000000000000000000000 P 3b1c4bd139bf4929b313361ea24d3eab: Log is configured to *not* fsync() on all Append() calls
I20260927 15:12:30.328706 24764 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3b1c4bd139bf4929b313361ea24d3eab: No bootstrap required, opened a new log
I20260927 15:12:30.331547 24764 raft_consensus.cc:348] T 00000000000000000000000000000000 P 3b1c4bd139bf4929b313361ea24d3eab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d94e22c8fa74c10a9732bb2af78fb98" member_type: VOTER last_known_addr { host: "127.17.136.62" port: 33401 } } peers { permanent_uuid: "cc335ec49c7b46d8b3bfc44fc1f32579" member_type: VOTER last_known_addr { host: "127.17.136.61" port: 42371 } } peers { permanent_uuid: "3b1c4bd139bf4929b313361ea24d3eab" member_type: VOTER last_known_addr { host: "127.17.136.60" port: 40351 } }
I20260927 15:12:30.331743 24764 raft_consensus.cc:374] T 00000000000000000000000000000000 P 3b1c4bd139bf4929b313361ea24d3eab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:12:30.331799 24764 raft_consensus.cc:729] T 00000000000000000000000000000000 P 3b1c4bd139bf4929b313361ea24d3eab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3b1c4bd139bf4929b313361ea24d3eab, State: Initialized, Role: FOLLOWER
I20260927 15:12:30.332178 24764 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3b1c4bd139bf4929b313361ea24d3eab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d94e22c8fa74c10a9732bb2af78fb98" member_type: VOTER last_known_addr { host: "127.17.136.62" port: 33401 } } peers { permanent_uuid: "cc335ec49c7b46d8b3bfc44fc1f32579" member_type: VOTER last_known_addr { host: "127.17.136.61" port: 42371 } } peers { permanent_uuid: "3b1c4bd139bf4929b313361ea24d3eab" member_type: VOTER last_known_addr { host: "127.17.136.60" port: 40351 } }
I20260927 15:12:30.332563 24770 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3b1c4bd139bf4929b313361ea24d3eab [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d94e22c8fa74c10a9732bb2af78fb98" member_type: VOTER last_known_addr { host: "127.17.136.62" port: 33401 } } peers { permanent_uuid: "cc335ec49c7b46d8b3bfc44fc1f32579" member_type: VOTER last_known_addr { host: "127.17.136.61" port: 42371 } } peers { permanent_uuid: "3b1c4bd139bf4929b313361ea24d3eab" member_type: VOTER last_known_addr { host: "127.17.136.60" port: 40351 } } }
I20260927 15:12:30.332669 24770 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3b1c4bd139bf4929b313361ea24d3eab [sys.catalog]: This master's current role is: FOLLOWER
I20260927 15:12:30.333221 24764 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3b1c4bd139bf4929b313361ea24d3eab [sys.catalog]: configured and running, proceeding with master startup.
W20260927 15:12:30.337404 24781 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 3b1c4bd139bf4929b313361ea24d3eab: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260927 15:12:30.337477 24781 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260927 15:12:30.340790 24618 master_runner.cc:428] Detected that this master 3b1c4bd139bf4929b313361ea24d3eab is joining an existing cluster
I20260927 15:12:30.340844 24618 master_runner.cc:432] Initiating AddMaster RPC to add 127.17.136.60:40351
I20260927 15:12:30.354984 17952 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu with pid 24108
I20260927 15:12:30.361315 17952 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu
/tmp/dist-test-taskiFOyeW/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790521920546562-17952-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790521920546562-17952-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790521920546562-17952-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790521920546562-17952-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.136.1:41807
--local_ip_for_outbound_sockets=127.17.136.1
--tserver_master_addrs=127.17.136.62:33401
--webserver_port=37655
--webserver_interface=127.17.136.1
--keytab_file=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790521920546562-17952-0/krb5kdc/oryx_127.17.136.1.keytab
--principal=oryx/127.17.136.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.136.20:43561
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.17.136.62:33401,127.17.136.61:42371
--tserver_master_addrs=127.17.136.62:33401,127.17.136.61:42371,127.17.136.60:40351 with env {KRB5CCNAME=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790521920546562-17952-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790521920546562-17952-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790521920546562-17952-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260927 15:12:30.372341 24787 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:30.342981 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.60:40351 (local address 127.0.0.1:56176)
0927 15:12:30.343283 (+ 302us) negotiation.cc:107] Waiting for socket to connect
0927 15:12:30.343297 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0927 15:12:30.343388 (+ 91us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0927 15:12:30.343647 (+ 259us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0927 15:12:30.343650 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0927 15:12:30.343871 (+ 221us) client_negotiation.cc:189] Negotiated authn=SASL
0927 15:12:30.344031 (+ 160us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:12:30.344038 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:12:30.344993 (+ 955us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:12:30.344996 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:12:30.345866 (+ 870us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:12:30.345878 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:12:30.346556 (+ 678us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:12:30.346560 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:12:30.346649 (+ 89us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:30.347185 (+ 536us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0927 15:12:30.347202 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0927 15:12:30.347691 (+ 489us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0927 15:12:30.369854 (+ 22163us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0927 15:12:30.369858 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0927 15:12:30.369860 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0927 15:12:30.370191 (+ 331us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0927 15:12:30.370827 (+ 636us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0927 15:12:30.370830 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0927 15:12:30.370832 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0927 15:12:30.370933 (+ 101us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0927 15:12:30.371360 (+ 427us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0927 15:12:30.371362 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0927 15:12:30.371648 (+ 286us) client_negotiation.cc:769] Sending connection context
0927 15:12:30.371749 (+ 101us) client_negotiation.cc:240] Negotiation successful
0927 15:12:30.372140 (+ 391us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":208,"mutex_wait_us":2,"spinlock_wait_cycles":3328,"thread_start_us":130,"threads_started":1}
I20260927 15:12:30.372937 24767 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:30.343014 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56176 (local address 127.17.136.60:40351)
0927 15:12:30.343104 (+ 90us) server_negotiation.cc:206] Beginning negotiation
0927 15:12:30.343109 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0927 15:12:30.343360 (+ 251us) server_negotiation.cc:407] Connection header received
0927 15:12:30.343483 (+ 123us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:12:30.343486 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:12:30.343534 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:12:30.343621 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0927 15:12:30.344127 (+ 506us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:30.344866 (+ 739us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:30.345994 (+ 1128us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:30.346313 (+ 319us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:30.346403 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:30.347827 (+ 1424us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0927 15:12:30.347831 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0927 15:12:30.347834 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0927 15:12:30.347858 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0927 15:12:30.369718 (+ 21860us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:12:30.370653 (+ 935us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:12:30.370656 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:12:30.370658 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:12:30.370737 (+ 79us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:12:30.371016 (+ 279us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:12:30.371018 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:12:30.371020 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:12:30.371226 (+ 206us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0927 15:12:30.371328 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0927 15:12:30.372681 (+ 1353us) server_negotiation.cc:299] Negotiation successful
0927 15:12:30.372786 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260927 15:12:30.373178 24768 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:30.343937 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35558 (local address 127.17.136.61:42371)
0927 15:12:30.344054 (+ 117us) server_negotiation.cc:206] Beginning negotiation
0927 15:12:30.344058 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0927 15:12:30.344437 (+ 379us) server_negotiation.cc:407] Connection header received
0927 15:12:30.344597 (+ 160us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:12:30.344601 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:12:30.344649 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:12:30.344694 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0927 15:12:30.345262 (+ 568us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:30.346042 (+ 780us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:30.347803 (+ 1761us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:30.348130 (+ 327us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:30.348188 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:30.368115 (+ 19927us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0927 15:12:30.368120 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0927 15:12:30.368123 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0927 15:12:30.368158 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0927 15:12:30.369717 (+ 1559us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:12:30.370584 (+ 867us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:12:30.370588 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:12:30.370591 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:12:30.370674 (+ 83us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:12:30.370993 (+ 319us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:12:30.370996 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:12:30.370998 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:12:30.371217 (+ 219us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0927 15:12:30.371324 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0927 15:12:30.372886 (+ 1562us) server_negotiation.cc:299] Negotiation successful
0927 15:12:30.373028 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260927 15:12:30.373620 24788 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:30.343831 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.61:42371 (local address 127.0.0.1:35558)
0927 15:12:30.344372 (+ 541us) negotiation.cc:107] Waiting for socket to connect
0927 15:12:30.344383 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0927 15:12:30.344497 (+ 114us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0927 15:12:30.344813 (+ 316us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0927 15:12:30.344815 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0927 15:12:30.345044 (+ 229us) client_negotiation.cc:189] Negotiated authn=SASL
0927 15:12:30.345142 (+ 98us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:12:30.345149 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:12:30.346205 (+ 1056us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:12:30.346208 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:12:30.347693 (+ 1485us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:12:30.347700 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:12:30.348326 (+ 626us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:12:30.348329 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:12:30.348407 (+ 78us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:30.348759 (+ 352us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0927 15:12:30.348768 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0927 15:12:30.367863 (+ 19095us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0927 15:12:30.369853 (+ 1990us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0927 15:12:30.369856 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0927 15:12:30.369859 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0927 15:12:30.370469 (+ 610us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0927 15:12:30.370788 (+ 319us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0927 15:12:30.370791 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0927 15:12:30.370793 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0927 15:12:30.370878 (+ 85us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0927 15:12:30.371390 (+ 512us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0927 15:12:30.371393 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0927 15:12:30.371951 (+ 558us) client_negotiation.cc:769] Sending connection context
0927 15:12:30.373316 (+ 1365us) client_negotiation.cc:240] Negotiation successful
0927 15:12:30.373452 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":486,"mutex_wait_us":103,"spinlock_wait_cycles":1792,"thread_start_us":62,"threads_started":1}
I20260927 15:12:30.375963 24789 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:30.343536 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.62:33401 (local address 127.0.0.1:39690)
0927 15:12:30.344066 (+ 530us) negotiation.cc:107] Waiting for socket to connect
0927 15:12:30.344078 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0927 15:12:30.344186 (+ 108us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0927 15:12:30.344489 (+ 303us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0927 15:12:30.344491 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0927 15:12:30.344663 (+ 172us) client_negotiation.cc:189] Negotiated authn=SASL
0927 15:12:30.344771 (+ 108us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:12:30.344778 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:12:30.345741 (+ 963us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:12:30.345744 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:12:30.346595 (+ 851us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:12:30.346605 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:12:30.347634 (+ 1029us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:12:30.347637 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:12:30.347717 (+ 80us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:30.348255 (+ 538us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0927 15:12:30.348267 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0927 15:12:30.370079 (+ 21812us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0927 15:12:30.374316 (+ 4237us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0927 15:12:30.374319 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0927 15:12:30.374321 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0927 15:12:30.374553 (+ 232us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0927 15:12:30.374888 (+ 335us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0927 15:12:30.374891 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0927 15:12:30.374893 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0927 15:12:30.374985 (+ 92us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0927 15:12:30.375477 (+ 492us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0927 15:12:30.375481 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0927 15:12:30.375574 (+ 93us) client_negotiation.cc:769] Sending connection context
0927 15:12:30.375670 (+ 96us) client_negotiation.cc:240] Negotiation successful
0927 15:12:30.375795 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":479,"mutex_wait_us":23,"thread_start_us":71,"threads_started":1}
I20260927 15:12:30.376029 24085 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:30.343351 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39690 (local address 127.17.136.62:33401)
0927 15:12:30.343459 (+ 108us) server_negotiation.cc:206] Beginning negotiation
0927 15:12:30.343463 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0927 15:12:30.344134 (+ 671us) server_negotiation.cc:407] Connection header received
0927 15:12:30.344269 (+ 135us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:12:30.344272 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:12:30.344320 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:12:30.344385 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0927 15:12:30.344883 (+ 498us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:30.345621 (+ 738us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:30.346727 (+ 1106us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:30.347428 (+ 701us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:30.347499 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:30.370244 (+ 22745us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0927 15:12:30.370248 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0927 15:12:30.370251 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0927 15:12:30.370281 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0927 15:12:30.372703 (+ 2422us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:12:30.374661 (+ 1958us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:12:30.374665 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:12:30.374667 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:12:30.374782 (+ 115us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:12:30.375090 (+ 308us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:12:30.375095 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:12:30.375105 (+ 10us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:12:30.375373 (+ 268us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0927 15:12:30.375469 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0927 15:12:30.375729 (+ 260us) server_negotiation.cc:299] Negotiation successful
0927 15:12:30.375874 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
Sep 27 15:12:30 dist-test-slave-5s2t krb5kdc[24001](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790521949, etypes {rep=17 tkt=17 ses=17}, oryx/127.17.136.62@KRBTEST.COM for oryx/127.17.136.60@KRBTEST.COM
I20260927 15:12:30.389031 24603 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:30.379668 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.60:40351 (local address 127.0.0.1:56182)
0927 15:12:30.379770 (+ 102us) negotiation.cc:107] Waiting for socket to connect
0927 15:12:30.379783 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0927 15:12:30.379855 (+ 72us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0927 15:12:30.380803 (+ 948us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0927 15:12:30.380806 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0927 15:12:30.381096 (+ 290us) client_negotiation.cc:189] Negotiated authn=SASL
0927 15:12:30.381202 (+ 106us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:12:30.381209 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:12:30.382189 (+ 980us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:12:30.382192 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:12:30.383108 (+ 916us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:12:30.383118 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:12:30.383683 (+ 565us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:12:30.383687 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:12:30.383778 (+ 91us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:30.384230 (+ 452us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0927 15:12:30.384243 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0927 15:12:30.385699 (+ 1456us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0927 15:12:30.387594 (+ 1895us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0927 15:12:30.387598 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0927 15:12:30.387600 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0927 15:12:30.387826 (+ 226us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0927 15:12:30.388074 (+ 248us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0927 15:12:30.388077 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0927 15:12:30.388079 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0927 15:12:30.388162 (+ 83us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0927 15:12:30.388533 (+ 371us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0927 15:12:30.388536 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0927 15:12:30.388628 (+ 92us) client_negotiation.cc:769] Sending connection context
0927 15:12:30.388726 (+ 98us) client_negotiation.cc:240] Negotiation successful
0927 15:12:30.388857 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":33}
I20260927 15:12:30.389041 24767 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:30.379748 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56182 (local address 127.17.136.60:40351)
0927 15:12:30.380556 (+ 808us) server_negotiation.cc:206] Beginning negotiation
0927 15:12:30.380560 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0927 15:12:30.380574 (+ 14us) server_negotiation.cc:407] Connection header received
0927 15:12:30.380635 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:12:30.380638 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:12:30.380685 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:12:30.380762 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0927 15:12:30.381312 (+ 550us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:30.382089 (+ 777us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:30.383219 (+ 1130us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:30.383571 (+ 352us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:30.383658 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:30.385858 (+ 2200us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0927 15:12:30.385863 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0927 15:12:30.385866 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0927 15:12:30.385891 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0927 15:12:30.387481 (+ 1590us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:12:30.387912 (+ 431us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:12:30.387916 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:12:30.387918 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:12:30.387995 (+ 77us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:12:30.388245 (+ 250us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:12:30.388249 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:12:30.388250 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:12:30.388448 (+ 198us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0927 15:12:30.388535 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0927 15:12:30.388777 (+ 242us) server_negotiation.cc:299] Negotiation successful
0927 15:12:30.388891 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":738}
I20260927 15:12:30.390394 24044 catalog_manager.cc:6979] Initiating ChangeConfig request to add master 127.17.136.60:40351: tablet_id: "00000000000000000000000000000000"
type: ADD_PEER
server {
permanent_uuid: "3b1c4bd139bf4929b313361ea24d3eab"
member_type: NON_VOTER
last_known_addr {
host: "127.17.136.60"
port: 40351
}
attrs {
promote: true
}
}
dest_uuid: "5d94e22c8fa74c10a9732bb2af78fb98"
cas_config_opid_index: 5
I20260927 15:12:30.390964 24044 consensus_queue.cc:237] T 00000000000000000000000000000000 P 5d94e22c8fa74c10a9732bb2af78fb98 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 1.5, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "5d94e22c8fa74c10a9732bb2af78fb98" member_type: VOTER last_known_addr { host: "127.17.136.62" port: 33401 } } peers { permanent_uuid: "cc335ec49c7b46d8b3bfc44fc1f32579" member_type: NON_VOTER last_known_addr { host: "127.17.136.61" port: 42371 } attrs { promote: true } } peers { permanent_uuid: "3b1c4bd139bf4929b313361ea24d3eab" member_type: NON_VOTER last_known_addr { host: "127.17.136.60" port: 40351 } attrs { promote: true } }
I20260927 15:12:30.392105 24606 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 5d94e22c8fa74c10a9732bb2af78fb98 [term 1 LEADER]: Committing config change with OpId 1.6: config changed from index 5 to 6, NON_VOTER 3b1c4bd139bf4929b313361ea24d3eab (127.17.136.60) added. New config: { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "5d94e22c8fa74c10a9732bb2af78fb98" member_type: VOTER last_known_addr { host: "127.17.136.62" port: 33401 } } peers { permanent_uuid: "cc335ec49c7b46d8b3bfc44fc1f32579" member_type: NON_VOTER last_known_addr { host: "127.17.136.61" port: 42371 } attrs { promote: true } } peers { permanent_uuid: "3b1c4bd139bf4929b313361ea24d3eab" member_type: NON_VOTER last_known_addr { host: "127.17.136.60" port: 40351 } attrs { promote: true } } }
I20260927 15:12:30.393507 24606 catalog_manager.cc:6983] Successfully completed master ChangeConfig request to add master 127.17.136.60:40351
I20260927 15:12:30.393666 24606 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5d94e22c8fa74c10a9732bb2af78fb98 [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "5d94e22c8fa74c10a9732bb2af78fb98" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "5d94e22c8fa74c10a9732bb2af78fb98" member_type: VOTER last_known_addr { host: "127.17.136.62" port: 33401 } } peers { permanent_uuid: "cc335ec49c7b46d8b3bfc44fc1f32579" member_type: NON_VOTER last_known_addr { host: "127.17.136.61" port: 42371 } attrs { promote: true } } peers { permanent_uuid: "3b1c4bd139bf4929b313361ea24d3eab" member_type: NON_VOTER last_known_addr { host: "127.17.136.60" port: 40351 } attrs { promote: true } } }
I20260927 15:12:30.393767 24606 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5d94e22c8fa74c10a9732bb2af78fb98 [sys.catalog]: This master's current role is: LEADER
I20260927 15:12:30.394446 24618 master.cc:537] Master@127.17.136.60:40351 shutting down...
I20260927 15:12:30.394726 24738 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3b1c4bd139bf4929b313361ea24d3eab [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:12:30.396202 24738 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 3b1c4bd139bf4929b313361ea24d3eab [term 1 FOLLOWER]: Refusing update from remote peer 5d94e22c8fa74c10a9732bb2af78fb98: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20260927 15:12:30.397017 24604 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 5d94e22c8fa74c10a9732bb2af78fb98 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3b1c4bd139bf4929b313361ea24d3eab" member_type: NON_VOTER last_known_addr { host: "127.17.136.60" port: 40351 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 0, Time since last communication: 0.000s
W20260927 15:12:30.399660 24030 consensus_peers.cc:487] T 00000000000000000000000000000000 P 5d94e22c8fa74c10a9732bb2af78fb98 -> Peer 3b1c4bd139bf4929b313361ea24d3eab (127.17.136.60:40351): Couldn't send request to peer 3b1c4bd139bf4929b313361ea24d3eab. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master. This is attempt 1: this message will repeat every 5th retry.
I20260927 15:12:30.400368 24618 raft_consensus.cc:2229] T 00000000000000000000000000000000 P 3b1c4bd139bf4929b313361ea24d3eab [term 1 FOLLOWER]: Raft consensus shutting down.
I20260927 15:12:30.400676 24618 raft_consensus.cc:2258] T 00000000000000000000000000000000 P 3b1c4bd139bf4929b313361ea24d3eab [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 15:12:30.400825 24618 tablet_replica.cc:330] T 00000000000000000000000000000000 P 3b1c4bd139bf4929b313361ea24d3eab: stopping tablet replica
I20260927 15:12:30.402567 24768 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:30.393930 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35560 (local address 127.17.136.61:42371)
0927 15:12:30.394068 (+ 138us) server_negotiation.cc:206] Beginning negotiation
0927 15:12:30.394073 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0927 15:12:30.397725 (+ 3652us) server_negotiation.cc:407] Connection header received
0927 15:12:30.397778 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:12:30.397781 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:12:30.397838 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:12:30.397911 (+ 73us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0927 15:12:30.398274 (+ 363us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:30.399021 (+ 747us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:30.400735 (+ 1714us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:30.401493 (+ 758us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:30.401571 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:30.401712 (+ 141us) server_negotiation.cc:1035] Waiting for connection context
0927 15:12:30.402388 (+ 676us) server_negotiation.cc:299] Negotiation successful
0927 15:12:30.402458 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260927 15:12:30.402207 24603 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:30.392242 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.61:42371 (local address 127.0.0.1:35560)
0927 15:12:30.397542 (+ 5300us) negotiation.cc:107] Waiting for socket to connect
0927 15:12:30.397558 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0927 15:12:30.397644 (+ 86us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0927 15:12:30.398050 (+ 406us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0927 15:12:30.398053 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0927 15:12:30.398069 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0927 15:12:30.398153 (+ 84us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:12:30.398159 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:12:30.399345 (+ 1186us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:12:30.399348 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:12:30.400598 (+ 1250us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:12:30.400609 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:12:30.401803 (+ 1194us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:12:30.401806 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:12:30.401895 (+ 89us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:30.401937 (+ 42us) client_negotiation.cc:769] Sending connection context
0927 15:12:30.402017 (+ 80us) client_negotiation.cc:240] Negotiation successful
0927 15:12:30.402085 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":5218}
I20260927 15:12:30.403218 24647 raft_consensus.cc:1261] T 00000000000000000000000000000000 P cc335ec49c7b46d8b3bfc44fc1f32579 [term 1 LEARNER]: Refusing update from remote peer 5d94e22c8fa74c10a9732bb2af78fb98: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20260927 15:12:30.403749 24604 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 5d94e22c8fa74c10a9732bb2af78fb98 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc335ec49c7b46d8b3bfc44fc1f32579" member_type: NON_VOTER last_known_addr { host: "127.17.136.61" port: 42371 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260927 15:12:30.405485 24647 raft_consensus.cc:2932] T 00000000000000000000000000000000 P cc335ec49c7b46d8b3bfc44fc1f32579 [term 1 LEARNER]: Committing config change with OpId 1.6: config changed from index 5 to 6, NON_VOTER 3b1c4bd139bf4929b313361ea24d3eab (127.17.136.60) added. New config: { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "5d94e22c8fa74c10a9732bb2af78fb98" member_type: VOTER last_known_addr { host: "127.17.136.62" port: 33401 } } peers { permanent_uuid: "cc335ec49c7b46d8b3bfc44fc1f32579" member_type: NON_VOTER last_known_addr { host: "127.17.136.61" port: 42371 } attrs { promote: true } } peers { permanent_uuid: "3b1c4bd139bf4929b313361ea24d3eab" member_type: NON_VOTER last_known_addr { host: "127.17.136.60" port: 40351 } attrs { promote: true } } }
I20260927 15:12:30.407697 24685 sys_catalog.cc:455] T 00000000000000000000000000000000 P cc335ec49c7b46d8b3bfc44fc1f32579 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5d94e22c8fa74c10a9732bb2af78fb98. Latest consensus state: current_term: 1 leader_uuid: "5d94e22c8fa74c10a9732bb2af78fb98" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "5d94e22c8fa74c10a9732bb2af78fb98" member_type: VOTER last_known_addr { host: "127.17.136.62" port: 33401 } } peers { permanent_uuid: "cc335ec49c7b46d8b3bfc44fc1f32579" member_type: NON_VOTER last_known_addr { host: "127.17.136.61" port: 42371 } attrs { promote: true } } peers { permanent_uuid: "3b1c4bd139bf4929b313361ea24d3eab" member_type: NON_VOTER last_known_addr { host: "127.17.136.60" port: 40351 } attrs { promote: true } } }
I20260927 15:12:30.407805 24685 sys_catalog.cc:458] T 00000000000000000000000000000000 P cc335ec49c7b46d8b3bfc44fc1f32579 [sys.catalog]: This master's current role is: LEARNER
I20260927 15:12:30.407902 24685 sys_catalog.cc:455] T 00000000000000000000000000000000 P cc335ec49c7b46d8b3bfc44fc1f32579 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "5d94e22c8fa74c10a9732bb2af78fb98" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "5d94e22c8fa74c10a9732bb2af78fb98" member_type: VOTER last_known_addr { host: "127.17.136.62" port: 33401 } } peers { permanent_uuid: "cc335ec49c7b46d8b3bfc44fc1f32579" member_type: NON_VOTER last_known_addr { host: "127.17.136.61" port: 42371 } attrs { promote: true } } peers { permanent_uuid: "3b1c4bd139bf4929b313361ea24d3eab" member_type: NON_VOTER last_known_addr { host: "127.17.136.60" port: 40351 } attrs { promote: true } } }
I20260927 15:12:30.407967 24685 sys_catalog.cc:458] T 00000000000000000000000000000000 P cc335ec49c7b46d8b3bfc44fc1f32579 [sys.catalog]: This master's current role is: LEARNER
I20260927 15:12:30.408712 24606 raft_consensus.cc:1050] T 00000000000000000000000000000000 P 5d94e22c8fa74c10a9732bb2af78fb98: attempting to promote NON_VOTER cc335ec49c7b46d8b3bfc44fc1f32579 to VOTER
I20260927 15:12:30.409144 24606 consensus_queue.cc:237] T 00000000000000000000000000000000 P 5d94e22c8fa74c10a9732bb2af78fb98 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 1.6, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "5d94e22c8fa74c10a9732bb2af78fb98" member_type: VOTER last_known_addr { host: "127.17.136.62" port: 33401 } } peers { permanent_uuid: "cc335ec49c7b46d8b3bfc44fc1f32579" member_type: VOTER last_known_addr { host: "127.17.136.61" port: 42371 } attrs { promote: false } } peers { permanent_uuid: "3b1c4bd139bf4929b313361ea24d3eab" member_type: NON_VOTER last_known_addr { host: "127.17.136.60" port: 40351 } attrs { promote: true } }
I20260927 15:12:30.410483 24647 raft_consensus.cc:1261] T 00000000000000000000000000000000 P cc335ec49c7b46d8b3bfc44fc1f32579 [term 1 LEARNER]: Refusing update from remote peer 5d94e22c8fa74c10a9732bb2af78fb98: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20260927 15:12:30.410918 24793 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 5d94e22c8fa74c10a9732bb2af78fb98 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc335ec49c7b46d8b3bfc44fc1f32579" member_type: VOTER last_known_addr { host: "127.17.136.61" port: 42371 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260927 15:12:30.411141 24603 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:30.410084 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.60:40351 (local address 127.0.0.1:56194)
0927 15:12:30.410938 (+ 854us) negotiation.cc:107] Waiting for socket to connect
0927 15:12:30.411011 (+ 73us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.136.60:40351: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":784}
I20260927 15:12:30.411969 24603 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:30.411730 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.60:40351 (local address 127.0.0.1:56202)
0927 15:12:30.411863 (+ 133us) negotiation.cc:107] Waiting for socket to connect
0927 15:12:30.411907 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.136.60:40351: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":69}
W20260927 15:12:30.412127 24030 consensus_peers.cc:487] T 00000000000000000000000000000000 P 5d94e22c8fa74c10a9732bb2af78fb98 -> Peer 3b1c4bd139bf4929b313361ea24d3eab (127.17.136.60:40351): Couldn't send request to peer 3b1c4bd139bf4929b313361ea24d3eab. Status: Network error: Client connection negotiation failed: client connection to 127.17.136.60:40351: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260927 15:12:30.412727 24604 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 5d94e22c8fa74c10a9732bb2af78fb98 [term 1 LEADER]: Committing config change with OpId 1.7: config changed from index 6 to 7, cc335ec49c7b46d8b3bfc44fc1f32579 (127.17.136.61) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "5d94e22c8fa74c10a9732bb2af78fb98" member_type: VOTER last_known_addr { host: "127.17.136.62" port: 33401 } } peers { permanent_uuid: "cc335ec49c7b46d8b3bfc44fc1f32579" member_type: VOTER last_known_addr { host: "127.17.136.61" port: 42371 } attrs { promote: false } } peers { permanent_uuid: "3b1c4bd139bf4929b313361ea24d3eab" member_type: NON_VOTER last_known_addr { host: "127.17.136.60" port: 40351 } attrs { promote: true } } }
I20260927 15:12:30.413162 24647 raft_consensus.cc:2932] T 00000000000000000000000000000000 P cc335ec49c7b46d8b3bfc44fc1f32579 [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, cc335ec49c7b46d8b3bfc44fc1f32579 (127.17.136.61) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "5d94e22c8fa74c10a9732bb2af78fb98" member_type: VOTER last_known_addr { host: "127.17.136.62" port: 33401 } } peers { permanent_uuid: "cc335ec49c7b46d8b3bfc44fc1f32579" member_type: VOTER last_known_addr { host: "127.17.136.61" port: 42371 } attrs { promote: false } } peers { permanent_uuid: "3b1c4bd139bf4929b313361ea24d3eab" member_type: NON_VOTER last_known_addr { host: "127.17.136.60" port: 40351 } attrs { promote: true } } }
I20260927 15:12:30.414247 24604 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5d94e22c8fa74c10a9732bb2af78fb98 [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "5d94e22c8fa74c10a9732bb2af78fb98" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "5d94e22c8fa74c10a9732bb2af78fb98" member_type: VOTER last_known_addr { host: "127.17.136.62" port: 33401 } } peers { permanent_uuid: "cc335ec49c7b46d8b3bfc44fc1f32579" member_type: VOTER last_known_addr { host: "127.17.136.61" port: 42371 } attrs { promote: false } } peers { permanent_uuid: "3b1c4bd139bf4929b313361ea24d3eab" member_type: NON_VOTER last_known_addr { host: "127.17.136.60" port: 40351 } attrs { promote: true } } }
I20260927 15:12:30.414338 24604 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5d94e22c8fa74c10a9732bb2af78fb98 [sys.catalog]: This master's current role is: LEADER
I20260927 15:12:30.414446 24604 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5d94e22c8fa74c10a9732bb2af78fb98 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "5d94e22c8fa74c10a9732bb2af78fb98" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "5d94e22c8fa74c10a9732bb2af78fb98" member_type: VOTER last_known_addr { host: "127.17.136.62" port: 33401 } } peers { permanent_uuid: "cc335ec49c7b46d8b3bfc44fc1f32579" member_type: VOTER last_known_addr { host: "127.17.136.61" port: 42371 } attrs { promote: false } } peers { permanent_uuid: "3b1c4bd139bf4929b313361ea24d3eab" member_type: NON_VOTER last_known_addr { host: "127.17.136.60" port: 40351 } attrs { promote: true } } }
I20260927 15:12:30.414508 24604 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5d94e22c8fa74c10a9732bb2af78fb98 [sys.catalog]: This master's current role is: LEADER
I20260927 15:12:30.414915 24792 sys_catalog.cc:455] T 00000000000000000000000000000000 P cc335ec49c7b46d8b3bfc44fc1f32579 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "5d94e22c8fa74c10a9732bb2af78fb98" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "5d94e22c8fa74c10a9732bb2af78fb98" member_type: VOTER last_known_addr { host: "127.17.136.62" port: 33401 } } peers { permanent_uuid: "cc335ec49c7b46d8b3bfc44fc1f32579" member_type: VOTER last_known_addr { host: "127.17.136.61" port: 42371 } attrs { promote: false } } peers { permanent_uuid: "3b1c4bd139bf4929b313361ea24d3eab" member_type: NON_VOTER last_known_addr { host: "127.17.136.60" port: 40351 } attrs { promote: true } } }
I20260927 15:12:30.415084 24792 sys_catalog.cc:458] T 00000000000000000000000000000000 P cc335ec49c7b46d8b3bfc44fc1f32579 [sys.catalog]: This master's current role is: FOLLOWER
I20260927 15:12:30.421656 24618 master.cc:552] Master@127.17.136.60:40351 shutdown complete.
I20260927 15:12:30.421712 24618 master_runner.cc:305] Clearing existing system tablet
I20260927 15:12:30.421943 24618 fs_manager.cc:359] Metadata directory not provided
I20260927 15:12:30.421998 24618 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260927 15:12:30.423240 24618 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.002s sys 0.000s
I20260927 15:12:30.424096 24796 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260927 15:12:30.424341 24618 fs_report.cc:383] FS layout report
--------------------
wal directory:
metadata directory:
1 data directories: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790521920546562-17952-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260927 15:12:30.424472 24618 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260927 15:12:30.424511 24618 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790521920546562-17952-0/minicluster-data/master-2/data,/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790521920546562-17952-0/minicluster-data/master-2/wal
uuid: "3b1c4bd139bf4929b313361ea24d3eab"
format_stamp: "Formatted at 2026-09-27 15:12:30 on dist-test-slave-5s2t"
server_key: "2be256d4a3bac1c76e0932980b9e3d62"
server_key_iv: "d9ea8ca056be58d3f08261612f35d717"
server_key_version: "encryptionkey@0"
I20260927 15:12:30.426476 24618 ts_tablet_manager.cc:1905] T 00000000000000000000000000000000 P 3b1c4bd139bf4929b313361ea24d3eab: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:12:30.429030 24618 ts_tablet_manager.cc:1918] T 00000000000000000000000000000000 P 3b1c4bd139bf4929b313361ea24d3eab: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId unknown
I20260927 15:12:30.429122 24618 log.cc:1196] T 00000000000000000000000000000000 P 3b1c4bd139bf4929b313361ea24d3eab: Deleting WAL directory at /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790521920546562-17952-0/minicluster-data/master-2/wal/wals/00000000000000000000000000000000
I20260927 15:12:30.429358 24618 ts_tablet_manager.cc:1939] T 00000000000000000000000000000000 P 3b1c4bd139bf4929b313361ea24d3eab: Deleting consensus metadata
I20260927 15:12:30.429528 24618 master_runner.cc:315] Copying system tablet from 127.17.136.62:33401
I20260927 15:12:30.430657 24618 tablet_copy_client.cc:316] T 00000000000000000000000000000000 P 3b1c4bd139bf4929b313361ea24d3eab: tablet copy: Beginning tablet copy session from remote peer at address 127.17.136.62:33401
I20260927 15:12:30.439858 24802 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:30.431617 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.62:33401 (local address 127.0.0.1:39706)
0927 15:12:30.431913 (+ 296us) negotiation.cc:107] Waiting for socket to connect
0927 15:12:30.431927 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0927 15:12:30.432049 (+ 122us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0927 15:12:30.432318 (+ 269us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0927 15:12:30.432321 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0927 15:12:30.432528 (+ 207us) client_negotiation.cc:189] Negotiated authn=SASL
0927 15:12:30.432645 (+ 117us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:12:30.432657 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:12:30.433650 (+ 993us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:12:30.433654 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:12:30.434617 (+ 963us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:12:30.434687 (+ 70us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:12:30.435313 (+ 626us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:12:30.435317 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:12:30.435412 (+ 95us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:30.435953 (+ 541us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0927 15:12:30.435967 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0927 15:12:30.436373 (+ 406us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0927 15:12:30.438274 (+ 1901us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0927 15:12:30.438277 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0927 15:12:30.438279 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0927 15:12:30.438519 (+ 240us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0927 15:12:30.438803 (+ 284us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0927 15:12:30.438806 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0927 15:12:30.438808 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0927 15:12:30.438895 (+ 87us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0927 15:12:30.439334 (+ 439us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0927 15:12:30.439337 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0927 15:12:30.439437 (+ 100us) client_negotiation.cc:769] Sending connection context
0927 15:12:30.439539 (+ 102us) client_negotiation.cc:240] Negotiation successful
0927 15:12:30.439689 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":231,"thread_start_us":89,"threads_started":1}
I20260927 15:12:30.440186 24085 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:30.431698 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39706 (local address 127.17.136.62:33401)
0927 15:12:30.431819 (+ 121us) server_negotiation.cc:206] Beginning negotiation
0927 15:12:30.431824 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0927 15:12:30.432006 (+ 182us) server_negotiation.cc:407] Connection header received
0927 15:12:30.432142 (+ 136us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:12:30.432145 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:12:30.432195 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:12:30.432288 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0927 15:12:30.432752 (+ 464us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:30.433547 (+ 795us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:30.434830 (+ 1283us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:30.435166 (+ 336us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:30.435328 (+ 162us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:30.436513 (+ 1185us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0927 15:12:30.436517 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0927 15:12:30.436520 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0927 15:12:30.436548 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0927 15:12:30.438162 (+ 1614us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:12:30.438627 (+ 465us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:12:30.438630 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:12:30.438632 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:12:30.438720 (+ 88us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:12:30.438983 (+ 263us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:12:30.438985 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:12:30.438987 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:12:30.439207 (+ 220us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0927 15:12:30.439340 (+ 133us) server_negotiation.cc:1035] Waiting for connection context
0927 15:12:30.439658 (+ 318us) server_negotiation.cc:299] Negotiation successful
0927 15:12:30.439769 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260927 15:12:30.440693 24066 tablet_copy_service.cc:140] P 5d94e22c8fa74c10a9732bb2af78fb98: Received BeginTabletCopySession request for tablet 00000000000000000000000000000000 from peer 3b1c4bd139bf4929b313361ea24d3eab ({username='oryx', principal='oryx/127.17.136.60@KRBTEST.COM'} at 127.0.0.1:39706)
I20260927 15:12:30.440796 24066 tablet_copy_service.cc:161] P 5d94e22c8fa74c10a9732bb2af78fb98: Beginning new tablet copy session on tablet 00000000000000000000000000000000 from peer 3b1c4bd139bf4929b313361ea24d3eab at {username='oryx', principal='oryx/127.17.136.60@KRBTEST.COM'} at 127.0.0.1:39706: session id = 3b1c4bd139bf4929b313361ea24d3eab-00000000000000000000000000000000
I20260927 15:12:30.441890 24066 tablet_copy_source_session.cc:205] T 00000000000000000000000000000000 P 5d94e22c8fa74c10a9732bb2af78fb98: Tablet Copy: opened 0 blocks and 1 log segments
I20260927 15:12:30.443071 24618 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total
I20260927 15:12:30.445487 24618 tablet_copy_client.cc:791] T 00000000000000000000000000000000 P 3b1c4bd139bf4929b313361ea24d3eab: tablet copy: Starting download of 0 data blocks...
I20260927 15:12:30.445647 24618 tablet_copy_client.cc:655] T 00000000000000000000000000000000 P 3b1c4bd139bf4929b313361ea24d3eab: tablet copy: Starting download of 1 WAL segments...
I20260927 15:12:30.447091 24618 tablet_copy_client.cc:531] T 00000000000000000000000000000000 P 3b1c4bd139bf4929b313361ea24d3eab: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260927 15:12:30.448891 24066 tablet_copy_service.cc:342] P 5d94e22c8fa74c10a9732bb2af78fb98: Request end of tablet copy session 3b1c4bd139bf4929b313361ea24d3eab-00000000000000000000000000000000 received from {username='oryx', principal='oryx/127.17.136.60@KRBTEST.COM'} at 127.0.0.1:39706
I20260927 15:12:30.448972 24066 tablet_copy_service.cc:433] P 5d94e22c8fa74c10a9732bb2af78fb98: ending tablet copy session 3b1c4bd139bf4929b313361ea24d3eab-00000000000000000000000000000000 on tablet 00000000000000000000000000000000 with peer 3b1c4bd139bf4929b313361ea24d3eab
I20260927 15:12:30.456779 24618 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260927 15:12:30.458444 24803 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260927 15:12:30.460104 24804 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260927 15:12:30.460281 24806 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260927 15:12:30.460744 24618 server_base.cc:1034] running on GCE node
I20260927 15:12:30.460985 24618 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260927 15:12:30.461258 24618 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260927 15:12:30.462397 24618 hybrid_clock.cc:648] HybridClock initialized: now 1790521950462380 us; error 34 us; skew 500 ppm
Sep 27 15:12:30 dist-test-slave-5s2t krb5kdc[24001](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790521950, etypes {rep=17 tkt=17 ses=17}, oryx/127.17.136.60@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260927 15:12:30.463989 24618 init.cc:377] Logged in from keytab as oryx/127.17.136.60@KRBTEST.COM (short username oryx)
I20260927 15:12:30.464412 24618 webserver.cc:460] Webserver started at http://127.17.136.60:36535/ using document root <none> and password file <none>
I20260927 15:12:30.464598 24618 fs_manager.cc:359] Metadata directory not provided
I20260927 15:12:30.464639 24618 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260927 15:12:30.465884 24618 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.001s
I20260927 15:12:30.466861 24813 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260927 15:12:30.467135 24618 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260927 15:12:30.467208 24618 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790521920546562-17952-0/minicluster-data/master-2/data,/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790521920546562-17952-0/minicluster-data/master-2/wal
uuid: "3b1c4bd139bf4929b313361ea24d3eab"
format_stamp: "Formatted at 2026-09-27 15:12:30 on dist-test-slave-5s2t"
server_key: "2be256d4a3bac1c76e0932980b9e3d62"
server_key_iv: "d9ea8ca056be58d3f08261612f35d717"
server_key_version: "encryptionkey@0"
I20260927 15:12:30.467320 24618 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790521920546562-17952-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790521920546562-17952-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790521920546562-17952-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260927 15:12:30.486725 24618 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260927 15:12:30.488842 24618 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260927 15:12:30.493635 24618 rpc_server.cc:307] RPC server started. Bound to: 127.17.136.60:40351
I20260927 15:12:30.494027 24865 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.136.60:40351 every 8 connection(s)
I20260927 15:12:30.494259 24618 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790521920546562-17952-0/minicluster-data/master-2/data/info.pb
I20260927 15:12:30.495997 24866 sys_catalog.cc:263] Verifying existing consensus state
I20260927 15:12:30.497016 24866 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3b1c4bd139bf4929b313361ea24d3eab: Bootstrap starting.
W20260927 15:12:30.500598 24790 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260927 15:12:30.500900 24790 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260927 15:12:30.500969 24790 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260927 15:12:30.505024 24790 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260927 15:12:30.505077 24790 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260927 15:12:30.505144 24790 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.136.1
I20260927 15:12:30.507005 24866 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3b1c4bd139bf4929b313361ea24d3eab: Bootstrap replayed 1/1 log segments. Stats: ops{read=7 overwritten=0 applied=7 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260927 15:12:30.507228 24866 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3b1c4bd139bf4929b313361ea24d3eab: Bootstrap complete.
I20260927 15:12:30.507691 24866 raft_consensus.cc:348] T 00000000000000000000000000000000 P 3b1c4bd139bf4929b313361ea24d3eab [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "5d94e22c8fa74c10a9732bb2af78fb98" member_type: VOTER last_known_addr { host: "127.17.136.62" port: 33401 } } peers { permanent_uuid: "cc335ec49c7b46d8b3bfc44fc1f32579" member_type: VOTER last_known_addr { host: "127.17.136.61" port: 42371 } attrs { promote: false } } peers { permanent_uuid: "3b1c4bd139bf4929b313361ea24d3eab" member_type: NON_VOTER last_known_addr { host: "127.17.136.60" port: 40351 } attrs { promote: true } }
I20260927 15:12:30.507815 24866 raft_consensus.cc:729] T 00000000000000000000000000000000 P 3b1c4bd139bf4929b313361ea24d3eab [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 3b1c4bd139bf4929b313361ea24d3eab, State: Initialized, Role: LEARNER
I20260927 15:12:30.507918 24866 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3b1c4bd139bf4929b313361ea24d3eab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 7, Last appended: 1.7, Last appended by leader: 7, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "5d94e22c8fa74c10a9732bb2af78fb98" member_type: VOTER last_known_addr { host: "127.17.136.62" port: 33401 } } peers { permanent_uuid: "cc335ec49c7b46d8b3bfc44fc1f32579" member_type: VOTER last_known_addr { host: "127.17.136.61" port: 42371 } attrs { promote: false } } peers { permanent_uuid: "3b1c4bd139bf4929b313361ea24d3eab" member_type: NON_VOTER last_known_addr { host: "127.17.136.60" port: 40351 } attrs { promote: true } }
I20260927 15:12:30.508222 24872 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3b1c4bd139bf4929b313361ea24d3eab [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "5d94e22c8fa74c10a9732bb2af78fb98" member_type: VOTER last_known_addr { host: "127.17.136.62" port: 33401 } } peers { permanent_uuid: "cc335ec49c7b46d8b3bfc44fc1f32579" member_type: VOTER last_known_addr { host: "127.17.136.61" port: 42371 } attrs { promote: false } } peers { permanent_uuid: "3b1c4bd139bf4929b313361ea24d3eab" member_type: NON_VOTER last_known_addr { host: "127.17.136.60" port: 40351 } attrs { promote: true } } }
I20260927 15:12:30.508306 24866 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3b1c4bd139bf4929b313361ea24d3eab [sys.catalog]: configured and running, proceeding with master startup.
I20260927 15:12:30.508378 24872 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3b1c4bd139bf4929b313361ea24d3eab [sys.catalog]: This master's current role is: LEARNER
I20260927 15:12:30.510679 24883 catalog_manager.cc:1259] Loaded cluster ID: cf487426c0ca458e8b8e643e352d17ca
I20260927 15:12:30.510725 24883 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 3b1c4bd139bf4929b313361ea24d3eab: loading cluster ID for follower catalog manager: success
I20260927 15:12:30.511385 24790 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.136.20:43561
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790521920546562-17952-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790521920546562-17952-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790521920546562-17952-0/krb5kdc/oryx_127.17.136.1.keytab
--principal=oryx/127.17.136.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.136.1:41807
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790521920546562-17952-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.17.136.1
--webserver_port=37655
--tserver_master_addrs=127.17.136.62:33401,127.17.136.61:42371,127.17.136.60:40351
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24790
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.136.1
--log_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790521920546562-17952-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 27 Sep 2026 14:27:13 UTC on ccycloud.quasar-psqrth.root.comops.site
build id 4676138
I20260927 15:12:30.512348 24790 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260927 15:12:30.512377 24883 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 3b1c4bd139bf4929b313361ea24d3eab: acquiring CA information for follower catalog manager: success
I20260927 15:12:30.513294 24790 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260927 15:12:30.513396 24883 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 3b1c4bd139bf4929b313361ea24d3eab: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
W20260927 15:12:30.522120 24886 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260927 15:12:30.522231 24790 server_base.cc:1034] running on GCE node
W20260927 15:12:30.522143 24888 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260927 15:12:30.522143 24885 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260927 15:12:30.522877 24790 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260927 15:12:30.523555 24790 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260927 15:12:30.524708 24790 hybrid_clock.cc:648] HybridClock initialized: now 1790521950524691 us; error 34 us; skew 500 ppm
Sep 27 15:12:30 dist-test-slave-5s2t krb5kdc[24001](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790521950, etypes {rep=17 tkt=17 ses=17}, oryx/127.17.136.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260927 15:12:30.527318 24790 init.cc:377] Logged in from keytab as oryx/127.17.136.1@KRBTEST.COM (short username oryx)
I20260927 15:12:30.528146 24790 webserver.cc:460] Webserver started at http://127.17.136.1:37655/ using document root <none> and password file <none>
I20260927 15:12:30.528666 24790 fs_manager.cc:359] Metadata directory not provided
I20260927 15:12:30.528744 24790 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260927 15:12:30.532428 24790 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.003s sys 0.000s
I20260927 15:12:30.534338 24895 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260927 15:12:30.535506 24790 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260927 15:12:30.535601 24790 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790521920546562-17952-0/minicluster-data/ts-0/data,/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790521920546562-17952-0/minicluster-data/ts-0/wal
uuid: "45aed58e7be84f1c93e2ca9ab659462e"
format_stamp: "Formatted at 2026-09-27 15:12:29 on dist-test-slave-5s2t"
server_key: "aab7424c1bcb8694ed67ae517b3be18f"
server_key_iv: "ae4edd45711dcdaf1a888818986af797"
server_key_version: "encryptionkey@0"
I20260927 15:12:30.536089 24790 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790521920546562-17952-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790521920546562-17952-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790521920546562-17952-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260927 15:12:30.549666 24790 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260927 15:12:30.552906 24790 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260927 15:12:30.553077 24790 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260927 15:12:30.553714 24790 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260927 15:12:30.554723 24790 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260927 15:12:30.554769 24790 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260927 15:12:30.554804 24790 ts_tablet_manager.cc:610] Registered 0 tablets
I20260927 15:12:30.554823 24790 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260927 15:12:30.562741 24790 rpc_server.cc:307] RPC server started. Bound to: 127.17.136.1:41807
I20260927 15:12:30.562796 25008 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.136.1:41807 every 8 connection(s)
I20260927 15:12:30.563647 24790 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790521920546562-17952-0/minicluster-data/ts-0/data/info.pb
I20260927 15:12:30.570637 24371 heartbeater.cc:503] Master 127.17.136.62:33401 was elected leader, sending a full tablet report...
I20260927 15:12:30.571920 17952 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu as pid 24790
I20260927 15:12:30.572108 17952 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu with pid 24242
Sep 27 15:12:30 dist-test-slave-5s2t krb5kdc[24001](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790521950, etypes {rep=17 tkt=17 ses=17}, oryx/127.17.136.1@KRBTEST.COM for oryx/127.17.136.60@KRBTEST.COM
Sep 27 15:12:30 dist-test-slave-5s2t krb5kdc[24001](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790521950, etypes {rep=17 tkt=17 ses=17}, oryx/127.17.136.1@KRBTEST.COM for oryx/127.17.136.61@KRBTEST.COM
Sep 27 15:12:30 dist-test-slave-5s2t krb5kdc[24001](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790521950, etypes {rep=17 tkt=17 ses=17}, oryx/127.17.136.1@KRBTEST.COM for oryx/127.17.136.62@KRBTEST.COM
I20260927 15:12:30.578029 24768 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:30.566804 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.136.1:58547 (local address 127.17.136.61:42371)
0927 15:12:30.566916 (+ 112us) server_negotiation.cc:206] Beginning negotiation
0927 15:12:30.566920 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0927 15:12:30.567000 (+ 80us) server_negotiation.cc:407] Connection header received
0927 15:12:30.567453 (+ 453us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:12:30.567456 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:12:30.567514 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:12:30.567585 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0927 15:12:30.568802 (+ 1217us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:30.569316 (+ 514us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:30.570408 (+ 1092us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:30.570631 (+ 223us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:30.570715 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:30.574244 (+ 3529us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0927 15:12:30.574248 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0927 15:12:30.574251 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0927 15:12:30.574277 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0927 15:12:30.575809 (+ 1532us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:12:30.576352 (+ 543us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:12:30.576356 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:12:30.576358 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:12:30.576434 (+ 76us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:12:30.576807 (+ 373us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:12:30.576810 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:12:30.576812 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:12:30.577018 (+ 206us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0927 15:12:30.577086 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0927 15:12:30.577756 (+ 670us) server_negotiation.cc:299] Negotiation successful
0927 15:12:30.577870 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260927 15:12:30.578035 25013 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:30.565292 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.136.1:58875 (local address 127.17.136.60:40351)
0927 15:12:30.565489 (+ 197us) server_negotiation.cc:206] Beginning negotiation
0927 15:12:30.565498 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0927 15:12:30.566345 (+ 847us) server_negotiation.cc:407] Connection header received
0927 15:12:30.567486 (+ 1141us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:12:30.567490 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:12:30.567545 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:12:30.567603 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0927 15:12:30.568810 (+ 1207us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:30.569830 (+ 1020us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:30.571222 (+ 1392us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:30.571567 (+ 345us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:30.571666 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:30.574585 (+ 2919us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0927 15:12:30.574589 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0927 15:12:30.574591 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0927 15:12:30.574614 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0927 15:12:30.576143 (+ 1529us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:12:30.576556 (+ 413us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:12:30.576559 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:12:30.576561 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:12:30.576631 (+ 70us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:12:30.576899 (+ 268us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:12:30.576902 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:12:30.576904 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:12:30.577101 (+ 197us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0927 15:12:30.577161 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0927 15:12:30.577756 (+ 595us) server_negotiation.cc:299] Negotiation successful
0927 15:12:30.577871 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":141,"thread_start_us":76,"threads_started":1}
I20260927 15:12:30.579239 24085 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:30.565217 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.136.1:38515 (local address 127.17.136.62:33401)
0927 15:12:30.565338 (+ 121us) server_negotiation.cc:206] Beginning negotiation
0927 15:12:30.565343 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0927 15:12:30.566344 (+ 1001us) server_negotiation.cc:407] Connection header received
0927 15:12:30.567535 (+ 1191us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:12:30.567538 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:12:30.567588 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:12:30.567650 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0927 15:12:30.568810 (+ 1160us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:30.569616 (+ 806us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:30.570728 (+ 1112us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:30.570955 (+ 227us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:30.571022 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:30.575219 (+ 4197us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0927 15:12:30.575223 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0927 15:12:30.575226 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0927 15:12:30.575282 (+ 56us) server_negotiation.cc:922] calling sasl_server_start()
0927 15:12:30.576978 (+ 1696us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:12:30.577424 (+ 446us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:12:30.577427 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:12:30.577429 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:12:30.577503 (+ 74us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:12:30.577747 (+ 244us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:12:30.577750 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:12:30.577751 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:12:30.577939 (+ 188us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0927 15:12:30.578014 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0927 15:12:30.578997 (+ 983us) server_negotiation.cc:299] Negotiation successful
0927 15:12:30.579102 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260927 15:12:30.579604 17952 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu
/tmp/dist-test-taskiFOyeW/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790521920546562-17952-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790521920546562-17952-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790521920546562-17952-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790521920546562-17952-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.136.2:42827
--local_ip_for_outbound_sockets=127.17.136.2
--tserver_master_addrs=127.17.136.62:33401
--webserver_port=38913
--webserver_interface=127.17.136.2
--keytab_file=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790521920546562-17952-0/krb5kdc/oryx_127.17.136.2.keytab
--principal=oryx/127.17.136.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.136.20:43561
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.17.136.62:33401,127.17.136.61:42371
--tserver_master_addrs=127.17.136.62:33401,127.17.136.61:42371,127.17.136.60:40351 with env {KRB5CCNAME=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790521920546562-17952-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790521920546562-17952-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790521920546562-17952-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260927 15:12:30.579609 25014 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:30.565719 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.60:40351 (local address 127.17.136.1:58875)
0927 15:12:30.566193 (+ 474us) negotiation.cc:107] Waiting for socket to connect
0927 15:12:30.566248 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0927 15:12:30.567227 (+ 979us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0927 15:12:30.567774 (+ 547us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0927 15:12:30.567777 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0927 15:12:30.568167 (+ 390us) client_negotiation.cc:189] Negotiated authn=SASL
0927 15:12:30.568678 (+ 511us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:12:30.568684 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:12:30.569956 (+ 1272us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:12:30.569959 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:12:30.571113 (+ 1154us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:12:30.571122 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:12:30.571693 (+ 571us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:12:30.571696 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:12:30.571786 (+ 90us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:30.572129 (+ 343us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0927 15:12:30.572225 (+ 96us) client_negotiation.cc:656] calling sasl_client_start()
0927 15:12:30.574481 (+ 2256us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0927 15:12:30.576252 (+ 1771us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0927 15:12:30.576255 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0927 15:12:30.576256 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0927 15:12:30.576459 (+ 203us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0927 15:12:30.576730 (+ 271us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0927 15:12:30.576733 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0927 15:12:30.576735 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0927 15:12:30.576810 (+ 75us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0927 15:12:30.577222 (+ 412us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0927 15:12:30.577224 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0927 15:12:30.577486 (+ 262us) client_negotiation.cc:769] Sending connection context
0927 15:12:30.578223 (+ 737us) client_negotiation.cc:240] Negotiation successful
0927 15:12:30.578576 (+ 353us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":279,"mutex_wait_us":86,"spinlock_wait_cycles":21504,"thread_start_us":127,"threads_started":1}
I20260927 15:12:30.579824 25016 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:30.566694 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.61:42371 (local address 127.17.136.1:58547)
0927 15:12:30.566932 (+ 238us) negotiation.cc:107] Waiting for socket to connect
0927 15:12:30.566945 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0927 15:12:30.567230 (+ 285us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0927 15:12:30.567762 (+ 532us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0927 15:12:30.567768 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0927 15:12:30.568134 (+ 366us) client_negotiation.cc:189] Negotiated authn=SASL
0927 15:12:30.568668 (+ 534us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:12:30.568681 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:12:30.569435 (+ 754us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:12:30.569438 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:12:30.570298 (+ 860us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:12:30.570307 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:12:30.571142 (+ 835us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:12:30.571145 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:12:30.571348 (+ 203us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:30.572022 (+ 674us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0927 15:12:30.572042 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0927 15:12:30.574073 (+ 2031us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0927 15:12:30.575936 (+ 1863us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0927 15:12:30.575942 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0927 15:12:30.575957 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0927 15:12:30.576254 (+ 297us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0927 15:12:30.576554 (+ 300us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0927 15:12:30.576556 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0927 15:12:30.576558 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0927 15:12:30.576713 (+ 155us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0927 15:12:30.577163 (+ 450us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0927 15:12:30.577169 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0927 15:12:30.577486 (+ 317us) client_negotiation.cc:769] Sending connection context
0927 15:12:30.578223 (+ 737us) client_negotiation.cc:240] Negotiation successful
0927 15:12:30.578631 (+ 408us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":180,"mutex_wait_us":207,"spinlock_wait_cycles":9472,"thread_start_us":78,"threads_started":1}
I20260927 15:12:30.580881 25009 heartbeater.cc:347] Connected to a master server at 127.17.136.60:40351
I20260927 15:12:30.580953 25011 heartbeater.cc:347] Connected to a master server at 127.17.136.61:42371
I20260927 15:12:30.581099 25009 heartbeater.cc:464] Registering TS with master...
I20260927 15:12:30.581099 25011 heartbeater.cc:464] Registering TS with master...
I20260927 15:12:30.581573 25015 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:30.565719 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.62:33401 (local address 127.17.136.1:38515)
0927 15:12:30.566193 (+ 474us) negotiation.cc:107] Waiting for socket to connect
0927 15:12:30.566248 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0927 15:12:30.567233 (+ 985us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0927 15:12:30.567764 (+ 531us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0927 15:12:30.567771 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0927 15:12:30.568147 (+ 376us) client_negotiation.cc:189] Negotiated authn=SASL
0927 15:12:30.568676 (+ 529us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:12:30.568684 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:12:30.569730 (+ 1046us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:12:30.569733 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:12:30.570610 (+ 877us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:12:30.570620 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:12:30.571327 (+ 707us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:12:30.571331 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:12:30.571420 (+ 89us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:30.572629 (+ 1209us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0927 15:12:30.572643 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0927 15:12:30.574462 (+ 1819us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0927 15:12:30.577099 (+ 2637us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0927 15:12:30.577101 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0927 15:12:30.577103 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0927 15:12:30.577323 (+ 220us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0927 15:12:30.577587 (+ 264us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0927 15:12:30.577590 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0927 15:12:30.577592 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0927 15:12:30.577667 (+ 75us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0927 15:12:30.578052 (+ 385us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0927 15:12:30.578055 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0927 15:12:30.578473 (+ 418us) client_negotiation.cc:769] Sending connection context
0927 15:12:30.578570 (+ 97us) client_negotiation.cc:240] Negotiation successful
0927 15:12:30.578693 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":362,"mutex_wait_us":117,"spinlock_wait_cycles":89216,"thread_start_us":118,"threads_started":1}
I20260927 15:12:30.581666 25009 heartbeater.cc:511] Master 127.17.136.60:40351 requested a full tablet report, sending...
I20260927 15:12:30.581664 25011 heartbeater.cc:511] Master 127.17.136.61:42371 requested a full tablet report, sending...
I20260927 15:12:30.582453 25010 heartbeater.cc:347] Connected to a master server at 127.17.136.62:33401
I20260927 15:12:30.582542 25010 heartbeater.cc:464] Registering TS with master...
I20260927 15:12:30.582695 25010 heartbeater.cc:511] Master 127.17.136.62:33401 requested a full tablet report, sending...
I20260927 15:12:30.583130 24646 ts_manager.cc:194] Registered new tserver with Master: 45aed58e7be84f1c93e2ca9ab659462e (127.17.136.1:41807)
I20260927 15:12:30.583225 24830 ts_manager.cc:194] Registered new tserver with Master: 45aed58e7be84f1c93e2ca9ab659462e (127.17.136.1:41807)
I20260927 15:12:30.584118 24044 ts_manager.cc:194] Re-registered known tserver with Master: 45aed58e7be84f1c93e2ca9ab659462e (127.17.136.1:41807)
I20260927 15:12:30.584647 24044 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.17.136.1@KRBTEST.COM'} at 127.17.136.1:38515
W20260927 15:12:30.685389 25017 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260927 15:12:30.685621 25017 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260927 15:12:30.685663 25017 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260927 15:12:30.689615 25017 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260927 15:12:30.689671 25017 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260927 15:12:30.689741 25017 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.136.2
I20260927 15:12:30.694811 25017 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.136.20:43561
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790521920546562-17952-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790521920546562-17952-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790521920546562-17952-0/krb5kdc/oryx_127.17.136.2.keytab
--principal=oryx/127.17.136.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.136.2:42827
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790521920546562-17952-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.17.136.2
--webserver_port=38913
--tserver_master_addrs=127.17.136.62:33401,127.17.136.61:42371,127.17.136.60:40351
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25017
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.136.2
--log_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790521920546562-17952-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 27 Sep 2026 14:27:13 UTC on ccycloud.quasar-psqrth.root.comops.site
build id 4676138
I20260927 15:12:30.695837 25017 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260927 15:12:30.696795 25017 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260927 15:12:30.705766 25023 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260927 15:12:30.705760 25022 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260927 15:12:30.705767 25025 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260927 15:12:30.706044 25017 server_base.cc:1034] running on GCE node
I20260927 15:12:30.706449 25017 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260927 15:12:30.707067 25017 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260927 15:12:30.708212 25017 hybrid_clock.cc:648] HybridClock initialized: now 1790521950708185 us; error 35 us; skew 500 ppm
Sep 27 15:12:30 dist-test-slave-5s2t krb5kdc[24001](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790521950, etypes {rep=17 tkt=17 ses=17}, oryx/127.17.136.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260927 15:12:30.710696 25017 init.cc:377] Logged in from keytab as oryx/127.17.136.2@KRBTEST.COM (short username oryx)
I20260927 15:12:30.711498 25017 webserver.cc:460] Webserver started at http://127.17.136.2:38913/ using document root <none> and password file <none>
I20260927 15:12:30.712023 25017 fs_manager.cc:359] Metadata directory not provided
I20260927 15:12:30.712103 25017 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260927 15:12:30.715760 25017 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.004s sys 0.000s
I20260927 15:12:30.717651 25032 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260927 15:12:30.718840 25017 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260927 15:12:30.718946 25017 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790521920546562-17952-0/minicluster-data/ts-1/data,/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790521920546562-17952-0/minicluster-data/ts-1/wal
uuid: "bce84efcd7394877943020b62471f259"
format_stamp: "Formatted at 2026-09-27 15:12:29 on dist-test-slave-5s2t"
server_key: "076b1dba3a0d5b641d6f9ed6539fc47d"
server_key_iv: "3094d9a6cbf8b20abba1f6e1ac0eb6fb"
server_key_version: "encryptionkey@0"
I20260927 15:12:30.719476 25017 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790521920546562-17952-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790521920546562-17952-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790521920546562-17952-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260927 15:12:30.748632 25017 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260927 15:12:30.751230 25017 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260927 15:12:30.751456 25017 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260927 15:12:30.752038 25017 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260927 15:12:30.752826 25017 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260927 15:12:30.752879 25017 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260927 15:12:30.752931 25017 ts_tablet_manager.cc:610] Registered 0 tablets
I20260927 15:12:30.752957 25017 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260927 15:12:30.762122 25017 rpc_server.cc:307] RPC server started. Bound to: 127.17.136.2:42827
I20260927 15:12:30.762164 25145 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.136.2:42827 every 8 connection(s)
I20260927 15:12:30.763020 25017 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790521920546562-17952-0/minicluster-data/ts-1/data/info.pb
I20260927 15:12:30.766188 17952 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu as pid 25017
I20260927 15:12:30.766384 17952 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu with pid 24376
I20260927 15:12:30.773295 17952 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu
/tmp/dist-test-taskiFOyeW/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790521920546562-17952-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790521920546562-17952-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790521920546562-17952-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790521920546562-17952-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.136.3:33145
--local_ip_for_outbound_sockets=127.17.136.3
--tserver_master_addrs=127.17.136.62:33401
--webserver_port=46765
--webserver_interface=127.17.136.3
--keytab_file=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790521920546562-17952-0/krb5kdc/oryx_127.17.136.3.keytab
--principal=oryx/127.17.136.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.136.20:43561
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.17.136.62:33401,127.17.136.61:42371
--tserver_master_addrs=127.17.136.62:33401,127.17.136.61:42371,127.17.136.60:40351 with env {KRB5CCNAME=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790521920546562-17952-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790521920546562-17952-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790521920546562-17952-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Sep 27 15:12:30 dist-test-slave-5s2t krb5kdc[24001](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790521950, etypes {rep=17 tkt=17 ses=17}, oryx/127.17.136.2@KRBTEST.COM for oryx/127.17.136.60@KRBTEST.COM
Sep 27 15:12:30 dist-test-slave-5s2t krb5kdc[24001](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790521950, etypes {rep=17 tkt=17 ses=17}, oryx/127.17.136.2@KRBTEST.COM for oryx/127.17.136.61@KRBTEST.COM
Sep 27 15:12:30 dist-test-slave-5s2t krb5kdc[24001](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790521950, etypes {rep=17 tkt=17 ses=17}, oryx/127.17.136.2@KRBTEST.COM for oryx/127.17.136.62@KRBTEST.COM
I20260927 15:12:30.778707 24768 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:30.764630 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.136.2:40029 (local address 127.17.136.61:42371)
0927 15:12:30.764760 (+ 130us) server_negotiation.cc:206] Beginning negotiation
0927 15:12:30.764765 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0927 15:12:30.765598 (+ 833us) server_negotiation.cc:407] Connection header received
0927 15:12:30.766594 (+ 996us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:12:30.766598 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:12:30.766644 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:12:30.766687 (+ 43us) server_negotiation.cc:226] Negotiated authn=SASL
0927 15:12:30.768749 (+ 2062us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:30.769558 (+ 809us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:30.771799 (+ 2241us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:30.772103 (+ 304us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:30.772171 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:30.774796 (+ 2625us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0927 15:12:30.774800 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0927 15:12:30.774802 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0927 15:12:30.774831 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0927 15:12:30.776466 (+ 1635us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:12:30.777028 (+ 562us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:12:30.777031 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:12:30.777033 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:12:30.777114 (+ 81us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:12:30.777469 (+ 355us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:12:30.777472 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:12:30.777474 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:12:30.777672 (+ 198us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0927 15:12:30.777735 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0927 15:12:30.778437 (+ 702us) server_negotiation.cc:299] Negotiation successful
0927 15:12:30.778546 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260927 15:12:30.778707 25013 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:30.764672 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.136.2:44783 (local address 127.17.136.60:40351)
0927 15:12:30.764784 (+ 112us) server_negotiation.cc:206] Beginning negotiation
0927 15:12:30.764788 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0927 15:12:30.766018 (+ 1230us) server_negotiation.cc:407] Connection header received
0927 15:12:30.766916 (+ 898us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:12:30.766920 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:12:30.766977 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:12:30.767030 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0927 15:12:30.768790 (+ 1760us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:30.769581 (+ 791us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:30.771191 (+ 1610us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:30.771560 (+ 369us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:30.771643 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:30.775148 (+ 3505us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0927 15:12:30.775151 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0927 15:12:30.775154 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0927 15:12:30.775177 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0927 15:12:30.776576 (+ 1399us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:12:30.777257 (+ 681us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:12:30.777260 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:12:30.777262 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:12:30.777336 (+ 74us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:12:30.777611 (+ 275us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:12:30.777614 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:12:30.777616 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:12:30.777804 (+ 188us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0927 15:12:30.777875 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0927 15:12:30.778434 (+ 559us) server_negotiation.cc:299] Negotiation successful
0927 15:12:30.778548 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260927 15:12:30.779201 24085 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:30.768081 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.136.2:46777 (local address 127.17.136.62:33401)
0927 15:12:30.768203 (+ 122us) server_negotiation.cc:206] Beginning negotiation
0927 15:12:30.768208 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0927 15:12:30.768236 (+ 28us) server_negotiation.cc:407] Connection header received
0927 15:12:30.768277 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:12:30.768280 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:12:30.768326 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:12:30.768411 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0927 15:12:30.769003 (+ 592us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:30.769743 (+ 740us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:30.770990 (+ 1247us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:30.771362 (+ 372us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:30.771452 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:30.775164 (+ 3712us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0927 15:12:30.775167 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0927 15:12:30.775170 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0927 15:12:30.775199 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0927 15:12:30.776746 (+ 1547us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:12:30.777225 (+ 479us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:12:30.777228 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:12:30.777230 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:12:30.777304 (+ 74us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:12:30.777571 (+ 267us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:12:30.777574 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:12:30.777575 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:12:30.777758 (+ 183us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0927 15:12:30.777837 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0927 15:12:30.778939 (+ 1102us) server_negotiation.cc:299] Negotiation successful
0927 15:12:30.779053 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260927 15:12:30.779983 25150 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:30.765018 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.61:42371 (local address 127.17.136.2:40029)
0927 15:12:30.765465 (+ 447us) negotiation.cc:107] Waiting for socket to connect
0927 15:12:30.765501 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0927 15:12:30.766394 (+ 893us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0927 15:12:30.767090 (+ 696us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0927 15:12:30.767098 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0927 15:12:30.767853 (+ 755us) client_negotiation.cc:189] Negotiated authn=SASL
0927 15:12:30.768597 (+ 744us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:12:30.768614 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:12:30.769707 (+ 1093us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:12:30.769710 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:12:30.771673 (+ 1963us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:12:30.771680 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:12:30.772331 (+ 651us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:12:30.772335 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:12:30.772425 (+ 90us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:30.772782 (+ 357us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0927 15:12:30.772795 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0927 15:12:30.774605 (+ 1810us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0927 15:12:30.776590 (+ 1985us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0927 15:12:30.776596 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0927 15:12:30.776610 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0927 15:12:30.776932 (+ 322us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0927 15:12:30.777202 (+ 270us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0927 15:12:30.777205 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0927 15:12:30.777206 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0927 15:12:30.777372 (+ 166us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0927 15:12:30.777807 (+ 435us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0927 15:12:30.777813 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0927 15:12:30.778160 (+ 347us) client_negotiation.cc:769] Sending connection context
0927 15:12:30.779158 (+ 998us) client_negotiation.cc:240] Negotiation successful
0927 15:12:30.779465 (+ 307us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":291,"mutex_wait_us":1069,"spinlock_wait_cycles":17536,"thread_start_us":633,"threads_started":1}
I20260927 15:12:30.780256 25152 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:30.766053 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.62:33401 (local address 127.17.136.2:46777)
0927 15:12:30.766293 (+ 240us) negotiation.cc:107] Waiting for socket to connect
0927 15:12:30.766305 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0927 15:12:30.766393 (+ 88us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0927 15:12:30.768610 (+ 2217us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0927 15:12:30.768612 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0927 15:12:30.768778 (+ 166us) client_negotiation.cc:189] Negotiated authn=SASL
0927 15:12:30.768878 (+ 100us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:12:30.768884 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:12:30.769859 (+ 975us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:12:30.769862 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:12:30.770880 (+ 1018us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:12:30.770889 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:12:30.771616 (+ 727us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:12:30.771620 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:12:30.771792 (+ 172us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:30.772769 (+ 977us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0927 15:12:30.772784 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0927 15:12:30.775007 (+ 2223us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0927 15:12:30.776845 (+ 1838us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0927 15:12:30.776848 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0927 15:12:30.776850 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0927 15:12:30.777046 (+ 196us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0927 15:12:30.777398 (+ 352us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0927 15:12:30.777401 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0927 15:12:30.777403 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0927 15:12:30.777484 (+ 81us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0927 15:12:30.777892 (+ 408us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0927 15:12:30.777895 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0927 15:12:30.778162 (+ 267us) client_negotiation.cc:769] Sending connection context
0927 15:12:30.778369 (+ 207us) client_negotiation.cc:240] Negotiation successful
0927 15:12:30.778695 (+ 326us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":185,"mutex_wait_us":114,"spinlock_wait_cycles":15104,"thread_start_us":85,"threads_started":1}
I20260927 15:12:30.779995 25151 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:30.765018 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.60:40351 (local address 127.17.136.2:44783)
0927 15:12:30.765929 (+ 911us) negotiation.cc:107] Waiting for socket to connect
0927 15:12:30.765942 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0927 15:12:30.766402 (+ 460us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0927 15:12:30.767163 (+ 761us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0927 15:12:30.767166 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0927 15:12:30.767847 (+ 681us) client_negotiation.cc:189] Negotiated authn=SASL
0927 15:12:30.768596 (+ 749us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:12:30.768615 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:12:30.769710 (+ 1095us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:12:30.769713 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:12:30.771067 (+ 1354us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:12:30.771077 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:12:30.771784 (+ 707us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:12:30.771787 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:12:30.771888 (+ 101us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:30.772495 (+ 607us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0927 15:12:30.772514 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0927 15:12:30.775006 (+ 2492us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0927 15:12:30.776670 (+ 1664us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0927 15:12:30.776673 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0927 15:12:30.776675 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0927 15:12:30.777170 (+ 495us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0927 15:12:30.777441 (+ 271us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0927 15:12:30.777444 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0927 15:12:30.777446 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0927 15:12:30.777522 (+ 76us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0927 15:12:30.777936 (+ 414us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0927 15:12:30.777938 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0927 15:12:30.778160 (+ 222us) client_negotiation.cc:769] Sending connection context
0927 15:12:30.778833 (+ 673us) client_negotiation.cc:240] Negotiation successful
0927 15:12:30.778984 (+ 151us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":811,"mutex_wait_us":216,"spinlock_wait_cycles":70912,"thread_start_us":132,"threads_started":1}
I20260927 15:12:30.781270 25146 heartbeater.cc:347] Connected to a master server at 127.17.136.60:40351
I20260927 15:12:30.781325 25147 heartbeater.cc:347] Connected to a master server at 127.17.136.62:33401
I20260927 15:12:30.781510 25147 heartbeater.cc:464] Registering TS with master...
I20260927 15:12:30.781512 25146 heartbeater.cc:464] Registering TS with master...
I20260927 15:12:30.782029 25146 heartbeater.cc:511] Master 127.17.136.60:40351 requested a full tablet report, sending...
I20260927 15:12:30.782027 25147 heartbeater.cc:511] Master 127.17.136.62:33401 requested a full tablet report, sending...
I20260927 15:12:30.783123 24830 ts_manager.cc:194] Registered new tserver with Master: bce84efcd7394877943020b62471f259 (127.17.136.2:42827)
I20260927 15:12:30.783128 24044 ts_manager.cc:194] Re-registered known tserver with Master: bce84efcd7394877943020b62471f259 (127.17.136.2:42827)
I20260927 15:12:30.783288 25148 heartbeater.cc:347] Connected to a master server at 127.17.136.61:42371
I20260927 15:12:30.783377 25148 heartbeater.cc:464] Registering TS with master...
I20260927 15:12:30.783517 25148 heartbeater.cc:511] Master 127.17.136.61:42371 requested a full tablet report, sending...
I20260927 15:12:30.783923 24044 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.17.136.2@KRBTEST.COM'} at 127.17.136.2:46777
I20260927 15:12:30.784148 24646 ts_manager.cc:194] Registered new tserver with Master: bce84efcd7394877943020b62471f259 (127.17.136.2:42827)
I20260927 15:12:30.795744 24603 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:30.792126 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.60:40351 (local address 127.0.0.1:56206)
0927 15:12:30.792243 (+ 117us) negotiation.cc:107] Waiting for socket to connect
0927 15:12:30.792259 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0927 15:12:30.792383 (+ 124us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0927 15:12:30.792667 (+ 284us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0927 15:12:30.792669 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0927 15:12:30.792689 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0927 15:12:30.792768 (+ 79us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:12:30.792773 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:12:30.793775 (+ 1002us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:12:30.793777 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:12:30.794524 (+ 747us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:12:30.794532 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:12:30.795434 (+ 902us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:12:30.795437 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:12:30.795506 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:30.795526 (+ 20us) client_negotiation.cc:769] Sending connection context
0927 15:12:30.795571 (+ 45us) client_negotiation.cc:240] Negotiation successful
0927 15:12:30.795631 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":33}
I20260927 15:12:30.795825 25013 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:30.792221 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56206 (local address 127.17.136.60:40351)
0927 15:12:30.792343 (+ 122us) server_negotiation.cc:206] Beginning negotiation
0927 15:12:30.792347 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0927 15:12:30.792361 (+ 14us) server_negotiation.cc:407] Connection header received
0927 15:12:30.792487 (+ 126us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:12:30.792490 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:12:30.792549 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:12:30.792639 (+ 90us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0927 15:12:30.792882 (+ 243us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:30.793687 (+ 805us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:30.794639 (+ 952us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:30.795332 (+ 693us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:30.795434 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:30.795610 (+ 176us) server_negotiation.cc:1035] Waiting for connection context
0927 15:12:30.795643 (+ 33us) server_negotiation.cc:299] Negotiation successful
0927 15:12:30.795705 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260927 15:12:30.796409 24840 raft_consensus.cc:1203] T 00000000000000000000000000000000 P 3b1c4bd139bf4929b313361ea24d3eab [term 1 LEARNER]: Deduplicated request from leader. Original: 1.6->[1.7-1.7] Dedup: 1.7->[]
I20260927 15:12:30.796856 24872 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3b1c4bd139bf4929b313361ea24d3eab [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5d94e22c8fa74c10a9732bb2af78fb98. Latest consensus state: current_term: 1 leader_uuid: "5d94e22c8fa74c10a9732bb2af78fb98" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "5d94e22c8fa74c10a9732bb2af78fb98" member_type: VOTER last_known_addr { host: "127.17.136.62" port: 33401 } } peers { permanent_uuid: "cc335ec49c7b46d8b3bfc44fc1f32579" member_type: VOTER last_known_addr { host: "127.17.136.61" port: 42371 } attrs { promote: false } } peers { permanent_uuid: "3b1c4bd139bf4929b313361ea24d3eab" member_type: NON_VOTER last_known_addr { host: "127.17.136.60" port: 40351 } attrs { promote: true } } }
I20260927 15:12:30.797016 24872 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3b1c4bd139bf4929b313361ea24d3eab [sys.catalog]: This master's current role is: LEARNER
W20260927 15:12:30.884855 25153 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260927 15:12:30.885090 25153 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260927 15:12:30.885130 25153 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260927 15:12:30.889019 25153 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260927 15:12:30.889072 25153 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260927 15:12:30.889137 25153 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.136.3
I20260927 15:12:30.894227 25153 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.136.20:43561
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790521920546562-17952-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790521920546562-17952-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790521920546562-17952-0/krb5kdc/oryx_127.17.136.3.keytab
--principal=oryx/127.17.136.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.136.3:33145
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790521920546562-17952-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.17.136.3
--webserver_port=46765
--tserver_master_addrs=127.17.136.62:33401,127.17.136.61:42371,127.17.136.60:40351
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25153
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.136.3
--log_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790521920546562-17952-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 27 Sep 2026 14:27:13 UTC on ccycloud.quasar-psqrth.root.comops.site
build id 4676138
I20260927 15:12:30.895203 25153 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260927 15:12:30.896154 25153 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260927 15:12:30.905215 25159 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260927 15:12:30.905231 25158 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260927 15:12:30.905231 25161 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260927 15:12:30.905460 25153 server_base.cc:1034] running on GCE node
I20260927 15:12:30.905907 25153 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260927 15:12:30.906520 25153 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260927 15:12:30.907722 25153 hybrid_clock.cc:648] HybridClock initialized: now 1790521950907695 us; error 40 us; skew 500 ppm
Sep 27 15:12:30 dist-test-slave-5s2t krb5kdc[24001](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790521950, etypes {rep=17 tkt=17 ses=17}, oryx/127.17.136.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260927 15:12:30.916219 25153 init.cc:377] Logged in from keytab as oryx/127.17.136.3@KRBTEST.COM (short username oryx)
I20260927 15:12:30.917131 25153 webserver.cc:460] Webserver started at http://127.17.136.3:46765/ using document root <none> and password file <none>
I20260927 15:12:30.917661 25153 fs_manager.cc:359] Metadata directory not provided
I20260927 15:12:30.917732 25153 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260927 15:12:30.921497 25153 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.000s sys 0.003s
I20260927 15:12:30.923583 25168 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260927 15:12:30.924803 25153 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260927 15:12:30.924896 25153 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790521920546562-17952-0/minicluster-data/ts-2/data,/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790521920546562-17952-0/minicluster-data/ts-2/wal
uuid: "e94ed22dcc4f4c828fb3714f2d327a6e"
format_stamp: "Formatted at 2026-09-27 15:12:29 on dist-test-slave-5s2t"
server_key: "902ca46ab19775f64670060e17276ea0"
server_key_iv: "337cc017a73307105fb07f3250053c89"
server_key_version: "encryptionkey@0"
I20260927 15:12:30.925406 25153 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790521920546562-17952-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790521920546562-17952-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790521920546562-17952-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260927 15:12:30.953569 25153 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260927 15:12:30.956527 25153 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260927 15:12:30.956691 25153 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260927 15:12:30.957253 25153 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260927 15:12:30.958048 25153 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260927 15:12:30.958092 25153 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260927 15:12:30.958133 25153 ts_tablet_manager.cc:610] Registered 0 tablets
I20260927 15:12:30.958161 25153 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260927 15:12:30.966224 25153 rpc_server.cc:307] RPC server started. Bound to: 127.17.136.3:33145
I20260927 15:12:30.966256 25281 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.136.3:33145 every 8 connection(s)
I20260927 15:12:30.967170 25153 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790521920546562-17952-0/minicluster-data/ts-2/data/info.pb
I20260927 15:12:30.970731 17952 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu as pid 25153
Sep 27 15:12:30 dist-test-slave-5s2t krb5kdc[24001](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790521950, etypes {rep=17 tkt=17 ses=17}, oryx/127.17.136.3@KRBTEST.COM for oryx/127.17.136.62@KRBTEST.COM
Sep 27 15:12:30 dist-test-slave-5s2t krb5kdc[24001](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790521950, etypes {rep=17 tkt=17 ses=17}, oryx/127.17.136.3@KRBTEST.COM for oryx/127.17.136.60@KRBTEST.COM
I20260927 15:12:30.985244 25293 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:30.972642 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39712 (local address 127.17.136.62:33401)
0927 15:12:30.972840 (+ 198us) server_negotiation.cc:206] Beginning negotiation
0927 15:12:30.972844 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0927 15:12:30.974519 (+ 1675us) server_negotiation.cc:407] Connection header received
0927 15:12:30.975087 (+ 568us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:12:30.975090 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:12:30.975134 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:12:30.975214 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0927 15:12:30.976474 (+ 1260us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:30.977172 (+ 698us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:30.978187 (+ 1015us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:30.978481 (+ 294us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:30.978574 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:30.981121 (+ 2547us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0927 15:12:30.981125 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0927 15:12:30.981127 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0927 15:12:30.981154 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0927 15:12:30.983159 (+ 2005us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:12:30.983615 (+ 456us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:12:30.983618 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:12:30.983620 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:12:30.983711 (+ 91us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:12:30.984045 (+ 334us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:12:30.984048 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:12:30.984050 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:12:30.984252 (+ 202us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0927 15:12:30.984368 (+ 116us) server_negotiation.cc:1035] Waiting for connection context
0927 15:12:30.984962 (+ 594us) server_negotiation.cc:299] Negotiation successful
0927 15:12:30.985077 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":135,"thread_start_us":61,"threads_started":1}
I20260927 15:12:30.986166 25286 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:30.969504 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.60:40351 (local address 127.17.136.3:49841)
0927 15:12:30.969976 (+ 472us) negotiation.cc:107] Waiting for socket to connect
0927 15:12:30.970028 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0927 15:12:30.970981 (+ 953us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0927 15:12:30.971616 (+ 635us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0927 15:12:30.971622 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0927 15:12:30.972294 (+ 672us) client_negotiation.cc:189] Negotiated authn=SASL
0927 15:12:30.973136 (+ 842us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:12:30.973155 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:12:30.974246 (+ 1091us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:12:30.974249 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:12:30.975797 (+ 1548us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:12:30.975808 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:12:30.976463 (+ 655us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:12:30.976478 (+ 15us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:12:30.976714 (+ 236us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:30.977662 (+ 948us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0927 15:12:30.977675 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0927 15:12:30.979926 (+ 2251us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0927 15:12:30.983151 (+ 3225us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0927 15:12:30.983154 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0927 15:12:30.983156 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0927 15:12:30.983511 (+ 355us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0927 15:12:30.983804 (+ 293us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0927 15:12:30.983807 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0927 15:12:30.983809 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0927 15:12:30.983984 (+ 175us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0927 15:12:30.984386 (+ 402us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0927 15:12:30.984392 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0927 15:12:30.984674 (+ 282us) client_negotiation.cc:769] Sending connection context
0927 15:12:30.984860 (+ 186us) client_negotiation.cc:240] Negotiation successful
0927 15:12:30.985175 (+ 315us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":271,"mutex_wait_us":450,"spinlock_wait_cycles":21120,"thread_start_us":129,"threads_started":1}
I20260927 15:12:30.986768 25013 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:30.968956 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.136.3:49841 (local address 127.17.136.60:40351)
0927 15:12:30.969071 (+ 115us) server_negotiation.cc:206] Beginning negotiation
0927 15:12:30.969075 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0927 15:12:30.970125 (+ 1050us) server_negotiation.cc:407] Connection header received
0927 15:12:30.971190 (+ 1065us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:12:30.971193 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:12:30.971283 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:12:30.971336 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0927 15:12:30.973297 (+ 1961us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:30.974131 (+ 834us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:30.975919 (+ 1788us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:30.976245 (+ 326us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:30.976327 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:30.980118 (+ 3791us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0927 15:12:30.980122 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0927 15:12:30.980125 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0927 15:12:30.980148 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0927 15:12:30.983035 (+ 2887us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:12:30.983615 (+ 580us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:12:30.983618 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:12:30.983620 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:12:30.983711 (+ 91us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:12:30.984087 (+ 376us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:12:30.984090 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:12:30.984092 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:12:30.984260 (+ 168us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0927 15:12:30.984336 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0927 15:12:30.986535 (+ 2199us) server_negotiation.cc:299] Negotiation successful
0927 15:12:30.986636 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260927 15:12:30.986775 25297 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:30.973557 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35576 (local address 127.17.136.61:42371)
0927 15:12:30.973993 (+ 436us) server_negotiation.cc:206] Beginning negotiation
0927 15:12:30.973997 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0927 15:12:30.974834 (+ 837us) server_negotiation.cc:407] Connection header received
0927 15:12:30.974872 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:12:30.974875 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:12:30.974915 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:12:30.974989 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0927 15:12:30.978821 (+ 3832us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:30.979656 (+ 835us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:30.980724 (+ 1068us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:30.981080 (+ 356us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:30.981166 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:30.982774 (+ 1608us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0927 15:12:30.982779 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0927 15:12:30.982782 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0927 15:12:30.982806 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0927 15:12:30.984646 (+ 1840us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:12:30.985110 (+ 464us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:12:30.985114 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:12:30.985115 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:12:30.985195 (+ 80us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:12:30.985447 (+ 252us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:12:30.985451 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:12:30.985453 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:12:30.985648 (+ 195us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0927 15:12:30.985753 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0927 15:12:30.986224 (+ 471us) server_negotiation.cc:299] Negotiation successful
0927 15:12:30.986618 (+ 394us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":373,"thread_start_us":74,"threads_started":1}
I20260927 15:12:30.987725 25294 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:30.972960 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56212 (local address 127.17.136.60:40351)
0927 15:12:30.978937 (+ 5977us) server_negotiation.cc:206] Beginning negotiation
0927 15:12:30.978949 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0927 15:12:30.978960 (+ 11us) server_negotiation.cc:407] Connection header received
0927 15:12:30.978990 (+ 30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:12:30.978993 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:12:30.979033 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:12:30.979815 (+ 782us) server_negotiation.cc:226] Negotiated authn=SASL
0927 15:12:30.979905 (+ 90us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:30.980655 (+ 750us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:30.981647 (+ 992us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:30.981973 (+ 326us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:30.982358 (+ 385us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:30.983411 (+ 1053us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0927 15:12:30.983415 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0927 15:12:30.983417 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0927 15:12:30.983456 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0927 15:12:30.985109 (+ 1653us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:12:30.985522 (+ 413us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:12:30.985525 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:12:30.985526 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:12:30.985591 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:12:30.985867 (+ 276us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:12:30.985870 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:12:30.985872 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:12:30.986061 (+ 189us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0927 15:12:30.986681 (+ 620us) server_negotiation.cc:1035] Waiting for connection context
0927 15:12:30.986751 (+ 70us) server_negotiation.cc:299] Negotiation successful
0927 15:12:30.987578 (+ 827us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":5907,"thread_start_us":79,"threads_started":1}
I20260927 15:12:30.987905 25282 heartbeater.cc:347] Connected to a master server at 127.17.136.60:40351
I20260927 15:12:30.988135 25282 heartbeater.cc:464] Registering TS with master...
I20260927 15:12:30.988504 24085 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:30.969633 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.136.3:33837 (local address 127.17.136.62:33401)
0927 15:12:30.969784 (+ 151us) server_negotiation.cc:206] Beginning negotiation
0927 15:12:30.969789 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0927 15:12:30.970125 (+ 336us) server_negotiation.cc:407] Connection header received
0927 15:12:30.971156 (+ 1031us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:12:30.971159 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:12:30.971213 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:12:30.971312 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0927 15:12:30.973284 (+ 1972us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:30.974043 (+ 759us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:30.975915 (+ 1872us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:30.976228 (+ 313us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:30.976319 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:30.980118 (+ 3799us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0927 15:12:30.980122 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0927 15:12:30.980125 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0927 15:12:30.980148 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0927 15:12:30.981795 (+ 1647us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:12:30.987171 (+ 5376us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:12:30.987175 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:12:30.987176 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:12:30.987277 (+ 101us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:12:30.987573 (+ 296us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:12:30.987576 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:12:30.987578 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:12:30.987757 (+ 179us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0927 15:12:30.987835 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0927 15:12:30.988266 (+ 431us) server_negotiation.cc:299] Negotiation successful
0927 15:12:30.988371 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260927 15:12:30.988667 25282 heartbeater.cc:511] Master 127.17.136.60:40351 requested a full tablet report, sending...
I20260927 15:12:30.989228 25287 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:30.969504 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.62:33401 (local address 127.17.136.3:33837)
0927 15:12:30.969993 (+ 489us) negotiation.cc:107] Waiting for socket to connect
0927 15:12:30.970028 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0927 15:12:30.970978 (+ 950us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0927 15:12:30.971612 (+ 634us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0927 15:12:30.971620 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0927 15:12:30.972294 (+ 674us) client_negotiation.cc:189] Negotiated authn=SASL
0927 15:12:30.973136 (+ 842us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:12:30.973155 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:12:30.974197 (+ 1042us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:12:30.974200 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:12:30.975788 (+ 1588us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:12:30.975799 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:12:30.976463 (+ 664us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:12:30.976467 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:12:30.976736 (+ 269us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:30.977412 (+ 676us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0927 15:12:30.977434 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0927 15:12:30.979950 (+ 2516us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0927 15:12:30.982226 (+ 2276us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0927 15:12:30.982231 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0927 15:12:30.982246 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0927 15:12:30.987068 (+ 4822us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0927 15:12:30.987392 (+ 324us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0927 15:12:30.987395 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0927 15:12:30.987397 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0927 15:12:30.987483 (+ 86us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0927 15:12:30.987886 (+ 403us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0927 15:12:30.987889 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0927 15:12:30.988003 (+ 114us) client_negotiation.cc:769] Sending connection context
0927 15:12:30.988626 (+ 623us) client_negotiation.cc:240] Negotiation successful
0927 15:12:30.988773 (+ 147us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":322,"mutex_wait_us":332,"spinlock_wait_cycles":24576,"thread_start_us":140,"threads_started":1}
I20260927 15:12:30.989657 24830 ts_manager.cc:194] Registered new tserver with Master: e94ed22dcc4f4c828fb3714f2d327a6e (127.17.136.3:33145)
Sep 27 15:12:30 dist-test-slave-5s2t krb5kdc[24001](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790521950, etypes {rep=17 tkt=17 ses=17}, oryx/127.17.136.3@KRBTEST.COM for oryx/127.17.136.61@KRBTEST.COM
I20260927 15:12:30.989477 24044 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:39712:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260927 15:12:30.992009 25283 heartbeater.cc:347] Connected to a master server at 127.17.136.62:33401
I20260927 15:12:30.992084 25283 heartbeater.cc:464] Registering TS with master...
I20260927 15:12:30.992254 25283 heartbeater.cc:511] Master 127.17.136.62:33401 requested a full tablet report, sending...
I20260927 15:12:30.992851 24043 ts_manager.cc:194] Re-registered known tserver with Master: e94ed22dcc4f4c828fb3714f2d327a6e (127.17.136.3:33145)
W20260927 15:12:30.993099 24044 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:12:30.993523 24043 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.17.136.3@KRBTEST.COM'} at 127.17.136.3:33837
I20260927 15:12:30.993594 25288 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:30.970553 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.61:42371 (local address 127.17.136.3:46297)
0927 15:12:30.971355 (+ 802us) negotiation.cc:107] Waiting for socket to connect
0927 15:12:30.971368 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0927 15:12:30.971487 (+ 119us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0927 15:12:30.971829 (+ 342us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0927 15:12:30.971831 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0927 15:12:30.973271 (+ 1440us) client_negotiation.cc:189] Negotiated authn=SASL
0927 15:12:30.973376 (+ 105us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:12:30.973382 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:12:30.974356 (+ 974us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:12:30.974359 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:12:30.975797 (+ 1438us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:12:30.975808 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:12:30.976463 (+ 655us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:12:30.976466 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:12:30.976723 (+ 257us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:30.977556 (+ 833us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0927 15:12:30.977570 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0927 15:12:30.990580 (+ 13010us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0927 15:12:30.992198 (+ 1618us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0927 15:12:30.992202 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0927 15:12:30.992203 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0927 15:12:30.992415 (+ 212us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0927 15:12:30.992692 (+ 277us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0927 15:12:30.992694 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0927 15:12:30.992696 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0927 15:12:30.992765 (+ 69us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0927 15:12:30.993130 (+ 365us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0927 15:12:30.993134 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0927 15:12:30.993219 (+ 85us) client_negotiation.cc:769] Sending connection context
0927 15:12:30.993301 (+ 82us) client_negotiation.cc:240] Negotiation successful
0927 15:12:30.993426 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":747,"mutex_wait_us":270,"spinlock_wait_cycles":4352,"thread_start_us":66,"threads_started":1}
I20260927 15:12:30.993613 24768 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:30.970643 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.136.3:46297 (local address 127.17.136.61:42371)
0927 15:12:30.970754 (+ 111us) server_negotiation.cc:206] Beginning negotiation
0927 15:12:30.970758 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0927 15:12:30.971430 (+ 672us) server_negotiation.cc:407] Connection header received
0927 15:12:30.971598 (+ 168us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:12:30.971602 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:12:30.971650 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:12:30.971699 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0927 15:12:30.973498 (+ 1799us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:30.974239 (+ 741us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:30.975919 (+ 1680us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:30.976250 (+ 331us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:30.976313 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:30.990693 (+ 14380us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0927 15:12:30.990696 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0927 15:12:30.990698 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0927 15:12:30.990717 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0927 15:12:30.992086 (+ 1369us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:12:30.992529 (+ 443us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:12:30.992533 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:12:30.992534 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:12:30.992612 (+ 78us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:12:30.992855 (+ 243us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:12:30.992858 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:12:30.992860 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:12:30.993047 (+ 187us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0927 15:12:30.993127 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0927 15:12:30.993375 (+ 248us) server_negotiation.cc:299] Negotiation successful
0927 15:12:30.993481 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260927 15:12:30.994216 25284 heartbeater.cc:347] Connected to a master server at 127.17.136.61:42371
I20260927 15:12:30.994293 25284 heartbeater.cc:464] Registering TS with master...
I20260927 15:12:30.994474 25284 heartbeater.cc:511] Master 127.17.136.61:42371 requested a full tablet report, sending...
I20260927 15:12:30.995069 24646 ts_manager.cc:194] Registered new tserver with Master: e94ed22dcc4f4c828fb3714f2d327a6e (127.17.136.3:33145)
I20260927 15:12:30.996037 24794 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5d94e22c8fa74c10a9732bb2af78fb98 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "5d94e22c8fa74c10a9732bb2af78fb98" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "5d94e22c8fa74c10a9732bb2af78fb98" member_type: VOTER last_known_addr { host: "127.17.136.62" port: 33401 } } peers { permanent_uuid: "cc335ec49c7b46d8b3bfc44fc1f32579" member_type: VOTER last_known_addr { host: "127.17.136.61" port: 42371 } attrs { promote: false } } peers { permanent_uuid: "3b1c4bd139bf4929b313361ea24d3eab" member_type: NON_VOTER last_known_addr { host: "127.17.136.60" port: 40351 } attrs { promote: true } } }
I20260927 15:12:30.996156 24794 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5d94e22c8fa74c10a9732bb2af78fb98 [sys.catalog]: This master's current role is: LEADER
I20260927 15:12:30.999135 25302 raft_consensus.cc:1050] T 00000000000000000000000000000000 P 5d94e22c8fa74c10a9732bb2af78fb98: attempting to promote NON_VOTER 3b1c4bd139bf4929b313361ea24d3eab to VOTER
I20260927 15:12:30.999517 25302 consensus_queue.cc:237] T 00000000000000000000000000000000 P 5d94e22c8fa74c10a9732bb2af78fb98 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "5d94e22c8fa74c10a9732bb2af78fb98" member_type: VOTER last_known_addr { host: "127.17.136.62" port: 33401 } } peers { permanent_uuid: "cc335ec49c7b46d8b3bfc44fc1f32579" member_type: VOTER last_known_addr { host: "127.17.136.61" port: 42371 } attrs { promote: false } } peers { permanent_uuid: "3b1c4bd139bf4929b313361ea24d3eab" member_type: VOTER last_known_addr { host: "127.17.136.60" port: 40351 } attrs { promote: false } }
I20260927 15:12:31.000521 24647 raft_consensus.cc:1261] T 00000000000000000000000000000000 P cc335ec49c7b46d8b3bfc44fc1f32579 [term 1 FOLLOWER]: Refusing update from remote peer 5d94e22c8fa74c10a9732bb2af78fb98: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20260927 15:12:31.000749 24840 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 3b1c4bd139bf4929b313361ea24d3eab [term 1 LEARNER]: Refusing update from remote peer 5d94e22c8fa74c10a9732bb2af78fb98: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20260927 15:12:31.000880 24794 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 5d94e22c8fa74c10a9732bb2af78fb98 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc335ec49c7b46d8b3bfc44fc1f32579" member_type: VOTER last_known_addr { host: "127.17.136.61" port: 42371 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260927 15:12:31.001103 25300 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 5d94e22c8fa74c10a9732bb2af78fb98 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3b1c4bd139bf4929b313361ea24d3eab" member_type: VOTER last_known_addr { host: "127.17.136.60" port: 40351 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260927 15:12:31.002188 25302 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 5d94e22c8fa74c10a9732bb2af78fb98 [term 1 LEADER]: Committing config change with OpId 1.9: config changed from index 7 to 9, 3b1c4bd139bf4929b313361ea24d3eab (127.17.136.60) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "5d94e22c8fa74c10a9732bb2af78fb98" member_type: VOTER last_known_addr { host: "127.17.136.62" port: 33401 } } peers { permanent_uuid: "cc335ec49c7b46d8b3bfc44fc1f32579" member_type: VOTER last_known_addr { host: "127.17.136.61" port: 42371 } attrs { promote: false } } peers { permanent_uuid: "3b1c4bd139bf4929b313361ea24d3eab" member_type: VOTER last_known_addr { host: "127.17.136.60" port: 40351 } attrs { promote: false } } }
I20260927 15:12:31.003605 25302 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5d94e22c8fa74c10a9732bb2af78fb98 [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "5d94e22c8fa74c10a9732bb2af78fb98" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "5d94e22c8fa74c10a9732bb2af78fb98" member_type: VOTER last_known_addr { host: "127.17.136.62" port: 33401 } } peers { permanent_uuid: "cc335ec49c7b46d8b3bfc44fc1f32579" member_type: VOTER last_known_addr { host: "127.17.136.61" port: 42371 } attrs { promote: false } } peers { permanent_uuid: "3b1c4bd139bf4929b313361ea24d3eab" member_type: VOTER last_known_addr { host: "127.17.136.60" port: 40351 } attrs { promote: false } } }
I20260927 15:12:31.003706 25302 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5d94e22c8fa74c10a9732bb2af78fb98 [sys.catalog]: This master's current role is: LEADER
I20260927 15:12:31.003602 24647 raft_consensus.cc:2932] T 00000000000000000000000000000000 P cc335ec49c7b46d8b3bfc44fc1f32579 [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 7 to 9, 3b1c4bd139bf4929b313361ea24d3eab (127.17.136.60) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "5d94e22c8fa74c10a9732bb2af78fb98" member_type: VOTER last_known_addr { host: "127.17.136.62" port: 33401 } } peers { permanent_uuid: "cc335ec49c7b46d8b3bfc44fc1f32579" member_type: VOTER last_known_addr { host: "127.17.136.61" port: 42371 } attrs { promote: false } } peers { permanent_uuid: "3b1c4bd139bf4929b313361ea24d3eab" member_type: VOTER last_known_addr { host: "127.17.136.60" port: 40351 } attrs { promote: false } } }
I20260927 15:12:31.003427 24840 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 3b1c4bd139bf4929b313361ea24d3eab [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 7 to 9, 3b1c4bd139bf4929b313361ea24d3eab (127.17.136.60) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "5d94e22c8fa74c10a9732bb2af78fb98" member_type: VOTER last_known_addr { host: "127.17.136.62" port: 33401 } } peers { permanent_uuid: "cc335ec49c7b46d8b3bfc44fc1f32579" member_type: VOTER last_known_addr { host: "127.17.136.61" port: 42371 } attrs { promote: false } } peers { permanent_uuid: "3b1c4bd139bf4929b313361ea24d3eab" member_type: VOTER last_known_addr { host: "127.17.136.60" port: 40351 } attrs { promote: false } } }
I20260927 15:12:31.003819 25302 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5d94e22c8fa74c10a9732bb2af78fb98 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "5d94e22c8fa74c10a9732bb2af78fb98" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "5d94e22c8fa74c10a9732bb2af78fb98" member_type: VOTER last_known_addr { host: "127.17.136.62" port: 33401 } } peers { permanent_uuid: "cc335ec49c7b46d8b3bfc44fc1f32579" member_type: VOTER last_known_addr { host: "127.17.136.61" port: 42371 } attrs { promote: false } } peers { permanent_uuid: "3b1c4bd139bf4929b313361ea24d3eab" member_type: VOTER last_known_addr { host: "127.17.136.60" port: 40351 } attrs { promote: false } } }
I20260927 15:12:31.003886 25302 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5d94e22c8fa74c10a9732bb2af78fb98 [sys.catalog]: This master's current role is: LEADER
I20260927 15:12:31.003988 25302 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5d94e22c8fa74c10a9732bb2af78fb98 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "5d94e22c8fa74c10a9732bb2af78fb98" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "5d94e22c8fa74c10a9732bb2af78fb98" member_type: VOTER last_known_addr { host: "127.17.136.62" port: 33401 } } peers { permanent_uuid: "cc335ec49c7b46d8b3bfc44fc1f32579" member_type: VOTER last_known_addr { host: "127.17.136.61" port: 42371 } attrs { promote: false } } peers { permanent_uuid: "3b1c4bd139bf4929b313361ea24d3eab" member_type: VOTER last_known_addr { host: "127.17.136.60" port: 40351 } attrs { promote: false } } }
I20260927 15:12:31.004057 25302 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5d94e22c8fa74c10a9732bb2af78fb98 [sys.catalog]: This master's current role is: LEADER
I20260927 15:12:31.004905 24872 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3b1c4bd139bf4929b313361ea24d3eab [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "5d94e22c8fa74c10a9732bb2af78fb98" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "5d94e22c8fa74c10a9732bb2af78fb98" member_type: VOTER last_known_addr { host: "127.17.136.62" port: 33401 } } peers { permanent_uuid: "cc335ec49c7b46d8b3bfc44fc1f32579" member_type: VOTER last_known_addr { host: "127.17.136.61" port: 42371 } attrs { promote: false } } peers { permanent_uuid: "3b1c4bd139bf4929b313361ea24d3eab" member_type: VOTER last_known_addr { host: "127.17.136.60" port: 40351 } attrs { promote: false } } }
I20260927 15:12:31.005012 24872 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3b1c4bd139bf4929b313361ea24d3eab [sys.catalog]: This master's current role is: FOLLOWER
I20260927 15:12:31.005479 25310 sys_catalog.cc:455] T 00000000000000000000000000000000 P cc335ec49c7b46d8b3bfc44fc1f32579 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "5d94e22c8fa74c10a9732bb2af78fb98" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "5d94e22c8fa74c10a9732bb2af78fb98" member_type: VOTER last_known_addr { host: "127.17.136.62" port: 33401 } } peers { permanent_uuid: "cc335ec49c7b46d8b3bfc44fc1f32579" member_type: VOTER last_known_addr { host: "127.17.136.61" port: 42371 } attrs { promote: false } } peers { permanent_uuid: "3b1c4bd139bf4929b313361ea24d3eab" member_type: VOTER last_known_addr { host: "127.17.136.60" port: 40351 } attrs { promote: false } } }
I20260927 15:12:31.005596 25310 sys_catalog.cc:458] T 00000000000000000000000000000000 P cc335ec49c7b46d8b3bfc44fc1f32579 [sys.catalog]: This master's current role is: FOLLOWER
I20260927 15:12:31.013793 24603 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:31.008536 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.1:41807 (local address 127.0.0.1:42108)
0927 15:12:31.009259 (+ 723us) negotiation.cc:107] Waiting for socket to connect
0927 15:12:31.009273 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0927 15:12:31.009351 (+ 78us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0927 15:12:31.009858 (+ 507us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0927 15:12:31.009861 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0927 15:12:31.009880 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0927 15:12:31.009977 (+ 97us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:12:31.009983 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:12:31.011215 (+ 1232us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:12:31.011218 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:12:31.012374 (+ 1156us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:12:31.012381 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:12:31.013459 (+ 1078us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:12:31.013462 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:12:31.013518 (+ 56us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:31.013543 (+ 25us) client_negotiation.cc:769] Sending connection context
0927 15:12:31.013604 (+ 61us) client_negotiation.cc:240] Negotiation successful
0927 15:12:31.013669 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":655}
I20260927 15:12:31.013839 25311 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:31.008667 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42108 (local address 127.17.136.1:41807)
0927 15:12:31.009122 (+ 455us) server_negotiation.cc:206] Beginning negotiation
0927 15:12:31.009133 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0927 15:12:31.009323 (+ 190us) server_negotiation.cc:407] Connection header received
0927 15:12:31.009465 (+ 142us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:12:31.009469 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:12:31.009711 (+ 242us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:12:31.010133 (+ 422us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0927 15:12:31.010255 (+ 122us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:31.011118 (+ 863us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:31.012492 (+ 1374us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:31.013329 (+ 837us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:31.013463 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:31.013619 (+ 156us) server_negotiation.cc:1035] Waiting for connection context
0927 15:12:31.013659 (+ 40us) server_negotiation.cc:299] Negotiation successful
0927 15:12:31.013731 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":345,"thread_start_us":117,"threads_started":1}
I20260927 15:12:31.014726 25313 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:31.008779 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.2:42827 (local address 127.0.0.1:53090)
0927 15:12:31.010118 (+ 1339us) negotiation.cc:107] Waiting for socket to connect
0927 15:12:31.010129 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0927 15:12:31.010196 (+ 67us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0927 15:12:31.010723 (+ 527us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0927 15:12:31.010726 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0927 15:12:31.010744 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0927 15:12:31.010829 (+ 85us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:12:31.010834 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:12:31.012269 (+ 1435us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:12:31.012272 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:12:31.013450 (+ 1178us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:12:31.013459 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:12:31.014423 (+ 964us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:12:31.014426 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:12:31.014502 (+ 76us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:31.014519 (+ 17us) client_negotiation.cc:769] Sending connection context
0927 15:12:31.014565 (+ 46us) client_negotiation.cc:240] Negotiation successful
0927 15:12:31.014612 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1287,"mutex_wait_us":25,"thread_start_us":73,"threads_started":1}
I20260927 15:12:31.014834 25314 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:31.008980 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53090 (local address 127.17.136.2:42827)
0927 15:12:31.010375 (+ 1395us) server_negotiation.cc:206] Beginning negotiation
0927 15:12:31.010384 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0927 15:12:31.010400 (+ 16us) server_negotiation.cc:407] Connection header received
0927 15:12:31.010455 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:12:31.010458 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:12:31.010602 (+ 144us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:12:31.010708 (+ 106us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0927 15:12:31.010953 (+ 245us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:31.012144 (+ 1191us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:31.013575 (+ 1431us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:31.014321 (+ 746us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:31.014430 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:31.014558 (+ 128us) server_negotiation.cc:1035] Waiting for connection context
0927 15:12:31.014604 (+ 46us) server_negotiation.cc:299] Negotiation successful
0927 15:12:31.014686 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1317,"thread_start_us":100,"threads_started":1}
I20260927 15:12:31.016322 25312 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:31.009006 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.3:33145 (local address 127.0.0.1:39730)
0927 15:12:31.010878 (+ 1872us) negotiation.cc:107] Waiting for socket to connect
0927 15:12:31.010889 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0927 15:12:31.010985 (+ 96us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0927 15:12:31.011455 (+ 470us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0927 15:12:31.011457 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0927 15:12:31.011473 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0927 15:12:31.011558 (+ 85us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:12:31.011564 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:12:31.012629 (+ 1065us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:12:31.012632 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:12:31.014726 (+ 2094us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:12:31.014735 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:12:31.015990 (+ 1255us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:12:31.015993 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:12:31.016061 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:31.016079 (+ 18us) client_negotiation.cc:769] Sending connection context
0927 15:12:31.016141 (+ 62us) client_negotiation.cc:240] Negotiation successful
0927 15:12:31.016203 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1823,"mutex_wait_us":1284,"thread_start_us":83,"threads_started":1}
I20260927 15:12:31.016390 25315 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:31.009623 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39730 (local address 127.17.136.3:33145)
0927 15:12:31.010120 (+ 497us) server_negotiation.cc:206] Beginning negotiation
0927 15:12:31.010134 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0927 15:12:31.010962 (+ 828us) server_negotiation.cc:407] Connection header received
0927 15:12:31.011094 (+ 132us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:12:31.011099 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:12:31.011334 (+ 235us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:12:31.011456 (+ 122us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0927 15:12:31.011666 (+ 210us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:31.012513 (+ 847us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:31.014847 (+ 2334us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:31.015700 (+ 853us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:31.015796 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:31.015933 (+ 137us) server_negotiation.cc:1035] Waiting for connection context
0927 15:12:31.016185 (+ 252us) server_negotiation.cc:299] Negotiation successful
0927 15:12:31.016267 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":403,"thread_start_us":112,"threads_started":1}
I20260927 15:12:31.016980 24943 tablet_service.cc:1467] Processing CreateTablet for tablet 936b28a07215490a8e30b6131ab4c569 (DEFAULT_TABLE table=test-table [id=f2c4877166d444d3b436c5a1103d0e02]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:12:31.018066 24943 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 936b28a07215490a8e30b6131ab4c569. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:12:31.017720 25080 tablet_service.cc:1467] Processing CreateTablet for tablet 936b28a07215490a8e30b6131ab4c569 (DEFAULT_TABLE table=test-table [id=f2c4877166d444d3b436c5a1103d0e02]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:12:31.018642 25080 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 936b28a07215490a8e30b6131ab4c569. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:12:31.024287 25216 tablet_service.cc:1467] Processing CreateTablet for tablet 936b28a07215490a8e30b6131ab4c569 (DEFAULT_TABLE table=test-table [id=f2c4877166d444d3b436c5a1103d0e02]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:12:31.025053 25216 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 936b28a07215490a8e30b6131ab4c569. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:12:31.026091 25317 tablet_bootstrap.cc:492] T 936b28a07215490a8e30b6131ab4c569 P 45aed58e7be84f1c93e2ca9ab659462e: Bootstrap starting.
I20260927 15:12:31.026489 25316 tablet_bootstrap.cc:492] T 936b28a07215490a8e30b6131ab4c569 P bce84efcd7394877943020b62471f259: Bootstrap starting.
I20260927 15:12:31.028777 25316 tablet_bootstrap.cc:654] T 936b28a07215490a8e30b6131ab4c569 P bce84efcd7394877943020b62471f259: Neither blocks nor log segments found. Creating new log.
I20260927 15:12:31.028951 25317 tablet_bootstrap.cc:654] T 936b28a07215490a8e30b6131ab4c569 P 45aed58e7be84f1c93e2ca9ab659462e: Neither blocks nor log segments found. Creating new log.
I20260927 15:12:31.029627 25316 log.cc:824] T 936b28a07215490a8e30b6131ab4c569 P bce84efcd7394877943020b62471f259: Log is configured to *not* fsync() on all Append() calls
I20260927 15:12:31.029722 25317 log.cc:824] T 936b28a07215490a8e30b6131ab4c569 P 45aed58e7be84f1c93e2ca9ab659462e: Log is configured to *not* fsync() on all Append() calls
I20260927 15:12:31.031649 25316 tablet_bootstrap.cc:492] T 936b28a07215490a8e30b6131ab4c569 P bce84efcd7394877943020b62471f259: No bootstrap required, opened a new log
I20260927 15:12:31.031649 25317 tablet_bootstrap.cc:492] T 936b28a07215490a8e30b6131ab4c569 P 45aed58e7be84f1c93e2ca9ab659462e: No bootstrap required, opened a new log
I20260927 15:12:31.031840 25316 ts_tablet_manager.cc:1397] T 936b28a07215490a8e30b6131ab4c569 P bce84efcd7394877943020b62471f259: Time spent bootstrapping tablet: real 0.005s user 0.001s sys 0.004s
I20260927 15:12:31.031840 25317 ts_tablet_manager.cc:1397] T 936b28a07215490a8e30b6131ab4c569 P 45aed58e7be84f1c93e2ca9ab659462e: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260927 15:12:31.032106 25320 tablet_bootstrap.cc:492] T 936b28a07215490a8e30b6131ab4c569 P e94ed22dcc4f4c828fb3714f2d327a6e: Bootstrap starting.
I20260927 15:12:31.033954 25320 tablet_bootstrap.cc:654] T 936b28a07215490a8e30b6131ab4c569 P e94ed22dcc4f4c828fb3714f2d327a6e: Neither blocks nor log segments found. Creating new log.
I20260927 15:12:31.034621 25320 log.cc:824] T 936b28a07215490a8e30b6131ab4c569 P e94ed22dcc4f4c828fb3714f2d327a6e: Log is configured to *not* fsync() on all Append() calls
I20260927 15:12:31.036207 25320 tablet_bootstrap.cc:492] T 936b28a07215490a8e30b6131ab4c569 P e94ed22dcc4f4c828fb3714f2d327a6e: No bootstrap required, opened a new log
I20260927 15:12:31.036376 25320 ts_tablet_manager.cc:1397] T 936b28a07215490a8e30b6131ab4c569 P e94ed22dcc4f4c828fb3714f2d327a6e: Time spent bootstrapping tablet: real 0.004s user 0.003s sys 0.000s
I20260927 15:12:31.036202 25317 raft_consensus.cc:348] T 936b28a07215490a8e30b6131ab4c569 P 45aed58e7be84f1c93e2ca9ab659462e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45aed58e7be84f1c93e2ca9ab659462e" member_type: VOTER last_known_addr { host: "127.17.136.1" port: 41807 } } peers { permanent_uuid: "bce84efcd7394877943020b62471f259" member_type: VOTER last_known_addr { host: "127.17.136.2" port: 42827 } } peers { permanent_uuid: "e94ed22dcc4f4c828fb3714f2d327a6e" member_type: VOTER last_known_addr { host: "127.17.136.3" port: 33145 } }
I20260927 15:12:31.036484 25317 raft_consensus.cc:374] T 936b28a07215490a8e30b6131ab4c569 P 45aed58e7be84f1c93e2ca9ab659462e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:12:31.036547 25317 raft_consensus.cc:729] T 936b28a07215490a8e30b6131ab4c569 P 45aed58e7be84f1c93e2ca9ab659462e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 45aed58e7be84f1c93e2ca9ab659462e, State: Initialized, Role: FOLLOWER
I20260927 15:12:31.036990 25317 consensus_queue.cc:260] T 936b28a07215490a8e30b6131ab4c569 P 45aed58e7be84f1c93e2ca9ab659462e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45aed58e7be84f1c93e2ca9ab659462e" member_type: VOTER last_known_addr { host: "127.17.136.1" port: 41807 } } peers { permanent_uuid: "bce84efcd7394877943020b62471f259" member_type: VOTER last_known_addr { host: "127.17.136.2" port: 42827 } } peers { permanent_uuid: "e94ed22dcc4f4c828fb3714f2d327a6e" member_type: VOTER last_known_addr { host: "127.17.136.3" port: 33145 } }
I20260927 15:12:31.037143 25316 raft_consensus.cc:348] T 936b28a07215490a8e30b6131ab4c569 P bce84efcd7394877943020b62471f259 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45aed58e7be84f1c93e2ca9ab659462e" member_type: VOTER last_known_addr { host: "127.17.136.1" port: 41807 } } peers { permanent_uuid: "bce84efcd7394877943020b62471f259" member_type: VOTER last_known_addr { host: "127.17.136.2" port: 42827 } } peers { permanent_uuid: "e94ed22dcc4f4c828fb3714f2d327a6e" member_type: VOTER last_known_addr { host: "127.17.136.3" port: 33145 } }
I20260927 15:12:31.037384 25316 raft_consensus.cc:374] T 936b28a07215490a8e30b6131ab4c569 P bce84efcd7394877943020b62471f259 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:12:31.037436 25316 raft_consensus.cc:729] T 936b28a07215490a8e30b6131ab4c569 P bce84efcd7394877943020b62471f259 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bce84efcd7394877943020b62471f259, State: Initialized, Role: FOLLOWER
I20260927 15:12:31.037992 25317 ts_tablet_manager.cc:1428] T 936b28a07215490a8e30b6131ab4c569 P 45aed58e7be84f1c93e2ca9ab659462e: Time spent starting tablet: real 0.006s user 0.001s sys 0.005s
I20260927 15:12:31.038036 25316 consensus_queue.cc:260] T 936b28a07215490a8e30b6131ab4c569 P bce84efcd7394877943020b62471f259 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45aed58e7be84f1c93e2ca9ab659462e" member_type: VOTER last_known_addr { host: "127.17.136.1" port: 41807 } } peers { permanent_uuid: "bce84efcd7394877943020b62471f259" member_type: VOTER last_known_addr { host: "127.17.136.2" port: 42827 } } peers { permanent_uuid: "e94ed22dcc4f4c828fb3714f2d327a6e" member_type: VOTER last_known_addr { host: "127.17.136.3" port: 33145 } }
I20260927 15:12:31.038303 25010 heartbeater.cc:503] Master 127.17.136.62:33401 was elected leader, sending a full tablet report...
I20260927 15:12:31.038944 25316 ts_tablet_manager.cc:1428] T 936b28a07215490a8e30b6131ab4c569 P bce84efcd7394877943020b62471f259: Time spent starting tablet: real 0.007s user 0.006s sys 0.000s
I20260927 15:12:31.040488 25147 heartbeater.cc:503] Master 127.17.136.62:33401 was elected leader, sending a full tablet report...
I20260927 15:12:31.040467 25320 raft_consensus.cc:348] T 936b28a07215490a8e30b6131ab4c569 P e94ed22dcc4f4c828fb3714f2d327a6e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45aed58e7be84f1c93e2ca9ab659462e" member_type: VOTER last_known_addr { host: "127.17.136.1" port: 41807 } } peers { permanent_uuid: "bce84efcd7394877943020b62471f259" member_type: VOTER last_known_addr { host: "127.17.136.2" port: 42827 } } peers { permanent_uuid: "e94ed22dcc4f4c828fb3714f2d327a6e" member_type: VOTER last_known_addr { host: "127.17.136.3" port: 33145 } }
I20260927 15:12:31.040841 25320 raft_consensus.cc:374] T 936b28a07215490a8e30b6131ab4c569 P e94ed22dcc4f4c828fb3714f2d327a6e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:12:31.040897 25320 raft_consensus.cc:729] T 936b28a07215490a8e30b6131ab4c569 P e94ed22dcc4f4c828fb3714f2d327a6e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e94ed22dcc4f4c828fb3714f2d327a6e, State: Initialized, Role: FOLLOWER
I20260927 15:12:31.041316 25320 consensus_queue.cc:260] T 936b28a07215490a8e30b6131ab4c569 P e94ed22dcc4f4c828fb3714f2d327a6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45aed58e7be84f1c93e2ca9ab659462e" member_type: VOTER last_known_addr { host: "127.17.136.1" port: 41807 } } peers { permanent_uuid: "bce84efcd7394877943020b62471f259" member_type: VOTER last_known_addr { host: "127.17.136.2" port: 42827 } } peers { permanent_uuid: "e94ed22dcc4f4c828fb3714f2d327a6e" member_type: VOTER last_known_addr { host: "127.17.136.3" port: 33145 } }
I20260927 15:12:31.042225 25320 ts_tablet_manager.cc:1428] T 936b28a07215490a8e30b6131ab4c569 P e94ed22dcc4f4c828fb3714f2d327a6e: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20260927 15:12:31.042541 25283 heartbeater.cc:503] Master 127.17.136.62:33401 was elected leader, sending a full tablet report...
W20260927 15:12:31.065416 25012 tablet.cc:2369] T 936b28a07215490a8e30b6131ab4c569 P 45aed58e7be84f1c93e2ca9ab659462e: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260927 15:12:31.218418 25285 tablet.cc:2369] T 936b28a07215490a8e30b6131ab4c569 P e94ed22dcc4f4c828fb3714f2d327a6e: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260927 15:12:31.258095 25322 raft_consensus.cc:482] T 936b28a07215490a8e30b6131ab4c569 P 45aed58e7be84f1c93e2ca9ab659462e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:12:31.258304 25322 raft_consensus.cc:504] T 936b28a07215490a8e30b6131ab4c569 P 45aed58e7be84f1c93e2ca9ab659462e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45aed58e7be84f1c93e2ca9ab659462e" member_type: VOTER last_known_addr { host: "127.17.136.1" port: 41807 } } peers { permanent_uuid: "bce84efcd7394877943020b62471f259" member_type: VOTER last_known_addr { host: "127.17.136.2" port: 42827 } } peers { permanent_uuid: "e94ed22dcc4f4c828fb3714f2d327a6e" member_type: VOTER last_known_addr { host: "127.17.136.3" port: 33145 } }
I20260927 15:12:31.259526 25322 leader_election.cc:288] T 936b28a07215490a8e30b6131ab4c569 P 45aed58e7be84f1c93e2ca9ab659462e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bce84efcd7394877943020b62471f259 (127.17.136.2:42827), e94ed22dcc4f4c828fb3714f2d327a6e (127.17.136.3:33145)
I20260927 15:12:31.263321 25314 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:31.259950 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.136.1:60215 (local address 127.17.136.2:42827)
0927 15:12:31.260123 (+ 173us) server_negotiation.cc:206] Beginning negotiation
0927 15:12:31.260127 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0927 15:12:31.260249 (+ 122us) server_negotiation.cc:407] Connection header received
0927 15:12:31.260407 (+ 158us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:12:31.260409 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:12:31.260448 (+ 39us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:12:31.260513 (+ 65us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0927 15:12:31.260803 (+ 290us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:31.261281 (+ 478us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:31.262293 (+ 1012us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:31.262684 (+ 391us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:31.262782 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:31.262834 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0927 15:12:31.263107 (+ 273us) server_negotiation.cc:299] Negotiation successful
0927 15:12:31.263176 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":101}
I20260927 15:12:31.263347 25326 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:31.259800 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.2:42827 (local address 127.17.136.1:60215)
0927 15:12:31.260186 (+ 386us) negotiation.cc:107] Waiting for socket to connect
0927 15:12:31.260198 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0927 15:12:31.260278 (+ 80us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0927 15:12:31.260550 (+ 272us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0927 15:12:31.260552 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0927 15:12:31.260568 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0927 15:12:31.260701 (+ 133us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:12:31.260705 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:12:31.261381 (+ 676us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:12:31.261385 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:12:31.262184 (+ 799us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:12:31.262193 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:12:31.262782 (+ 589us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:12:31.262786 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:12:31.262980 (+ 194us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:31.263016 (+ 36us) client_negotiation.cc:769] Sending connection context
0927 15:12:31.263080 (+ 64us) client_negotiation.cc:240] Negotiation successful
0927 15:12:31.263147 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":329,"mutex_wait_us":251,"thread_start_us":40,"threads_started":1}
I20260927 15:12:31.263468 25315 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:31.259879 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.136.1:50401 (local address 127.17.136.3:33145)
0927 15:12:31.260027 (+ 148us) server_negotiation.cc:206] Beginning negotiation
0927 15:12:31.260033 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0927 15:12:31.260209 (+ 176us) server_negotiation.cc:407] Connection header received
0927 15:12:31.260342 (+ 133us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:12:31.260346 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:12:31.260395 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:12:31.260455 (+ 60us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0927 15:12:31.260726 (+ 271us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:31.261208 (+ 482us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:31.262311 (+ 1103us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:31.262685 (+ 374us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:31.262784 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:31.262834 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0927 15:12:31.263220 (+ 386us) server_negotiation.cc:299] Negotiation successful
0927 15:12:31.263318 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260927 15:12:31.263638 25325 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:31.259796 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.3:33145 (local address 127.17.136.1:50401)
0927 15:12:31.260119 (+ 323us) negotiation.cc:107] Waiting for socket to connect
0927 15:12:31.260134 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0927 15:12:31.260248 (+ 114us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0927 15:12:31.260473 (+ 225us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0927 15:12:31.260476 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0927 15:12:31.260492 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0927 15:12:31.260625 (+ 133us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:12:31.260631 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:12:31.261305 (+ 674us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:12:31.261308 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:12:31.262193 (+ 885us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:12:31.262201 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:12:31.262785 (+ 584us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:12:31.262788 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:12:31.262990 (+ 202us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:31.263087 (+ 97us) client_negotiation.cc:769] Sending connection context
0927 15:12:31.263190 (+ 103us) client_negotiation.cc:240] Negotiation successful
0927 15:12:31.263311 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":259,"mutex_wait_us":155,"thread_start_us":68,"threads_started":1}
I20260927 15:12:31.264256 25099 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "936b28a07215490a8e30b6131ab4c569" candidate_uuid: "45aed58e7be84f1c93e2ca9ab659462e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bce84efcd7394877943020b62471f259" is_pre_election: true
I20260927 15:12:31.264264 25236 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "936b28a07215490a8e30b6131ab4c569" candidate_uuid: "45aed58e7be84f1c93e2ca9ab659462e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e94ed22dcc4f4c828fb3714f2d327a6e" is_pre_election: true
I20260927 15:12:31.264528 25099 raft_consensus.cc:2454] T 936b28a07215490a8e30b6131ab4c569 P bce84efcd7394877943020b62471f259 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45aed58e7be84f1c93e2ca9ab659462e in term 0.
I20260927 15:12:31.264536 25236 raft_consensus.cc:2454] T 936b28a07215490a8e30b6131ab4c569 P e94ed22dcc4f4c828fb3714f2d327a6e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45aed58e7be84f1c93e2ca9ab659462e in term 0.
I20260927 15:12:31.264964 24896 leader_election.cc:302] T 936b28a07215490a8e30b6131ab4c569 P 45aed58e7be84f1c93e2ca9ab659462e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45aed58e7be84f1c93e2ca9ab659462e, bce84efcd7394877943020b62471f259; no voters:
I20260927 15:12:31.265214 25322 raft_consensus.cc:2781] T 936b28a07215490a8e30b6131ab4c569 P 45aed58e7be84f1c93e2ca9ab659462e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 15:12:31.265306 25322 raft_consensus.cc:482] T 936b28a07215490a8e30b6131ab4c569 P 45aed58e7be84f1c93e2ca9ab659462e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 15:12:31.265358 25322 raft_consensus.cc:3037] T 936b28a07215490a8e30b6131ab4c569 P 45aed58e7be84f1c93e2ca9ab659462e [term 0 FOLLOWER]: Advancing to term 1
W20260927 15:12:31.265589 25149 tablet.cc:2369] T 936b28a07215490a8e30b6131ab4c569 P bce84efcd7394877943020b62471f259: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260927 15:12:31.266435 25322 raft_consensus.cc:504] T 936b28a07215490a8e30b6131ab4c569 P 45aed58e7be84f1c93e2ca9ab659462e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45aed58e7be84f1c93e2ca9ab659462e" member_type: VOTER last_known_addr { host: "127.17.136.1" port: 41807 } } peers { permanent_uuid: "bce84efcd7394877943020b62471f259" member_type: VOTER last_known_addr { host: "127.17.136.2" port: 42827 } } peers { permanent_uuid: "e94ed22dcc4f4c828fb3714f2d327a6e" member_type: VOTER last_known_addr { host: "127.17.136.3" port: 33145 } }
I20260927 15:12:31.266780 25322 leader_election.cc:288] T 936b28a07215490a8e30b6131ab4c569 P 45aed58e7be84f1c93e2ca9ab659462e [CANDIDATE]: Term 1 election: Requested vote from peers bce84efcd7394877943020b62471f259 (127.17.136.2:42827), e94ed22dcc4f4c828fb3714f2d327a6e (127.17.136.3:33145)
I20260927 15:12:31.267113 25236 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "936b28a07215490a8e30b6131ab4c569" candidate_uuid: "45aed58e7be84f1c93e2ca9ab659462e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e94ed22dcc4f4c828fb3714f2d327a6e"
I20260927 15:12:31.267117 25099 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "936b28a07215490a8e30b6131ab4c569" candidate_uuid: "45aed58e7be84f1c93e2ca9ab659462e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bce84efcd7394877943020b62471f259"
I20260927 15:12:31.267238 25099 raft_consensus.cc:3037] T 936b28a07215490a8e30b6131ab4c569 P bce84efcd7394877943020b62471f259 [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:12:31.267238 25236 raft_consensus.cc:3037] T 936b28a07215490a8e30b6131ab4c569 P e94ed22dcc4f4c828fb3714f2d327a6e [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:12:31.268532 25236 raft_consensus.cc:2454] T 936b28a07215490a8e30b6131ab4c569 P e94ed22dcc4f4c828fb3714f2d327a6e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45aed58e7be84f1c93e2ca9ab659462e in term 1.
I20260927 15:12:31.268532 25099 raft_consensus.cc:2454] T 936b28a07215490a8e30b6131ab4c569 P bce84efcd7394877943020b62471f259 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45aed58e7be84f1c93e2ca9ab659462e in term 1.
I20260927 15:12:31.268796 24896 leader_election.cc:302] T 936b28a07215490a8e30b6131ab4c569 P 45aed58e7be84f1c93e2ca9ab659462e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 45aed58e7be84f1c93e2ca9ab659462e, bce84efcd7394877943020b62471f259, e94ed22dcc4f4c828fb3714f2d327a6e; no voters:
I20260927 15:12:31.268971 25322 raft_consensus.cc:2781] T 936b28a07215490a8e30b6131ab4c569 P 45aed58e7be84f1c93e2ca9ab659462e [term 1 FOLLOWER]: Leader election won for term 1
I20260927 15:12:31.269166 25322 raft_consensus.cc:686] T 936b28a07215490a8e30b6131ab4c569 P 45aed58e7be84f1c93e2ca9ab659462e [term 1 LEADER]: Becoming Leader. State: Replica: 45aed58e7be84f1c93e2ca9ab659462e, State: Running, Role: LEADER
I20260927 15:12:31.269485 25322 consensus_queue.cc:237] T 936b28a07215490a8e30b6131ab4c569 P 45aed58e7be84f1c93e2ca9ab659462e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45aed58e7be84f1c93e2ca9ab659462e" member_type: VOTER last_known_addr { host: "127.17.136.1" port: 41807 } } peers { permanent_uuid: "bce84efcd7394877943020b62471f259" member_type: VOTER last_known_addr { host: "127.17.136.2" port: 42827 } } peers { permanent_uuid: "e94ed22dcc4f4c828fb3714f2d327a6e" member_type: VOTER last_known_addr { host: "127.17.136.3" port: 33145 } }
I20260927 15:12:31.272811 24044 catalog_manager.cc:5495] T 936b28a07215490a8e30b6131ab4c569 P 45aed58e7be84f1c93e2ca9ab659462e reported cstate change: term changed from 0 to 1, leader changed from <none> to 45aed58e7be84f1c93e2ca9ab659462e (127.17.136.1). New cstate: current_term: 1 leader_uuid: "45aed58e7be84f1c93e2ca9ab659462e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45aed58e7be84f1c93e2ca9ab659462e" member_type: VOTER last_known_addr { host: "127.17.136.1" port: 41807 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bce84efcd7394877943020b62471f259" member_type: VOTER last_known_addr { host: "127.17.136.2" port: 42827 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e94ed22dcc4f4c828fb3714f2d327a6e" member_type: VOTER last_known_addr { host: "127.17.136.3" port: 33145 } health_report { overall_health: UNKNOWN } } }
I20260927 15:12:31.303660 25311 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:31.300222 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42110 (local address 127.17.136.1:41807)
0927 15:12:31.300378 (+ 156us) server_negotiation.cc:206] Beginning negotiation
0927 15:12:31.300382 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0927 15:12:31.300414 (+ 32us) server_negotiation.cc:407] Connection header received
0927 15:12:31.300487 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:12:31.300489 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:12:31.300545 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:12:31.300645 (+ 100us) server_negotiation.cc:226] Negotiated authn=TOKEN
0927 15:12:31.300937 (+ 292us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:31.301450 (+ 513us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:31.302294 (+ 844us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:31.302510 (+ 216us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:31.302584 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:31.302873 (+ 289us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0927 15:12:31.303338 (+ 465us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0927 15:12:31.303442 (+ 104us) server_negotiation.cc:1035] Waiting for connection context
0927 15:12:31.303468 (+ 26us) server_negotiation.cc:299] Negotiation successful
0927 15:12:31.303518 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260927 15:12:31.309549 25099 raft_consensus.cc:1261] T 936b28a07215490a8e30b6131ab4c569 P bce84efcd7394877943020b62471f259 [term 1 FOLLOWER]: Refusing update from remote peer 45aed58e7be84f1c93e2ca9ab659462e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260927 15:12:31.309549 25236 raft_consensus.cc:1261] T 936b28a07215490a8e30b6131ab4c569 P e94ed22dcc4f4c828fb3714f2d327a6e [term 1 FOLLOWER]: Refusing update from remote peer 45aed58e7be84f1c93e2ca9ab659462e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260927 15:12:31.310207 25327 consensus_queue.cc:1035] T 936b28a07215490a8e30b6131ab4c569 P 45aed58e7be84f1c93e2ca9ab659462e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e94ed22dcc4f4c828fb3714f2d327a6e" member_type: VOTER last_known_addr { host: "127.17.136.3" port: 33145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260927 15:12:31.310380 25322 consensus_queue.cc:1035] T 936b28a07215490a8e30b6131ab4c569 P 45aed58e7be84f1c93e2ca9ab659462e [LEADER]: Connected to new peer: Peer: permanent_uuid: "bce84efcd7394877943020b62471f259" member_type: VOTER last_known_addr { host: "127.17.136.2" port: 42827 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260927 15:12:31.321354 25330 mvcc.cc:205] Tried to move back new op lower bound from 7333977912557092864 to 7333977912402149376. Current Snapshot: MvccSnapshot[applied={T|T < 7333977912557092864 or (T in {7333977912557092864})}]
I20260927 15:12:31.323325 25332 mvcc.cc:205] Tried to move back new op lower bound from 7333977912557092864 to 7333977912402149376. Current Snapshot: MvccSnapshot[applied={T|T < 7333977912557092864 or (T in {7333977912557092864})}]
I20260927 15:12:31.327313 24044 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:39712:
table { table_name: "test-table" } modify_external_catalogs: true
I20260927 15:12:31.327467 24044 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:39712:
table { table_name: "test-table" } modify_external_catalogs: true
I20260927 15:12:31.331542 24044 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 5d94e22c8fa74c10a9732bb2af78fb98: Sending DeleteTablet for 3 replicas of tablet 936b28a07215490a8e30b6131ab4c569
I20260927 15:12:31.332516 25080 tablet_service.cc:1514] Processing DeleteTablet for tablet 936b28a07215490a8e30b6131ab4c569 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:12:31 UTC) from {username='oryx', principal='oryx/127.17.136.62@KRBTEST.COM'} at 127.0.0.1:53090
I20260927 15:12:31.332777 25216 tablet_service.cc:1514] Processing DeleteTablet for tablet 936b28a07215490a8e30b6131ab4c569 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:12:31 UTC) from {username='oryx', principal='oryx/127.17.136.62@KRBTEST.COM'} at 127.0.0.1:39730
I20260927 15:12:31.333223 25341 tablet_replica.cc:330] T 936b28a07215490a8e30b6131ab4c569 P e94ed22dcc4f4c828fb3714f2d327a6e: stopping tablet replica
I20260927 15:12:31.333554 25341 raft_consensus.cc:2229] T 936b28a07215490a8e30b6131ab4c569 P e94ed22dcc4f4c828fb3714f2d327a6e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260927 15:12:31.333875 25341 raft_consensus.cc:2258] T 936b28a07215490a8e30b6131ab4c569 P e94ed22dcc4f4c828fb3714f2d327a6e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 15:12:31.334877 24943 tablet_service.cc:1514] Processing DeleteTablet for tablet 936b28a07215490a8e30b6131ab4c569 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:12:31 UTC) from {username='oryx', principal='oryx/127.17.136.62@KRBTEST.COM'} at 127.0.0.1:42108
I20260927 15:12:31.335233 25341 ts_tablet_manager.cc:1905] T 936b28a07215490a8e30b6131ab4c569 P e94ed22dcc4f4c828fb3714f2d327a6e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:12:31.335400 25343 tablet_replica.cc:330] T 936b28a07215490a8e30b6131ab4c569 P 45aed58e7be84f1c93e2ca9ab659462e: stopping tablet replica
I20260927 15:12:31.335420 17952 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu with pid 24014
I20260927 15:12:31.336648 25343 raft_consensus.cc:2229] T 936b28a07215490a8e30b6131ab4c569 P 45aed58e7be84f1c93e2ca9ab659462e [term 1 LEADER]: Raft consensus shutting down.
I20260927 15:12:31.337057 25343 raft_consensus.cc:2258] T 936b28a07215490a8e30b6131ab4c569 P 45aed58e7be84f1c93e2ca9ab659462e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 15:12:31.338066 25341 ts_tablet_manager.cc:1918] T 936b28a07215490a8e30b6131ab4c569 P e94ed22dcc4f4c828fb3714f2d327a6e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260927 15:12:31.338162 25341 log.cc:1196] T 936b28a07215490a8e30b6131ab4c569 P e94ed22dcc4f4c828fb3714f2d327a6e: Deleting WAL directory at /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790521920546562-17952-0/minicluster-data/ts-2/wal/wals/936b28a07215490a8e30b6131ab4c569
I20260927 15:12:31.338485 25341 ts_tablet_manager.cc:1939] T 936b28a07215490a8e30b6131ab4c569 P e94ed22dcc4f4c828fb3714f2d327a6e: Deleting consensus metadata
I20260927 15:12:31.338721 25343 ts_tablet_manager.cc:1905] T 936b28a07215490a8e30b6131ab4c569 P 45aed58e7be84f1c93e2ca9ab659462e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:12:31.340950 25343 ts_tablet_manager.cc:1918] T 936b28a07215490a8e30b6131ab4c569 P 45aed58e7be84f1c93e2ca9ab659462e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260927 15:12:31.341032 25343 log.cc:1196] T 936b28a07215490a8e30b6131ab4c569 P 45aed58e7be84f1c93e2ca9ab659462e: Deleting WAL directory at /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790521920546562-17952-0/minicluster-data/ts-0/wal/wals/936b28a07215490a8e30b6131ab4c569
I20260927 15:12:31.341274 25343 ts_tablet_manager.cc:1939] T 936b28a07215490a8e30b6131ab4c569 P 45aed58e7be84f1c93e2ca9ab659462e: Deleting consensus metadata
W20260927 15:12:31.342607 25171 connection.cc:535] server connection from 127.0.0.1:39730 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260927 15:12:31.342845 24898 connection.cc:535] server connection from 127.0.0.1:42108 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260927 15:12:31.346088 25340 tablet_replica.cc:330] T 936b28a07215490a8e30b6131ab4c569 P bce84efcd7394877943020b62471f259: stopping tablet replica
I20260927 15:12:31.346495 25340 raft_consensus.cc:2229] T 936b28a07215490a8e30b6131ab4c569 P bce84efcd7394877943020b62471f259 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260927 15:12:31.346799 25340 raft_consensus.cc:2258] T 936b28a07215490a8e30b6131ab4c569 P bce84efcd7394877943020b62471f259 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 15:12:31.348227 25340 ts_tablet_manager.cc:1905] T 936b28a07215490a8e30b6131ab4c569 P bce84efcd7394877943020b62471f259: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:12:31.349617 24768 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:31.333779 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35592 (local address 127.17.136.61:42371)
0927 15:12:31.333948 (+ 169us) server_negotiation.cc:206] Beginning negotiation
0927 15:12:31.333952 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0927 15:12:31.339512 (+ 5560us) server_negotiation.cc:407] Connection header received
0927 15:12:31.339679 (+ 167us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:12:31.339682 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:12:31.339727 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:12:31.339772 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0927 15:12:31.341159 (+ 1387us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:31.341942 (+ 783us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:31.342999 (+ 1057us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:31.343279 (+ 280us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:31.343383 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:31.344812 (+ 1429us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0927 15:12:31.344816 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0927 15:12:31.344818 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0927 15:12:31.344843 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0927 15:12:31.347209 (+ 2366us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:12:31.347665 (+ 456us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:12:31.347669 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:12:31.347671 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:12:31.347759 (+ 88us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:12:31.348038 (+ 279us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:12:31.348041 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:12:31.348043 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:12:31.348251 (+ 208us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0927 15:12:31.348384 (+ 133us) server_negotiation.cc:1035] Waiting for connection context
0927 15:12:31.349358 (+ 974us) server_negotiation.cc:299] Negotiation successful
0927 15:12:31.349464 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":96}
I20260927 15:12:31.350986 25340 ts_tablet_manager.cc:1918] T 936b28a07215490a8e30b6131ab4c569 P bce84efcd7394877943020b62471f259: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260927 15:12:31.351071 25340 log.cc:1196] T 936b28a07215490a8e30b6131ab4c569 P bce84efcd7394877943020b62471f259: Deleting WAL directory at /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790521920546562-17952-0/minicluster-data/ts-1/wal/wals/936b28a07215490a8e30b6131ab4c569
I20260927 15:12:31.351362 25340 ts_tablet_manager.cc:1939] T 936b28a07215490a8e30b6131ab4c569 P bce84efcd7394877943020b62471f259: Deleting consensus metadata
W20260927 15:12:31.352353 25036 connection.cc:441] server connection from 127.0.0.1:53090 torn down before Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:53090 (request call id 1) could send its response
I20260927 15:12:31.357414 25013 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:31.346110 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56238 (local address 127.17.136.60:40351)
0927 15:12:31.346228 (+ 118us) server_negotiation.cc:206] Beginning negotiation
0927 15:12:31.346232 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0927 15:12:31.347785 (+ 1553us) server_negotiation.cc:407] Connection header received
0927 15:12:31.347952 (+ 167us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:12:31.347956 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:12:31.348006 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:12:31.348054 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0927 15:12:31.348875 (+ 821us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:31.349626 (+ 751us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:31.351174 (+ 1548us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:31.351511 (+ 337us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:31.351593 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:31.353177 (+ 1584us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0927 15:12:31.353181 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0927 15:12:31.353184 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0927 15:12:31.353209 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0927 15:12:31.355717 (+ 2508us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:12:31.356174 (+ 457us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:12:31.356177 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:12:31.356179 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:12:31.356258 (+ 79us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:12:31.356527 (+ 269us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:12:31.356531 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:12:31.356532 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:12:31.356722 (+ 190us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0927 15:12:31.356819 (+ 97us) server_negotiation.cc:1035] Waiting for connection context
0927 15:12:31.357150 (+ 331us) server_negotiation.cc:299] Negotiation successful
0927 15:12:31.357258 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260927 15:12:31.358551 25294 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:31.334020 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56228 (local address 127.17.136.60:40351)
0927 15:12:31.334115 (+ 95us) server_negotiation.cc:206] Beginning negotiation
0927 15:12:31.334119 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0927 15:12:31.349096 (+ 14977us) server_negotiation.cc:407] Connection header received
0927 15:12:31.349131 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:12:31.349134 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:12:31.349172 (+ 38us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:12:31.349230 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0927 15:12:31.350629 (+ 1399us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:31.351368 (+ 739us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:31.352793 (+ 1425us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:31.353133 (+ 340us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:31.353218 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:31.354810 (+ 1592us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0927 15:12:31.354814 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0927 15:12:31.354817 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0927 15:12:31.354842 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0927 15:12:31.356555 (+ 1713us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:12:31.357189 (+ 634us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:12:31.357193 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:12:31.357195 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:12:31.357283 (+ 88us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:12:31.357584 (+ 301us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:12:31.357587 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:12:31.357589 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:12:31.357767 (+ 178us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0927 15:12:31.357881 (+ 114us) server_negotiation.cc:1035] Waiting for connection context
0927 15:12:31.358293 (+ 412us) server_negotiation.cc:299] Negotiation successful
0927 15:12:31.358409 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260927 15:12:31.361495 25297 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:31.346592 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35598 (local address 127.17.136.61:42371)
0927 15:12:31.346702 (+ 110us) server_negotiation.cc:206] Beginning negotiation
0927 15:12:31.346706 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0927 15:12:31.352219 (+ 5513us) server_negotiation.cc:407] Connection header received
0927 15:12:31.353266 (+ 1047us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:12:31.353269 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:12:31.353314 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:12:31.353372 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0927 15:12:31.354147 (+ 775us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:31.354912 (+ 765us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:31.356061 (+ 1149us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:31.356414 (+ 353us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:31.356490 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:31.358589 (+ 2099us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0927 15:12:31.358592 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0927 15:12:31.358595 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0927 15:12:31.358618 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0927 15:12:31.360096 (+ 1478us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:12:31.360457 (+ 361us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:12:31.360460 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:12:31.360462 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:12:31.360535 (+ 73us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:12:31.360757 (+ 222us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:12:31.360760 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:12:31.360762 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:12:31.360935 (+ 173us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0927 15:12:31.361037 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0927 15:12:31.361244 (+ 207us) server_negotiation.cc:299] Negotiation successful
0927 15:12:31.361355 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260927 15:12:32.325071 25351 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:32.324575 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.62:33401 (local address 127.17.136.3:51497)
0927 15:12:32.324851 (+ 276us) negotiation.cc:107] Waiting for socket to connect
0927 15:12:32.324951 (+ 100us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.136.62:33401: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":194,"threads_started":1}
I20260927 15:12:32.326903 25353 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:32.326518 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.62:33401 (local address 127.17.136.2:47913)
0927 15:12:32.326730 (+ 212us) negotiation.cc:107] Waiting for socket to connect
0927 15:12:32.326809 (+ 79us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.136.62:33401: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":146,"thread_start_us":80,"threads_started":1}
W20260927 15:12:32.326860 25283 heartbeater.cc:644] Failed to heartbeat to 127.17.136.62:33401 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.17.136.62:33401: connect: Connection refused (error 111)
W20260927 15:12:32.327292 25147 heartbeater.cc:644] Failed to heartbeat to 127.17.136.62:33401 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.17.136.62:33401: connect: Connection refused (error 111)
I20260927 15:12:32.327613 25352 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:32.324941 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.62:33401 (local address 127.17.136.1:45213)
0927 15:12:32.327445 (+ 2504us) negotiation.cc:107] Waiting for socket to connect
0927 15:12:32.327524 (+ 79us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.136.62:33401: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":2172,"thread_start_us":1337,"threads_started":1}
W20260927 15:12:32.327876 25010 heartbeater.cc:644] Failed to heartbeat to 127.17.136.62:33401 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.17.136.62:33401: connect: Connection refused (error 111)
I20260927 15:12:32.831957 25354 raft_consensus.cc:482] T 00000000000000000000000000000000 P cc335ec49c7b46d8b3bfc44fc1f32579 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5d94e22c8fa74c10a9732bb2af78fb98)
I20260927 15:12:32.832196 25354 raft_consensus.cc:504] T 00000000000000000000000000000000 P cc335ec49c7b46d8b3bfc44fc1f32579 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "5d94e22c8fa74c10a9732bb2af78fb98" member_type: VOTER last_known_addr { host: "127.17.136.62" port: 33401 } } peers { permanent_uuid: "cc335ec49c7b46d8b3bfc44fc1f32579" member_type: VOTER last_known_addr { host: "127.17.136.61" port: 42371 } attrs { promote: false } } peers { permanent_uuid: "3b1c4bd139bf4929b313361ea24d3eab" member_type: VOTER last_known_addr { host: "127.17.136.60" port: 40351 } attrs { promote: false } }
I20260927 15:12:32.833048 25355 raft_consensus.cc:482] T 00000000000000000000000000000000 P 3b1c4bd139bf4929b313361ea24d3eab [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5d94e22c8fa74c10a9732bb2af78fb98)
I20260927 15:12:32.833199 25355 raft_consensus.cc:504] T 00000000000000000000000000000000 P 3b1c4bd139bf4929b313361ea24d3eab [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "5d94e22c8fa74c10a9732bb2af78fb98" member_type: VOTER last_known_addr { host: "127.17.136.62" port: 33401 } } peers { permanent_uuid: "cc335ec49c7b46d8b3bfc44fc1f32579" member_type: VOTER last_known_addr { host: "127.17.136.61" port: 42371 } attrs { promote: false } } peers { permanent_uuid: "3b1c4bd139bf4929b313361ea24d3eab" member_type: VOTER last_known_addr { host: "127.17.136.60" port: 40351 } attrs { promote: false } }
I20260927 15:12:32.833309 25354 leader_election.cc:288] T 00000000000000000000000000000000 P cc335ec49c7b46d8b3bfc44fc1f32579 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5d94e22c8fa74c10a9732bb2af78fb98 (127.17.136.62:33401), 3b1c4bd139bf4929b313361ea24d3eab (127.17.136.60:40351)
I20260927 15:12:32.833891 25357 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:32.833465 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.62:33401 (local address 127.0.0.1:40188)
0927 15:12:32.833717 (+ 252us) negotiation.cc:107] Waiting for socket to connect
0927 15:12:32.833793 (+ 76us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.136.62:33401: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":180,"thread_start_us":66,"threads_started":1}
W20260927 15:12:32.834096 24631 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.17.136.62:33401: connect: Connection refused (error 111)
I20260927 15:12:32.834913 25357 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:32.834651 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.62:33401 (local address 127.0.0.1:40194)
0927 15:12:32.834763 (+ 112us) negotiation.cc:107] Waiting for socket to connect
0927 15:12:32.834832 (+ 69us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.136.62:33401: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":43}
W20260927 15:12:32.835043 24631 leader_election.cc:334] T 00000000000000000000000000000000 P cc335ec49c7b46d8b3bfc44fc1f32579 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 5d94e22c8fa74c10a9732bb2af78fb98 (127.17.136.62:33401): Network error: Client connection negotiation failed: client connection to 127.17.136.62:33401: connect: Connection refused (error 111)
I20260927 15:12:32.835220 25355 leader_election.cc:288] T 00000000000000000000000000000000 P 3b1c4bd139bf4929b313361ea24d3eab [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5d94e22c8fa74c10a9732bb2af78fb98 (127.17.136.62:33401), cc335ec49c7b46d8b3bfc44fc1f32579 (127.17.136.61:42371)
I20260927 15:12:32.835527 25360 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:32.834651 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.62:33401 (local address 127.0.0.1:40196)
0927 15:12:32.834852 (+ 201us) negotiation.cc:107] Waiting for socket to connect
0927 15:12:32.834915 (+ 63us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.136.62:33401: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":143,"thread_start_us":80,"threads_started":1}
W20260927 15:12:32.835682 24815 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.17.136.62:33401: connect: Connection refused (error 111)
I20260927 15:12:32.836395 25360 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:32.836187 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.62:33401 (local address 127.0.0.1:40208)
0927 15:12:32.836274 (+ 87us) negotiation.cc:107] Waiting for socket to connect
0927 15:12:32.836338 (+ 64us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.136.62:33401: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":32}
W20260927 15:12:32.836601 24815 leader_election.cc:334] T 00000000000000000000000000000000 P 3b1c4bd139bf4929b313361ea24d3eab [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 5d94e22c8fa74c10a9732bb2af78fb98 (127.17.136.62:33401): Network error: Client connection negotiation failed: client connection to 127.17.136.62:33401: connect: Connection refused (error 111)
I20260927 15:12:32.837839 25358 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:32.833692 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56246 (local address 127.17.136.60:40351)
0927 15:12:32.833938 (+ 246us) server_negotiation.cc:206] Beginning negotiation
0927 15:12:32.833943 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0927 15:12:32.833958 (+ 15us) server_negotiation.cc:407] Connection header received
0927 15:12:32.834011 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:12:32.834014 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:12:32.834063 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:12:32.834144 (+ 81us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0927 15:12:32.834446 (+ 302us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:32.835188 (+ 742us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:32.836760 (+ 1572us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:32.837378 (+ 618us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:32.837480 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:32.837537 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0927 15:12:32.837671 (+ 134us) server_negotiation.cc:299] Negotiation successful
0927 15:12:32.837734 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":23,"server-negotiator.queue_time_us":170,"thread_start_us":61,"threads_started":1}
I20260927 15:12:32.837800 25356 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:32.833525 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.60:40351 (local address 127.0.0.1:56246)
0927 15:12:32.833740 (+ 215us) negotiation.cc:107] Waiting for socket to connect
0927 15:12:32.833756 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0927 15:12:32.833869 (+ 113us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0927 15:12:32.834167 (+ 298us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0927 15:12:32.834170 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0927 15:12:32.834190 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0927 15:12:32.834292 (+ 102us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:12:32.834298 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:12:32.835317 (+ 1019us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:12:32.835321 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:12:32.836606 (+ 1285us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:12:32.836617 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:12:32.837493 (+ 876us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:12:32.837496 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:12:32.837565 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:32.837587 (+ 22us) client_negotiation.cc:769] Sending connection context
0927 15:12:32.837653 (+ 66us) client_negotiation.cc:240] Negotiation successful
0927 15:12:32.837706 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":150,"thread_start_us":63,"threads_started":1}
I20260927 15:12:32.838296 24840 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "cc335ec49c7b46d8b3bfc44fc1f32579" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "3b1c4bd139bf4929b313361ea24d3eab" is_pre_election: true
I20260927 15:12:32.838459 24840 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 3b1c4bd139bf4929b313361ea24d3eab [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc335ec49c7b46d8b3bfc44fc1f32579 in term 1.
I20260927 15:12:32.838768 24630 leader_election.cc:302] T 00000000000000000000000000000000 P cc335ec49c7b46d8b3bfc44fc1f32579 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3b1c4bd139bf4929b313361ea24d3eab, cc335ec49c7b46d8b3bfc44fc1f32579; no voters: 5d94e22c8fa74c10a9732bb2af78fb98
I20260927 15:12:32.838976 25354 raft_consensus.cc:2781] T 00000000000000000000000000000000 P cc335ec49c7b46d8b3bfc44fc1f32579 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260927 15:12:32.839042 25354 raft_consensus.cc:482] T 00000000000000000000000000000000 P cc335ec49c7b46d8b3bfc44fc1f32579 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 5d94e22c8fa74c10a9732bb2af78fb98)
I20260927 15:12:32.839087 25354 raft_consensus.cc:3037] T 00000000000000000000000000000000 P cc335ec49c7b46d8b3bfc44fc1f32579 [term 1 FOLLOWER]: Advancing to term 2
I20260927 15:12:32.839170 25361 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:32.835075 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.61:42371 (local address 127.0.0.1:35600)
0927 15:12:32.835436 (+ 361us) negotiation.cc:107] Waiting for socket to connect
0927 15:12:32.835450 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0927 15:12:32.835548 (+ 98us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0927 15:12:32.835909 (+ 361us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0927 15:12:32.835913 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0927 15:12:32.835933 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0927 15:12:32.836028 (+ 95us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:12:32.836035 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:12:32.836931 (+ 896us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:12:32.836934 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:12:32.838057 (+ 1123us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:12:32.838067 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:12:32.838794 (+ 727us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:12:32.838798 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:12:32.838882 (+ 84us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:32.838903 (+ 21us) client_negotiation.cc:769] Sending connection context
0927 15:12:32.838975 (+ 72us) client_negotiation.cc:240] Negotiation successful
0927 15:12:32.839039 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":297,"mutex_wait_us":3,"thread_start_us":55,"threads_started":1}
I20260927 15:12:32.839214 25362 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:32.835210 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35600 (local address 127.17.136.61:42371)
0927 15:12:32.835453 (+ 243us) server_negotiation.cc:206] Beginning negotiation
0927 15:12:32.835461 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0927 15:12:32.835520 (+ 59us) server_negotiation.cc:407] Connection header received
0927 15:12:32.835672 (+ 152us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:12:32.835676 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:12:32.835722 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:12:32.835803 (+ 81us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0927 15:12:32.836151 (+ 348us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:32.836845 (+ 694us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:32.838148 (+ 1303us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:32.838650 (+ 502us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:32.838753 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:32.838811 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0927 15:12:32.839001 (+ 190us) server_negotiation.cc:299] Negotiation successful
0927 15:12:32.839072 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":186,"thread_start_us":110,"threads_started":1}
I20260927 15:12:32.839592 24647 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "3b1c4bd139bf4929b313361ea24d3eab" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "cc335ec49c7b46d8b3bfc44fc1f32579" is_pre_election: true
I20260927 15:12:32.840502 25354 raft_consensus.cc:504] T 00000000000000000000000000000000 P cc335ec49c7b46d8b3bfc44fc1f32579 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "5d94e22c8fa74c10a9732bb2af78fb98" member_type: VOTER last_known_addr { host: "127.17.136.62" port: 33401 } } peers { permanent_uuid: "cc335ec49c7b46d8b3bfc44fc1f32579" member_type: VOTER last_known_addr { host: "127.17.136.61" port: 42371 } attrs { promote: false } } peers { permanent_uuid: "3b1c4bd139bf4929b313361ea24d3eab" member_type: VOTER last_known_addr { host: "127.17.136.60" port: 40351 } attrs { promote: false } }
I20260927 15:12:32.840732 24647 raft_consensus.cc:2379] T 00000000000000000000000000000000 P cc335ec49c7b46d8b3bfc44fc1f32579 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3b1c4bd139bf4929b313361ea24d3eab in current term 2: Already voted for candidate cc335ec49c7b46d8b3bfc44fc1f32579 in this term.
I20260927 15:12:32.840871 25354 leader_election.cc:288] T 00000000000000000000000000000000 P cc335ec49c7b46d8b3bfc44fc1f32579 [CANDIDATE]: Term 2 election: Requested vote from peers 5d94e22c8fa74c10a9732bb2af78fb98 (127.17.136.62:33401), 3b1c4bd139bf4929b313361ea24d3eab (127.17.136.60:40351)
I20260927 15:12:32.841192 25356 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:32.840939 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.62:33401 (local address 127.0.0.1:40218)
0927 15:12:32.841090 (+ 151us) negotiation.cc:107] Waiting for socket to connect
0927 15:12:32.841137 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.136.62:33401: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":96}
I20260927 15:12:32.841171 24840 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "cc335ec49c7b46d8b3bfc44fc1f32579" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "3b1c4bd139bf4929b313361ea24d3eab"
I20260927 15:12:32.841280 24840 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3b1c4bd139bf4929b313361ea24d3eab [term 1 FOLLOWER]: Advancing to term 2
I20260927 15:12:32.841506 24815 leader_election.cc:302] T 00000000000000000000000000000000 P 3b1c4bd139bf4929b313361ea24d3eab [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3b1c4bd139bf4929b313361ea24d3eab; no voters: 5d94e22c8fa74c10a9732bb2af78fb98, cc335ec49c7b46d8b3bfc44fc1f32579
I20260927 15:12:32.841849 25356 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:32.841626 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.62:33401 (local address 127.0.0.1:40228)
0927 15:12:32.841743 (+ 117us) negotiation.cc:107] Waiting for socket to connect
0927 15:12:32.841787 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.136.62:33401: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":69}
W20260927 15:12:32.841930 24631 leader_election.cc:334] T 00000000000000000000000000000000 P cc335ec49c7b46d8b3bfc44fc1f32579 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 5d94e22c8fa74c10a9732bb2af78fb98 (127.17.136.62:33401): Network error: Client connection negotiation failed: client connection to 127.17.136.62:33401: connect: Connection refused (error 111)
I20260927 15:12:32.842290 24840 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 3b1c4bd139bf4929b313361ea24d3eab [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc335ec49c7b46d8b3bfc44fc1f32579 in term 2.
I20260927 15:12:32.842397 25355 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 3b1c4bd139bf4929b313361ea24d3eab [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260927 15:12:32.842609 24630 leader_election.cc:302] T 00000000000000000000000000000000 P cc335ec49c7b46d8b3bfc44fc1f32579 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3b1c4bd139bf4929b313361ea24d3eab, cc335ec49c7b46d8b3bfc44fc1f32579; no voters: 5d94e22c8fa74c10a9732bb2af78fb98
I20260927 15:12:32.842770 25354 raft_consensus.cc:2781] T 00000000000000000000000000000000 P cc335ec49c7b46d8b3bfc44fc1f32579 [term 2 FOLLOWER]: Leader election won for term 2
I20260927 15:12:32.842965 25354 raft_consensus.cc:686] T 00000000000000000000000000000000 P cc335ec49c7b46d8b3bfc44fc1f32579 [term 2 LEADER]: Becoming Leader. State: Replica: cc335ec49c7b46d8b3bfc44fc1f32579, State: Running, Role: LEADER
I20260927 15:12:32.843191 25354 consensus_queue.cc:237] T 00000000000000000000000000000000 P cc335ec49c7b46d8b3bfc44fc1f32579 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 1.12, Last appended by leader: 12, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "5d94e22c8fa74c10a9732bb2af78fb98" member_type: VOTER last_known_addr { host: "127.17.136.62" port: 33401 } } peers { permanent_uuid: "cc335ec49c7b46d8b3bfc44fc1f32579" member_type: VOTER last_known_addr { host: "127.17.136.61" port: 42371 } attrs { promote: false } } peers { permanent_uuid: "3b1c4bd139bf4929b313361ea24d3eab" member_type: VOTER last_known_addr { host: "127.17.136.60" port: 40351 } attrs { promote: false } }
I20260927 15:12:32.844193 25364 sys_catalog.cc:455] T 00000000000000000000000000000000 P cc335ec49c7b46d8b3bfc44fc1f32579 [sys.catalog]: SysCatalogTable state changed. Reason: New leader cc335ec49c7b46d8b3bfc44fc1f32579. Latest consensus state: current_term: 2 leader_uuid: "cc335ec49c7b46d8b3bfc44fc1f32579" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "5d94e22c8fa74c10a9732bb2af78fb98" member_type: VOTER last_known_addr { host: "127.17.136.62" port: 33401 } } peers { permanent_uuid: "cc335ec49c7b46d8b3bfc44fc1f32579" member_type: VOTER last_known_addr { host: "127.17.136.61" port: 42371 } attrs { promote: false } } peers { permanent_uuid: "3b1c4bd139bf4929b313361ea24d3eab" member_type: VOTER last_known_addr { host: "127.17.136.60" port: 40351 } attrs { promote: false } } }
I20260927 15:12:32.844300 25364 sys_catalog.cc:458] T 00000000000000000000000000000000 P cc335ec49c7b46d8b3bfc44fc1f32579 [sys.catalog]: This master's current role is: LEADER
I20260927 15:12:32.844544 25366 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260927 15:12:32.846766 25366 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260927 15:12:32.847144 25366 catalog_manager.cc:1259] Loaded cluster ID: cf487426c0ca458e8b8e643e352d17ca
I20260927 15:12:32.847193 25366 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260927 15:12:32.847755 25366 catalog_manager.cc:1504] Loading token signing keys...
I20260927 15:12:32.848121 25366 catalog_manager.cc:5879] T 00000000000000000000000000000000 P cc335ec49c7b46d8b3bfc44fc1f32579: Loaded TSK: 0
I20260927 15:12:32.848904 25366 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260927 15:12:32.873692 24645 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:35598:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:12:32.876745 24645 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:12:32.879556 25356 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:32.879299 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.62:33401 (local address 127.0.0.1:40246)
0927 15:12:32.879409 (+ 110us) negotiation.cc:107] Waiting for socket to connect
0927 15:12:32.879478 (+ 69us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.136.62:33401: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":28}
I20260927 15:12:32.879666 24840 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 3b1c4bd139bf4929b313361ea24d3eab [term 2 FOLLOWER]: Refusing update from remote peer cc335ec49c7b46d8b3bfc44fc1f32579: Log matching property violated. Preceding OpId in replica: term: 1 index: 12. Preceding OpId from leader: term: 2 index: 14. (index mismatch)
I20260927 15:12:32.880177 25364 consensus_queue.cc:1035] T 00000000000000000000000000000000 P cc335ec49c7b46d8b3bfc44fc1f32579 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3b1c4bd139bf4929b313361ea24d3eab" member_type: VOTER last_known_addr { host: "127.17.136.60" port: 40351 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260927 15:12:32.880323 25356 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:32.880081 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.62:33401 (local address 127.0.0.1:40252)
0927 15:12:32.880189 (+ 108us) negotiation.cc:107] Waiting for socket to connect
0927 15:12:32.880260 (+ 71us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.136.62:33401: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":41}
W20260927 15:12:32.880465 24631 consensus_peers.cc:487] T 00000000000000000000000000000000 P cc335ec49c7b46d8b3bfc44fc1f32579 -> Peer 5d94e22c8fa74c10a9732bb2af78fb98 (127.17.136.62:33401): Couldn't send request to peer 5d94e22c8fa74c10a9732bb2af78fb98. Status: Network error: Client connection negotiation failed: client connection to 127.17.136.62:33401: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260927 15:12:32.881624 25355 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3b1c4bd139bf4929b313361ea24d3eab [sys.catalog]: SysCatalogTable state changed. Reason: New leader cc335ec49c7b46d8b3bfc44fc1f32579. Latest consensus state: current_term: 2 leader_uuid: "cc335ec49c7b46d8b3bfc44fc1f32579" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "5d94e22c8fa74c10a9732bb2af78fb98" member_type: VOTER last_known_addr { host: "127.17.136.62" port: 33401 } } peers { permanent_uuid: "cc335ec49c7b46d8b3bfc44fc1f32579" member_type: VOTER last_known_addr { host: "127.17.136.61" port: 42371 } attrs { promote: false } } peers { permanent_uuid: "3b1c4bd139bf4929b313361ea24d3eab" member_type: VOTER last_known_addr { host: "127.17.136.60" port: 40351 } attrs { promote: false } } }
I20260927 15:12:32.881765 25355 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3b1c4bd139bf4929b313361ea24d3eab [sys.catalog]: This master's current role is: FOLLOWER
I20260927 15:12:32.882673 25364 sys_catalog.cc:455] T 00000000000000000000000000000000 P cc335ec49c7b46d8b3bfc44fc1f32579 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 2 leader_uuid: "cc335ec49c7b46d8b3bfc44fc1f32579" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "5d94e22c8fa74c10a9732bb2af78fb98" member_type: VOTER last_known_addr { host: "127.17.136.62" port: 33401 } } peers { permanent_uuid: "cc335ec49c7b46d8b3bfc44fc1f32579" member_type: VOTER last_known_addr { host: "127.17.136.61" port: 42371 } attrs { promote: false } } peers { permanent_uuid: "3b1c4bd139bf4929b313361ea24d3eab" member_type: VOTER last_known_addr { host: "127.17.136.60" port: 40351 } attrs { promote: false } } }
I20260927 15:12:32.882790 25364 sys_catalog.cc:458] T 00000000000000000000000000000000 P cc335ec49c7b46d8b3bfc44fc1f32579 [sys.catalog]: This master's current role is: LEADER
I20260927 15:12:32.883236 25355 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3b1c4bd139bf4929b313361ea24d3eab [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 2 leader_uuid: "cc335ec49c7b46d8b3bfc44fc1f32579" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "5d94e22c8fa74c10a9732bb2af78fb98" member_type: VOTER last_known_addr { host: "127.17.136.62" port: 33401 } } peers { permanent_uuid: "cc335ec49c7b46d8b3bfc44fc1f32579" member_type: VOTER last_known_addr { host: "127.17.136.61" port: 42371 } attrs { promote: false } } peers { permanent_uuid: "3b1c4bd139bf4929b313361ea24d3eab" member_type: VOTER last_known_addr { host: "127.17.136.60" port: 40351 } attrs { promote: false } } }
I20260927 15:12:32.883360 25355 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3b1c4bd139bf4929b313361ea24d3eab [sys.catalog]: This master's current role is: FOLLOWER
I20260927 15:12:32.892783 25356 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:32.888320 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.2:42827 (local address 127.0.0.1:53098)
0927 15:12:32.888436 (+ 116us) negotiation.cc:107] Waiting for socket to connect
0927 15:12:32.888452 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0927 15:12:32.888534 (+ 82us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0927 15:12:32.889331 (+ 797us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0927 15:12:32.889335 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0927 15:12:32.889354 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0927 15:12:32.889464 (+ 110us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:12:32.889471 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:12:32.890577 (+ 1106us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:12:32.890580 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:12:32.891559 (+ 979us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:12:32.891581 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:12:32.892386 (+ 805us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:12:32.892390 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:12:32.892483 (+ 93us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:32.892514 (+ 31us) client_negotiation.cc:769] Sending connection context
0927 15:12:32.892567 (+ 53us) client_negotiation.cc:240] Negotiation successful
0927 15:12:32.892642 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":49,"mutex_wait_us":26}
I20260927 15:12:32.893064 25373 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:32.888736 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39736 (local address 127.17.136.3:33145)
0927 15:12:32.889306 (+ 570us) server_negotiation.cc:206] Beginning negotiation
0927 15:12:32.889311 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0927 15:12:32.889325 (+ 14us) server_negotiation.cc:407] Connection header received
0927 15:12:32.889373 (+ 48us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:12:32.889376 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:12:32.889419 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:12:32.889510 (+ 91us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0927 15:12:32.889727 (+ 217us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:32.890617 (+ 890us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:32.891984 (+ 1367us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:32.892411 (+ 427us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:32.892501 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:32.892563 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0927 15:12:32.892834 (+ 271us) server_negotiation.cc:299] Negotiation successful
0927 15:12:32.892930 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":495,"thread_start_us":87,"threads_started":1}
I20260927 15:12:32.893138 25357 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:32.888644 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.3:33145 (local address 127.0.0.1:39736)
0927 15:12:32.888769 (+ 125us) negotiation.cc:107] Waiting for socket to connect
0927 15:12:32.888781 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0927 15:12:32.888859 (+ 78us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0927 15:12:32.889522 (+ 663us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0927 15:12:32.889524 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0927 15:12:32.889539 (+ 15us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0927 15:12:32.889628 (+ 89us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:12:32.889633 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:12:32.890713 (+ 1080us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:12:32.890715 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:12:32.891899 (+ 1184us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:12:32.891906 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:12:32.892514 (+ 608us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:12:32.892517 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:12:32.892599 (+ 82us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:32.892622 (+ 23us) client_negotiation.cc:769] Sending connection context
0927 15:12:32.892684 (+ 62us) client_negotiation.cc:240] Negotiation successful
0927 15:12:32.892751 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":71,"mutex_wait_us":1}
I20260927 15:12:32.893244 25374 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:32.888972 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.1:41807 (local address 127.0.0.1:42116)
0927 15:12:32.889226 (+ 254us) negotiation.cc:107] Waiting for socket to connect
0927 15:12:32.889239 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0927 15:12:32.889335 (+ 96us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0927 15:12:32.889624 (+ 289us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0927 15:12:32.889626 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0927 15:12:32.889639 (+ 13us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0927 15:12:32.889706 (+ 67us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:12:32.889711 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:12:32.890394 (+ 683us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:12:32.890398 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:12:32.891831 (+ 1433us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:12:32.891840 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:12:32.892659 (+ 819us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:12:32.892662 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:12:32.892738 (+ 76us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:32.892756 (+ 18us) client_negotiation.cc:769] Sending connection context
0927 15:12:32.892820 (+ 64us) client_negotiation.cc:240] Negotiation successful
0927 15:12:32.892970 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":199,"mutex_wait_us":1,"thread_start_us":109,"threads_started":1}
I20260927 15:12:32.893651 25372 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:32.888431 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53098 (local address 127.17.136.2:42827)
0927 15:12:32.889045 (+ 614us) server_negotiation.cc:206] Beginning negotiation
0927 15:12:32.889051 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0927 15:12:32.889069 (+ 18us) server_negotiation.cc:407] Connection header received
0927 15:12:32.889127 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:12:32.889130 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:12:32.889184 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:12:32.889570 (+ 386us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0927 15:12:32.889684 (+ 114us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:32.890447 (+ 763us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:32.891704 (+ 1257us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:32.892237 (+ 533us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:32.893310 (+ 1073us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:32.893396 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0927 15:12:32.893435 (+ 39us) server_negotiation.cc:299] Negotiation successful
0927 15:12:32.893512 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":530,"thread_start_us":72,"threads_started":1}
I20260927 15:12:32.893939 25216 tablet_service.cc:1467] Processing CreateTablet for tablet 25b5ae05ba194dceab76826da1b3ae1e (DEFAULT_TABLE table=test-table [id=ecc98e77b4e247768336231ca1384e0b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:12:32.894094 25080 tablet_service.cc:1467] Processing CreateTablet for tablet 25b5ae05ba194dceab76826da1b3ae1e (DEFAULT_TABLE table=test-table [id=ecc98e77b4e247768336231ca1384e0b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:12:32.894207 25216 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 25b5ae05ba194dceab76826da1b3ae1e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:12:32.894253 25375 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:32.889048 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42116 (local address 127.17.136.1:41807)
0927 15:12:32.889248 (+ 200us) server_negotiation.cc:206] Beginning negotiation
0927 15:12:32.889253 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0927 15:12:32.889300 (+ 47us) server_negotiation.cc:407] Connection header received
0927 15:12:32.889419 (+ 119us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:12:32.889421 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:12:32.889465 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:12:32.889533 (+ 68us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0927 15:12:32.889788 (+ 255us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:32.890290 (+ 502us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:32.891961 (+ 1671us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:32.892555 (+ 594us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:32.892663 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:32.892738 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0927 15:12:32.892846 (+ 108us) server_negotiation.cc:299] Negotiation successful
0927 15:12:32.894061 (+ 1215us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":141,"thread_start_us":60,"threads_started":1}
I20260927 15:12:32.894295 25080 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 25b5ae05ba194dceab76826da1b3ae1e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:12:32.896642 25377 tablet_bootstrap.cc:492] T 25b5ae05ba194dceab76826da1b3ae1e P e94ed22dcc4f4c828fb3714f2d327a6e: Bootstrap starting.
I20260927 15:12:32.896934 24943 tablet_service.cc:1467] Processing CreateTablet for tablet 25b5ae05ba194dceab76826da1b3ae1e (DEFAULT_TABLE table=test-table [id=ecc98e77b4e247768336231ca1384e0b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:12:32.897161 24943 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 25b5ae05ba194dceab76826da1b3ae1e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:12:32.897668 25377 tablet_bootstrap.cc:654] T 25b5ae05ba194dceab76826da1b3ae1e P e94ed22dcc4f4c828fb3714f2d327a6e: Neither blocks nor log segments found. Creating new log.
I20260927 15:12:32.898264 25376 tablet_bootstrap.cc:492] T 25b5ae05ba194dceab76826da1b3ae1e P bce84efcd7394877943020b62471f259: Bootstrap starting.
I20260927 15:12:32.899003 25376 tablet_bootstrap.cc:654] T 25b5ae05ba194dceab76826da1b3ae1e P bce84efcd7394877943020b62471f259: Neither blocks nor log segments found. Creating new log.
I20260927 15:12:32.899123 25379 tablet_bootstrap.cc:492] T 25b5ae05ba194dceab76826da1b3ae1e P 45aed58e7be84f1c93e2ca9ab659462e: Bootstrap starting.
I20260927 15:12:32.899905 25379 tablet_bootstrap.cc:654] T 25b5ae05ba194dceab76826da1b3ae1e P 45aed58e7be84f1c93e2ca9ab659462e: Neither blocks nor log segments found. Creating new log.
I20260927 15:12:32.900003 25377 tablet_bootstrap.cc:492] T 25b5ae05ba194dceab76826da1b3ae1e P e94ed22dcc4f4c828fb3714f2d327a6e: No bootstrap required, opened a new log
I20260927 15:12:32.900104 25377 ts_tablet_manager.cc:1397] T 25b5ae05ba194dceab76826da1b3ae1e P e94ed22dcc4f4c828fb3714f2d327a6e: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.000s
I20260927 15:12:32.900213 25376 tablet_bootstrap.cc:492] T 25b5ae05ba194dceab76826da1b3ae1e P bce84efcd7394877943020b62471f259: No bootstrap required, opened a new log
I20260927 15:12:32.900300 25376 ts_tablet_manager.cc:1397] T 25b5ae05ba194dceab76826da1b3ae1e P bce84efcd7394877943020b62471f259: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260927 15:12:32.900542 25377 raft_consensus.cc:348] T 25b5ae05ba194dceab76826da1b3ae1e P e94ed22dcc4f4c828fb3714f2d327a6e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bce84efcd7394877943020b62471f259" member_type: VOTER last_known_addr { host: "127.17.136.2" port: 42827 } } peers { permanent_uuid: "e94ed22dcc4f4c828fb3714f2d327a6e" member_type: VOTER last_known_addr { host: "127.17.136.3" port: 33145 } } peers { permanent_uuid: "45aed58e7be84f1c93e2ca9ab659462e" member_type: VOTER last_known_addr { host: "127.17.136.1" port: 41807 } }
I20260927 15:12:32.900612 25376 raft_consensus.cc:348] T 25b5ae05ba194dceab76826da1b3ae1e P bce84efcd7394877943020b62471f259 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bce84efcd7394877943020b62471f259" member_type: VOTER last_known_addr { host: "127.17.136.2" port: 42827 } } peers { permanent_uuid: "e94ed22dcc4f4c828fb3714f2d327a6e" member_type: VOTER last_known_addr { host: "127.17.136.3" port: 33145 } } peers { permanent_uuid: "45aed58e7be84f1c93e2ca9ab659462e" member_type: VOTER last_known_addr { host: "127.17.136.1" port: 41807 } }
I20260927 15:12:32.900664 25377 raft_consensus.cc:374] T 25b5ae05ba194dceab76826da1b3ae1e P e94ed22dcc4f4c828fb3714f2d327a6e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:12:32.900698 25376 raft_consensus.cc:374] T 25b5ae05ba194dceab76826da1b3ae1e P bce84efcd7394877943020b62471f259 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:12:32.900702 25377 raft_consensus.cc:729] T 25b5ae05ba194dceab76826da1b3ae1e P e94ed22dcc4f4c828fb3714f2d327a6e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e94ed22dcc4f4c828fb3714f2d327a6e, State: Initialized, Role: FOLLOWER
I20260927 15:12:32.900733 25376 raft_consensus.cc:729] T 25b5ae05ba194dceab76826da1b3ae1e P bce84efcd7394877943020b62471f259 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bce84efcd7394877943020b62471f259, State: Initialized, Role: FOLLOWER
I20260927 15:12:32.900868 25376 consensus_queue.cc:260] T 25b5ae05ba194dceab76826da1b3ae1e P bce84efcd7394877943020b62471f259 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bce84efcd7394877943020b62471f259" member_type: VOTER last_known_addr { host: "127.17.136.2" port: 42827 } } peers { permanent_uuid: "e94ed22dcc4f4c828fb3714f2d327a6e" member_type: VOTER last_known_addr { host: "127.17.136.3" port: 33145 } } peers { permanent_uuid: "45aed58e7be84f1c93e2ca9ab659462e" member_type: VOTER last_known_addr { host: "127.17.136.1" port: 41807 } }
I20260927 15:12:32.900872 25377 consensus_queue.cc:260] T 25b5ae05ba194dceab76826da1b3ae1e P e94ed22dcc4f4c828fb3714f2d327a6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bce84efcd7394877943020b62471f259" member_type: VOTER last_known_addr { host: "127.17.136.2" port: 42827 } } peers { permanent_uuid: "e94ed22dcc4f4c828fb3714f2d327a6e" member_type: VOTER last_known_addr { host: "127.17.136.3" port: 33145 } } peers { permanent_uuid: "45aed58e7be84f1c93e2ca9ab659462e" member_type: VOTER last_known_addr { host: "127.17.136.1" port: 41807 } }
I20260927 15:12:32.901155 25376 ts_tablet_manager.cc:1428] T 25b5ae05ba194dceab76826da1b3ae1e P bce84efcd7394877943020b62471f259: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260927 15:12:32.901244 25377 ts_tablet_manager.cc:1428] T 25b5ae05ba194dceab76826da1b3ae1e P e94ed22dcc4f4c828fb3714f2d327a6e: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260927 15:12:32.903419 25385 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:32.902057 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.62:33401 (local address 127.17.136.2:60421)
0927 15:12:32.902865 (+ 808us) negotiation.cc:107] Waiting for socket to connect
0927 15:12:32.903321 (+ 456us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.136.62:33401: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":703,"thread_start_us":81,"threads_started":1}
I20260927 15:12:32.903772 25284 heartbeater.cc:503] Master 127.17.136.61:42371 was elected leader, sending a full tablet report...
I20260927 15:12:32.903784 25148 heartbeater.cc:503] Master 127.17.136.61:42371 was elected leader, sending a full tablet report...
I20260927 15:12:32.904301 25384 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:32.901675 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.62:33401 (local address 127.17.136.3:48865)
0927 15:12:32.904155 (+ 2480us) negotiation.cc:107] Waiting for socket to connect
0927 15:12:32.904213 (+ 58us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.136.62:33401: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":2398,"thread_start_us":84,"threads_started":1}
I20260927 15:12:32.905094 25385 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:32.904220 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.62:33401 (local address 127.17.136.2:55597)
0927 15:12:32.904971 (+ 751us) negotiation.cc:107] Waiting for socket to connect
0927 15:12:32.905026 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.136.62:33401: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":680}
I20260927 15:12:32.905254 25386 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:32.904696 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.62:33401 (local address 127.17.136.3:51643)
0927 15:12:32.905110 (+ 414us) negotiation.cc:107] Waiting for socket to connect
0927 15:12:32.905170 (+ 60us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.136.62:33401: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":172,"thread_start_us":106,"threads_started":1}
I20260927 15:12:32.905791 25379 tablet_bootstrap.cc:492] T 25b5ae05ba194dceab76826da1b3ae1e P 45aed58e7be84f1c93e2ca9ab659462e: No bootstrap required, opened a new log
I20260927 15:12:32.905897 25379 ts_tablet_manager.cc:1397] T 25b5ae05ba194dceab76826da1b3ae1e P 45aed58e7be84f1c93e2ca9ab659462e: Time spent bootstrapping tablet: real 0.007s user 0.001s sys 0.000s
I20260927 15:12:32.906316 25379 raft_consensus.cc:348] T 25b5ae05ba194dceab76826da1b3ae1e P 45aed58e7be84f1c93e2ca9ab659462e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bce84efcd7394877943020b62471f259" member_type: VOTER last_known_addr { host: "127.17.136.2" port: 42827 } } peers { permanent_uuid: "e94ed22dcc4f4c828fb3714f2d327a6e" member_type: VOTER last_known_addr { host: "127.17.136.3" port: 33145 } } peers { permanent_uuid: "45aed58e7be84f1c93e2ca9ab659462e" member_type: VOTER last_known_addr { host: "127.17.136.1" port: 41807 } }
I20260927 15:12:32.906425 25379 raft_consensus.cc:374] T 25b5ae05ba194dceab76826da1b3ae1e P 45aed58e7be84f1c93e2ca9ab659462e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:12:32.906461 25379 raft_consensus.cc:729] T 25b5ae05ba194dceab76826da1b3ae1e P 45aed58e7be84f1c93e2ca9ab659462e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 45aed58e7be84f1c93e2ca9ab659462e, State: Initialized, Role: FOLLOWER
I20260927 15:12:32.906594 25379 consensus_queue.cc:260] T 25b5ae05ba194dceab76826da1b3ae1e P 45aed58e7be84f1c93e2ca9ab659462e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bce84efcd7394877943020b62471f259" member_type: VOTER last_known_addr { host: "127.17.136.2" port: 42827 } } peers { permanent_uuid: "e94ed22dcc4f4c828fb3714f2d327a6e" member_type: VOTER last_known_addr { host: "127.17.136.3" port: 33145 } } peers { permanent_uuid: "45aed58e7be84f1c93e2ca9ab659462e" member_type: VOTER last_known_addr { host: "127.17.136.1" port: 41807 } }
I20260927 15:12:32.906914 25379 ts_tablet_manager.cc:1428] T 25b5ae05ba194dceab76826da1b3ae1e P 45aed58e7be84f1c93e2ca9ab659462e: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260927 15:12:32.907758 25388 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:32.907219 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.62:33401 (local address 127.17.136.1:53639)
0927 15:12:32.907638 (+ 419us) negotiation.cc:107] Waiting for socket to connect
0927 15:12:32.907686 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.136.62:33401: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":362,"thread_start_us":108,"threads_started":1}
I20260927 15:12:32.908429 25011 heartbeater.cc:503] Master 127.17.136.61:42371 was elected leader, sending a full tablet report...
I20260927 15:12:32.908591 25388 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:32.908144 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.62:33401 (local address 127.17.136.1:37551)
0927 15:12:32.908364 (+ 220us) negotiation.cc:107] Waiting for socket to connect
0927 15:12:32.908418 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.136.62:33401: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":119}
I20260927 15:12:32.942411 25383 raft_consensus.cc:482] T 25b5ae05ba194dceab76826da1b3ae1e P e94ed22dcc4f4c828fb3714f2d327a6e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:12:32.942579 25383 raft_consensus.cc:504] T 25b5ae05ba194dceab76826da1b3ae1e P e94ed22dcc4f4c828fb3714f2d327a6e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bce84efcd7394877943020b62471f259" member_type: VOTER last_known_addr { host: "127.17.136.2" port: 42827 } } peers { permanent_uuid: "e94ed22dcc4f4c828fb3714f2d327a6e" member_type: VOTER last_known_addr { host: "127.17.136.3" port: 33145 } } peers { permanent_uuid: "45aed58e7be84f1c93e2ca9ab659462e" member_type: VOTER last_known_addr { host: "127.17.136.1" port: 41807 } }
I20260927 15:12:32.943756 25383 leader_election.cc:288] T 25b5ae05ba194dceab76826da1b3ae1e P e94ed22dcc4f4c828fb3714f2d327a6e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bce84efcd7394877943020b62471f259 (127.17.136.2:42827), 45aed58e7be84f1c93e2ca9ab659462e (127.17.136.1:41807)
I20260927 15:12:32.948643 25372 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:32.944071 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.136.3:55145 (local address 127.17.136.2:42827)
0927 15:12:32.944184 (+ 113us) server_negotiation.cc:206] Beginning negotiation
0927 15:12:32.944189 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0927 15:12:32.944264 (+ 75us) server_negotiation.cc:407] Connection header received
0927 15:12:32.944400 (+ 136us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:12:32.944403 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:12:32.944450 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:12:32.944517 (+ 67us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0927 15:12:32.944874 (+ 357us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:32.945683 (+ 809us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:32.947401 (+ 1718us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:32.947991 (+ 590us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:32.948113 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:32.948162 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0927 15:12:32.948448 (+ 286us) server_negotiation.cc:299] Negotiation successful
0927 15:12:32.948523 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260927 15:12:32.948643 25375 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:32.944119 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.136.3:38433 (local address 127.17.136.1:41807)
0927 15:12:32.944226 (+ 107us) server_negotiation.cc:206] Beginning negotiation
0927 15:12:32.944230 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0927 15:12:32.944308 (+ 78us) server_negotiation.cc:407] Connection header received
0927 15:12:32.944422 (+ 114us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:12:32.944425 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:12:32.944465 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:12:32.944523 (+ 58us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0927 15:12:32.944836 (+ 313us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:32.945654 (+ 818us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:32.947396 (+ 1742us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:32.948027 (+ 631us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:32.948117 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:32.948162 (+ 45us) server_negotiation.cc:1035] Waiting for connection context
0927 15:12:32.948448 (+ 286us) server_negotiation.cc:299] Negotiation successful
0927 15:12:32.948519 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260927 15:12:32.948678 25386 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:32.943981 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.1:41807 (local address 127.17.136.3:38433)
0927 15:12:32.944224 (+ 243us) negotiation.cc:107] Waiting for socket to connect
0927 15:12:32.944237 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0927 15:12:32.944332 (+ 95us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0927 15:12:32.944537 (+ 205us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0927 15:12:32.944540 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0927 15:12:32.944571 (+ 31us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0927 15:12:32.944725 (+ 154us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:12:32.944730 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:12:32.945772 (+ 1042us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:12:32.945776 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:12:32.947284 (+ 1508us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:12:32.947293 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:12:32.948135 (+ 842us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:12:32.948139 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:12:32.948300 (+ 161us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:32.948363 (+ 63us) client_negotiation.cc:769] Sending connection context
0927 15:12:32.948456 (+ 93us) client_negotiation.cc:240] Negotiation successful
0927 15:12:32.948524 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":173,"mutex_wait_us":235,"spinlock_wait_cycles":6144}
I20260927 15:12:32.948690 25384 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:32.943974 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.2:42827 (local address 127.17.136.3:55145)
0927 15:12:32.944171 (+ 197us) negotiation.cc:107] Waiting for socket to connect
0927 15:12:32.944186 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0927 15:12:32.944302 (+ 116us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0927 15:12:32.944534 (+ 232us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0927 15:12:32.944537 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0927 15:12:32.944570 (+ 33us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0927 15:12:32.944766 (+ 196us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:12:32.944773 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:12:32.945772 (+ 999us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:12:32.945776 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:12:32.947283 (+ 1507us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:12:32.947293 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:12:32.948136 (+ 843us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:12:32.948139 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:12:32.948299 (+ 160us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:32.948350 (+ 51us) client_negotiation.cc:769] Sending connection context
0927 15:12:32.948428 (+ 78us) client_negotiation.cc:240] Negotiation successful
0927 15:12:32.948512 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":119,"mutex_wait_us":106,"spinlock_wait_cycles":7296}
I20260927 15:12:32.949100 25099 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "25b5ae05ba194dceab76826da1b3ae1e" candidate_uuid: "e94ed22dcc4f4c828fb3714f2d327a6e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bce84efcd7394877943020b62471f259" is_pre_election: true
I20260927 15:12:32.949247 25099 raft_consensus.cc:2454] T 25b5ae05ba194dceab76826da1b3ae1e P bce84efcd7394877943020b62471f259 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e94ed22dcc4f4c828fb3714f2d327a6e in term 0.
I20260927 15:12:32.949573 24963 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "25b5ae05ba194dceab76826da1b3ae1e" candidate_uuid: "e94ed22dcc4f4c828fb3714f2d327a6e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45aed58e7be84f1c93e2ca9ab659462e" is_pre_election: true
I20260927 15:12:32.949633 25169 leader_election.cc:302] T 25b5ae05ba194dceab76826da1b3ae1e P e94ed22dcc4f4c828fb3714f2d327a6e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bce84efcd7394877943020b62471f259, e94ed22dcc4f4c828fb3714f2d327a6e; no voters:
I20260927 15:12:32.949800 24963 raft_consensus.cc:2454] T 25b5ae05ba194dceab76826da1b3ae1e P 45aed58e7be84f1c93e2ca9ab659462e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e94ed22dcc4f4c828fb3714f2d327a6e in term 0.
I20260927 15:12:32.949885 25383 raft_consensus.cc:2781] T 25b5ae05ba194dceab76826da1b3ae1e P e94ed22dcc4f4c828fb3714f2d327a6e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 15:12:32.949927 25383 raft_consensus.cc:482] T 25b5ae05ba194dceab76826da1b3ae1e P e94ed22dcc4f4c828fb3714f2d327a6e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 15:12:32.949962 25383 raft_consensus.cc:3037] T 25b5ae05ba194dceab76826da1b3ae1e P e94ed22dcc4f4c828fb3714f2d327a6e [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:12:32.951021 25383 raft_consensus.cc:504] T 25b5ae05ba194dceab76826da1b3ae1e P e94ed22dcc4f4c828fb3714f2d327a6e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bce84efcd7394877943020b62471f259" member_type: VOTER last_known_addr { host: "127.17.136.2" port: 42827 } } peers { permanent_uuid: "e94ed22dcc4f4c828fb3714f2d327a6e" member_type: VOTER last_known_addr { host: "127.17.136.3" port: 33145 } } peers { permanent_uuid: "45aed58e7be84f1c93e2ca9ab659462e" member_type: VOTER last_known_addr { host: "127.17.136.1" port: 41807 } }
I20260927 15:12:32.951378 25383 leader_election.cc:288] T 25b5ae05ba194dceab76826da1b3ae1e P e94ed22dcc4f4c828fb3714f2d327a6e [CANDIDATE]: Term 1 election: Requested vote from peers bce84efcd7394877943020b62471f259 (127.17.136.2:42827), 45aed58e7be84f1c93e2ca9ab659462e (127.17.136.1:41807)
I20260927 15:12:32.951653 25099 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "25b5ae05ba194dceab76826da1b3ae1e" candidate_uuid: "e94ed22dcc4f4c828fb3714f2d327a6e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bce84efcd7394877943020b62471f259"
I20260927 15:12:32.951681 24963 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "25b5ae05ba194dceab76826da1b3ae1e" candidate_uuid: "e94ed22dcc4f4c828fb3714f2d327a6e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45aed58e7be84f1c93e2ca9ab659462e"
I20260927 15:12:32.951761 25099 raft_consensus.cc:3037] T 25b5ae05ba194dceab76826da1b3ae1e P bce84efcd7394877943020b62471f259 [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:12:32.951777 24963 raft_consensus.cc:3037] T 25b5ae05ba194dceab76826da1b3ae1e P 45aed58e7be84f1c93e2ca9ab659462e [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:12:32.952592 25099 raft_consensus.cc:2454] T 25b5ae05ba194dceab76826da1b3ae1e P bce84efcd7394877943020b62471f259 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e94ed22dcc4f4c828fb3714f2d327a6e in term 1.
I20260927 15:12:32.952639 24963 raft_consensus.cc:2454] T 25b5ae05ba194dceab76826da1b3ae1e P 45aed58e7be84f1c93e2ca9ab659462e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e94ed22dcc4f4c828fb3714f2d327a6e in term 1.
I20260927 15:12:32.952819 25169 leader_election.cc:302] T 25b5ae05ba194dceab76826da1b3ae1e P e94ed22dcc4f4c828fb3714f2d327a6e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bce84efcd7394877943020b62471f259, e94ed22dcc4f4c828fb3714f2d327a6e; no voters:
I20260927 15:12:32.952986 25383 raft_consensus.cc:2781] T 25b5ae05ba194dceab76826da1b3ae1e P e94ed22dcc4f4c828fb3714f2d327a6e [term 1 FOLLOWER]: Leader election won for term 1
I20260927 15:12:32.953188 25383 raft_consensus.cc:686] T 25b5ae05ba194dceab76826da1b3ae1e P e94ed22dcc4f4c828fb3714f2d327a6e [term 1 LEADER]: Becoming Leader. State: Replica: e94ed22dcc4f4c828fb3714f2d327a6e, State: Running, Role: LEADER
I20260927 15:12:32.953420 25383 consensus_queue.cc:237] T 25b5ae05ba194dceab76826da1b3ae1e P e94ed22dcc4f4c828fb3714f2d327a6e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bce84efcd7394877943020b62471f259" member_type: VOTER last_known_addr { host: "127.17.136.2" port: 42827 } } peers { permanent_uuid: "e94ed22dcc4f4c828fb3714f2d327a6e" member_type: VOTER last_known_addr { host: "127.17.136.3" port: 33145 } } peers { permanent_uuid: "45aed58e7be84f1c93e2ca9ab659462e" member_type: VOTER last_known_addr { host: "127.17.136.1" port: 41807 } }
I20260927 15:12:32.953799 25384 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:32.953591 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.62:33401 (local address 127.17.136.3:35963)
0927 15:12:32.953685 (+ 94us) negotiation.cc:107] Waiting for socket to connect
0927 15:12:32.953737 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.136.62:33401: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":36}
I20260927 15:12:32.955792 24646 catalog_manager.cc:5495] T 25b5ae05ba194dceab76826da1b3ae1e P e94ed22dcc4f4c828fb3714f2d327a6e reported cstate change: term changed from 0 to 1, leader changed from <none> to e94ed22dcc4f4c828fb3714f2d327a6e (127.17.136.3). New cstate: current_term: 1 leader_uuid: "e94ed22dcc4f4c828fb3714f2d327a6e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bce84efcd7394877943020b62471f259" member_type: VOTER last_known_addr { host: "127.17.136.2" port: 42827 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e94ed22dcc4f4c828fb3714f2d327a6e" member_type: VOTER last_known_addr { host: "127.17.136.3" port: 33145 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "45aed58e7be84f1c93e2ca9ab659462e" member_type: VOTER last_known_addr { host: "127.17.136.1" port: 41807 } health_report { overall_health: UNKNOWN } } }
I20260927 15:12:32.973179 25373 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:32.969859 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39738 (local address 127.17.136.3:33145)
0927 15:12:32.969974 (+ 115us) server_negotiation.cc:206] Beginning negotiation
0927 15:12:32.969979 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0927 15:12:32.969995 (+ 16us) server_negotiation.cc:407] Connection header received
0927 15:12:32.970153 (+ 158us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:12:32.970157 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:12:32.970209 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:12:32.970292 (+ 83us) server_negotiation.cc:226] Negotiated authn=TOKEN
0927 15:12:32.970514 (+ 222us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:32.971013 (+ 499us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:32.971874 (+ 861us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:32.972090 (+ 216us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:32.972173 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:32.972416 (+ 243us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0927 15:12:32.972838 (+ 422us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0927 15:12:32.972934 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0927 15:12:32.973013 (+ 79us) server_negotiation.cc:299] Negotiation successful
0927 15:12:32.973064 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260927 15:12:32.975495 25099 raft_consensus.cc:1261] T 25b5ae05ba194dceab76826da1b3ae1e P bce84efcd7394877943020b62471f259 [term 1 FOLLOWER]: Refusing update from remote peer e94ed22dcc4f4c828fb3714f2d327a6e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260927 15:12:32.975782 24963 raft_consensus.cc:1261] T 25b5ae05ba194dceab76826da1b3ae1e P 45aed58e7be84f1c93e2ca9ab659462e [term 1 FOLLOWER]: Refusing update from remote peer e94ed22dcc4f4c828fb3714f2d327a6e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260927 15:12:32.975956 25389 consensus_queue.cc:1035] T 25b5ae05ba194dceab76826da1b3ae1e P e94ed22dcc4f4c828fb3714f2d327a6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "bce84efcd7394877943020b62471f259" member_type: VOTER last_known_addr { host: "127.17.136.2" port: 42827 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260927 15:12:32.976270 25383 consensus_queue.cc:1035] T 25b5ae05ba194dceab76826da1b3ae1e P e94ed22dcc4f4c828fb3714f2d327a6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "45aed58e7be84f1c93e2ca9ab659462e" member_type: VOTER last_known_addr { host: "127.17.136.1" port: 41807 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260927 15:12:32.978328 25385 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:32.977996 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.62:33401 (local address 127.17.136.2:43581)
0927 15:12:32.978199 (+ 203us) negotiation.cc:107] Waiting for socket to connect
0927 15:12:32.978256 (+ 57us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.136.62:33401: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":139}
I20260927 15:12:32.978420 25388 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:32.978111 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.62:33401 (local address 127.17.136.1:42343)
0927 15:12:32.978287 (+ 176us) negotiation.cc:107] Waiting for socket to connect
0927 15:12:32.978352 (+ 65us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.136.62:33401: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":111}
I20260927 15:12:32.980633 25384 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:32.980422 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.62:33401 (local address 127.17.136.3:42131)
0927 15:12:32.980516 (+ 94us) negotiation.cc:107] Waiting for socket to connect
0927 15:12:32.980567 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.136.62:33401: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":37}
I20260927 15:12:32.980893 25385 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:32.980489 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.62:33401 (local address 127.17.136.2:35625)
0927 15:12:32.980784 (+ 295us) negotiation.cc:107] Waiting for socket to connect
0927 15:12:32.980834 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.136.62:33401: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":234}
I20260927 15:12:32.982584 25388 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:32.982349 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.62:33401 (local address 127.17.136.1:39073)
0927 15:12:32.982475 (+ 126us) negotiation.cc:107] Waiting for socket to connect
0927 15:12:32.982525 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.136.62:33401: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":69}
I20260927 15:12:32.983278 25394 mvcc.cc:205] Tried to move back new op lower bound from 7333977919383478272 to 7333977919300669440. Current Snapshot: MvccSnapshot[applied={T|T < 7333977919383478272}]
I20260927 15:12:32.987821 25384 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:32.987564 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.62:33401 (local address 127.17.136.3:57223)
0927 15:12:32.987689 (+ 125us) negotiation.cc:107] Waiting for socket to connect
0927 15:12:32.987750 (+ 61us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.136.62:33401: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":50}
I20260927 15:12:32.988416 24645 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:35598:
table { table_name: "test-table" } modify_external_catalogs: true
I20260927 15:12:32.988579 24645 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:35598:
table { table_name: "test-table" } modify_external_catalogs: true
I20260927 15:12:32.992053 24645 catalog_manager.cc:5782] T 00000000000000000000000000000000 P cc335ec49c7b46d8b3bfc44fc1f32579: Sending DeleteTablet for 3 replicas of tablet 25b5ae05ba194dceab76826da1b3ae1e
I20260927 15:12:32.992729 24943 tablet_service.cc:1514] Processing DeleteTablet for tablet 25b5ae05ba194dceab76826da1b3ae1e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:12:32 UTC) from {username='oryx', principal='oryx/127.17.136.61@KRBTEST.COM'} at 127.0.0.1:42116
I20260927 15:12:32.992739 25216 tablet_service.cc:1514] Processing DeleteTablet for tablet 25b5ae05ba194dceab76826da1b3ae1e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:12:32 UTC) from {username='oryx', principal='oryx/127.17.136.61@KRBTEST.COM'} at 127.0.0.1:39736
I20260927 15:12:32.993180 25403 tablet_replica.cc:330] T 25b5ae05ba194dceab76826da1b3ae1e P e94ed22dcc4f4c828fb3714f2d327a6e: stopping tablet replica
I20260927 15:12:32.993180 25080 tablet_service.cc:1514] Processing DeleteTablet for tablet 25b5ae05ba194dceab76826da1b3ae1e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:12:32 UTC) from {username='oryx', principal='oryx/127.17.136.61@KRBTEST.COM'} at 127.0.0.1:53098
I20260927 15:12:32.993578 25404 tablet_replica.cc:330] T 25b5ae05ba194dceab76826da1b3ae1e P 45aed58e7be84f1c93e2ca9ab659462e: stopping tablet replica
I20260927 15:12:32.993697 25404 raft_consensus.cc:2229] T 25b5ae05ba194dceab76826da1b3ae1e P 45aed58e7be84f1c93e2ca9ab659462e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260927 15:12:32.993712 17952 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu with pid 24790
I20260927 15:12:32.993810 25404 raft_consensus.cc:2258] T 25b5ae05ba194dceab76826da1b3ae1e P 45aed58e7be84f1c93e2ca9ab659462e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 15:12:32.994019 25405 tablet_replica.cc:330] T 25b5ae05ba194dceab76826da1b3ae1e P bce84efcd7394877943020b62471f259: stopping tablet replica
I20260927 15:12:32.994108 25405 raft_consensus.cc:2229] T 25b5ae05ba194dceab76826da1b3ae1e P bce84efcd7394877943020b62471f259 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260927 15:12:32.994210 25405 raft_consensus.cc:2258] T 25b5ae05ba194dceab76826da1b3ae1e P bce84efcd7394877943020b62471f259 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 15:12:32.994848 25405 ts_tablet_manager.cc:1905] T 25b5ae05ba194dceab76826da1b3ae1e P bce84efcd7394877943020b62471f259: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:12:32.996779 25405 ts_tablet_manager.cc:1918] T 25b5ae05ba194dceab76826da1b3ae1e P bce84efcd7394877943020b62471f259: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260927 15:12:32.996827 25405 log.cc:1196] T 25b5ae05ba194dceab76826da1b3ae1e P bce84efcd7394877943020b62471f259: Deleting WAL directory at /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790521920546562-17952-0/minicluster-data/ts-1/wal/wals/25b5ae05ba194dceab76826da1b3ae1e
I20260927 15:12:32.996995 25405 ts_tablet_manager.cc:1939] T 25b5ae05ba194dceab76826da1b3ae1e P bce84efcd7394877943020b62471f259: Deleting consensus metadata
I20260927 15:12:32.997653 24630 catalog_manager.cc:4841] TS bce84efcd7394877943020b62471f259 (127.17.136.2:42827): tablet 25b5ae05ba194dceab76826da1b3ae1e (table test-table [id=ecc98e77b4e247768336231ca1384e0b]) successfully deleted
I20260927 15:12:32.999388 25403 raft_consensus.cc:2229] T 25b5ae05ba194dceab76826da1b3ae1e P e94ed22dcc4f4c828fb3714f2d327a6e [term 1 LEADER]: Raft consensus shutting down.
I20260927 15:12:32.999706 25403 raft_consensus.cc:2258] T 25b5ae05ba194dceab76826da1b3ae1e P e94ed22dcc4f4c828fb3714f2d327a6e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 15:12:33.000317 25403 ts_tablet_manager.cc:1905] T 25b5ae05ba194dceab76826da1b3ae1e P e94ed22dcc4f4c828fb3714f2d327a6e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:12:33.002131 25403 ts_tablet_manager.cc:1918] T 25b5ae05ba194dceab76826da1b3ae1e P e94ed22dcc4f4c828fb3714f2d327a6e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260927 15:12:33.002197 25403 log.cc:1196] T 25b5ae05ba194dceab76826da1b3ae1e P e94ed22dcc4f4c828fb3714f2d327a6e: Deleting WAL directory at /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790521920546562-17952-0/minicluster-data/ts-2/wal/wals/25b5ae05ba194dceab76826da1b3ae1e
I20260927 15:12:33.002440 25403 ts_tablet_manager.cc:1939] T 25b5ae05ba194dceab76826da1b3ae1e P e94ed22dcc4f4c828fb3714f2d327a6e: Deleting consensus metadata
I20260927 15:12:33.003018 24632 catalog_manager.cc:4841] TS e94ed22dcc4f4c828fb3714f2d327a6e (127.17.136.3:33145): tablet 25b5ae05ba194dceab76826da1b3ae1e (table test-table [id=ecc98e77b4e247768336231ca1384e0b]) successfully deleted
I20260927 15:12:33.004138 17952 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu with pid 25017
I20260927 15:12:33.004320 25374 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:33.004027 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.1:41807 (local address 127.0.0.1:42124)
0927 15:12:33.004182 (+ 155us) negotiation.cc:107] Waiting for socket to connect
0927 15:12:33.004235 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.136.1:41807: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":91}
W20260927 15:12:33.004515 24633 catalog_manager.cc:4584] TS 45aed58e7be84f1c93e2ca9ab659462e (127.17.136.1:41807): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 25b5ae05ba194dceab76826da1b3ae1e: Network error: Client connection negotiation failed: client connection to 127.17.136.1:41807: connect: Connection refused (error 111)
I20260927 15:12:33.011732 17952 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu with pid 25153
I20260927 15:12:33.016407 17952 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu with pid 24510
I20260927 15:12:33.020738 17952 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu with pid 24618
2026-09-27T15:12:33Z chronyd exiting
[ OK ] SecurityITest.TestNonDefaultPrincipalMultipleMaster (5180 ms)
[ RUN ] SecurityITest.TestNonDefaultPrincipal
Loading random data
Initializing database '/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790521920546562-17952-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 27 15:12:33 dist-test-slave-5s2t krb5kdc[25408](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 27 15:12:33 dist-test-slave-5s2t krb5kdc[25408](info): set up 2 sockets
Sep 27 15:12:33 dist-test-slave-5s2t krb5kdc[25408](info): commencing operation
krb5kdc: starting...
W20260927 15:12:33.971483 17952 mini_kdc.cc:121] Time spent starting KDC: real 0.930s user 0.005s sys 0.000s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790521920546562-17952-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790521920546562-17952-0/krb5kdc/test-user.keytab.
Sep 27 15:12:34 dist-test-slave-5s2t krb5kdc[25408](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790521954, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-27T15:12:34Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-27T15:12:34Z Disabled control of system clock
WARNING: no policy specified for oryx/127.17.136.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.17.136.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.17.136.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790521920546562-17952-0/krb5kdc/oryx_127.17.136.62.keytab.
Entry for principal oryx/127.17.136.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790521920546562-17952-0/krb5kdc/oryx_127.17.136.62.keytab.
I20260927 15:12:34.086400 17952 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu
/tmp/dist-test-taskiFOyeW/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790521920546562-17952-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790521920546562-17952-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790521920546562-17952-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790521920546562-17952-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.136.62:46025
--webserver_interface=127.17.136.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790521920546562-17952-0/krb5kdc/oryx_127.17.136.62.keytab
--principal=oryx/127.17.136.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.136.20:34495
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.136.62:46025
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790521920546562-17952-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790521920546562-17952-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790521920546562-17952-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260927 15:12:34.192533 25421 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260927 15:12:34.192786 25421 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260927 15:12:34.192837 25421 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260927 15:12:34.196743 25421 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260927 15:12:34.196803 25421 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260927 15:12:34.196826 25421 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260927 15:12:34.196847 25421 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260927 15:12:34.196869 25421 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260927 15:12:34.196904 25421 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260927 15:12:34.202088 25421 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.136.20:34495
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790521920546562-17952-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790521920546562-17952-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.17.136.62:46025
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790521920546562-17952-0/krb5kdc/oryx_127.17.136.62.keytab
--principal=oryx/127.17.136.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.136.62:46025
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790521920546562-17952-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.17.136.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25421
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790521920546562-17952-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 27 Sep 2026 14:27:13 UTC on ccycloud.quasar-psqrth.root.comops.site
build id 4676138
I20260927 15:12:34.203126 25421 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260927 15:12:34.204110 25421 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260927 15:12:34.212045 25429 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260927 15:12:34.212090 25426 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260927 15:12:34.212176 25427 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260927 15:12:34.212332 25421 server_base.cc:1034] running on GCE node
I20260927 15:12:34.212903 25421 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260927 15:12:34.213932 25421 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260927 15:12:34.215082 25421 hybrid_clock.cc:648] HybridClock initialized: now 1790521954215065 us; error 34 us; skew 500 ppm
Sep 27 15:12:34 dist-test-slave-5s2t krb5kdc[25408](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790521954, etypes {rep=17 tkt=17 ses=17}, oryx/127.17.136.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260927 15:12:34.217479 25421 init.cc:377] Logged in from keytab as oryx/127.17.136.62@KRBTEST.COM (short username oryx)
I20260927 15:12:34.218291 25421 webserver.cc:460] Webserver started at http://127.17.136.62:38917/ using document root <none> and password file <none>
I20260927 15:12:34.218796 25421 fs_manager.cc:359] Metadata directory not provided
I20260927 15:12:34.218856 25421 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260927 15:12:34.219029 25421 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260927 15:12:34.220944 25421 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790521920546562-17952-0/minicluster-data/master-0/data/instance:
uuid: "e567bae41ac64f3aa35dce62bd53dc51"
format_stamp: "Formatted at 2026-09-27 15:12:34 on dist-test-slave-5s2t"
server_key: "7bbe58a91c20c9ee987a72a185914336"
server_key_iv: "6175f8a8ec1de9df8b5db7f5e17a7492"
server_key_version: "encryptionkey@0"
I20260927 15:12:34.221436 25421 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790521920546562-17952-0/minicluster-data/master-0/wal/instance:
uuid: "e567bae41ac64f3aa35dce62bd53dc51"
format_stamp: "Formatted at 2026-09-27 15:12:34 on dist-test-slave-5s2t"
server_key: "7bbe58a91c20c9ee987a72a185914336"
server_key_iv: "6175f8a8ec1de9df8b5db7f5e17a7492"
server_key_version: "encryptionkey@0"
I20260927 15:12:34.225013 25421 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.003s
I20260927 15:12:34.227562 25436 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260927 15:12:34.228904 25421 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260927 15:12:34.229015 25421 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790521920546562-17952-0/minicluster-data/master-0/data,/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790521920546562-17952-0/minicluster-data/master-0/wal
uuid: "e567bae41ac64f3aa35dce62bd53dc51"
format_stamp: "Formatted at 2026-09-27 15:12:34 on dist-test-slave-5s2t"
server_key: "7bbe58a91c20c9ee987a72a185914336"
server_key_iv: "6175f8a8ec1de9df8b5db7f5e17a7492"
server_key_version: "encryptionkey@0"
I20260927 15:12:34.229125 25421 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790521920546562-17952-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790521920546562-17952-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790521920546562-17952-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260927 15:12:34.244508 25421 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260927 15:12:34.247400 25421 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260927 15:12:34.247573 25421 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260927 15:12:34.254725 25421 rpc_server.cc:307] RPC server started. Bound to: 127.17.136.62:46025
I20260927 15:12:34.254757 25498 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.136.62:46025 every 8 connection(s)
I20260927 15:12:34.255661 25421 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790521920546562-17952-0/minicluster-data/master-0/data/info.pb
I20260927 15:12:34.258303 25499 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:12:34.262049 17952 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu as pid 25421
I20260927 15:12:34.262176 17952 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790521920546562-17952-0/minicluster-data/master-0/wal/instance
I20260927 15:12:34.262472 17952 external_mini_cluster.cc:1428] Setting key 51947283360ae3c4b250588bafbb691c
I20260927 15:12:34.264300 25499 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e567bae41ac64f3aa35dce62bd53dc51: Bootstrap starting.
I20260927 15:12:34.266407 25499 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e567bae41ac64f3aa35dce62bd53dc51: Neither blocks nor log segments found. Creating new log.
I20260927 15:12:34.267071 25499 log.cc:824] T 00000000000000000000000000000000 P e567bae41ac64f3aa35dce62bd53dc51: Log is configured to *not* fsync() on all Append() calls
I20260927 15:12:34.269019 25499 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e567bae41ac64f3aa35dce62bd53dc51: No bootstrap required, opened a new log
Sep 27 15:12:34 dist-test-slave-5s2t krb5kdc[25408](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790521954, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.17.136.62@KRBTEST.COM
I20260927 15:12:34.272874 25499 raft_consensus.cc:348] T 00000000000000000000000000000000 P e567bae41ac64f3aa35dce62bd53dc51 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e567bae41ac64f3aa35dce62bd53dc51" member_type: VOTER last_known_addr { host: "127.17.136.62" port: 46025 } }
I20260927 15:12:34.273092 25499 raft_consensus.cc:374] T 00000000000000000000000000000000 P e567bae41ac64f3aa35dce62bd53dc51 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:12:34.273146 25499 raft_consensus.cc:729] T 00000000000000000000000000000000 P e567bae41ac64f3aa35dce62bd53dc51 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e567bae41ac64f3aa35dce62bd53dc51, State: Initialized, Role: FOLLOWER
I20260927 15:12:34.273578 25499 consensus_queue.cc:260] T 00000000000000000000000000000000 P e567bae41ac64f3aa35dce62bd53dc51 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e567bae41ac64f3aa35dce62bd53dc51" member_type: VOTER last_known_addr { host: "127.17.136.62" port: 46025 } }
I20260927 15:12:34.273703 25499 raft_consensus.cc:388] T 00000000000000000000000000000000 P e567bae41ac64f3aa35dce62bd53dc51 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260927 15:12:34.273765 25499 raft_consensus.cc:482] T 00000000000000000000000000000000 P e567bae41ac64f3aa35dce62bd53dc51 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260927 15:12:34.273864 25499 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e567bae41ac64f3aa35dce62bd53dc51 [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:12:34.274674 25499 raft_consensus.cc:504] T 00000000000000000000000000000000 P e567bae41ac64f3aa35dce62bd53dc51 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e567bae41ac64f3aa35dce62bd53dc51" member_type: VOTER last_known_addr { host: "127.17.136.62" port: 46025 } }
I20260927 15:12:34.274986 25499 leader_election.cc:302] T 00000000000000000000000000000000 P e567bae41ac64f3aa35dce62bd53dc51 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e567bae41ac64f3aa35dce62bd53dc51; no voters:
I20260927 15:12:34.275274 25499 leader_election.cc:288] T 00000000000000000000000000000000 P e567bae41ac64f3aa35dce62bd53dc51 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260927 15:12:34.275359 25504 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e567bae41ac64f3aa35dce62bd53dc51 [term 1 FOLLOWER]: Leader election won for term 1
I20260927 15:12:34.275543 25504 raft_consensus.cc:686] T 00000000000000000000000000000000 P e567bae41ac64f3aa35dce62bd53dc51 [term 1 LEADER]: Becoming Leader. State: Replica: e567bae41ac64f3aa35dce62bd53dc51, State: Running, Role: LEADER
I20260927 15:12:34.275836 25504 consensus_queue.cc:237] T 00000000000000000000000000000000 P e567bae41ac64f3aa35dce62bd53dc51 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e567bae41ac64f3aa35dce62bd53dc51" member_type: VOTER last_known_addr { host: "127.17.136.62" port: 46025 } }
I20260927 15:12:34.275997 25502 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:34.263860 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42276 (local address 127.17.136.62:46025)
0927 15:12:34.264278 (+ 418us) server_negotiation.cc:206] Beginning negotiation
0927 15:12:34.264291 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0927 15:12:34.264324 (+ 33us) server_negotiation.cc:407] Connection header received
0927 15:12:34.264935 (+ 611us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:12:34.264951 (+ 16us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:12:34.265272 (+ 321us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:12:34.265560 (+ 288us) server_negotiation.cc:226] Negotiated authn=SASL
0927 15:12:34.266291 (+ 731us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:34.267368 (+ 1077us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:34.268425 (+ 1057us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:34.268873 (+ 448us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:34.268981 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:34.271610 (+ 2629us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0927 15:12:34.271615 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0927 15:12:34.271627 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0927 15:12:34.271651 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0927 15:12:34.273145 (+ 1494us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:12:34.273519 (+ 374us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:12:34.273525 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:12:34.273529 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:12:34.273628 (+ 99us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:12:34.273870 (+ 242us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:12:34.273873 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:12:34.273875 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:12:34.274267 (+ 392us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0927 15:12:34.274447 (+ 180us) server_negotiation.cc:1035] Waiting for connection context
0927 15:12:34.274709 (+ 262us) server_negotiation.cc:299] Negotiation successful
0927 15:12:34.275001 (+ 292us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":279,"thread_start_us":124,"threads_started":1}
I20260927 15:12:34.276552 25499 sys_catalog.cc:564] T 00000000000000000000000000000000 P e567bae41ac64f3aa35dce62bd53dc51 [sys.catalog]: configured and running, proceeding with master startup.
I20260927 15:12:34.277532 25505 sys_catalog.cc:455] T 00000000000000000000000000000000 P e567bae41ac64f3aa35dce62bd53dc51 [sys.catalog]: SysCatalogTable state changed. Reason: New leader e567bae41ac64f3aa35dce62bd53dc51. Latest consensus state: current_term: 1 leader_uuid: "e567bae41ac64f3aa35dce62bd53dc51" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e567bae41ac64f3aa35dce62bd53dc51" member_type: VOTER last_known_addr { host: "127.17.136.62" port: 46025 } } }
I20260927 15:12:34.277551 25506 sys_catalog.cc:455] T 00000000000000000000000000000000 P e567bae41ac64f3aa35dce62bd53dc51 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "e567bae41ac64f3aa35dce62bd53dc51" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e567bae41ac64f3aa35dce62bd53dc51" member_type: VOTER last_known_addr { host: "127.17.136.62" port: 46025 } } }
I20260927 15:12:34.277642 25505 sys_catalog.cc:458] T 00000000000000000000000000000000 P e567bae41ac64f3aa35dce62bd53dc51 [sys.catalog]: This master's current role is: LEADER
I20260927 15:12:34.277645 25506 sys_catalog.cc:458] T 00000000000000000000000000000000 P e567bae41ac64f3aa35dce62bd53dc51 [sys.catalog]: This master's current role is: LEADER
I20260927 15:12:34.278012 25513 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260927 15:12:34.281041 25513 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260927 15:12:34.286723 25513 catalog_manager.cc:1347] Generated new cluster ID: 3d5fd78617944ce3984606e46fb43e02
I20260927 15:12:34.286795 25513 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260927 15:12:34.301380 25513 catalog_manager.cc:1370] Generated new certificate authority record
I20260927 15:12:34.302347 25513 catalog_manager.cc:1504] Loading token signing keys...
I20260927 15:12:34.319375 25513 catalog_manager.cc:5868] T 00000000000000000000000000000000 P e567bae41ac64f3aa35dce62bd53dc51: Generated new TSK 0
I20260927 15:12:34.320727 25513 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for oryx/127.17.136.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.17.136.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.17.136.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790521920546562-17952-0/krb5kdc/oryx_127.17.136.1.keytab.
Entry for principal oryx/127.17.136.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790521920546562-17952-0/krb5kdc/oryx_127.17.136.1.keytab.
I20260927 15:12:34.358050 17952 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu
/tmp/dist-test-taskiFOyeW/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790521920546562-17952-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790521920546562-17952-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790521920546562-17952-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790521920546562-17952-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.136.1:0
--local_ip_for_outbound_sockets=127.17.136.1
--webserver_interface=127.17.136.1
--webserver_port=0
--tserver_master_addrs=127.17.136.62:46025
--keytab_file=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790521920546562-17952-0/krb5kdc/oryx_127.17.136.1.keytab
--principal=oryx/127.17.136.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.136.20:34495
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790521920546562-17952-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790521920546562-17952-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790521920546562-17952-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260927 15:12:34.490146 25525 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260927 15:12:34.490396 25525 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260927 15:12:34.490439 25525 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260927 15:12:34.494345 25525 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260927 15:12:34.494402 25525 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260927 15:12:34.494438 25525 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260927 15:12:34.494469 25525 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.136.1
I20260927 15:12:34.499521 25525 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.136.20:34495
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790521920546562-17952-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790521920546562-17952-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790521920546562-17952-0/krb5kdc/oryx_127.17.136.1.keytab
--principal=oryx/127.17.136.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.136.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790521920546562-17952-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.17.136.1
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.17.136.62:46025
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25525
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.136.1
--log_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790521920546562-17952-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 27 Sep 2026 14:27:13 UTC on ccycloud.quasar-psqrth.root.comops.site
build id 4676138
I20260927 15:12:34.500422 25525 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260927 15:12:34.501303 25525 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260927 15:12:34.510121 25530 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260927 15:12:34.510272 25525 server_base.cc:1034] running on GCE node
W20260927 15:12:34.510195 25533 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260927 15:12:34.510149 25531 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260927 15:12:34.510762 25525 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260927 15:12:34.511382 25525 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260927 15:12:34.512532 25525 hybrid_clock.cc:648] HybridClock initialized: now 1790521954512514 us; error 32 us; skew 500 ppm
Sep 27 15:12:34 dist-test-slave-5s2t krb5kdc[25408](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790521954, etypes {rep=17 tkt=17 ses=17}, oryx/127.17.136.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260927 15:12:34.515069 25525 init.cc:377] Logged in from keytab as oryx/127.17.136.1@KRBTEST.COM (short username oryx)
I20260927 15:12:34.515883 25525 webserver.cc:460] Webserver started at http://127.17.136.1:46105/ using document root <none> and password file <none>
I20260927 15:12:34.516382 25525 fs_manager.cc:359] Metadata directory not provided
I20260927 15:12:34.516435 25525 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260927 15:12:34.516598 25525 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260927 15:12:34.518581 25525 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790521920546562-17952-0/minicluster-data/ts-0/data/instance:
uuid: "85642702871f48d2a4811e71cf09ec44"
format_stamp: "Formatted at 2026-09-27 15:12:34 on dist-test-slave-5s2t"
server_key: "15bdff3e7b8f18a253e7f0c6b488ba7b"
server_key_iv: "f9dc53fffbc9a6b53e891db77c834ac2"
server_key_version: "encryptionkey@0"
I20260927 15:12:34.519080 25525 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790521920546562-17952-0/minicluster-data/ts-0/wal/instance:
uuid: "85642702871f48d2a4811e71cf09ec44"
format_stamp: "Formatted at 2026-09-27 15:12:34 on dist-test-slave-5s2t"
server_key: "15bdff3e7b8f18a253e7f0c6b488ba7b"
server_key_iv: "f9dc53fffbc9a6b53e891db77c834ac2"
server_key_version: "encryptionkey@0"
I20260927 15:12:34.522588 25525 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.000s
I20260927 15:12:34.524917 25540 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260927 15:12:34.526078 25525 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260927 15:12:34.526167 25525 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790521920546562-17952-0/minicluster-data/ts-0/data,/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790521920546562-17952-0/minicluster-data/ts-0/wal
uuid: "85642702871f48d2a4811e71cf09ec44"
format_stamp: "Formatted at 2026-09-27 15:12:34 on dist-test-slave-5s2t"
server_key: "15bdff3e7b8f18a253e7f0c6b488ba7b"
server_key_iv: "f9dc53fffbc9a6b53e891db77c834ac2"
server_key_version: "encryptionkey@0"
I20260927 15:12:34.526262 25525 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790521920546562-17952-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790521920546562-17952-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790521920546562-17952-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260927 15:12:34.548030 25525 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260927 15:12:34.550758 25525 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260927 15:12:34.550900 25525 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260927 15:12:34.552248 25525 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260927 15:12:34.552309 25525 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260927 15:12:34.552350 25525 ts_tablet_manager.cc:610] Registered 0 tablets
I20260927 15:12:34.552378 25525 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Sep 27 15:12:34 dist-test-slave-5s2t krb5kdc[25408](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790521954, etypes {rep=17 tkt=17 ses=17}, oryx/127.17.136.1@KRBTEST.COM for oryx/127.17.136.62@KRBTEST.COM
I20260927 15:12:34.561924 25525 rpc_server.cc:307] RPC server started. Bound to: 127.17.136.1:39629
I20260927 15:12:34.562042 25655 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.136.1:39629 every 8 connection(s)
I20260927 15:12:34.562820 25525 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790521920546562-17952-0/minicluster-data/ts-0/data/info.pb
I20260927 15:12:34.564623 17952 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu as pid 25525
I20260927 15:12:34.564754 17952 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790521920546562-17952-0/minicluster-data/ts-0/wal/instance
I20260927 15:12:34.564962 25502 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:34.553024 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.136.1:40091 (local address 127.17.136.62:46025)
0927 15:12:34.553131 (+ 107us) server_negotiation.cc:206] Beginning negotiation
0927 15:12:34.553134 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0927 15:12:34.554155 (+ 1021us) server_negotiation.cc:407] Connection header received
0927 15:12:34.555229 (+ 1074us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:12:34.555233 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:12:34.555315 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:12:34.555405 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0927 15:12:34.557044 (+ 1639us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:34.557591 (+ 547us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:34.558738 (+ 1147us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:34.558974 (+ 236us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:34.559061 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:34.561394 (+ 2333us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0927 15:12:34.561398 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0927 15:12:34.561400 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0927 15:12:34.561425 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0927 15:12:34.562810 (+ 1385us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:12:34.563410 (+ 600us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:12:34.563414 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:12:34.563415 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:12:34.563506 (+ 91us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:12:34.563983 (+ 477us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:12:34.563986 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:12:34.563988 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:12:34.564168 (+ 180us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0927 15:12:34.564246 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0927 15:12:34.564683 (+ 437us) server_negotiation.cc:299] Negotiation successful
0927 15:12:34.564810 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260927 15:12:34.565089 17952 external_mini_cluster.cc:1428] Setting key 3f97d51451a5328879cddaec9ea29051
I20260927 15:12:34.565743 25549 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:34.553557 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.62:46025 (local address 127.17.136.1:40091)
0927 15:12:34.554015 (+ 458us) negotiation.cc:107] Waiting for socket to connect
0927 15:12:34.554056 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0927 15:12:34.554991 (+ 935us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0927 15:12:34.555707 (+ 716us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0927 15:12:34.555716 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0927 15:12:34.556183 (+ 467us) client_negotiation.cc:189] Negotiated authn=SASL
0927 15:12:34.556864 (+ 681us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:12:34.556884 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:12:34.557714 (+ 830us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:12:34.557717 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:12:34.558617 (+ 900us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:12:34.558626 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:12:34.559122 (+ 496us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:12:34.559126 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:12:34.559338 (+ 212us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:34.559857 (+ 519us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0927 15:12:34.559873 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0927 15:12:34.561235 (+ 1362us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0927 15:12:34.562924 (+ 1689us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0927 15:12:34.562929 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0927 15:12:34.562942 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0927 15:12:34.563294 (+ 352us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0927 15:12:34.563778 (+ 484us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0927 15:12:34.563781 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0927 15:12:34.563782 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0927 15:12:34.563899 (+ 117us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0927 15:12:34.564247 (+ 348us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0927 15:12:34.564251 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0927 15:12:34.564456 (+ 205us) client_negotiation.cc:769] Sending connection context
0927 15:12:34.564601 (+ 145us) client_negotiation.cc:240] Negotiation successful
0927 15:12:34.564881 (+ 280us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":275,"thread_start_us":133,"threads_started":1}
I20260927 15:12:34.566833 25656 heartbeater.cc:347] Connected to a master server at 127.17.136.62:46025
I20260927 15:12:34.566959 25656 heartbeater.cc:464] Registering TS with master...
I20260927 15:12:34.567422 25656 heartbeater.cc:511] Master 127.17.136.62:46025 requested a full tablet report, sending...
I20260927 15:12:34.568887 25452 ts_manager.cc:194] Registered new tserver with Master: 85642702871f48d2a4811e71cf09ec44 (127.17.136.1:39629)
I20260927 15:12:34.569957 25452 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.17.136.1@KRBTEST.COM'} at 127.17.136.1:40091
WARNING: no policy specified for oryx/127.17.136.2@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.17.136.2@KRBTEST.COM" created.
I20260927 15:12:34.580247 25502 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:34.570468 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.136.1:34835 (local address 127.17.136.62:46025)
0927 15:12:34.570566 (+ 98us) server_negotiation.cc:206] Beginning negotiation
0927 15:12:34.570570 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0927 15:12:34.570582 (+ 12us) server_negotiation.cc:407] Connection header received
0927 15:12:34.570611 (+ 29us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:12:34.570613 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:12:34.570651 (+ 38us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:12:34.570738 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0927 15:12:34.574703 (+ 3965us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:34.575227 (+ 524us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:34.576034 (+ 807us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:34.576241 (+ 207us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:34.576323 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:34.577394 (+ 1071us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0927 15:12:34.577397 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0927 15:12:34.577400 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0927 15:12:34.577425 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0927 15:12:34.578749 (+ 1324us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:12:34.579165 (+ 416us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:12:34.579167 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:12:34.579168 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:12:34.579230 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:12:34.579503 (+ 273us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:12:34.579506 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:12:34.579508 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:12:34.579664 (+ 156us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0927 15:12:34.579791 (+ 127us) server_negotiation.cc:1035] Waiting for connection context
0927 15:12:34.580004 (+ 213us) server_negotiation.cc:299] Negotiation successful
0927 15:12:34.580100 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260927 15:12:34.580264 25663 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:34.568826 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.62:46025 (local address 127.17.136.1:34835)
0927 15:12:34.569201 (+ 375us) negotiation.cc:107] Waiting for socket to connect
0927 15:12:34.569214 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0927 15:12:34.569285 (+ 71us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0927 15:12:34.574318 (+ 5033us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0927 15:12:34.574321 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0927 15:12:34.574488 (+ 167us) client_negotiation.cc:189] Negotiated authn=SASL
0927 15:12:34.574585 (+ 97us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:12:34.574591 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:12:34.575353 (+ 762us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:12:34.575356 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:12:34.575901 (+ 545us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:12:34.575908 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:12:34.576341 (+ 433us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:12:34.576343 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:12:34.576413 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:34.576848 (+ 435us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0927 15:12:34.576859 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0927 15:12:34.577274 (+ 415us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0927 15:12:34.578842 (+ 1568us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0927 15:12:34.578845 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0927 15:12:34.578847 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0927 15:12:34.579086 (+ 239us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0927 15:12:34.579324 (+ 238us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0927 15:12:34.579327 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0927 15:12:34.579329 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0927 15:12:34.579421 (+ 92us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0927 15:12:34.579750 (+ 329us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0927 15:12:34.579753 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0927 15:12:34.579840 (+ 87us) client_negotiation.cc:769] Sending connection context
0927 15:12:34.579950 (+ 110us) client_negotiation.cc:240] Negotiation successful
0927 15:12:34.580087 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":302,"thread_start_us":86,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.17.136.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790521920546562-17952-0/krb5kdc/oryx_127.17.136.2.keytab.
Entry for principal oryx/127.17.136.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790521920546562-17952-0/krb5kdc/oryx_127.17.136.2.keytab.
I20260927 15:12:34.591816 17952 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu
/tmp/dist-test-taskiFOyeW/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790521920546562-17952-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790521920546562-17952-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790521920546562-17952-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790521920546562-17952-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.136.2:0
--local_ip_for_outbound_sockets=127.17.136.2
--webserver_interface=127.17.136.2
--webserver_port=0
--tserver_master_addrs=127.17.136.62:46025
--keytab_file=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790521920546562-17952-0/krb5kdc/oryx_127.17.136.2.keytab
--principal=oryx/127.17.136.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.136.20:34495
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790521920546562-17952-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790521920546562-17952-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790521920546562-17952-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260927 15:12:34.697741 25665 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260927 15:12:34.697989 25665 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260927 15:12:34.698031 25665 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260927 15:12:34.701922 25665 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260927 15:12:34.701972 25665 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260927 15:12:34.702008 25665 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260927 15:12:34.702044 25665 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.136.2
I20260927 15:12:34.707041 25665 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.136.20:34495
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790521920546562-17952-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790521920546562-17952-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790521920546562-17952-0/krb5kdc/oryx_127.17.136.2.keytab
--principal=oryx/127.17.136.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.136.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790521920546562-17952-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.17.136.2
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.17.136.62:46025
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25665
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.136.2
--log_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790521920546562-17952-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 27 Sep 2026 14:27:13 UTC on ccycloud.quasar-psqrth.root.comops.site
build id 4676138
I20260927 15:12:34.707981 25665 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260927 15:12:34.708899 25665 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260927 15:12:34.717820 25673 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260927 15:12:34.717922 25665 server_base.cc:1034] running on GCE node
W20260927 15:12:34.717828 25671 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260927 15:12:34.717890 25670 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260927 15:12:34.718400 25665 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260927 15:12:34.719046 25665 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260927 15:12:34.720211 25665 hybrid_clock.cc:648] HybridClock initialized: now 1790521954720194 us; error 61 us; skew 500 ppm
Sep 27 15:12:34 dist-test-slave-5s2t krb5kdc[25408](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790521954, etypes {rep=17 tkt=17 ses=17}, oryx/127.17.136.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260927 15:12:34.722906 25665 init.cc:377] Logged in from keytab as oryx/127.17.136.2@KRBTEST.COM (short username oryx)
I20260927 15:12:34.723783 25665 webserver.cc:460] Webserver started at http://127.17.136.2:34309/ using document root <none> and password file <none>
I20260927 15:12:34.724300 25665 fs_manager.cc:359] Metadata directory not provided
I20260927 15:12:34.724363 25665 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260927 15:12:34.724542 25665 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260927 15:12:34.726487 25665 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790521920546562-17952-0/minicluster-data/ts-1/data/instance:
uuid: "3f232ccfc16f4e63ab07b0a0a0ecdeb3"
format_stamp: "Formatted at 2026-09-27 15:12:34 on dist-test-slave-5s2t"
server_key: "a50b18b280b175731c9bd28a9edbf56a"
server_key_iv: "020e96eff313dcbfcd88f2ca08edcbc6"
server_key_version: "encryptionkey@0"
I20260927 15:12:34.727027 25665 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790521920546562-17952-0/minicluster-data/ts-1/wal/instance:
uuid: "3f232ccfc16f4e63ab07b0a0a0ecdeb3"
format_stamp: "Formatted at 2026-09-27 15:12:34 on dist-test-slave-5s2t"
server_key: "a50b18b280b175731c9bd28a9edbf56a"
server_key_iv: "020e96eff313dcbfcd88f2ca08edcbc6"
server_key_version: "encryptionkey@0"
I20260927 15:12:34.730604 25665 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.000s
I20260927 15:12:34.733053 25680 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260927 15:12:34.734225 25665 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260927 15:12:34.734325 25665 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790521920546562-17952-0/minicluster-data/ts-1/data,/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790521920546562-17952-0/minicluster-data/ts-1/wal
uuid: "3f232ccfc16f4e63ab07b0a0a0ecdeb3"
format_stamp: "Formatted at 2026-09-27 15:12:34 on dist-test-slave-5s2t"
server_key: "a50b18b280b175731c9bd28a9edbf56a"
server_key_iv: "020e96eff313dcbfcd88f2ca08edcbc6"
server_key_version: "encryptionkey@0"
I20260927 15:12:34.734417 25665 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790521920546562-17952-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790521920546562-17952-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790521920546562-17952-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260927 15:12:34.747241 25665 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260927 15:12:34.749948 25665 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260927 15:12:34.750106 25665 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260927 15:12:34.751487 25665 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260927 15:12:34.751534 25665 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260927 15:12:34.751596 25665 ts_tablet_manager.cc:610] Registered 0 tablets
I20260927 15:12:34.751624 25665 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Sep 27 15:12:34 dist-test-slave-5s2t krb5kdc[25408](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790521954, etypes {rep=17 tkt=17 ses=17}, oryx/127.17.136.2@KRBTEST.COM for oryx/127.17.136.62@KRBTEST.COM
I20260927 15:12:34.761687 25665 rpc_server.cc:307] RPC server started. Bound to: 127.17.136.2:34359
I20260927 15:12:34.761781 25795 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.136.2:34359 every 8 connection(s)
I20260927 15:12:34.762523 25665 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790521920546562-17952-0/minicluster-data/ts-1/data/info.pb
I20260927 15:12:34.765185 25502 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:34.752305 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.136.2:50127 (local address 127.17.136.62:46025)
0927 15:12:34.752435 (+ 130us) server_negotiation.cc:206] Beginning negotiation
0927 15:12:34.752438 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0927 15:12:34.753436 (+ 998us) server_negotiation.cc:407] Connection header received
0927 15:12:34.754503 (+ 1067us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:12:34.754507 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:12:34.754573 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:12:34.754636 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0927 15:12:34.756139 (+ 1503us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:34.756964 (+ 825us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:34.758420 (+ 1456us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:34.758653 (+ 233us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:34.758747 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:34.761496 (+ 2749us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0927 15:12:34.761500 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0927 15:12:34.761503 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0927 15:12:34.761534 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0927 15:12:34.763188 (+ 1654us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:12:34.763696 (+ 508us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:12:34.763699 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:12:34.763701 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:12:34.763785 (+ 84us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:12:34.764218 (+ 433us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:12:34.764221 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:12:34.764223 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:12:34.764431 (+ 208us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0927 15:12:34.764518 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0927 15:12:34.764962 (+ 444us) server_negotiation.cc:299] Negotiation successful
0927 15:12:34.765068 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260927 15:12:34.765977 25689 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:34.752792 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.62:46025 (local address 127.17.136.2:50127)
0927 15:12:34.753274 (+ 482us) negotiation.cc:107] Waiting for socket to connect
0927 15:12:34.753328 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0927 15:12:34.754228 (+ 900us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0927 15:12:34.755112 (+ 884us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0927 15:12:34.755121 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0927 15:12:34.755512 (+ 391us) client_negotiation.cc:189] Negotiated authn=SASL
0927 15:12:34.756010 (+ 498us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:12:34.756023 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:12:34.757086 (+ 1063us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:12:34.757090 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:12:34.758287 (+ 1197us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:12:34.758298 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:12:34.758829 (+ 531us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:12:34.758834 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:12:34.758991 (+ 157us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:34.759597 (+ 606us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0927 15:12:34.759615 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0927 15:12:34.761302 (+ 1687us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0927 15:12:34.763335 (+ 2033us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0927 15:12:34.763341 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0927 15:12:34.763354 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0927 15:12:34.763606 (+ 252us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0927 15:12:34.763949 (+ 343us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0927 15:12:34.763969 (+ 20us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0927 15:12:34.763970 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0927 15:12:34.764105 (+ 135us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0927 15:12:34.764519 (+ 414us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0927 15:12:34.764524 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0927 15:12:34.764743 (+ 219us) client_negotiation.cc:769] Sending connection context
0927 15:12:34.764887 (+ 144us) client_negotiation.cc:240] Negotiation successful
0927 15:12:34.765142 (+ 255us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":295,"thread_start_us":127,"threads_started":1}
I20260927 15:12:34.767356 25796 heartbeater.cc:347] Connected to a master server at 127.17.136.62:46025
I20260927 15:12:34.767506 25796 heartbeater.cc:464] Registering TS with master...
I20260927 15:12:34.767649 17952 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu as pid 25665
I20260927 15:12:34.767783 17952 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790521920546562-17952-0/minicluster-data/ts-1/wal/instance
I20260927 15:12:34.768092 25796 heartbeater.cc:511] Master 127.17.136.62:46025 requested a full tablet report, sending...
I20260927 15:12:34.768116 17952 external_mini_cluster.cc:1428] Setting key 8f213298aa9b5f5936b1f8a0b4f1df40
I20260927 15:12:34.768983 25452 ts_manager.cc:194] Registered new tserver with Master: 3f232ccfc16f4e63ab07b0a0a0ecdeb3 (127.17.136.2:34359)
I20260927 15:12:34.769639 25452 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.17.136.2@KRBTEST.COM'} at 127.17.136.2:50127
WARNING: no policy specified for oryx/127.17.136.3@KRBTEST.COM; defaulting to no policy
I20260927 15:12:34.777050 25502 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:34.769468 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.136.2:44519 (local address 127.17.136.62:46025)
0927 15:12:34.771029 (+ 1561us) server_negotiation.cc:206] Beginning negotiation
0927 15:12:34.771033 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0927 15:12:34.771047 (+ 14us) server_negotiation.cc:407] Connection header received
0927 15:12:34.771080 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:12:34.771083 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:12:34.771122 (+ 39us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:12:34.771200 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0927 15:12:34.771634 (+ 434us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:34.772259 (+ 625us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:34.773021 (+ 762us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:34.773239 (+ 218us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:34.773320 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:34.774319 (+ 999us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0927 15:12:34.774322 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0927 15:12:34.774324 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0927 15:12:34.774343 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0927 15:12:34.775646 (+ 1303us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:12:34.775991 (+ 345us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:12:34.775995 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:12:34.775997 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:12:34.776062 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:12:34.776288 (+ 226us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:12:34.776290 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:12:34.776292 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:12:34.776482 (+ 190us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0927 15:12:34.776585 (+ 103us) server_negotiation.cc:1035] Waiting for connection context
0927 15:12:34.776812 (+ 227us) server_negotiation.cc:299] Negotiation successful
0927 15:12:34.776906 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1482}
I20260927 15:12:34.777072 25802 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:34.769428 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.62:46025 (local address 127.17.136.2:44519)
0927 15:12:34.769685 (+ 257us) negotiation.cc:107] Waiting for socket to connect
0927 15:12:34.769739 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0927 15:12:34.769819 (+ 80us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0927 15:12:34.771263 (+ 1444us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0927 15:12:34.771266 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0927 15:12:34.771434 (+ 168us) client_negotiation.cc:189] Negotiated authn=SASL
0927 15:12:34.771524 (+ 90us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:12:34.771529 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:12:34.772363 (+ 834us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:12:34.772365 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:12:34.772907 (+ 542us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:12:34.772914 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:12:34.773330 (+ 416us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:12:34.773334 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:12:34.773420 (+ 86us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:34.773889 (+ 469us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0927 15:12:34.773899 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0927 15:12:34.774204 (+ 305us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0927 15:12:34.775737 (+ 1533us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0927 15:12:34.775740 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0927 15:12:34.775742 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0927 15:12:34.775912 (+ 170us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0927 15:12:34.776136 (+ 224us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0927 15:12:34.776139 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0927 15:12:34.776141 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0927 15:12:34.776215 (+ 74us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0927 15:12:34.776585 (+ 370us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0927 15:12:34.776588 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0927 15:12:34.776672 (+ 84us) client_negotiation.cc:769] Sending connection context
0927 15:12:34.776753 (+ 81us) client_negotiation.cc:240] Negotiation successful
0927 15:12:34.776880 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":177,"thread_start_us":101,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.17.136.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.17.136.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790521920546562-17952-0/krb5kdc/oryx_127.17.136.3.keytab.
Entry for principal oryx/127.17.136.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790521920546562-17952-0/krb5kdc/oryx_127.17.136.3.keytab.
I20260927 15:12:34.793612 17952 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu
/tmp/dist-test-taskiFOyeW/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790521920546562-17952-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790521920546562-17952-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790521920546562-17952-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790521920546562-17952-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.136.3:0
--local_ip_for_outbound_sockets=127.17.136.3
--webserver_interface=127.17.136.3
--webserver_port=0
--tserver_master_addrs=127.17.136.62:46025
--keytab_file=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790521920546562-17952-0/krb5kdc/oryx_127.17.136.3.keytab
--principal=oryx/127.17.136.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.136.20:34495
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790521920546562-17952-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790521920546562-17952-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790521920546562-17952-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260927 15:12:34.900664 25805 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260927 15:12:34.900923 25805 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260927 15:12:34.900966 25805 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260927 15:12:34.904938 25805 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260927 15:12:34.904999 25805 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260927 15:12:34.905054 25805 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260927 15:12:34.905108 25805 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.136.3
I20260927 15:12:34.910495 25805 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.136.20:34495
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790521920546562-17952-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790521920546562-17952-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790521920546562-17952-0/krb5kdc/oryx_127.17.136.3.keytab
--principal=oryx/127.17.136.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.136.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790521920546562-17952-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.17.136.3
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.17.136.62:46025
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25805
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.136.3
--log_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790521920546562-17952-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 27 Sep 2026 14:27:13 UTC on ccycloud.quasar-psqrth.root.comops.site
build id 4676138
I20260927 15:12:34.911537 25805 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260927 15:12:34.912513 25805 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260927 15:12:34.921768 25810 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260927 15:12:34.921789 25811 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260927 15:12:34.921768 25813 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260927 15:12:34.921958 25805 server_base.cc:1034] running on GCE node
I20260927 15:12:34.922513 25805 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260927 15:12:34.923085 25805 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260927 15:12:34.924224 25805 hybrid_clock.cc:648] HybridClock initialized: now 1790521954924204 us; error 57 us; skew 500 ppm
Sep 27 15:12:34 dist-test-slave-5s2t krb5kdc[25408](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790521954, etypes {rep=17 tkt=17 ses=17}, oryx/127.17.136.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260927 15:12:34.926664 25805 init.cc:377] Logged in from keytab as oryx/127.17.136.3@KRBTEST.COM (short username oryx)
I20260927 15:12:34.927595 25805 webserver.cc:460] Webserver started at http://127.17.136.3:42533/ using document root <none> and password file <none>
I20260927 15:12:34.928234 25805 fs_manager.cc:359] Metadata directory not provided
I20260927 15:12:34.928305 25805 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260927 15:12:34.928524 25805 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260927 15:12:34.930876 25805 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790521920546562-17952-0/minicluster-data/ts-2/data/instance:
uuid: "8c31bcf6ceaa411dba57437f661a6917"
format_stamp: "Formatted at 2026-09-27 15:12:34 on dist-test-slave-5s2t"
server_key: "8017de9e0d0d660c6247946f557a66b1"
server_key_iv: "87d1cbed747488d265e2390dd13bd298"
server_key_version: "encryptionkey@0"
I20260927 15:12:34.931424 25805 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790521920546562-17952-0/minicluster-data/ts-2/wal/instance:
uuid: "8c31bcf6ceaa411dba57437f661a6917"
format_stamp: "Formatted at 2026-09-27 15:12:34 on dist-test-slave-5s2t"
server_key: "8017de9e0d0d660c6247946f557a66b1"
server_key_iv: "87d1cbed747488d265e2390dd13bd298"
server_key_version: "encryptionkey@0"
I20260927 15:12:34.934955 25805 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.000s
I20260927 15:12:34.937212 25820 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260927 15:12:34.938403 25805 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.000s sys 0.002s
I20260927 15:12:34.938509 25805 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790521920546562-17952-0/minicluster-data/ts-2/data,/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790521920546562-17952-0/minicluster-data/ts-2/wal
uuid: "8c31bcf6ceaa411dba57437f661a6917"
format_stamp: "Formatted at 2026-09-27 15:12:34 on dist-test-slave-5s2t"
server_key: "8017de9e0d0d660c6247946f557a66b1"
server_key_iv: "87d1cbed747488d265e2390dd13bd298"
server_key_version: "encryptionkey@0"
I20260927 15:12:34.938596 25805 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790521920546562-17952-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790521920546562-17952-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790521920546562-17952-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260927 15:12:34.958871 25805 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260927 15:12:34.962008 25805 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260927 15:12:34.962208 25805 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260927 15:12:34.963778 25805 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260927 15:12:34.963836 25805 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260927 15:12:34.963896 25805 ts_tablet_manager.cc:610] Registered 0 tablets
I20260927 15:12:34.963925 25805 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Sep 27 15:12:34 dist-test-slave-5s2t krb5kdc[25408](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790521954, etypes {rep=17 tkt=17 ses=17}, oryx/127.17.136.3@KRBTEST.COM for oryx/127.17.136.62@KRBTEST.COM
I20260927 15:12:34.974407 25805 rpc_server.cc:307] RPC server started. Bound to: 127.17.136.3:38959
I20260927 15:12:34.974473 25935 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.136.3:38959 every 8 connection(s)
I20260927 15:12:34.975522 25805 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790521920546562-17952-0/minicluster-data/ts-2/data/info.pb
I20260927 15:12:34.977391 25502 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:34.964378 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.136.3:45449 (local address 127.17.136.62:46025)
0927 15:12:34.964520 (+ 142us) server_negotiation.cc:206] Beginning negotiation
0927 15:12:34.964525 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0927 15:12:34.965391 (+ 866us) server_negotiation.cc:407] Connection header received
0927 15:12:34.966396 (+ 1005us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:12:34.966399 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:12:34.966468 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:12:34.966518 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0927 15:12:34.967970 (+ 1452us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:34.968780 (+ 810us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:34.970221 (+ 1441us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:34.970532 (+ 311us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:34.970622 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:34.973506 (+ 2884us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0927 15:12:34.973510 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0927 15:12:34.973514 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0927 15:12:34.973541 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0927 15:12:34.975108 (+ 1567us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:12:34.975639 (+ 531us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:12:34.975642 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:12:34.975644 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:12:34.975736 (+ 92us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:12:34.976208 (+ 472us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:12:34.976212 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:12:34.976214 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:12:34.976468 (+ 254us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0927 15:12:34.976558 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0927 15:12:34.977127 (+ 569us) server_negotiation.cc:299] Negotiation successful
0927 15:12:34.977241 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260927 15:12:34.978119 25829 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:34.964782 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.62:46025 (local address 127.17.136.3:45449)
0927 15:12:34.965228 (+ 446us) negotiation.cc:107] Waiting for socket to connect
0927 15:12:34.965276 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0927 15:12:34.966164 (+ 888us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0927 15:12:34.966859 (+ 695us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0927 15:12:34.966865 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0927 15:12:34.967240 (+ 375us) client_negotiation.cc:189] Negotiated authn=SASL
0927 15:12:34.967823 (+ 583us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:12:34.967838 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:12:34.968964 (+ 1126us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:12:34.968968 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:12:34.970111 (+ 1143us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:12:34.970120 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:12:34.970679 (+ 559us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:12:34.970683 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:12:34.970853 (+ 170us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:34.971409 (+ 556us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0927 15:12:34.971425 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0927 15:12:34.973306 (+ 1881us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0927 15:12:34.975218 (+ 1912us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0927 15:12:34.975222 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0927 15:12:34.975233 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0927 15:12:34.975535 (+ 302us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0927 15:12:34.975929 (+ 394us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0927 15:12:34.975933 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0927 15:12:34.975935 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0927 15:12:34.976100 (+ 165us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0927 15:12:34.976565 (+ 465us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0927 15:12:34.976569 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0927 15:12:34.976838 (+ 269us) client_negotiation.cc:769] Sending connection context
0927 15:12:34.977017 (+ 179us) client_negotiation.cc:240] Negotiation successful
0927 15:12:34.977276 (+ 259us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":256,"thread_start_us":114,"threads_started":1}
I20260927 15:12:34.979265 25936 heartbeater.cc:347] Connected to a master server at 127.17.136.62:46025
I20260927 15:12:34.979405 25936 heartbeater.cc:464] Registering TS with master...
I20260927 15:12:34.979880 25936 heartbeater.cc:511] Master 127.17.136.62:46025 requested a full tablet report, sending...
I20260927 15:12:34.980052 17952 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu as pid 25805
I20260927 15:12:34.980175 17952 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790521920546562-17952-0/minicluster-data/ts-2/wal/instance
I20260927 15:12:34.980485 17952 external_mini_cluster.cc:1428] Setting key aa3df4b427274c26486dbe457f504c9b
I20260927 15:12:34.980911 25453 ts_manager.cc:194] Registered new tserver with Master: 8c31bcf6ceaa411dba57437f661a6917 (127.17.136.3:38959)
I20260927 15:12:34.981566 25453 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.17.136.3@KRBTEST.COM'} at 127.17.136.3:45449
I20260927 15:12:34.982522 17952 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260927 15:12:34.988965 25502 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:34.981500 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.136.3:50359 (local address 127.17.136.62:46025)
0927 15:12:34.981609 (+ 109us) server_negotiation.cc:206] Beginning negotiation
0927 15:12:34.981613 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0927 15:12:34.981889 (+ 276us) server_negotiation.cc:407] Connection header received
0927 15:12:34.982030 (+ 141us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:12:34.982033 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:12:34.982077 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:12:34.982147 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0927 15:12:34.982644 (+ 497us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:34.983386 (+ 742us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:34.984455 (+ 1069us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:34.984765 (+ 310us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:34.984869 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:34.985989 (+ 1120us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0927 15:12:34.985992 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0927 15:12:34.985994 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0927 15:12:34.986014 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0927 15:12:34.987416 (+ 1402us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:12:34.987828 (+ 412us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:12:34.987831 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:12:34.987833 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:12:34.987926 (+ 93us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:12:34.988214 (+ 288us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:12:34.988216 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:12:34.988218 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:12:34.988402 (+ 184us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0927 15:12:34.988492 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0927 15:12:34.988769 (+ 277us) server_negotiation.cc:299] Negotiation successful
0927 15:12:34.988859 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260927 15:12:34.989051 25942 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:34.981461 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.62:46025 (local address 127.17.136.3:50359)
0927 15:12:34.981804 (+ 343us) negotiation.cc:107] Waiting for socket to connect
0927 15:12:34.981831 (+ 27us) client_negotiation.cc:174] Beginning negotiation
0927 15:12:34.981931 (+ 100us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0927 15:12:34.982182 (+ 251us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0927 15:12:34.982185 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0927 15:12:34.982381 (+ 196us) client_negotiation.cc:189] Negotiated authn=SASL
0927 15:12:34.982495 (+ 114us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:12:34.982503 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:12:34.983512 (+ 1009us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:12:34.983516 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:12:34.984313 (+ 797us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:12:34.984325 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:12:34.984903 (+ 578us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:12:34.984906 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:12:34.984981 (+ 75us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:34.985473 (+ 492us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0927 15:12:34.985487 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0927 15:12:34.985853 (+ 366us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0927 15:12:34.987568 (+ 1715us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0927 15:12:34.987570 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0927 15:12:34.987572 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0927 15:12:34.987741 (+ 169us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0927 15:12:34.988034 (+ 293us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0927 15:12:34.988037 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0927 15:12:34.988038 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0927 15:12:34.988133 (+ 95us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0927 15:12:34.988509 (+ 376us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0927 15:12:34.988513 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0927 15:12:34.988607 (+ 94us) client_negotiation.cc:769] Sending connection context
0927 15:12:34.988721 (+ 114us) client_negotiation.cc:240] Negotiation successful
0927 15:12:34.988846 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":267,"thread_start_us":97,"threads_started":1}
Sep 27 15:12:34 dist-test-slave-5s2t krb5kdc[25408](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790521954, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Sep 27 15:12:35 dist-test-slave-5s2t krb5kdc[25408](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-user@KRBTEST.COM for kudu/127.17.136.62@KRBTEST.COM, Server not found in Kerberos database
Sep 27 15:12:35 dist-test-slave-5s2t krb5kdc[25408](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-user@KRBTEST.COM for kudu/127.17.136.62@KRBTEST.COM, Server not found in Kerberos database
W20260927 15:12:35.005700 25502 negotiation.cc:337] Failed RPC negotiation. Trace:
0927 15:12:34.999887 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42284 (local address 127.17.136.62:46025)
0927 15:12:34.999996 (+ 109us) server_negotiation.cc:206] Beginning negotiation
0927 15:12:35.000000 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0927 15:12:35.000013 (+ 13us) server_negotiation.cc:407] Connection header received
0927 15:12:35.000051 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:12:35.000052 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:12:35.000090 (+ 38us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:12:35.000154 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0927 15:12:35.000819 (+ 665us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:35.001320 (+ 501us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:35.002192 (+ 872us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:35.002388 (+ 196us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:35.002463 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:35.005539 (+ 3076us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:42284: BlockingRecv error: recv got EOF from 127.0.0.1:42284 (error 108)
Metrics: {"server-negotiator.queue_time_us":39}
Sep 27 15:12:35 dist-test-slave-5s2t krb5kdc[25408](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790521954, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for oryx/127.17.136.62@KRBTEST.COM
I20260927 15:12:35.014220 25502 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:35.007045 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42298 (local address 127.17.136.62:46025)
0927 15:12:35.007138 (+ 93us) server_negotiation.cc:206] Beginning negotiation
0927 15:12:35.007141 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0927 15:12:35.007296 (+ 155us) server_negotiation.cc:407] Connection header received
0927 15:12:35.007401 (+ 105us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:12:35.007403 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:12:35.007438 (+ 35us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:12:35.007511 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0927 15:12:35.008022 (+ 511us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:35.008514 (+ 492us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:35.009253 (+ 739us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:35.009447 (+ 194us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:35.009526 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:35.011643 (+ 2117us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0927 15:12:35.011646 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0927 15:12:35.011648 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0927 15:12:35.011669 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0927 15:12:35.012902 (+ 1233us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:12:35.013234 (+ 332us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:12:35.013236 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:12:35.013237 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:12:35.013297 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:12:35.013509 (+ 212us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:12:35.013510 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:12:35.013512 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:12:35.013657 (+ 145us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0927 15:12:35.013755 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0927 15:12:35.014022 (+ 267us) server_negotiation.cc:299] Negotiation successful
0927 15:12:35.014109 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260927 15:12:35.016808 25452 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:42298:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:12:35.019682 25452 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:12:35.033908 25963 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:35.028637 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47094 (local address 127.17.136.1:39629)
0927 15:12:35.029290 (+ 653us) server_negotiation.cc:206] Beginning negotiation
0927 15:12:35.029303 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0927 15:12:35.029322 (+ 19us) server_negotiation.cc:407] Connection header received
0927 15:12:35.029381 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:12:35.029385 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:12:35.029622 (+ 237us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:12:35.029755 (+ 133us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0927 15:12:35.029982 (+ 227us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:35.030764 (+ 782us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:35.032585 (+ 1821us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:35.033223 (+ 638us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:35.033317 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:35.033494 (+ 177us) server_negotiation.cc:1035] Waiting for connection context
0927 15:12:35.033656 (+ 162us) server_negotiation.cc:299] Negotiation successful
0927 15:12:35.033750 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":562,"thread_start_us":64,"threads_started":1}
I20260927 15:12:35.033944 25958 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:35.027725 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.3:38959 (local address 127.0.0.1:56574)
0927 15:12:35.028124 (+ 399us) negotiation.cc:107] Waiting for socket to connect
0927 15:12:35.028169 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0927 15:12:35.028282 (+ 113us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0927 15:12:35.029292 (+ 1010us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0927 15:12:35.029297 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0927 15:12:35.029320 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0927 15:12:35.029480 (+ 160us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:12:35.029487 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:12:35.030888 (+ 1401us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:12:35.030891 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:12:35.032407 (+ 1516us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:12:35.032417 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:12:35.033410 (+ 993us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:12:35.033413 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:12:35.033561 (+ 148us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:35.033585 (+ 24us) client_negotiation.cc:769] Sending connection context
0927 15:12:35.033633 (+ 48us) client_negotiation.cc:240] Negotiation successful
0927 15:12:35.033756 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":227,"mutex_wait_us":196,"thread_start_us":113,"threads_started":1}
I20260927 15:12:35.033946 25962 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:35.028460 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.1:39629 (local address 127.0.0.1:47094)
0927 15:12:35.029022 (+ 562us) negotiation.cc:107] Waiting for socket to connect
0927 15:12:35.029033 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0927 15:12:35.029095 (+ 62us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0927 15:12:35.029748 (+ 653us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0927 15:12:35.029751 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0927 15:12:35.029768 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0927 15:12:35.029851 (+ 83us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:12:35.029856 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:12:35.030857 (+ 1001us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:12:35.030860 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:12:35.032502 (+ 1642us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:12:35.032509 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:12:35.033325 (+ 816us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:12:35.033329 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:12:35.033427 (+ 98us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:35.033518 (+ 91us) client_negotiation.cc:769] Sending connection context
0927 15:12:35.033619 (+ 101us) client_negotiation.cc:240] Negotiation successful
0927 15:12:35.033762 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":482,"mutex_wait_us":217,"thread_start_us":89,"threads_started":1}
I20260927 15:12:35.034260 25960 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:35.028085 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59930 (local address 127.17.136.2:34359)
0927 15:12:35.028706 (+ 621us) server_negotiation.cc:206] Beginning negotiation
0927 15:12:35.028717 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0927 15:12:35.029146 (+ 429us) server_negotiation.cc:407] Connection header received
0927 15:12:35.029226 (+ 80us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:12:35.029231 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:12:35.029410 (+ 179us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:12:35.029566 (+ 156us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0927 15:12:35.029798 (+ 232us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:35.030889 (+ 1091us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:35.032432 (+ 1543us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:35.033279 (+ 847us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:35.033391 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:35.033555 (+ 164us) server_negotiation.cc:1035] Waiting for connection context
0927 15:12:35.034023 (+ 468us) server_negotiation.cc:299] Negotiation successful
0927 15:12:35.034133 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":511,"thread_start_us":84,"threads_started":1}
I20260927 15:12:35.033947 25959 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:35.027845 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.2:34359 (local address 127.0.0.1:59930)
0927 15:12:35.028949 (+ 1104us) negotiation.cc:107] Waiting for socket to connect
0927 15:12:35.028962 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0927 15:12:35.029056 (+ 94us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0927 15:12:35.029557 (+ 501us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0927 15:12:35.029559 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0927 15:12:35.029578 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0927 15:12:35.029679 (+ 101us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:12:35.029684 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:12:35.030969 (+ 1285us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:12:35.030973 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:12:35.032284 (+ 1311us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:12:35.032300 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:12:35.033609 (+ 1309us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:12:35.033612 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:12:35.033698 (+ 86us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:35.033717 (+ 19us) client_negotiation.cc:769] Sending connection context
0927 15:12:35.033774 (+ 57us) client_negotiation.cc:240] Negotiation successful
0927 15:12:35.033828 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1043,"mutex_wait_us":120,"thread_start_us":105,"threads_started":1}
I20260927 15:12:35.034986 25961 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:35.028416 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56574 (local address 127.17.136.3:38959)
0927 15:12:35.028789 (+ 373us) server_negotiation.cc:206] Beginning negotiation
0927 15:12:35.028799 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0927 15:12:35.028818 (+ 19us) server_negotiation.cc:407] Connection header received
0927 15:12:35.028881 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:12:35.028885 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:12:35.029132 (+ 247us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:12:35.029291 (+ 159us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0927 15:12:35.029599 (+ 308us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:35.030794 (+ 1195us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:35.032518 (+ 1724us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:35.033277 (+ 759us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:35.034552 (+ 1275us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:35.034708 (+ 156us) server_negotiation.cc:1035] Waiting for connection context
0927 15:12:35.034754 (+ 46us) server_negotiation.cc:299] Negotiation successful
0927 15:12:35.034852 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":297,"thread_start_us":89,"threads_started":1}
I20260927 15:12:35.036878 25590 tablet_service.cc:1467] Processing CreateTablet for tablet 547156fb7f9a4290b4fadc56709bde6c (DEFAULT_TABLE table=test-table [id=76164475b0b34977888b749f6535d600]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:12:35.037292 25867 tablet_service.cc:1467] Processing CreateTablet for tablet 547156fb7f9a4290b4fadc56709bde6c (DEFAULT_TABLE table=test-table [id=76164475b0b34977888b749f6535d600]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:12:35.037290 25730 tablet_service.cc:1467] Processing CreateTablet for tablet 547156fb7f9a4290b4fadc56709bde6c (DEFAULT_TABLE table=test-table [id=76164475b0b34977888b749f6535d600]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:12:35.037920 25590 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 547156fb7f9a4290b4fadc56709bde6c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:12:35.038308 25867 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 547156fb7f9a4290b4fadc56709bde6c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:12:35.038308 25730 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 547156fb7f9a4290b4fadc56709bde6c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:12:35.044781 25964 tablet_bootstrap.cc:492] T 547156fb7f9a4290b4fadc56709bde6c P 85642702871f48d2a4811e71cf09ec44: Bootstrap starting.
I20260927 15:12:35.046430 25965 tablet_bootstrap.cc:492] T 547156fb7f9a4290b4fadc56709bde6c P 3f232ccfc16f4e63ab07b0a0a0ecdeb3: Bootstrap starting.
I20260927 15:12:35.046590 25966 tablet_bootstrap.cc:492] T 547156fb7f9a4290b4fadc56709bde6c P 8c31bcf6ceaa411dba57437f661a6917: Bootstrap starting.
I20260927 15:12:35.046979 25964 tablet_bootstrap.cc:654] T 547156fb7f9a4290b4fadc56709bde6c P 85642702871f48d2a4811e71cf09ec44: Neither blocks nor log segments found. Creating new log.
I20260927 15:12:35.047717 25964 log.cc:824] T 547156fb7f9a4290b4fadc56709bde6c P 85642702871f48d2a4811e71cf09ec44: Log is configured to *not* fsync() on all Append() calls
I20260927 15:12:35.048544 25966 tablet_bootstrap.cc:654] T 547156fb7f9a4290b4fadc56709bde6c P 8c31bcf6ceaa411dba57437f661a6917: Neither blocks nor log segments found. Creating new log.
I20260927 15:12:35.048544 25965 tablet_bootstrap.cc:654] T 547156fb7f9a4290b4fadc56709bde6c P 3f232ccfc16f4e63ab07b0a0a0ecdeb3: Neither blocks nor log segments found. Creating new log.
I20260927 15:12:35.049348 25966 log.cc:824] T 547156fb7f9a4290b4fadc56709bde6c P 8c31bcf6ceaa411dba57437f661a6917: Log is configured to *not* fsync() on all Append() calls
I20260927 15:12:35.049355 25965 log.cc:824] T 547156fb7f9a4290b4fadc56709bde6c P 3f232ccfc16f4e63ab07b0a0a0ecdeb3: Log is configured to *not* fsync() on all Append() calls
I20260927 15:12:35.049468 25964 tablet_bootstrap.cc:492] T 547156fb7f9a4290b4fadc56709bde6c P 85642702871f48d2a4811e71cf09ec44: No bootstrap required, opened a new log
I20260927 15:12:35.049649 25964 ts_tablet_manager.cc:1397] T 547156fb7f9a4290b4fadc56709bde6c P 85642702871f48d2a4811e71cf09ec44: Time spent bootstrapping tablet: real 0.005s user 0.003s sys 0.000s
I20260927 15:12:35.051196 25966 tablet_bootstrap.cc:492] T 547156fb7f9a4290b4fadc56709bde6c P 8c31bcf6ceaa411dba57437f661a6917: No bootstrap required, opened a new log
I20260927 15:12:35.051196 25965 tablet_bootstrap.cc:492] T 547156fb7f9a4290b4fadc56709bde6c P 3f232ccfc16f4e63ab07b0a0a0ecdeb3: No bootstrap required, opened a new log
I20260927 15:12:35.051400 25965 ts_tablet_manager.cc:1397] T 547156fb7f9a4290b4fadc56709bde6c P 3f232ccfc16f4e63ab07b0a0a0ecdeb3: Time spent bootstrapping tablet: real 0.005s user 0.001s sys 0.003s
I20260927 15:12:35.051400 25966 ts_tablet_manager.cc:1397] T 547156fb7f9a4290b4fadc56709bde6c P 8c31bcf6ceaa411dba57437f661a6917: Time spent bootstrapping tablet: real 0.005s user 0.005s sys 0.000s
I20260927 15:12:35.052623 25964 raft_consensus.cc:348] T 547156fb7f9a4290b4fadc56709bde6c P 85642702871f48d2a4811e71cf09ec44 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c31bcf6ceaa411dba57437f661a6917" member_type: VOTER last_known_addr { host: "127.17.136.3" port: 38959 } } peers { permanent_uuid: "3f232ccfc16f4e63ab07b0a0a0ecdeb3" member_type: VOTER last_known_addr { host: "127.17.136.2" port: 34359 } } peers { permanent_uuid: "85642702871f48d2a4811e71cf09ec44" member_type: VOTER last_known_addr { host: "127.17.136.1" port: 39629 } }
I20260927 15:12:35.052829 25964 raft_consensus.cc:374] T 547156fb7f9a4290b4fadc56709bde6c P 85642702871f48d2a4811e71cf09ec44 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:12:35.052884 25964 raft_consensus.cc:729] T 547156fb7f9a4290b4fadc56709bde6c P 85642702871f48d2a4811e71cf09ec44 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 85642702871f48d2a4811e71cf09ec44, State: Initialized, Role: FOLLOWER
I20260927 15:12:35.053277 25964 consensus_queue.cc:260] T 547156fb7f9a4290b4fadc56709bde6c P 85642702871f48d2a4811e71cf09ec44 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c31bcf6ceaa411dba57437f661a6917" member_type: VOTER last_known_addr { host: "127.17.136.3" port: 38959 } } peers { permanent_uuid: "3f232ccfc16f4e63ab07b0a0a0ecdeb3" member_type: VOTER last_known_addr { host: "127.17.136.2" port: 34359 } } peers { permanent_uuid: "85642702871f48d2a4811e71cf09ec44" member_type: VOTER last_known_addr { host: "127.17.136.1" port: 39629 } }
I20260927 15:12:35.053862 25656 heartbeater.cc:503] Master 127.17.136.62:46025 was elected leader, sending a full tablet report...
I20260927 15:12:35.055094 25964 ts_tablet_manager.cc:1428] T 547156fb7f9a4290b4fadc56709bde6c P 85642702871f48d2a4811e71cf09ec44: Time spent starting tablet: real 0.005s user 0.005s sys 0.000s
I20260927 15:12:35.055096 25966 raft_consensus.cc:348] T 547156fb7f9a4290b4fadc56709bde6c P 8c31bcf6ceaa411dba57437f661a6917 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c31bcf6ceaa411dba57437f661a6917" member_type: VOTER last_known_addr { host: "127.17.136.3" port: 38959 } } peers { permanent_uuid: "3f232ccfc16f4e63ab07b0a0a0ecdeb3" member_type: VOTER last_known_addr { host: "127.17.136.2" port: 34359 } } peers { permanent_uuid: "85642702871f48d2a4811e71cf09ec44" member_type: VOTER last_known_addr { host: "127.17.136.1" port: 39629 } }
I20260927 15:12:35.055096 25965 raft_consensus.cc:348] T 547156fb7f9a4290b4fadc56709bde6c P 3f232ccfc16f4e63ab07b0a0a0ecdeb3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c31bcf6ceaa411dba57437f661a6917" member_type: VOTER last_known_addr { host: "127.17.136.3" port: 38959 } } peers { permanent_uuid: "3f232ccfc16f4e63ab07b0a0a0ecdeb3" member_type: VOTER last_known_addr { host: "127.17.136.2" port: 34359 } } peers { permanent_uuid: "85642702871f48d2a4811e71cf09ec44" member_type: VOTER last_known_addr { host: "127.17.136.1" port: 39629 } }
I20260927 15:12:35.055361 25965 raft_consensus.cc:374] T 547156fb7f9a4290b4fadc56709bde6c P 3f232ccfc16f4e63ab07b0a0a0ecdeb3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:12:35.055361 25966 raft_consensus.cc:374] T 547156fb7f9a4290b4fadc56709bde6c P 8c31bcf6ceaa411dba57437f661a6917 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:12:35.055408 25965 raft_consensus.cc:729] T 547156fb7f9a4290b4fadc56709bde6c P 3f232ccfc16f4e63ab07b0a0a0ecdeb3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f232ccfc16f4e63ab07b0a0a0ecdeb3, State: Initialized, Role: FOLLOWER
I20260927 15:12:35.055408 25966 raft_consensus.cc:729] T 547156fb7f9a4290b4fadc56709bde6c P 8c31bcf6ceaa411dba57437f661a6917 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8c31bcf6ceaa411dba57437f661a6917, State: Initialized, Role: FOLLOWER
I20260927 15:12:35.055819 25965 consensus_queue.cc:260] T 547156fb7f9a4290b4fadc56709bde6c P 3f232ccfc16f4e63ab07b0a0a0ecdeb3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c31bcf6ceaa411dba57437f661a6917" member_type: VOTER last_known_addr { host: "127.17.136.3" port: 38959 } } peers { permanent_uuid: "3f232ccfc16f4e63ab07b0a0a0ecdeb3" member_type: VOTER last_known_addr { host: "127.17.136.2" port: 34359 } } peers { permanent_uuid: "85642702871f48d2a4811e71cf09ec44" member_type: VOTER last_known_addr { host: "127.17.136.1" port: 39629 } }
I20260927 15:12:35.055819 25966 consensus_queue.cc:260] T 547156fb7f9a4290b4fadc56709bde6c P 8c31bcf6ceaa411dba57437f661a6917 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c31bcf6ceaa411dba57437f661a6917" member_type: VOTER last_known_addr { host: "127.17.136.3" port: 38959 } } peers { permanent_uuid: "3f232ccfc16f4e63ab07b0a0a0ecdeb3" member_type: VOTER last_known_addr { host: "127.17.136.2" port: 34359 } } peers { permanent_uuid: "85642702871f48d2a4811e71cf09ec44" member_type: VOTER last_known_addr { host: "127.17.136.1" port: 39629 } }
I20260927 15:12:35.056439 25796 heartbeater.cc:503] Master 127.17.136.62:46025 was elected leader, sending a full tablet report...
I20260927 15:12:35.056746 25965 ts_tablet_manager.cc:1428] T 547156fb7f9a4290b4fadc56709bde6c P 3f232ccfc16f4e63ab07b0a0a0ecdeb3: Time spent starting tablet: real 0.005s user 0.005s sys 0.000s
I20260927 15:12:35.056746 25966 ts_tablet_manager.cc:1428] T 547156fb7f9a4290b4fadc56709bde6c P 8c31bcf6ceaa411dba57437f661a6917: Time spent starting tablet: real 0.005s user 0.005s sys 0.000s
I20260927 15:12:35.057030 25936 heartbeater.cc:503] Master 127.17.136.62:46025 was elected leader, sending a full tablet report...
W20260927 15:12:35.064072 25657 tablet.cc:2369] T 547156fb7f9a4290b4fadc56709bde6c P 85642702871f48d2a4811e71cf09ec44: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260927 15:12:35.105559 25972 raft_consensus.cc:482] T 547156fb7f9a4290b4fadc56709bde6c P 8c31bcf6ceaa411dba57437f661a6917 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:12:35.105752 25972 raft_consensus.cc:504] T 547156fb7f9a4290b4fadc56709bde6c P 8c31bcf6ceaa411dba57437f661a6917 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c31bcf6ceaa411dba57437f661a6917" member_type: VOTER last_known_addr { host: "127.17.136.3" port: 38959 } } peers { permanent_uuid: "3f232ccfc16f4e63ab07b0a0a0ecdeb3" member_type: VOTER last_known_addr { host: "127.17.136.2" port: 34359 } } peers { permanent_uuid: "85642702871f48d2a4811e71cf09ec44" member_type: VOTER last_known_addr { host: "127.17.136.1" port: 39629 } }
I20260927 15:12:35.106910 25972 leader_election.cc:288] T 547156fb7f9a4290b4fadc56709bde6c P 8c31bcf6ceaa411dba57437f661a6917 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3f232ccfc16f4e63ab07b0a0a0ecdeb3 (127.17.136.2:34359), 85642702871f48d2a4811e71cf09ec44 (127.17.136.1:39629)
I20260927 15:12:35.110211 25829 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:35.107130 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.1:39629 (local address 127.17.136.3:41577)
0927 15:12:35.107330 (+ 200us) negotiation.cc:107] Waiting for socket to connect
0927 15:12:35.107344 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0927 15:12:35.107427 (+ 83us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0927 15:12:35.107635 (+ 208us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0927 15:12:35.107637 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0927 15:12:35.107654 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0927 15:12:35.107754 (+ 100us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:12:35.107759 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:12:35.108439 (+ 680us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:12:35.108442 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:12:35.109222 (+ 780us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:12:35.109231 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:12:35.109827 (+ 596us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:12:35.109831 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:12:35.109926 (+ 95us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:35.109944 (+ 18us) client_negotiation.cc:769] Sending connection context
0927 15:12:35.110011 (+ 67us) client_negotiation.cc:240] Negotiation successful
0927 15:12:35.110082 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":106}
I20260927 15:12:35.110211 25963 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:35.107335 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.136.3:41577 (local address 127.17.136.1:39629)
0927 15:12:35.107438 (+ 103us) server_negotiation.cc:206] Beginning negotiation
0927 15:12:35.107442 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0927 15:12:35.107467 (+ 25us) server_negotiation.cc:407] Connection header received
0927 15:12:35.107515 (+ 48us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:12:35.107518 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:12:35.107554 (+ 36us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:12:35.107612 (+ 58us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0927 15:12:35.107851 (+ 239us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:35.108336 (+ 485us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:35.109344 (+ 1008us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:35.109727 (+ 383us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:35.109827 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:35.109879 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0927 15:12:35.110038 (+ 159us) server_negotiation.cc:299] Negotiation successful
0927 15:12:35.110104 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260927 15:12:35.110852 25610 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "547156fb7f9a4290b4fadc56709bde6c" candidate_uuid: "8c31bcf6ceaa411dba57437f661a6917" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85642702871f48d2a4811e71cf09ec44" is_pre_election: true
I20260927 15:12:35.111045 25973 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:35.107130 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.2:34359 (local address 127.17.136.3:43565)
0927 15:12:35.107590 (+ 460us) negotiation.cc:107] Waiting for socket to connect
0927 15:12:35.107600 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0927 15:12:35.107702 (+ 102us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0927 15:12:35.107913 (+ 211us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0927 15:12:35.107915 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0927 15:12:35.107930 (+ 15us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0927 15:12:35.108041 (+ 111us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:12:35.108046 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:12:35.108744 (+ 698us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:12:35.108747 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:12:35.109958 (+ 1211us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:12:35.109968 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:12:35.110664 (+ 696us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:12:35.110667 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:12:35.110758 (+ 91us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:35.110780 (+ 22us) client_negotiation.cc:769] Sending connection context
0927 15:12:35.110846 (+ 66us) client_negotiation.cc:240] Negotiation successful
0927 15:12:35.110909 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":406,"mutex_wait_us":145,"thread_start_us":127,"threads_started":1}
I20260927 15:12:35.111088 25960 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:35.107243 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.136.3:43565 (local address 127.17.136.2:34359)
0927 15:12:35.107406 (+ 163us) server_negotiation.cc:206] Beginning negotiation
0927 15:12:35.107411 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0927 15:12:35.107678 (+ 267us) server_negotiation.cc:407] Connection header received
0927 15:12:35.107791 (+ 113us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:12:35.107794 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:12:35.107833 (+ 39us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:12:35.107900 (+ 67us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0927 15:12:35.108136 (+ 236us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:35.108642 (+ 506us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:35.110073 (+ 1431us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:35.110540 (+ 467us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:35.110646 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:35.110682 (+ 36us) server_negotiation.cc:1035] Waiting for connection context
0927 15:12:35.110868 (+ 186us) server_negotiation.cc:299] Negotiation successful
0927 15:12:35.110966 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260927 15:12:35.111166 25610 raft_consensus.cc:2454] T 547156fb7f9a4290b4fadc56709bde6c P 85642702871f48d2a4811e71cf09ec44 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c31bcf6ceaa411dba57437f661a6917 in term 0.
I20260927 15:12:35.111683 25823 leader_election.cc:302] T 547156fb7f9a4290b4fadc56709bde6c P 8c31bcf6ceaa411dba57437f661a6917 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85642702871f48d2a4811e71cf09ec44, 8c31bcf6ceaa411dba57437f661a6917; no voters:
I20260927 15:12:35.111672 25750 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "547156fb7f9a4290b4fadc56709bde6c" candidate_uuid: "8c31bcf6ceaa411dba57437f661a6917" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f232ccfc16f4e63ab07b0a0a0ecdeb3" is_pre_election: true
I20260927 15:12:35.111924 25750 raft_consensus.cc:2454] T 547156fb7f9a4290b4fadc56709bde6c P 3f232ccfc16f4e63ab07b0a0a0ecdeb3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c31bcf6ceaa411dba57437f661a6917 in term 0.
I20260927 15:12:35.111937 25972 raft_consensus.cc:2781] T 547156fb7f9a4290b4fadc56709bde6c P 8c31bcf6ceaa411dba57437f661a6917 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 15:12:35.112001 25972 raft_consensus.cc:482] T 547156fb7f9a4290b4fadc56709bde6c P 8c31bcf6ceaa411dba57437f661a6917 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 15:12:35.112033 25972 raft_consensus.cc:3037] T 547156fb7f9a4290b4fadc56709bde6c P 8c31bcf6ceaa411dba57437f661a6917 [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:12:35.113023 25972 raft_consensus.cc:504] T 547156fb7f9a4290b4fadc56709bde6c P 8c31bcf6ceaa411dba57437f661a6917 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c31bcf6ceaa411dba57437f661a6917" member_type: VOTER last_known_addr { host: "127.17.136.3" port: 38959 } } peers { permanent_uuid: "3f232ccfc16f4e63ab07b0a0a0ecdeb3" member_type: VOTER last_known_addr { host: "127.17.136.2" port: 34359 } } peers { permanent_uuid: "85642702871f48d2a4811e71cf09ec44" member_type: VOTER last_known_addr { host: "127.17.136.1" port: 39629 } }
I20260927 15:12:35.113332 25972 leader_election.cc:288] T 547156fb7f9a4290b4fadc56709bde6c P 8c31bcf6ceaa411dba57437f661a6917 [CANDIDATE]: Term 1 election: Requested vote from peers 3f232ccfc16f4e63ab07b0a0a0ecdeb3 (127.17.136.2:34359), 85642702871f48d2a4811e71cf09ec44 (127.17.136.1:39629)
I20260927 15:12:35.113667 25610 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "547156fb7f9a4290b4fadc56709bde6c" candidate_uuid: "8c31bcf6ceaa411dba57437f661a6917" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85642702871f48d2a4811e71cf09ec44"
I20260927 15:12:35.113670 25750 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "547156fb7f9a4290b4fadc56709bde6c" candidate_uuid: "8c31bcf6ceaa411dba57437f661a6917" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f232ccfc16f4e63ab07b0a0a0ecdeb3"
I20260927 15:12:35.113785 25610 raft_consensus.cc:3037] T 547156fb7f9a4290b4fadc56709bde6c P 85642702871f48d2a4811e71cf09ec44 [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:12:35.113785 25750 raft_consensus.cc:3037] T 547156fb7f9a4290b4fadc56709bde6c P 3f232ccfc16f4e63ab07b0a0a0ecdeb3 [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:12:35.115017 25610 raft_consensus.cc:2454] T 547156fb7f9a4290b4fadc56709bde6c P 85642702871f48d2a4811e71cf09ec44 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c31bcf6ceaa411dba57437f661a6917 in term 1.
I20260927 15:12:35.115332 25823 leader_election.cc:302] T 547156fb7f9a4290b4fadc56709bde6c P 8c31bcf6ceaa411dba57437f661a6917 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85642702871f48d2a4811e71cf09ec44, 8c31bcf6ceaa411dba57437f661a6917; no voters:
I20260927 15:12:35.115374 25750 raft_consensus.cc:2454] T 547156fb7f9a4290b4fadc56709bde6c P 3f232ccfc16f4e63ab07b0a0a0ecdeb3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c31bcf6ceaa411dba57437f661a6917 in term 1.
I20260927 15:12:35.115506 25972 raft_consensus.cc:2781] T 547156fb7f9a4290b4fadc56709bde6c P 8c31bcf6ceaa411dba57437f661a6917 [term 1 FOLLOWER]: Leader election won for term 1
I20260927 15:12:35.115698 25972 raft_consensus.cc:686] T 547156fb7f9a4290b4fadc56709bde6c P 8c31bcf6ceaa411dba57437f661a6917 [term 1 LEADER]: Becoming Leader. State: Replica: 8c31bcf6ceaa411dba57437f661a6917, State: Running, Role: LEADER
I20260927 15:12:35.116037 25972 consensus_queue.cc:237] T 547156fb7f9a4290b4fadc56709bde6c P 8c31bcf6ceaa411dba57437f661a6917 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c31bcf6ceaa411dba57437f661a6917" member_type: VOTER last_known_addr { host: "127.17.136.3" port: 38959 } } peers { permanent_uuid: "3f232ccfc16f4e63ab07b0a0a0ecdeb3" member_type: VOTER last_known_addr { host: "127.17.136.2" port: 34359 } } peers { permanent_uuid: "85642702871f48d2a4811e71cf09ec44" member_type: VOTER last_known_addr { host: "127.17.136.1" port: 39629 } }
I20260927 15:12:35.119051 25451 catalog_manager.cc:5495] T 547156fb7f9a4290b4fadc56709bde6c P 8c31bcf6ceaa411dba57437f661a6917 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8c31bcf6ceaa411dba57437f661a6917 (127.17.136.3). New cstate: current_term: 1 leader_uuid: "8c31bcf6ceaa411dba57437f661a6917" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c31bcf6ceaa411dba57437f661a6917" member_type: VOTER last_known_addr { host: "127.17.136.3" port: 38959 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3f232ccfc16f4e63ab07b0a0a0ecdeb3" member_type: VOTER last_known_addr { host: "127.17.136.2" port: 34359 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "85642702871f48d2a4811e71cf09ec44" member_type: VOTER last_known_addr { host: "127.17.136.1" port: 39629 } health_report { overall_health: UNKNOWN } } }
I20260927 15:12:35.131418 25961 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:35.127988 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56586 (local address 127.17.136.3:38959)
0927 15:12:35.128094 (+ 106us) server_negotiation.cc:206] Beginning negotiation
0927 15:12:35.128097 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0927 15:12:35.128112 (+ 15us) server_negotiation.cc:407] Connection header received
0927 15:12:35.128246 (+ 134us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:12:35.128247 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:12:35.128296 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:12:35.128385 (+ 89us) server_negotiation.cc:226] Negotiated authn=TOKEN
0927 15:12:35.128557 (+ 172us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:35.129062 (+ 505us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:35.130048 (+ 986us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:35.130273 (+ 225us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:35.130346 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:35.130604 (+ 258us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0927 15:12:35.131051 (+ 447us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0927 15:12:35.131141 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0927 15:12:35.131222 (+ 81us) server_negotiation.cc:299] Negotiation successful
0927 15:12:35.131299 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260927 15:12:35.137025 25610 raft_consensus.cc:1261] T 547156fb7f9a4290b4fadc56709bde6c P 85642702871f48d2a4811e71cf09ec44 [term 1 FOLLOWER]: Refusing update from remote peer 8c31bcf6ceaa411dba57437f661a6917: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260927 15:12:35.137025 25750 raft_consensus.cc:1261] T 547156fb7f9a4290b4fadc56709bde6c P 3f232ccfc16f4e63ab07b0a0a0ecdeb3 [term 1 FOLLOWER]: Refusing update from remote peer 8c31bcf6ceaa411dba57437f661a6917: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260927 15:12:35.137728 25972 consensus_queue.cc:1035] T 547156fb7f9a4290b4fadc56709bde6c P 8c31bcf6ceaa411dba57437f661a6917 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85642702871f48d2a4811e71cf09ec44" member_type: VOTER last_known_addr { host: "127.17.136.1" port: 39629 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260927 15:12:35.137974 25974 consensus_queue.cc:1035] T 547156fb7f9a4290b4fadc56709bde6c P 8c31bcf6ceaa411dba57437f661a6917 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f232ccfc16f4e63ab07b0a0a0ecdeb3" member_type: VOTER last_known_addr { host: "127.17.136.2" port: 34359 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260927 15:12:35.147473 25979 mvcc.cc:205] Tried to move back new op lower bound from 7333977928233791488 to 7333977928157884416. Current Snapshot: MvccSnapshot[applied={T|T < 7333977928233791488 or (T in {7333977928233791488})}]
I20260927 15:12:35.153498 25451 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:42298:
table { table_name: "test-table" } modify_external_catalogs: true
I20260927 15:12:35.153676 25451 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:42298:
table { table_name: "test-table" } modify_external_catalogs: true
I20260927 15:12:35.156154 25451 catalog_manager.cc:5782] T 00000000000000000000000000000000 P e567bae41ac64f3aa35dce62bd53dc51: Sending DeleteTablet for 3 replicas of tablet 547156fb7f9a4290b4fadc56709bde6c
I20260927 15:12:35.157063 25867 tablet_service.cc:1514] Processing DeleteTablet for tablet 547156fb7f9a4290b4fadc56709bde6c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:12:35 UTC) from {username='oryx', principal='oryx/127.17.136.62@KRBTEST.COM'} at 127.0.0.1:56574
I20260927 15:12:35.157105 25730 tablet_service.cc:1514] Processing DeleteTablet for tablet 547156fb7f9a4290b4fadc56709bde6c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:12:35 UTC) from {username='oryx', principal='oryx/127.17.136.62@KRBTEST.COM'} at 127.0.0.1:59930
I20260927 15:12:35.157532 25451 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:42298:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260927 15:12:35.157574 25590 tablet_service.cc:1514] Processing DeleteTablet for tablet 547156fb7f9a4290b4fadc56709bde6c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:12:35 UTC) from {username='oryx', principal='oryx/127.17.136.62@KRBTEST.COM'} at 127.0.0.1:47094
I20260927 15:12:35.157930 25986 tablet_replica.cc:330] T 547156fb7f9a4290b4fadc56709bde6c P 8c31bcf6ceaa411dba57437f661a6917: stopping tablet replica
W20260927 15:12:35.157949 25451 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:12:35.158068 25987 tablet_replica.cc:330] T 547156fb7f9a4290b4fadc56709bde6c P 3f232ccfc16f4e63ab07b0a0a0ecdeb3: stopping tablet replica
I20260927 15:12:35.158365 25986 raft_consensus.cc:2229] T 547156fb7f9a4290b4fadc56709bde6c P 8c31bcf6ceaa411dba57437f661a6917 [term 1 LEADER]: Raft consensus shutting down.
I20260927 15:12:35.158365 25987 raft_consensus.cc:2229] T 547156fb7f9a4290b4fadc56709bde6c P 3f232ccfc16f4e63ab07b0a0a0ecdeb3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260927 15:12:35.158689 25987 raft_consensus.cc:2258] T 547156fb7f9a4290b4fadc56709bde6c P 3f232ccfc16f4e63ab07b0a0a0ecdeb3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 15:12:35.158888 25986 raft_consensus.cc:2258] T 547156fb7f9a4290b4fadc56709bde6c P 8c31bcf6ceaa411dba57437f661a6917 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 15:12:35.159065 25988 tablet_replica.cc:330] T 547156fb7f9a4290b4fadc56709bde6c P 85642702871f48d2a4811e71cf09ec44: stopping tablet replica
I20260927 15:12:35.159394 25988 raft_consensus.cc:2229] T 547156fb7f9a4290b4fadc56709bde6c P 85642702871f48d2a4811e71cf09ec44 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260927 15:12:35.159678 25988 raft_consensus.cc:2258] T 547156fb7f9a4290b4fadc56709bde6c P 85642702871f48d2a4811e71cf09ec44 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 15:12:35.160676 25986 ts_tablet_manager.cc:1905] T 547156fb7f9a4290b4fadc56709bde6c P 8c31bcf6ceaa411dba57437f661a6917: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:12:35.161022 25988 ts_tablet_manager.cc:1905] T 547156fb7f9a4290b4fadc56709bde6c P 85642702871f48d2a4811e71cf09ec44: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:12:35.163589 25988 ts_tablet_manager.cc:1918] T 547156fb7f9a4290b4fadc56709bde6c P 85642702871f48d2a4811e71cf09ec44: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260927 15:12:35.163590 25986 ts_tablet_manager.cc:1918] T 547156fb7f9a4290b4fadc56709bde6c P 8c31bcf6ceaa411dba57437f661a6917: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260927 15:12:35.163697 25988 log.cc:1196] T 547156fb7f9a4290b4fadc56709bde6c P 85642702871f48d2a4811e71cf09ec44: Deleting WAL directory at /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790521920546562-17952-0/minicluster-data/ts-0/wal/wals/547156fb7f9a4290b4fadc56709bde6c
I20260927 15:12:35.163827 25986 log.cc:1196] T 547156fb7f9a4290b4fadc56709bde6c P 8c31bcf6ceaa411dba57437f661a6917: Deleting WAL directory at /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790521920546562-17952-0/minicluster-data/ts-2/wal/wals/547156fb7f9a4290b4fadc56709bde6c
I20260927 15:12:35.163821 25867 tablet_service.cc:1467] Processing CreateTablet for tablet 6e0db5f07f074d4ebf6c98e9f7059ab0 (DEFAULT_TABLE table=test-table [id=2797273e7d1247c7bdfaea5d799b65a5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:12:35.163239 25590 tablet_service.cc:1467] Processing CreateTablet for tablet 6e0db5f07f074d4ebf6c98e9f7059ab0 (DEFAULT_TABLE table=test-table [id=2797273e7d1247c7bdfaea5d799b65a5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:12:35.164002 25988 ts_tablet_manager.cc:1939] T 547156fb7f9a4290b4fadc56709bde6c P 85642702871f48d2a4811e71cf09ec44: Deleting consensus metadata
I20260927 15:12:35.164179 25590 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6e0db5f07f074d4ebf6c98e9f7059ab0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:12:35.164186 25867 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6e0db5f07f074d4ebf6c98e9f7059ab0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:12:35.165256 25439 catalog_manager.cc:4841] TS 85642702871f48d2a4811e71cf09ec44 (127.17.136.1:39629): tablet 547156fb7f9a4290b4fadc56709bde6c (table test-table [id=76164475b0b34977888b749f6535d600]) successfully deleted
I20260927 15:12:35.166224 25964 tablet_bootstrap.cc:492] T 6e0db5f07f074d4ebf6c98e9f7059ab0 P 85642702871f48d2a4811e71cf09ec44: Bootstrap starting.
I20260927 15:12:35.166481 25966 tablet_bootstrap.cc:492] T 6e0db5f07f074d4ebf6c98e9f7059ab0 P 8c31bcf6ceaa411dba57437f661a6917: Bootstrap starting.
I20260927 15:12:35.166826 25987 ts_tablet_manager.cc:1905] T 547156fb7f9a4290b4fadc56709bde6c P 3f232ccfc16f4e63ab07b0a0a0ecdeb3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:12:35.167140 25964 tablet_bootstrap.cc:654] T 6e0db5f07f074d4ebf6c98e9f7059ab0 P 85642702871f48d2a4811e71cf09ec44: Neither blocks nor log segments found. Creating new log.
I20260927 15:12:35.167495 25966 tablet_bootstrap.cc:654] T 6e0db5f07f074d4ebf6c98e9f7059ab0 P 8c31bcf6ceaa411dba57437f661a6917: Neither blocks nor log segments found. Creating new log.
I20260927 15:12:35.163501 25730 tablet_service.cc:1467] Processing CreateTablet for tablet 6e0db5f07f074d4ebf6c98e9f7059ab0 (DEFAULT_TABLE table=test-table [id=2797273e7d1247c7bdfaea5d799b65a5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:12:35.168020 25730 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6e0db5f07f074d4ebf6c98e9f7059ab0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:12:35.168545 25986 ts_tablet_manager.cc:1939] T 547156fb7f9a4290b4fadc56709bde6c P 8c31bcf6ceaa411dba57437f661a6917: Deleting consensus metadata
I20260927 15:12:35.169665 25987 ts_tablet_manager.cc:1918] T 547156fb7f9a4290b4fadc56709bde6c P 3f232ccfc16f4e63ab07b0a0a0ecdeb3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260927 15:12:35.169762 25987 log.cc:1196] T 547156fb7f9a4290b4fadc56709bde6c P 3f232ccfc16f4e63ab07b0a0a0ecdeb3: Deleting WAL directory at /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790521920546562-17952-0/minicluster-data/ts-1/wal/wals/547156fb7f9a4290b4fadc56709bde6c
I20260927 15:12:35.169726 25438 catalog_manager.cc:4841] TS 8c31bcf6ceaa411dba57437f661a6917 (127.17.136.3:38959): tablet 547156fb7f9a4290b4fadc56709bde6c (table test-table [id=76164475b0b34977888b749f6535d600]) successfully deleted
I20260927 15:12:35.170063 25987 ts_tablet_manager.cc:1939] T 547156fb7f9a4290b4fadc56709bde6c P 3f232ccfc16f4e63ab07b0a0a0ecdeb3: Deleting consensus metadata
I20260927 15:12:35.170194 25965 tablet_bootstrap.cc:492] T 6e0db5f07f074d4ebf6c98e9f7059ab0 P 3f232ccfc16f4e63ab07b0a0a0ecdeb3: Bootstrap starting.
I20260927 15:12:35.171087 25965 tablet_bootstrap.cc:654] T 6e0db5f07f074d4ebf6c98e9f7059ab0 P 3f232ccfc16f4e63ab07b0a0a0ecdeb3: Neither blocks nor log segments found. Creating new log.
I20260927 15:12:35.171145 25437 catalog_manager.cc:4841] TS 3f232ccfc16f4e63ab07b0a0a0ecdeb3 (127.17.136.2:34359): tablet 547156fb7f9a4290b4fadc56709bde6c (table test-table [id=76164475b0b34977888b749f6535d600]) successfully deleted
I20260927 15:12:35.172271 25964 tablet_bootstrap.cc:492] T 6e0db5f07f074d4ebf6c98e9f7059ab0 P 85642702871f48d2a4811e71cf09ec44: No bootstrap required, opened a new log
I20260927 15:12:35.172377 25964 ts_tablet_manager.cc:1397] T 6e0db5f07f074d4ebf6c98e9f7059ab0 P 85642702871f48d2a4811e71cf09ec44: Time spent bootstrapping tablet: real 0.006s user 0.001s sys 0.001s
I20260927 15:12:35.172469 25965 tablet_bootstrap.cc:492] T 6e0db5f07f074d4ebf6c98e9f7059ab0 P 3f232ccfc16f4e63ab07b0a0a0ecdeb3: No bootstrap required, opened a new log
I20260927 15:12:35.172536 25965 ts_tablet_manager.cc:1397] T 6e0db5f07f074d4ebf6c98e9f7059ab0 P 3f232ccfc16f4e63ab07b0a0a0ecdeb3: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20260927 15:12:35.172923 25965 raft_consensus.cc:348] T 6e0db5f07f074d4ebf6c98e9f7059ab0 P 3f232ccfc16f4e63ab07b0a0a0ecdeb3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85642702871f48d2a4811e71cf09ec44" member_type: VOTER last_known_addr { host: "127.17.136.1" port: 39629 } } peers { permanent_uuid: "3f232ccfc16f4e63ab07b0a0a0ecdeb3" member_type: VOTER last_known_addr { host: "127.17.136.2" port: 34359 } } peers { permanent_uuid: "8c31bcf6ceaa411dba57437f661a6917" member_type: VOTER last_known_addr { host: "127.17.136.3" port: 38959 } }
I20260927 15:12:35.173033 25965 raft_consensus.cc:374] T 6e0db5f07f074d4ebf6c98e9f7059ab0 P 3f232ccfc16f4e63ab07b0a0a0ecdeb3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:12:35.173061 25965 raft_consensus.cc:729] T 6e0db5f07f074d4ebf6c98e9f7059ab0 P 3f232ccfc16f4e63ab07b0a0a0ecdeb3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f232ccfc16f4e63ab07b0a0a0ecdeb3, State: Initialized, Role: FOLLOWER
I20260927 15:12:35.173035 25964 raft_consensus.cc:348] T 6e0db5f07f074d4ebf6c98e9f7059ab0 P 85642702871f48d2a4811e71cf09ec44 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85642702871f48d2a4811e71cf09ec44" member_type: VOTER last_known_addr { host: "127.17.136.1" port: 39629 } } peers { permanent_uuid: "3f232ccfc16f4e63ab07b0a0a0ecdeb3" member_type: VOTER last_known_addr { host: "127.17.136.2" port: 34359 } } peers { permanent_uuid: "8c31bcf6ceaa411dba57437f661a6917" member_type: VOTER last_known_addr { host: "127.17.136.3" port: 38959 } }
I20260927 15:12:35.173156 25964 raft_consensus.cc:374] T 6e0db5f07f074d4ebf6c98e9f7059ab0 P 85642702871f48d2a4811e71cf09ec44 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:12:35.173194 25964 raft_consensus.cc:729] T 6e0db5f07f074d4ebf6c98e9f7059ab0 P 85642702871f48d2a4811e71cf09ec44 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 85642702871f48d2a4811e71cf09ec44, State: Initialized, Role: FOLLOWER
I20260927 15:12:35.173174 25965 consensus_queue.cc:260] T 6e0db5f07f074d4ebf6c98e9f7059ab0 P 3f232ccfc16f4e63ab07b0a0a0ecdeb3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85642702871f48d2a4811e71cf09ec44" member_type: VOTER last_known_addr { host: "127.17.136.1" port: 39629 } } peers { permanent_uuid: "3f232ccfc16f4e63ab07b0a0a0ecdeb3" member_type: VOTER last_known_addr { host: "127.17.136.2" port: 34359 } } peers { permanent_uuid: "8c31bcf6ceaa411dba57437f661a6917" member_type: VOTER last_known_addr { host: "127.17.136.3" port: 38959 } }
I20260927 15:12:35.173338 25964 consensus_queue.cc:260] T 6e0db5f07f074d4ebf6c98e9f7059ab0 P 85642702871f48d2a4811e71cf09ec44 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85642702871f48d2a4811e71cf09ec44" member_type: VOTER last_known_addr { host: "127.17.136.1" port: 39629 } } peers { permanent_uuid: "3f232ccfc16f4e63ab07b0a0a0ecdeb3" member_type: VOTER last_known_addr { host: "127.17.136.2" port: 34359 } } peers { permanent_uuid: "8c31bcf6ceaa411dba57437f661a6917" member_type: VOTER last_known_addr { host: "127.17.136.3" port: 38959 } }
I20260927 15:12:35.173405 25965 ts_tablet_manager.cc:1428] T 6e0db5f07f074d4ebf6c98e9f7059ab0 P 3f232ccfc16f4e63ab07b0a0a0ecdeb3: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20260927 15:12:35.173580 25964 ts_tablet_manager.cc:1428] T 6e0db5f07f074d4ebf6c98e9f7059ab0 P 85642702871f48d2a4811e71cf09ec44: Time spent starting tablet: real 0.001s user 0.000s sys 0.002s
I20260927 15:12:35.174938 25966 tablet_bootstrap.cc:492] T 6e0db5f07f074d4ebf6c98e9f7059ab0 P 8c31bcf6ceaa411dba57437f661a6917: No bootstrap required, opened a new log
I20260927 15:12:35.175022 25966 ts_tablet_manager.cc:1397] T 6e0db5f07f074d4ebf6c98e9f7059ab0 P 8c31bcf6ceaa411dba57437f661a6917: Time spent bootstrapping tablet: real 0.009s user 0.002s sys 0.000s
I20260927 15:12:35.175490 25966 raft_consensus.cc:348] T 6e0db5f07f074d4ebf6c98e9f7059ab0 P 8c31bcf6ceaa411dba57437f661a6917 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85642702871f48d2a4811e71cf09ec44" member_type: VOTER last_known_addr { host: "127.17.136.1" port: 39629 } } peers { permanent_uuid: "3f232ccfc16f4e63ab07b0a0a0ecdeb3" member_type: VOTER last_known_addr { host: "127.17.136.2" port: 34359 } } peers { permanent_uuid: "8c31bcf6ceaa411dba57437f661a6917" member_type: VOTER last_known_addr { host: "127.17.136.3" port: 38959 } }
I20260927 15:12:35.175601 25966 raft_consensus.cc:374] T 6e0db5f07f074d4ebf6c98e9f7059ab0 P 8c31bcf6ceaa411dba57437f661a6917 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:12:35.175631 25966 raft_consensus.cc:729] T 6e0db5f07f074d4ebf6c98e9f7059ab0 P 8c31bcf6ceaa411dba57437f661a6917 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8c31bcf6ceaa411dba57437f661a6917, State: Initialized, Role: FOLLOWER
I20260927 15:12:35.175765 25966 consensus_queue.cc:260] T 6e0db5f07f074d4ebf6c98e9f7059ab0 P 8c31bcf6ceaa411dba57437f661a6917 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85642702871f48d2a4811e71cf09ec44" member_type: VOTER last_known_addr { host: "127.17.136.1" port: 39629 } } peers { permanent_uuid: "3f232ccfc16f4e63ab07b0a0a0ecdeb3" member_type: VOTER last_known_addr { host: "127.17.136.2" port: 34359 } } peers { permanent_uuid: "8c31bcf6ceaa411dba57437f661a6917" member_type: VOTER last_known_addr { host: "127.17.136.3" port: 38959 } }
I20260927 15:12:35.176003 25966 ts_tablet_manager.cc:1428] T 6e0db5f07f074d4ebf6c98e9f7059ab0 P 8c31bcf6ceaa411dba57437f661a6917: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
W20260927 15:12:35.226639 25937 tablet.cc:2369] T 6e0db5f07f074d4ebf6c98e9f7059ab0 P 8c31bcf6ceaa411dba57437f661a6917: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260927 15:12:35.263716 25797 tablet.cc:2369] T 6e0db5f07f074d4ebf6c98e9f7059ab0 P 3f232ccfc16f4e63ab07b0a0a0ecdeb3: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260927 15:12:35.320168 25971 raft_consensus.cc:482] T 6e0db5f07f074d4ebf6c98e9f7059ab0 P 3f232ccfc16f4e63ab07b0a0a0ecdeb3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:12:35.320312 25971 raft_consensus.cc:504] T 6e0db5f07f074d4ebf6c98e9f7059ab0 P 3f232ccfc16f4e63ab07b0a0a0ecdeb3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85642702871f48d2a4811e71cf09ec44" member_type: VOTER last_known_addr { host: "127.17.136.1" port: 39629 } } peers { permanent_uuid: "3f232ccfc16f4e63ab07b0a0a0ecdeb3" member_type: VOTER last_known_addr { host: "127.17.136.2" port: 34359 } } peers { permanent_uuid: "8c31bcf6ceaa411dba57437f661a6917" member_type: VOTER last_known_addr { host: "127.17.136.3" port: 38959 } }
I20260927 15:12:35.321365 25971 leader_election.cc:288] T 6e0db5f07f074d4ebf6c98e9f7059ab0 P 3f232ccfc16f4e63ab07b0a0a0ecdeb3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 85642702871f48d2a4811e71cf09ec44 (127.17.136.1:39629), 8c31bcf6ceaa411dba57437f661a6917 (127.17.136.3:38959)
I20260927 15:12:35.326242 25961 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:35.321724 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.136.2:35951 (local address 127.17.136.3:38959)
0927 15:12:35.321846 (+ 122us) server_negotiation.cc:206] Beginning negotiation
0927 15:12:35.321850 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0927 15:12:35.322237 (+ 387us) server_negotiation.cc:407] Connection header received
0927 15:12:35.322355 (+ 118us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:12:35.322357 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:12:35.322399 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:12:35.322466 (+ 67us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0927 15:12:35.322707 (+ 241us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:35.323215 (+ 508us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:35.324757 (+ 1542us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:35.325337 (+ 580us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:35.325467 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:35.325522 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0927 15:12:35.326033 (+ 511us) server_negotiation.cc:299] Negotiation successful
0927 15:12:35.326108 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260927 15:12:35.326763 25993 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:35.321658 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.3:38959 (local address 127.17.136.2:35951)
0927 15:12:35.322158 (+ 500us) negotiation.cc:107] Waiting for socket to connect
0927 15:12:35.322173 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0927 15:12:35.322276 (+ 103us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0927 15:12:35.322488 (+ 212us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0927 15:12:35.322490 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0927 15:12:35.322507 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0927 15:12:35.322628 (+ 121us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:12:35.322634 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:12:35.323342 (+ 708us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:12:35.323346 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:12:35.324641 (+ 1295us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:12:35.324650 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:12:35.325579 (+ 929us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:12:35.325583 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:12:35.325684 (+ 101us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:35.325922 (+ 238us) client_negotiation.cc:769] Sending connection context
0927 15:12:35.326545 (+ 623us) client_negotiation.cc:240] Negotiation successful
0927 15:12:35.326624 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":275,"thread_start_us":362,"threads_started":1}
I20260927 15:12:35.327440 25963 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:35.321973 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.136.2:36673 (local address 127.17.136.1:39629)
0927 15:12:35.322529 (+ 556us) server_negotiation.cc:206] Beginning negotiation
0927 15:12:35.322534 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0927 15:12:35.322546 (+ 12us) server_negotiation.cc:407] Connection header received
0927 15:12:35.322589 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:12:35.322593 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:12:35.322633 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:12:35.322709 (+ 76us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0927 15:12:35.323769 (+ 1060us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:35.324489 (+ 720us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:35.326251 (+ 1762us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:35.326794 (+ 543us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:35.326884 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:35.326941 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0927 15:12:35.327268 (+ 327us) server_negotiation.cc:299] Negotiation successful
0927 15:12:35.327342 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":454}
I20260927 15:12:35.327800 25992 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:35.321569 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.1:39629 (local address 127.17.136.2:36673)
0927 15:12:35.321985 (+ 416us) negotiation.cc:107] Waiting for socket to connect
0927 15:12:35.321999 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0927 15:12:35.322105 (+ 106us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0927 15:12:35.323379 (+ 1274us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0927 15:12:35.323382 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0927 15:12:35.323399 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0927 15:12:35.323647 (+ 248us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:12:35.323654 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:12:35.325099 (+ 1445us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:12:35.325103 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:12:35.326133 (+ 1030us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:12:35.326142 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:12:35.327024 (+ 882us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:12:35.327027 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:12:35.327114 (+ 87us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:35.327136 (+ 22us) client_negotiation.cc:769] Sending connection context
0927 15:12:35.327571 (+ 435us) client_negotiation.cc:240] Negotiation successful
0927 15:12:35.327665 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":332,"mutex_wait_us":129,"thread_start_us":87,"threads_started":1}
I20260927 15:12:35.327713 25890 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e0db5f07f074d4ebf6c98e9f7059ab0" candidate_uuid: "3f232ccfc16f4e63ab07b0a0a0ecdeb3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c31bcf6ceaa411dba57437f661a6917" is_pre_election: true
I20260927 15:12:35.327983 25890 raft_consensus.cc:2454] T 6e0db5f07f074d4ebf6c98e9f7059ab0 P 8c31bcf6ceaa411dba57437f661a6917 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f232ccfc16f4e63ab07b0a0a0ecdeb3 in term 0.
I20260927 15:12:35.328421 25682 leader_election.cc:302] T 6e0db5f07f074d4ebf6c98e9f7059ab0 P 3f232ccfc16f4e63ab07b0a0a0ecdeb3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f232ccfc16f4e63ab07b0a0a0ecdeb3, 8c31bcf6ceaa411dba57437f661a6917; no voters:
I20260927 15:12:35.328720 25971 raft_consensus.cc:2781] T 6e0db5f07f074d4ebf6c98e9f7059ab0 P 3f232ccfc16f4e63ab07b0a0a0ecdeb3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 15:12:35.328783 25971 raft_consensus.cc:482] T 6e0db5f07f074d4ebf6c98e9f7059ab0 P 3f232ccfc16f4e63ab07b0a0a0ecdeb3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 15:12:35.328828 25971 raft_consensus.cc:3037] T 6e0db5f07f074d4ebf6c98e9f7059ab0 P 3f232ccfc16f4e63ab07b0a0a0ecdeb3 [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:12:35.330121 25971 raft_consensus.cc:504] T 6e0db5f07f074d4ebf6c98e9f7059ab0 P 3f232ccfc16f4e63ab07b0a0a0ecdeb3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85642702871f48d2a4811e71cf09ec44" member_type: VOTER last_known_addr { host: "127.17.136.1" port: 39629 } } peers { permanent_uuid: "3f232ccfc16f4e63ab07b0a0a0ecdeb3" member_type: VOTER last_known_addr { host: "127.17.136.2" port: 34359 } } peers { permanent_uuid: "8c31bcf6ceaa411dba57437f661a6917" member_type: VOTER last_known_addr { host: "127.17.136.3" port: 38959 } }
I20260927 15:12:35.330256 25610 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e0db5f07f074d4ebf6c98e9f7059ab0" candidate_uuid: "3f232ccfc16f4e63ab07b0a0a0ecdeb3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85642702871f48d2a4811e71cf09ec44" is_pre_election: true
I20260927 15:12:35.330471 25971 leader_election.cc:288] T 6e0db5f07f074d4ebf6c98e9f7059ab0 P 3f232ccfc16f4e63ab07b0a0a0ecdeb3 [CANDIDATE]: Term 1 election: Requested vote from peers 85642702871f48d2a4811e71cf09ec44 (127.17.136.1:39629), 8c31bcf6ceaa411dba57437f661a6917 (127.17.136.3:38959)
I20260927 15:12:35.330533 25610 raft_consensus.cc:2454] T 6e0db5f07f074d4ebf6c98e9f7059ab0 P 85642702871f48d2a4811e71cf09ec44 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f232ccfc16f4e63ab07b0a0a0ecdeb3 in term 0.
I20260927 15:12:35.330840 25890 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e0db5f07f074d4ebf6c98e9f7059ab0" candidate_uuid: "3f232ccfc16f4e63ab07b0a0a0ecdeb3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c31bcf6ceaa411dba57437f661a6917"
I20260927 15:12:35.330950 25890 raft_consensus.cc:3037] T 6e0db5f07f074d4ebf6c98e9f7059ab0 P 8c31bcf6ceaa411dba57437f661a6917 [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:12:35.331120 25610 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e0db5f07f074d4ebf6c98e9f7059ab0" candidate_uuid: "3f232ccfc16f4e63ab07b0a0a0ecdeb3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85642702871f48d2a4811e71cf09ec44"
I20260927 15:12:35.331209 25610 raft_consensus.cc:3037] T 6e0db5f07f074d4ebf6c98e9f7059ab0 P 85642702871f48d2a4811e71cf09ec44 [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:12:35.332166 25890 raft_consensus.cc:2454] T 6e0db5f07f074d4ebf6c98e9f7059ab0 P 8c31bcf6ceaa411dba57437f661a6917 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f232ccfc16f4e63ab07b0a0a0ecdeb3 in term 1.
I20260927 15:12:35.332365 25610 raft_consensus.cc:2454] T 6e0db5f07f074d4ebf6c98e9f7059ab0 P 85642702871f48d2a4811e71cf09ec44 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f232ccfc16f4e63ab07b0a0a0ecdeb3 in term 1.
I20260927 15:12:35.332468 25682 leader_election.cc:302] T 6e0db5f07f074d4ebf6c98e9f7059ab0 P 3f232ccfc16f4e63ab07b0a0a0ecdeb3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f232ccfc16f4e63ab07b0a0a0ecdeb3, 8c31bcf6ceaa411dba57437f661a6917; no voters:
I20260927 15:12:35.332638 25971 raft_consensus.cc:2781] T 6e0db5f07f074d4ebf6c98e9f7059ab0 P 3f232ccfc16f4e63ab07b0a0a0ecdeb3 [term 1 FOLLOWER]: Leader election won for term 1
I20260927 15:12:35.332803 25971 raft_consensus.cc:686] T 6e0db5f07f074d4ebf6c98e9f7059ab0 P 3f232ccfc16f4e63ab07b0a0a0ecdeb3 [term 1 LEADER]: Becoming Leader. State: Replica: 3f232ccfc16f4e63ab07b0a0a0ecdeb3, State: Running, Role: LEADER
I20260927 15:12:35.333050 25971 consensus_queue.cc:237] T 6e0db5f07f074d4ebf6c98e9f7059ab0 P 3f232ccfc16f4e63ab07b0a0a0ecdeb3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85642702871f48d2a4811e71cf09ec44" member_type: VOTER last_known_addr { host: "127.17.136.1" port: 39629 } } peers { permanent_uuid: "3f232ccfc16f4e63ab07b0a0a0ecdeb3" member_type: VOTER last_known_addr { host: "127.17.136.2" port: 34359 } } peers { permanent_uuid: "8c31bcf6ceaa411dba57437f661a6917" member_type: VOTER last_known_addr { host: "127.17.136.3" port: 38959 } }
I20260927 15:12:35.335386 25453 catalog_manager.cc:5495] T 6e0db5f07f074d4ebf6c98e9f7059ab0 P 3f232ccfc16f4e63ab07b0a0a0ecdeb3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3f232ccfc16f4e63ab07b0a0a0ecdeb3 (127.17.136.2). New cstate: current_term: 1 leader_uuid: "3f232ccfc16f4e63ab07b0a0a0ecdeb3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85642702871f48d2a4811e71cf09ec44" member_type: VOTER last_known_addr { host: "127.17.136.1" port: 39629 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f232ccfc16f4e63ab07b0a0a0ecdeb3" member_type: VOTER last_known_addr { host: "127.17.136.2" port: 34359 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c31bcf6ceaa411dba57437f661a6917" member_type: VOTER last_known_addr { host: "127.17.136.3" port: 38959 } health_report { overall_health: UNKNOWN } } }
Sep 27 15:12:35 dist-test-slave-5s2t krb5kdc[25408](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790521954, etypes {rep=17 tkt=17 ses=17}, oryx/127.17.136.62@KRBTEST.COM for oryx/127.17.136.62@KRBTEST.COM
I20260927 15:12:35.389113 25502 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:35.381069 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42308 (local address 127.17.136.62:46025)
0927 15:12:35.381206 (+ 137us) server_negotiation.cc:206] Beginning negotiation
0927 15:12:35.381210 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0927 15:12:35.381326 (+ 116us) server_negotiation.cc:407] Connection header received
0927 15:12:35.381473 (+ 147us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:12:35.381475 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:12:35.381515 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:12:35.381571 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0927 15:12:35.382272 (+ 701us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:35.382783 (+ 511us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:35.383641 (+ 858us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:35.383851 (+ 210us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:35.383948 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:35.386187 (+ 2239us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0927 15:12:35.386190 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0927 15:12:35.386192 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0927 15:12:35.386212 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0927 15:12:35.387542 (+ 1330us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:12:35.387962 (+ 420us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:12:35.387965 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:12:35.387966 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:12:35.388034 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:12:35.388260 (+ 226us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:12:35.388262 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:12:35.388263 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:12:35.388419 (+ 156us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0927 15:12:35.388485 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0927 15:12:35.388809 (+ 324us) server_negotiation.cc:299] Negotiation successful
0927 15:12:35.388987 (+ 178us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":70,"server-negotiator.queue_time_us":60}
I20260927 15:12:35.389117 26001 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:35.380976 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.62:46025 (local address 127.0.0.1:42308)
0927 15:12:35.381244 (+ 268us) negotiation.cc:107] Waiting for socket to connect
0927 15:12:35.381258 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0927 15:12:35.381376 (+ 118us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0927 15:12:35.381633 (+ 257us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0927 15:12:35.381635 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0927 15:12:35.382071 (+ 436us) client_negotiation.cc:189] Negotiated authn=SASL
0927 15:12:35.382170 (+ 99us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:12:35.382176 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:12:35.382910 (+ 734us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:12:35.382913 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:12:35.383520 (+ 607us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:12:35.383529 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:12:35.383973 (+ 444us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:12:35.383976 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:12:35.384040 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:35.384567 (+ 527us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0927 15:12:35.384579 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0927 15:12:35.386058 (+ 1479us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0927 15:12:35.387641 (+ 1583us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0927 15:12:35.387649 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0927 15:12:35.387654 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0927 15:12:35.387881 (+ 227us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0927 15:12:35.388113 (+ 232us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0927 15:12:35.388115 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0927 15:12:35.388116 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0927 15:12:35.388194 (+ 78us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0927 15:12:35.388526 (+ 332us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0927 15:12:35.388532 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0927 15:12:35.388644 (+ 112us) client_negotiation.cc:769] Sending connection context
0927 15:12:35.388752 (+ 108us) client_negotiation.cc:240] Negotiation successful
0927 15:12:35.388926 (+ 174us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":185,"thread_start_us":83,"threads_started":1}
I20260927 15:12:35.393076 25453 catalog_manager.cc:1908] Servicing CreateTable request from {username='oryx', principal='oryx/127.17.136.62@KRBTEST.COM'} at 127.0.0.1:42308:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260927 15:12:35.393802 25453 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:12:35.398463 25590 tablet_service.cc:1467] Processing CreateTablet for tablet bbabcd446bc44eaeb64cbb56c5b45271 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=15ef489364c1409caba0d0a970de5e83]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260927 15:12:35.398582 25867 tablet_service.cc:1467] Processing CreateTablet for tablet bbabcd446bc44eaeb64cbb56c5b45271 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=15ef489364c1409caba0d0a970de5e83]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260927 15:12:35.398844 25590 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bbabcd446bc44eaeb64cbb56c5b45271. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:12:35.398938 25867 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bbabcd446bc44eaeb64cbb56c5b45271. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:12:35.401211 25966 tablet_bootstrap.cc:492] T bbabcd446bc44eaeb64cbb56c5b45271 P 8c31bcf6ceaa411dba57437f661a6917: Bootstrap starting.
I20260927 15:12:35.401569 25730 tablet_service.cc:1467] Processing CreateTablet for tablet bbabcd446bc44eaeb64cbb56c5b45271 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=15ef489364c1409caba0d0a970de5e83]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260927 15:12:35.401893 25730 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bbabcd446bc44eaeb64cbb56c5b45271. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:12:35.402032 25966 tablet_bootstrap.cc:654] T bbabcd446bc44eaeb64cbb56c5b45271 P 8c31bcf6ceaa411dba57437f661a6917: Neither blocks nor log segments found. Creating new log.
I20260927 15:12:35.403047 25966 tablet_bootstrap.cc:492] T bbabcd446bc44eaeb64cbb56c5b45271 P 8c31bcf6ceaa411dba57437f661a6917: No bootstrap required, opened a new log
I20260927 15:12:35.403115 25966 ts_tablet_manager.cc:1397] T bbabcd446bc44eaeb64cbb56c5b45271 P 8c31bcf6ceaa411dba57437f661a6917: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260927 15:12:35.403403 25964 tablet_bootstrap.cc:492] T bbabcd446bc44eaeb64cbb56c5b45271 P 85642702871f48d2a4811e71cf09ec44: Bootstrap starting.
I20260927 15:12:35.403525 25966 raft_consensus.cc:348] T bbabcd446bc44eaeb64cbb56c5b45271 P 8c31bcf6ceaa411dba57437f661a6917 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85642702871f48d2a4811e71cf09ec44" member_type: VOTER last_known_addr { host: "127.17.136.1" port: 39629 } } peers { permanent_uuid: "3f232ccfc16f4e63ab07b0a0a0ecdeb3" member_type: VOTER last_known_addr { host: "127.17.136.2" port: 34359 } } peers { permanent_uuid: "8c31bcf6ceaa411dba57437f661a6917" member_type: VOTER last_known_addr { host: "127.17.136.3" port: 38959 } }
I20260927 15:12:35.403632 25966 raft_consensus.cc:374] T bbabcd446bc44eaeb64cbb56c5b45271 P 8c31bcf6ceaa411dba57437f661a6917 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:12:35.403664 25966 raft_consensus.cc:729] T bbabcd446bc44eaeb64cbb56c5b45271 P 8c31bcf6ceaa411dba57437f661a6917 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8c31bcf6ceaa411dba57437f661a6917, State: Initialized, Role: FOLLOWER
I20260927 15:12:35.403777 25966 consensus_queue.cc:260] T bbabcd446bc44eaeb64cbb56c5b45271 P 8c31bcf6ceaa411dba57437f661a6917 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85642702871f48d2a4811e71cf09ec44" member_type: VOTER last_known_addr { host: "127.17.136.1" port: 39629 } } peers { permanent_uuid: "3f232ccfc16f4e63ab07b0a0a0ecdeb3" member_type: VOTER last_known_addr { host: "127.17.136.2" port: 34359 } } peers { permanent_uuid: "8c31bcf6ceaa411dba57437f661a6917" member_type: VOTER last_known_addr { host: "127.17.136.3" port: 38959 } }
I20260927 15:12:35.404042 25966 ts_tablet_manager.cc:1428] T bbabcd446bc44eaeb64cbb56c5b45271 P 8c31bcf6ceaa411dba57437f661a6917: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260927 15:12:35.404320 25964 tablet_bootstrap.cc:654] T bbabcd446bc44eaeb64cbb56c5b45271 P 85642702871f48d2a4811e71cf09ec44: Neither blocks nor log segments found. Creating new log.
I20260927 15:12:35.404485 25965 tablet_bootstrap.cc:492] T bbabcd446bc44eaeb64cbb56c5b45271 P 3f232ccfc16f4e63ab07b0a0a0ecdeb3: Bootstrap starting.
I20260927 15:12:35.404570 25972 tablet_replica.cc:439] T bbabcd446bc44eaeb64cbb56c5b45271 P 8c31bcf6ceaa411dba57437f661a6917: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85642702871f48d2a4811e71cf09ec44" member_type: VOTER last_known_addr { host: "127.17.136.1" port: 39629 } } peers { permanent_uuid: "3f232ccfc16f4e63ab07b0a0a0ecdeb3" member_type: VOTER last_known_addr { host: "127.17.136.2" port: 34359 } } peers { permanent_uuid: "8c31bcf6ceaa411dba57437f661a6917" member_type: VOTER last_known_addr { host: "127.17.136.3" port: 38959 } } }
I20260927 15:12:35.404695 25972 tablet_replica.cc:442] T bbabcd446bc44eaeb64cbb56c5b45271 P 8c31bcf6ceaa411dba57437f661a6917: This TxnStatusTablet replica's current role is: FOLLOWER
I20260927 15:12:35.405383 25965 tablet_bootstrap.cc:654] T bbabcd446bc44eaeb64cbb56c5b45271 P 3f232ccfc16f4e63ab07b0a0a0ecdeb3: Neither blocks nor log segments found. Creating new log.
I20260927 15:12:35.405526 25964 tablet_bootstrap.cc:492] T bbabcd446bc44eaeb64cbb56c5b45271 P 85642702871f48d2a4811e71cf09ec44: No bootstrap required, opened a new log
I20260927 15:12:35.405613 25964 ts_tablet_manager.cc:1397] T bbabcd446bc44eaeb64cbb56c5b45271 P 85642702871f48d2a4811e71cf09ec44: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260927 15:12:35.406023 25964 raft_consensus.cc:348] T bbabcd446bc44eaeb64cbb56c5b45271 P 85642702871f48d2a4811e71cf09ec44 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85642702871f48d2a4811e71cf09ec44" member_type: VOTER last_known_addr { host: "127.17.136.1" port: 39629 } } peers { permanent_uuid: "3f232ccfc16f4e63ab07b0a0a0ecdeb3" member_type: VOTER last_known_addr { host: "127.17.136.2" port: 34359 } } peers { permanent_uuid: "8c31bcf6ceaa411dba57437f661a6917" member_type: VOTER last_known_addr { host: "127.17.136.3" port: 38959 } }
I20260927 15:12:35.406116 25964 raft_consensus.cc:374] T bbabcd446bc44eaeb64cbb56c5b45271 P 85642702871f48d2a4811e71cf09ec44 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:12:35.406144 25964 raft_consensus.cc:729] T bbabcd446bc44eaeb64cbb56c5b45271 P 85642702871f48d2a4811e71cf09ec44 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 85642702871f48d2a4811e71cf09ec44, State: Initialized, Role: FOLLOWER
I20260927 15:12:35.406275 25964 consensus_queue.cc:260] T bbabcd446bc44eaeb64cbb56c5b45271 P 85642702871f48d2a4811e71cf09ec44 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85642702871f48d2a4811e71cf09ec44" member_type: VOTER last_known_addr { host: "127.17.136.1" port: 39629 } } peers { permanent_uuid: "3f232ccfc16f4e63ab07b0a0a0ecdeb3" member_type: VOTER last_known_addr { host: "127.17.136.2" port: 34359 } } peers { permanent_uuid: "8c31bcf6ceaa411dba57437f661a6917" member_type: VOTER last_known_addr { host: "127.17.136.3" port: 38959 } }
I20260927 15:12:35.406558 25964 ts_tablet_manager.cc:1428] T bbabcd446bc44eaeb64cbb56c5b45271 P 85642702871f48d2a4811e71cf09ec44: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260927 15:12:35.406575 25965 tablet_bootstrap.cc:492] T bbabcd446bc44eaeb64cbb56c5b45271 P 3f232ccfc16f4e63ab07b0a0a0ecdeb3: No bootstrap required, opened a new log
I20260927 15:12:35.406528 25970 tablet_replica.cc:439] T bbabcd446bc44eaeb64cbb56c5b45271 P 85642702871f48d2a4811e71cf09ec44: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85642702871f48d2a4811e71cf09ec44" member_type: VOTER last_known_addr { host: "127.17.136.1" port: 39629 } } peers { permanent_uuid: "3f232ccfc16f4e63ab07b0a0a0ecdeb3" member_type: VOTER last_known_addr { host: "127.17.136.2" port: 34359 } } peers { permanent_uuid: "8c31bcf6ceaa411dba57437f661a6917" member_type: VOTER last_known_addr { host: "127.17.136.3" port: 38959 } } }
I20260927 15:12:35.406642 25965 ts_tablet_manager.cc:1397] T bbabcd446bc44eaeb64cbb56c5b45271 P 3f232ccfc16f4e63ab07b0a0a0ecdeb3: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.001s
I20260927 15:12:35.406653 25970 tablet_replica.cc:442] T bbabcd446bc44eaeb64cbb56c5b45271 P 85642702871f48d2a4811e71cf09ec44: This TxnStatusTablet replica's current role is: FOLLOWER
I20260927 15:12:35.407069 25965 raft_consensus.cc:348] T bbabcd446bc44eaeb64cbb56c5b45271 P 3f232ccfc16f4e63ab07b0a0a0ecdeb3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85642702871f48d2a4811e71cf09ec44" member_type: VOTER last_known_addr { host: "127.17.136.1" port: 39629 } } peers { permanent_uuid: "3f232ccfc16f4e63ab07b0a0a0ecdeb3" member_type: VOTER last_known_addr { host: "127.17.136.2" port: 34359 } } peers { permanent_uuid: "8c31bcf6ceaa411dba57437f661a6917" member_type: VOTER last_known_addr { host: "127.17.136.3" port: 38959 } }
I20260927 15:12:35.407178 25965 raft_consensus.cc:374] T bbabcd446bc44eaeb64cbb56c5b45271 P 3f232ccfc16f4e63ab07b0a0a0ecdeb3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:12:35.407208 25965 raft_consensus.cc:729] T bbabcd446bc44eaeb64cbb56c5b45271 P 3f232ccfc16f4e63ab07b0a0a0ecdeb3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f232ccfc16f4e63ab07b0a0a0ecdeb3, State: Initialized, Role: FOLLOWER
I20260927 15:12:35.407358 25965 consensus_queue.cc:260] T bbabcd446bc44eaeb64cbb56c5b45271 P 3f232ccfc16f4e63ab07b0a0a0ecdeb3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85642702871f48d2a4811e71cf09ec44" member_type: VOTER last_known_addr { host: "127.17.136.1" port: 39629 } } peers { permanent_uuid: "3f232ccfc16f4e63ab07b0a0a0ecdeb3" member_type: VOTER last_known_addr { host: "127.17.136.2" port: 34359 } } peers { permanent_uuid: "8c31bcf6ceaa411dba57437f661a6917" member_type: VOTER last_known_addr { host: "127.17.136.3" port: 38959 } }
I20260927 15:12:35.407595 25965 ts_tablet_manager.cc:1428] T bbabcd446bc44eaeb64cbb56c5b45271 P 3f232ccfc16f4e63ab07b0a0a0ecdeb3: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260927 15:12:35.408069 25971 tablet_replica.cc:439] T bbabcd446bc44eaeb64cbb56c5b45271 P 3f232ccfc16f4e63ab07b0a0a0ecdeb3: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85642702871f48d2a4811e71cf09ec44" member_type: VOTER last_known_addr { host: "127.17.136.1" port: 39629 } } peers { permanent_uuid: "3f232ccfc16f4e63ab07b0a0a0ecdeb3" member_type: VOTER last_known_addr { host: "127.17.136.2" port: 34359 } } peers { permanent_uuid: "8c31bcf6ceaa411dba57437f661a6917" member_type: VOTER last_known_addr { host: "127.17.136.3" port: 38959 } } }
I20260927 15:12:35.408185 25971 tablet_replica.cc:442] T bbabcd446bc44eaeb64cbb56c5b45271 P 3f232ccfc16f4e63ab07b0a0a0ecdeb3: This TxnStatusTablet replica's current role is: FOLLOWER
I20260927 15:12:35.473747 25972 raft_consensus.cc:482] T bbabcd446bc44eaeb64cbb56c5b45271 P 8c31bcf6ceaa411dba57437f661a6917 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:12:35.473888 25972 raft_consensus.cc:504] T bbabcd446bc44eaeb64cbb56c5b45271 P 8c31bcf6ceaa411dba57437f661a6917 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85642702871f48d2a4811e71cf09ec44" member_type: VOTER last_known_addr { host: "127.17.136.1" port: 39629 } } peers { permanent_uuid: "3f232ccfc16f4e63ab07b0a0a0ecdeb3" member_type: VOTER last_known_addr { host: "127.17.136.2" port: 34359 } } peers { permanent_uuid: "8c31bcf6ceaa411dba57437f661a6917" member_type: VOTER last_known_addr { host: "127.17.136.3" port: 38959 } }
I20260927 15:12:35.474324 25972 leader_election.cc:288] T bbabcd446bc44eaeb64cbb56c5b45271 P 8c31bcf6ceaa411dba57437f661a6917 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 85642702871f48d2a4811e71cf09ec44 (127.17.136.1:39629), 3f232ccfc16f4e63ab07b0a0a0ecdeb3 (127.17.136.2:34359)
I20260927 15:12:35.474819 25610 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bbabcd446bc44eaeb64cbb56c5b45271" candidate_uuid: "8c31bcf6ceaa411dba57437f661a6917" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85642702871f48d2a4811e71cf09ec44" is_pre_election: true
I20260927 15:12:35.474805 25750 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bbabcd446bc44eaeb64cbb56c5b45271" candidate_uuid: "8c31bcf6ceaa411dba57437f661a6917" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f232ccfc16f4e63ab07b0a0a0ecdeb3" is_pre_election: true
I20260927 15:12:35.474963 25610 raft_consensus.cc:2454] T bbabcd446bc44eaeb64cbb56c5b45271 P 85642702871f48d2a4811e71cf09ec44 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c31bcf6ceaa411dba57437f661a6917 in term 0.
I20260927 15:12:35.474967 25750 raft_consensus.cc:2454] T bbabcd446bc44eaeb64cbb56c5b45271 P 3f232ccfc16f4e63ab07b0a0a0ecdeb3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c31bcf6ceaa411dba57437f661a6917 in term 0.
I20260927 15:12:35.475235 25823 leader_election.cc:302] T bbabcd446bc44eaeb64cbb56c5b45271 P 8c31bcf6ceaa411dba57437f661a6917 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85642702871f48d2a4811e71cf09ec44, 8c31bcf6ceaa411dba57437f661a6917; no voters:
I20260927 15:12:35.475435 25972 raft_consensus.cc:2781] T bbabcd446bc44eaeb64cbb56c5b45271 P 8c31bcf6ceaa411dba57437f661a6917 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 15:12:35.475494 25972 raft_consensus.cc:482] T bbabcd446bc44eaeb64cbb56c5b45271 P 8c31bcf6ceaa411dba57437f661a6917 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 15:12:35.475538 25972 raft_consensus.cc:3037] T bbabcd446bc44eaeb64cbb56c5b45271 P 8c31bcf6ceaa411dba57437f661a6917 [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:12:35.476573 25972 raft_consensus.cc:504] T bbabcd446bc44eaeb64cbb56c5b45271 P 8c31bcf6ceaa411dba57437f661a6917 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85642702871f48d2a4811e71cf09ec44" member_type: VOTER last_known_addr { host: "127.17.136.1" port: 39629 } } peers { permanent_uuid: "3f232ccfc16f4e63ab07b0a0a0ecdeb3" member_type: VOTER last_known_addr { host: "127.17.136.2" port: 34359 } } peers { permanent_uuid: "8c31bcf6ceaa411dba57437f661a6917" member_type: VOTER last_known_addr { host: "127.17.136.3" port: 38959 } }
I20260927 15:12:35.476898 25972 leader_election.cc:288] T bbabcd446bc44eaeb64cbb56c5b45271 P 8c31bcf6ceaa411dba57437f661a6917 [CANDIDATE]: Term 1 election: Requested vote from peers 85642702871f48d2a4811e71cf09ec44 (127.17.136.1:39629), 3f232ccfc16f4e63ab07b0a0a0ecdeb3 (127.17.136.2:34359)
I20260927 15:12:35.477227 25610 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bbabcd446bc44eaeb64cbb56c5b45271" candidate_uuid: "8c31bcf6ceaa411dba57437f661a6917" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85642702871f48d2a4811e71cf09ec44"
I20260927 15:12:35.477348 25610 raft_consensus.cc:3037] T bbabcd446bc44eaeb64cbb56c5b45271 P 85642702871f48d2a4811e71cf09ec44 [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:12:35.477330 25750 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bbabcd446bc44eaeb64cbb56c5b45271" candidate_uuid: "8c31bcf6ceaa411dba57437f661a6917" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f232ccfc16f4e63ab07b0a0a0ecdeb3"
I20260927 15:12:35.477440 25750 raft_consensus.cc:3037] T bbabcd446bc44eaeb64cbb56c5b45271 P 3f232ccfc16f4e63ab07b0a0a0ecdeb3 [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:12:35.478456 25750 raft_consensus.cc:2454] T bbabcd446bc44eaeb64cbb56c5b45271 P 3f232ccfc16f4e63ab07b0a0a0ecdeb3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c31bcf6ceaa411dba57437f661a6917 in term 1.
I20260927 15:12:35.478469 25610 raft_consensus.cc:2454] T bbabcd446bc44eaeb64cbb56c5b45271 P 85642702871f48d2a4811e71cf09ec44 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c31bcf6ceaa411dba57437f661a6917 in term 1.
I20260927 15:12:35.478746 25821 leader_election.cc:302] T bbabcd446bc44eaeb64cbb56c5b45271 P 8c31bcf6ceaa411dba57437f661a6917 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 3f232ccfc16f4e63ab07b0a0a0ecdeb3, 85642702871f48d2a4811e71cf09ec44, 8c31bcf6ceaa411dba57437f661a6917; no voters:
I20260927 15:12:35.478906 25972 raft_consensus.cc:2781] T bbabcd446bc44eaeb64cbb56c5b45271 P 8c31bcf6ceaa411dba57437f661a6917 [term 1 FOLLOWER]: Leader election won for term 1
I20260927 15:12:35.479001 25972 raft_consensus.cc:686] T bbabcd446bc44eaeb64cbb56c5b45271 P 8c31bcf6ceaa411dba57437f661a6917 [term 1 LEADER]: Becoming Leader. State: Replica: 8c31bcf6ceaa411dba57437f661a6917, State: Running, Role: LEADER
I20260927 15:12:35.479136 25972 consensus_queue.cc:237] T bbabcd446bc44eaeb64cbb56c5b45271 P 8c31bcf6ceaa411dba57437f661a6917 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85642702871f48d2a4811e71cf09ec44" member_type: VOTER last_known_addr { host: "127.17.136.1" port: 39629 } } peers { permanent_uuid: "3f232ccfc16f4e63ab07b0a0a0ecdeb3" member_type: VOTER last_known_addr { host: "127.17.136.2" port: 34359 } } peers { permanent_uuid: "8c31bcf6ceaa411dba57437f661a6917" member_type: VOTER last_known_addr { host: "127.17.136.3" port: 38959 } }
I20260927 15:12:35.479764 25974 tablet_replica.cc:439] T bbabcd446bc44eaeb64cbb56c5b45271 P 8c31bcf6ceaa411dba57437f661a6917: TxnStatusTablet state changed. Reason: New leader 8c31bcf6ceaa411dba57437f661a6917. Latest consensus state: current_term: 1 leader_uuid: "8c31bcf6ceaa411dba57437f661a6917" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85642702871f48d2a4811e71cf09ec44" member_type: VOTER last_known_addr { host: "127.17.136.1" port: 39629 } } peers { permanent_uuid: "3f232ccfc16f4e63ab07b0a0a0ecdeb3" member_type: VOTER last_known_addr { host: "127.17.136.2" port: 34359 } } peers { permanent_uuid: "8c31bcf6ceaa411dba57437f661a6917" member_type: VOTER last_known_addr { host: "127.17.136.3" port: 38959 } } }
I20260927 15:12:35.479873 25974 tablet_replica.cc:442] T bbabcd446bc44eaeb64cbb56c5b45271 P 8c31bcf6ceaa411dba57437f661a6917: This TxnStatusTablet replica's current role is: LEADER
I20260927 15:12:35.480095 26006 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260927 15:12:35.480237 26006 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260927 15:12:35.480686 25451 catalog_manager.cc:5495] T bbabcd446bc44eaeb64cbb56c5b45271 P 8c31bcf6ceaa411dba57437f661a6917 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8c31bcf6ceaa411dba57437f661a6917 (127.17.136.3). New cstate: current_term: 1 leader_uuid: "8c31bcf6ceaa411dba57437f661a6917" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85642702871f48d2a4811e71cf09ec44" member_type: VOTER last_known_addr { host: "127.17.136.1" port: 39629 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f232ccfc16f4e63ab07b0a0a0ecdeb3" member_type: VOTER last_known_addr { host: "127.17.136.2" port: 34359 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c31bcf6ceaa411dba57437f661a6917" member_type: VOTER last_known_addr { host: "127.17.136.3" port: 38959 } health_report { overall_health: HEALTHY } } }
I20260927 15:12:35.503510 25961 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:35.500104 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56592 (local address 127.17.136.3:38959)
0927 15:12:35.500226 (+ 122us) server_negotiation.cc:206] Beginning negotiation
0927 15:12:35.500229 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0927 15:12:35.500245 (+ 16us) server_negotiation.cc:407] Connection header received
0927 15:12:35.500381 (+ 136us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:12:35.500383 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:12:35.500429 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:12:35.500504 (+ 75us) server_negotiation.cc:226] Negotiated authn=TOKEN
0927 15:12:35.500768 (+ 264us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:35.501296 (+ 528us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:35.502472 (+ 1176us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:35.502687 (+ 215us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:35.502775 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:35.503085 (+ 310us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0927 15:12:35.503161 (+ 76us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0927 15:12:35.503225 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0927 15:12:35.503353 (+ 128us) server_negotiation.cc:299] Negotiation successful
0927 15:12:35.503400 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260927 15:12:35.503564 26001 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:35.499988 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.3:38959 (local address 127.0.0.1:56592)
0927 15:12:35.500150 (+ 162us) negotiation.cc:107] Waiting for socket to connect
0927 15:12:35.500166 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0927 15:12:35.500264 (+ 98us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0927 15:12:35.500535 (+ 271us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0927 15:12:35.500538 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0927 15:12:35.500545 (+ 7us) client_negotiation.cc:189] Negotiated authn=TOKEN
0927 15:12:35.500669 (+ 124us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:12:35.500675 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:12:35.501399 (+ 724us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:12:35.501402 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:12:35.502350 (+ 948us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:12:35.502360 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:12:35.502787 (+ 427us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:12:35.502791 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:12:35.502885 (+ 94us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:35.502937 (+ 52us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0927 15:12:35.503242 (+ 305us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0927 15:12:35.503272 (+ 30us) client_negotiation.cc:769] Sending connection context
0927 15:12:35.503338 (+ 66us) client_negotiation.cc:240] Negotiation successful
0927 15:12:35.503421 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":52}
I20260927 15:12:35.505903 25610 raft_consensus.cc:1261] T bbabcd446bc44eaeb64cbb56c5b45271 P 85642702871f48d2a4811e71cf09ec44 [term 1 FOLLOWER]: Refusing update from remote peer 8c31bcf6ceaa411dba57437f661a6917: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260927 15:12:35.505916 25750 raft_consensus.cc:1261] T bbabcd446bc44eaeb64cbb56c5b45271 P 3f232ccfc16f4e63ab07b0a0a0ecdeb3 [term 1 FOLLOWER]: Refusing update from remote peer 8c31bcf6ceaa411dba57437f661a6917: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260927 15:12:35.506289 25972 consensus_queue.cc:1035] T bbabcd446bc44eaeb64cbb56c5b45271 P 8c31bcf6ceaa411dba57437f661a6917 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85642702871f48d2a4811e71cf09ec44" member_type: VOTER last_known_addr { host: "127.17.136.1" port: 39629 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260927 15:12:35.506469 25974 consensus_queue.cc:1035] T bbabcd446bc44eaeb64cbb56c5b45271 P 8c31bcf6ceaa411dba57437f661a6917 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f232ccfc16f4e63ab07b0a0a0ecdeb3" member_type: VOTER last_known_addr { host: "127.17.136.2" port: 34359 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260927 15:12:35.507858 25970 tablet_replica.cc:439] T bbabcd446bc44eaeb64cbb56c5b45271 P 85642702871f48d2a4811e71cf09ec44: TxnStatusTablet state changed. Reason: New leader 8c31bcf6ceaa411dba57437f661a6917. Latest consensus state: current_term: 1 leader_uuid: "8c31bcf6ceaa411dba57437f661a6917" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85642702871f48d2a4811e71cf09ec44" member_type: VOTER last_known_addr { host: "127.17.136.1" port: 39629 } } peers { permanent_uuid: "3f232ccfc16f4e63ab07b0a0a0ecdeb3" member_type: VOTER last_known_addr { host: "127.17.136.2" port: 34359 } } peers { permanent_uuid: "8c31bcf6ceaa411dba57437f661a6917" member_type: VOTER last_known_addr { host: "127.17.136.3" port: 38959 } } }
I20260927 15:12:35.507965 25970 tablet_replica.cc:442] T bbabcd446bc44eaeb64cbb56c5b45271 P 85642702871f48d2a4811e71cf09ec44: This TxnStatusTablet replica's current role is: FOLLOWER
I20260927 15:12:35.508164 25971 tablet_replica.cc:439] T bbabcd446bc44eaeb64cbb56c5b45271 P 3f232ccfc16f4e63ab07b0a0a0ecdeb3: TxnStatusTablet state changed. Reason: New leader 8c31bcf6ceaa411dba57437f661a6917. Latest consensus state: current_term: 1 leader_uuid: "8c31bcf6ceaa411dba57437f661a6917" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85642702871f48d2a4811e71cf09ec44" member_type: VOTER last_known_addr { host: "127.17.136.1" port: 39629 } } peers { permanent_uuid: "3f232ccfc16f4e63ab07b0a0a0ecdeb3" member_type: VOTER last_known_addr { host: "127.17.136.2" port: 34359 } } peers { permanent_uuid: "8c31bcf6ceaa411dba57437f661a6917" member_type: VOTER last_known_addr { host: "127.17.136.3" port: 38959 } } }
I20260927 15:12:35.508277 25971 tablet_replica.cc:442] T bbabcd446bc44eaeb64cbb56c5b45271 P 3f232ccfc16f4e63ab07b0a0a0ecdeb3: This TxnStatusTablet replica's current role is: FOLLOWER
I20260927 15:12:35.509793 25977 mvcc.cc:205] Tried to move back new op lower bound from 7333977929748365312 to 7333977929643933696. Current Snapshot: MvccSnapshot[applied={T|T < 7333977929748365312}]
I20260927 15:12:35.509910 25974 tablet_replica.cc:439] T bbabcd446bc44eaeb64cbb56c5b45271 P 8c31bcf6ceaa411dba57437f661a6917: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "8c31bcf6ceaa411dba57437f661a6917" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85642702871f48d2a4811e71cf09ec44" member_type: VOTER last_known_addr { host: "127.17.136.1" port: 39629 } } peers { permanent_uuid: "3f232ccfc16f4e63ab07b0a0a0ecdeb3" member_type: VOTER last_known_addr { host: "127.17.136.2" port: 34359 } } peers { permanent_uuid: "8c31bcf6ceaa411dba57437f661a6917" member_type: VOTER last_known_addr { host: "127.17.136.3" port: 38959 } } }
I20260927 15:12:35.510011 25974 tablet_replica.cc:442] T bbabcd446bc44eaeb64cbb56c5b45271 P 8c31bcf6ceaa411dba57437f661a6917: This TxnStatusTablet replica's current role is: LEADER
I20260927 15:12:35.510409 25978 mvcc.cc:205] Tried to move back new op lower bound from 7333977929748365312 to 7333977929643933696. Current Snapshot: MvccSnapshot[applied={T|T < 7333977929748365312}]
I20260927 15:12:35.510569 25970 tablet_replica.cc:439] T bbabcd446bc44eaeb64cbb56c5b45271 P 85642702871f48d2a4811e71cf09ec44: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "8c31bcf6ceaa411dba57437f661a6917" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85642702871f48d2a4811e71cf09ec44" member_type: VOTER last_known_addr { host: "127.17.136.1" port: 39629 } } peers { permanent_uuid: "3f232ccfc16f4e63ab07b0a0a0ecdeb3" member_type: VOTER last_known_addr { host: "127.17.136.2" port: 34359 } } peers { permanent_uuid: "8c31bcf6ceaa411dba57437f661a6917" member_type: VOTER last_known_addr { host: "127.17.136.3" port: 38959 } } }
I20260927 15:12:35.510654 25970 tablet_replica.cc:442] T bbabcd446bc44eaeb64cbb56c5b45271 P 85642702871f48d2a4811e71cf09ec44: This TxnStatusTablet replica's current role is: FOLLOWER
I20260927 15:12:35.512732 25972 tablet_replica.cc:439] T bbabcd446bc44eaeb64cbb56c5b45271 P 8c31bcf6ceaa411dba57437f661a6917: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "8c31bcf6ceaa411dba57437f661a6917" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85642702871f48d2a4811e71cf09ec44" member_type: VOTER last_known_addr { host: "127.17.136.1" port: 39629 } } peers { permanent_uuid: "3f232ccfc16f4e63ab07b0a0a0ecdeb3" member_type: VOTER last_known_addr { host: "127.17.136.2" port: 34359 } } peers { permanent_uuid: "8c31bcf6ceaa411dba57437f661a6917" member_type: VOTER last_known_addr { host: "127.17.136.3" port: 38959 } } }
I20260927 15:12:35.512835 25972 tablet_replica.cc:442] T bbabcd446bc44eaeb64cbb56c5b45271 P 8c31bcf6ceaa411dba57437f661a6917: This TxnStatusTablet replica's current role is: LEADER
I20260927 15:12:35.513777 25971 tablet_replica.cc:439] T bbabcd446bc44eaeb64cbb56c5b45271 P 3f232ccfc16f4e63ab07b0a0a0ecdeb3: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "8c31bcf6ceaa411dba57437f661a6917" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85642702871f48d2a4811e71cf09ec44" member_type: VOTER last_known_addr { host: "127.17.136.1" port: 39629 } } peers { permanent_uuid: "3f232ccfc16f4e63ab07b0a0a0ecdeb3" member_type: VOTER last_known_addr { host: "127.17.136.2" port: 34359 } } peers { permanent_uuid: "8c31bcf6ceaa411dba57437f661a6917" member_type: VOTER last_known_addr { host: "127.17.136.3" port: 38959 } } }
I20260927 15:12:35.513888 25971 tablet_replica.cc:442] T bbabcd446bc44eaeb64cbb56c5b45271 P 3f232ccfc16f4e63ab07b0a0a0ecdeb3: This TxnStatusTablet replica's current role is: FOLLOWER
I20260927 15:12:35.520264 25960 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:35.516237 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59938 (local address 127.17.136.2:34359)
0927 15:12:35.516346 (+ 109us) server_negotiation.cc:206] Beginning negotiation
0927 15:12:35.516350 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0927 15:12:35.516365 (+ 15us) server_negotiation.cc:407] Connection header received
0927 15:12:35.516501 (+ 136us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:12:35.516504 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:12:35.516563 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:12:35.516669 (+ 106us) server_negotiation.cc:226] Negotiated authn=TOKEN
0927 15:12:35.516845 (+ 176us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:35.517581 (+ 736us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:35.518407 (+ 826us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:35.518755 (+ 348us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:35.518851 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:35.519171 (+ 320us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0927 15:12:35.519799 (+ 628us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0927 15:12:35.519912 (+ 113us) server_negotiation.cc:1035] Waiting for connection context
0927 15:12:35.520053 (+ 141us) server_negotiation.cc:299] Negotiation successful
0927 15:12:35.520117 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260927 15:12:35.531862 25961 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:35.528293 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.136.2:50769 (local address 127.17.136.3:38959)
0927 15:12:35.528434 (+ 141us) server_negotiation.cc:206] Beginning negotiation
0927 15:12:35.528438 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0927 15:12:35.528546 (+ 108us) server_negotiation.cc:407] Connection header received
0927 15:12:35.528692 (+ 146us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:12:35.528695 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:12:35.528746 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:12:35.528806 (+ 60us) server_negotiation.cc:226] Negotiated authn=TOKEN
0927 15:12:35.529144 (+ 338us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:35.529770 (+ 626us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:35.530788 (+ 1018us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:35.531012 (+ 224us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:35.531099 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:35.531424 (+ 325us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0927 15:12:35.531502 (+ 78us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0927 15:12:35.531569 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0927 15:12:35.531662 (+ 93us) server_negotiation.cc:299] Negotiation successful
0927 15:12:35.531716 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260927 15:12:35.532145 26014 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:35.528171 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.3:38959 (local address 127.17.136.2:50769)
0927 15:12:35.528465 (+ 294us) negotiation.cc:107] Waiting for socket to connect
0927 15:12:35.528478 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0927 15:12:35.528589 (+ 111us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0927 15:12:35.528822 (+ 233us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0927 15:12:35.528824 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0927 15:12:35.528831 (+ 7us) client_negotiation.cc:189] Negotiated authn=TOKEN
0927 15:12:35.529004 (+ 173us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:12:35.529015 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:12:35.529907 (+ 892us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:12:35.529911 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:12:35.530677 (+ 766us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:12:35.530686 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:12:35.531112 (+ 426us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:12:35.531116 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:12:35.531211 (+ 95us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:35.531288 (+ 77us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0927 15:12:35.531584 (+ 296us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0927 15:12:35.531591 (+ 7us) client_negotiation.cc:769] Sending connection context
0927 15:12:35.531644 (+ 53us) client_negotiation.cc:240] Negotiation successful
0927 15:12:35.531724 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":198,"thread_start_us":100,"threads_started":1}
I20260927 15:12:35.539469 25610 raft_consensus.cc:1261] T 6e0db5f07f074d4ebf6c98e9f7059ab0 P 85642702871f48d2a4811e71cf09ec44 [term 1 FOLLOWER]: Refusing update from remote peer 3f232ccfc16f4e63ab07b0a0a0ecdeb3: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260927 15:12:35.539844 25890 raft_consensus.cc:1261] T 6e0db5f07f074d4ebf6c98e9f7059ab0 P 8c31bcf6ceaa411dba57437f661a6917 [term 1 FOLLOWER]: Refusing update from remote peer 3f232ccfc16f4e63ab07b0a0a0ecdeb3: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260927 15:12:35.539933 25971 consensus_queue.cc:1035] T 6e0db5f07f074d4ebf6c98e9f7059ab0 P 3f232ccfc16f4e63ab07b0a0a0ecdeb3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85642702871f48d2a4811e71cf09ec44" member_type: VOTER last_known_addr { host: "127.17.136.1" port: 39629 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260927 15:12:35.540438 25971 consensus_queue.cc:1035] T 6e0db5f07f074d4ebf6c98e9f7059ab0 P 3f232ccfc16f4e63ab07b0a0a0ecdeb3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c31bcf6ceaa411dba57437f661a6917" member_type: VOTER last_known_addr { host: "127.17.136.3" port: 38959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260927 15:12:35.561414 25960 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:35.557824 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.136.3:42815 (local address 127.17.136.2:34359)
0927 15:12:35.557935 (+ 111us) server_negotiation.cc:206] Beginning negotiation
0927 15:12:35.557940 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0927 15:12:35.558167 (+ 227us) server_negotiation.cc:407] Connection header received
0927 15:12:35.558279 (+ 112us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:12:35.558283 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:12:35.558349 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:12:35.558405 (+ 56us) server_negotiation.cc:226] Negotiated authn=TOKEN
0927 15:12:35.558658 (+ 253us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:35.559315 (+ 657us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:35.560495 (+ 1180us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:35.560707 (+ 212us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:35.560778 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:35.561057 (+ 279us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0927 15:12:35.561121 (+ 64us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0927 15:12:35.561166 (+ 45us) server_negotiation.cc:1035] Waiting for connection context
0927 15:12:35.561260 (+ 94us) server_negotiation.cc:299] Negotiation successful
0927 15:12:35.561304 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260927 15:12:35.561517 26018 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:35.557763 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.2:34359 (local address 127.17.136.3:42815)
0927 15:12:35.558092 (+ 329us) negotiation.cc:107] Waiting for socket to connect
0927 15:12:35.558104 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0927 15:12:35.558202 (+ 98us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0927 15:12:35.558428 (+ 226us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0927 15:12:35.558430 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0927 15:12:35.558438 (+ 8us) client_negotiation.cc:189] Negotiated authn=TOKEN
0927 15:12:35.558547 (+ 109us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:12:35.558552 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:12:35.559398 (+ 846us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:12:35.559401 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:12:35.560368 (+ 967us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:12:35.560379 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:12:35.560798 (+ 419us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:12:35.560801 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:12:35.560889 (+ 88us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:35.560945 (+ 56us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0927 15:12:35.561185 (+ 240us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0927 15:12:35.561190 (+ 5us) client_negotiation.cc:769] Sending connection context
0927 15:12:35.561244 (+ 54us) client_negotiation.cc:240] Negotiation successful
0927 15:12:35.561321 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":224,"thread_start_us":125,"threads_started":1}
I20260927 15:12:35.589443 25453 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:42298:
table { table_name: "test-table" } modify_external_catalogs: true
I20260927 15:12:35.589598 25453 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:42298:
table { table_name: "test-table" } modify_external_catalogs: true
I20260927 15:12:35.591621 25453 catalog_manager.cc:5782] T 00000000000000000000000000000000 P e567bae41ac64f3aa35dce62bd53dc51: Sending DeleteTablet for 3 replicas of tablet 6e0db5f07f074d4ebf6c98e9f7059ab0
I20260927 15:12:35.592250 25590 tablet_service.cc:1514] Processing DeleteTablet for tablet 6e0db5f07f074d4ebf6c98e9f7059ab0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:12:35 UTC) from {username='oryx', principal='oryx/127.17.136.62@KRBTEST.COM'} at 127.0.0.1:47094
I20260927 15:12:35.592391 25867 tablet_service.cc:1514] Processing DeleteTablet for tablet 6e0db5f07f074d4ebf6c98e9f7059ab0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:12:35 UTC) from {username='oryx', principal='oryx/127.17.136.62@KRBTEST.COM'} at 127.0.0.1:56574
I20260927 15:12:35.592451 25988 tablet_replica.cc:330] T 6e0db5f07f074d4ebf6c98e9f7059ab0 P 85642702871f48d2a4811e71cf09ec44: stopping tablet replica
I20260927 15:12:35.592554 25988 raft_consensus.cc:2229] T 6e0db5f07f074d4ebf6c98e9f7059ab0 P 85642702871f48d2a4811e71cf09ec44 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260927 15:12:35.592670 25988 raft_consensus.cc:2258] T 6e0db5f07f074d4ebf6c98e9f7059ab0 P 85642702871f48d2a4811e71cf09ec44 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 15:12:35.592833 25986 tablet_replica.cc:330] T 6e0db5f07f074d4ebf6c98e9f7059ab0 P 8c31bcf6ceaa411dba57437f661a6917: stopping tablet replica
I20260927 15:12:35.592959 25986 raft_consensus.cc:2229] T 6e0db5f07f074d4ebf6c98e9f7059ab0 P 8c31bcf6ceaa411dba57437f661a6917 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260927 15:12:35.593072 25986 raft_consensus.cc:2258] T 6e0db5f07f074d4ebf6c98e9f7059ab0 P 8c31bcf6ceaa411dba57437f661a6917 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 15:12:35.593498 25730 tablet_service.cc:1514] Processing DeleteTablet for tablet 6e0db5f07f074d4ebf6c98e9f7059ab0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:12:35 UTC) from {username='oryx', principal='oryx/127.17.136.62@KRBTEST.COM'} at 127.0.0.1:59930
I20260927 15:12:35.593665 25987 tablet_replica.cc:330] T 6e0db5f07f074d4ebf6c98e9f7059ab0 P 3f232ccfc16f4e63ab07b0a0a0ecdeb3: stopping tablet replica
I20260927 15:12:35.593762 25987 raft_consensus.cc:2229] T 6e0db5f07f074d4ebf6c98e9f7059ab0 P 3f232ccfc16f4e63ab07b0a0a0ecdeb3 [term 1 LEADER]: Raft consensus shutting down.
I20260927 15:12:35.594075 25987 raft_consensus.cc:2258] T 6e0db5f07f074d4ebf6c98e9f7059ab0 P 3f232ccfc16f4e63ab07b0a0a0ecdeb3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 15:12:35.594301 25988 ts_tablet_manager.cc:1905] T 6e0db5f07f074d4ebf6c98e9f7059ab0 P 85642702871f48d2a4811e71cf09ec44: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:12:35.594818 25987 ts_tablet_manager.cc:1905] T 6e0db5f07f074d4ebf6c98e9f7059ab0 P 3f232ccfc16f4e63ab07b0a0a0ecdeb3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:12:35.596678 25988 ts_tablet_manager.cc:1918] T 6e0db5f07f074d4ebf6c98e9f7059ab0 P 85642702871f48d2a4811e71cf09ec44: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260927 15:12:35.596748 25988 log.cc:1196] T 6e0db5f07f074d4ebf6c98e9f7059ab0 P 85642702871f48d2a4811e71cf09ec44: Deleting WAL directory at /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790521920546562-17952-0/minicluster-data/ts-0/wal/wals/6e0db5f07f074d4ebf6c98e9f7059ab0
I20260927 15:12:35.596959 25988 ts_tablet_manager.cc:1939] T 6e0db5f07f074d4ebf6c98e9f7059ab0 P 85642702871f48d2a4811e71cf09ec44: Deleting consensus metadata
I20260927 15:12:35.597630 25987 ts_tablet_manager.cc:1918] T 6e0db5f07f074d4ebf6c98e9f7059ab0 P 3f232ccfc16f4e63ab07b0a0a0ecdeb3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260927 15:12:35.597641 25439 catalog_manager.cc:4841] TS 85642702871f48d2a4811e71cf09ec44 (127.17.136.1:39629): tablet 6e0db5f07f074d4ebf6c98e9f7059ab0 (table test-table [id=2797273e7d1247c7bdfaea5d799b65a5]) successfully deleted
I20260927 15:12:35.597705 25987 log.cc:1196] T 6e0db5f07f074d4ebf6c98e9f7059ab0 P 3f232ccfc16f4e63ab07b0a0a0ecdeb3: Deleting WAL directory at /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790521920546562-17952-0/minicluster-data/ts-1/wal/wals/6e0db5f07f074d4ebf6c98e9f7059ab0
I20260927 15:12:35.597949 25987 ts_tablet_manager.cc:1939] T 6e0db5f07f074d4ebf6c98e9f7059ab0 P 3f232ccfc16f4e63ab07b0a0a0ecdeb3: Deleting consensus metadata
I20260927 15:12:35.598290 25986 ts_tablet_manager.cc:1905] T 6e0db5f07f074d4ebf6c98e9f7059ab0 P 8c31bcf6ceaa411dba57437f661a6917: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:12:35.598618 25437 catalog_manager.cc:4841] TS 3f232ccfc16f4e63ab07b0a0a0ecdeb3 (127.17.136.2:34359): tablet 6e0db5f07f074d4ebf6c98e9f7059ab0 (table test-table [id=2797273e7d1247c7bdfaea5d799b65a5]) successfully deleted
I20260927 15:12:35.600417 25986 ts_tablet_manager.cc:1918] T 6e0db5f07f074d4ebf6c98e9f7059ab0 P 8c31bcf6ceaa411dba57437f661a6917: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260927 15:12:35.600482 25986 log.cc:1196] T 6e0db5f07f074d4ebf6c98e9f7059ab0 P 8c31bcf6ceaa411dba57437f661a6917: Deleting WAL directory at /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790521920546562-17952-0/minicluster-data/ts-2/wal/wals/6e0db5f07f074d4ebf6c98e9f7059ab0
I20260927 15:12:35.600665 25986 ts_tablet_manager.cc:1939] T 6e0db5f07f074d4ebf6c98e9f7059ab0 P 8c31bcf6ceaa411dba57437f661a6917: Deleting consensus metadata
I20260927 15:12:35.601245 25438 catalog_manager.cc:4841] TS 8c31bcf6ceaa411dba57437f661a6917 (127.17.136.3:38959): tablet 6e0db5f07f074d4ebf6c98e9f7059ab0 (table test-table [id=2797273e7d1247c7bdfaea5d799b65a5]) successfully deleted
Sep 27 15:12:35 dist-test-slave-5s2t krb5kdc[25408](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790521955, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Sep 27 15:12:35 dist-test-slave-5s2t krb5kdc[25408](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-admin@KRBTEST.COM for kudu/127.17.136.62@KRBTEST.COM, Server not found in Kerberos database
Sep 27 15:12:35 dist-test-slave-5s2t krb5kdc[25408](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-admin@KRBTEST.COM for kudu/127.17.136.62@KRBTEST.COM, Server not found in Kerberos database
W20260927 15:12:35.634999 25502 negotiation.cc:337] Failed RPC negotiation. Trace:
0927 15:12:35.626916 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42324 (local address 127.17.136.62:46025)
0927 15:12:35.627050 (+ 134us) server_negotiation.cc:206] Beginning negotiation
0927 15:12:35.627055 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0927 15:12:35.627368 (+ 313us) server_negotiation.cc:407] Connection header received
0927 15:12:35.627503 (+ 135us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:12:35.627507 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:12:35.627564 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:12:35.627649 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0927 15:12:35.628509 (+ 860us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:35.629369 (+ 860us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:35.630704 (+ 1335us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:35.631051 (+ 347us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:35.631152 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:35.634861 (+ 3709us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:42324: BlockingRecv error: recv got EOF from 127.0.0.1:42324 (error 108)
Metrics: {"server-negotiator.queue_time_us":53}
Sep 27 15:12:35 dist-test-slave-5s2t krb5kdc[25408](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790521955, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.17.136.62@KRBTEST.COM
I20260927 15:12:35.647562 25502 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:35.637482 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42336 (local address 127.17.136.62:46025)
0927 15:12:35.637619 (+ 137us) server_negotiation.cc:206] Beginning negotiation
0927 15:12:35.637624 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0927 15:12:35.637791 (+ 167us) server_negotiation.cc:407] Connection header received
0927 15:12:35.637996 (+ 205us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:12:35.637999 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:12:35.638049 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:12:35.638122 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0927 15:12:35.638872 (+ 750us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:35.639702 (+ 830us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:35.640858 (+ 1156us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:35.641224 (+ 366us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:35.641322 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:35.644311 (+ 2989us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0927 15:12:35.644315 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0927 15:12:35.644318 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0927 15:12:35.644348 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0927 15:12:35.645890 (+ 1542us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:12:35.646329 (+ 439us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:12:35.646333 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:12:35.646335 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:12:35.646423 (+ 88us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:12:35.646669 (+ 246us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:12:35.646671 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:12:35.646673 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:12:35.646884 (+ 211us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0927 15:12:35.647005 (+ 121us) server_negotiation.cc:1035] Waiting for connection context
0927 15:12:35.647236 (+ 231us) server_negotiation.cc:299] Negotiation successful
0927 15:12:35.647397 (+ 161us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260927 15:12:35.650467 25453 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:42336:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:12:35.650940 25453 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:12:35.656152 25590 tablet_service.cc:1467] Processing CreateTablet for tablet 85238ff8a6274049ac1b3ce0d546518e (DEFAULT_TABLE table=test-table [id=6dacdcbf87a84a6bacd0cbd1d4c15b38]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:12:35.656459 25590 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 85238ff8a6274049ac1b3ce0d546518e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:12:35.659018 25867 tablet_service.cc:1467] Processing CreateTablet for tablet 85238ff8a6274049ac1b3ce0d546518e (DEFAULT_TABLE table=test-table [id=6dacdcbf87a84a6bacd0cbd1d4c15b38]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:12:35.659344 25867 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 85238ff8a6274049ac1b3ce0d546518e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:12:35.659456 25964 tablet_bootstrap.cc:492] T 85238ff8a6274049ac1b3ce0d546518e P 85642702871f48d2a4811e71cf09ec44: Bootstrap starting.
I20260927 15:12:35.660262 25964 tablet_bootstrap.cc:654] T 85238ff8a6274049ac1b3ce0d546518e P 85642702871f48d2a4811e71cf09ec44: Neither blocks nor log segments found. Creating new log.
I20260927 15:12:35.660996 25730 tablet_service.cc:1467] Processing CreateTablet for tablet 85238ff8a6274049ac1b3ce0d546518e (DEFAULT_TABLE table=test-table [id=6dacdcbf87a84a6bacd0cbd1d4c15b38]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:12:35.661240 25730 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 85238ff8a6274049ac1b3ce0d546518e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:12:35.661681 25966 tablet_bootstrap.cc:492] T 85238ff8a6274049ac1b3ce0d546518e P 8c31bcf6ceaa411dba57437f661a6917: Bootstrap starting.
I20260927 15:12:35.662488 25966 tablet_bootstrap.cc:654] T 85238ff8a6274049ac1b3ce0d546518e P 8c31bcf6ceaa411dba57437f661a6917: Neither blocks nor log segments found. Creating new log.
I20260927 15:12:35.663553 25965 tablet_bootstrap.cc:492] T 85238ff8a6274049ac1b3ce0d546518e P 3f232ccfc16f4e63ab07b0a0a0ecdeb3: Bootstrap starting.
I20260927 15:12:35.663760 25964 tablet_bootstrap.cc:492] T 85238ff8a6274049ac1b3ce0d546518e P 85642702871f48d2a4811e71cf09ec44: No bootstrap required, opened a new log
I20260927 15:12:35.663849 25964 ts_tablet_manager.cc:1397] T 85238ff8a6274049ac1b3ce0d546518e P 85642702871f48d2a4811e71cf09ec44: Time spent bootstrapping tablet: real 0.004s user 0.001s sys 0.000s
I20260927 15:12:35.664548 25965 tablet_bootstrap.cc:654] T 85238ff8a6274049ac1b3ce0d546518e P 3f232ccfc16f4e63ab07b0a0a0ecdeb3: Neither blocks nor log segments found. Creating new log.
I20260927 15:12:35.664867 25966 tablet_bootstrap.cc:492] T 85238ff8a6274049ac1b3ce0d546518e P 8c31bcf6ceaa411dba57437f661a6917: No bootstrap required, opened a new log
I20260927 15:12:35.664952 25966 ts_tablet_manager.cc:1397] T 85238ff8a6274049ac1b3ce0d546518e P 8c31bcf6ceaa411dba57437f661a6917: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20260927 15:12:35.664424 25964 raft_consensus.cc:348] T 85238ff8a6274049ac1b3ce0d546518e P 85642702871f48d2a4811e71cf09ec44 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85642702871f48d2a4811e71cf09ec44" member_type: VOTER last_known_addr { host: "127.17.136.1" port: 39629 } } peers { permanent_uuid: "3f232ccfc16f4e63ab07b0a0a0ecdeb3" member_type: VOTER last_known_addr { host: "127.17.136.2" port: 34359 } } peers { permanent_uuid: "8c31bcf6ceaa411dba57437f661a6917" member_type: VOTER last_known_addr { host: "127.17.136.3" port: 38959 } }
I20260927 15:12:35.665141 25964 raft_consensus.cc:374] T 85238ff8a6274049ac1b3ce0d546518e P 85642702871f48d2a4811e71cf09ec44 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:12:35.665186 25964 raft_consensus.cc:729] T 85238ff8a6274049ac1b3ce0d546518e P 85642702871f48d2a4811e71cf09ec44 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 85642702871f48d2a4811e71cf09ec44, State: Initialized, Role: FOLLOWER
I20260927 15:12:35.665315 25964 consensus_queue.cc:260] T 85238ff8a6274049ac1b3ce0d546518e P 85642702871f48d2a4811e71cf09ec44 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85642702871f48d2a4811e71cf09ec44" member_type: VOTER last_known_addr { host: "127.17.136.1" port: 39629 } } peers { permanent_uuid: "3f232ccfc16f4e63ab07b0a0a0ecdeb3" member_type: VOTER last_known_addr { host: "127.17.136.2" port: 34359 } } peers { permanent_uuid: "8c31bcf6ceaa411dba57437f661a6917" member_type: VOTER last_known_addr { host: "127.17.136.3" port: 38959 } }
I20260927 15:12:35.665305 25966 raft_consensus.cc:348] T 85238ff8a6274049ac1b3ce0d546518e P 8c31bcf6ceaa411dba57437f661a6917 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85642702871f48d2a4811e71cf09ec44" member_type: VOTER last_known_addr { host: "127.17.136.1" port: 39629 } } peers { permanent_uuid: "3f232ccfc16f4e63ab07b0a0a0ecdeb3" member_type: VOTER last_known_addr { host: "127.17.136.2" port: 34359 } } peers { permanent_uuid: "8c31bcf6ceaa411dba57437f661a6917" member_type: VOTER last_known_addr { host: "127.17.136.3" port: 38959 } }
I20260927 15:12:35.665414 25966 raft_consensus.cc:374] T 85238ff8a6274049ac1b3ce0d546518e P 8c31bcf6ceaa411dba57437f661a6917 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:12:35.665452 25966 raft_consensus.cc:729] T 85238ff8a6274049ac1b3ce0d546518e P 8c31bcf6ceaa411dba57437f661a6917 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8c31bcf6ceaa411dba57437f661a6917, State: Initialized, Role: FOLLOWER
I20260927 15:12:35.665578 25964 ts_tablet_manager.cc:1428] T 85238ff8a6274049ac1b3ce0d546518e P 85642702871f48d2a4811e71cf09ec44: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260927 15:12:35.665558 25966 consensus_queue.cc:260] T 85238ff8a6274049ac1b3ce0d546518e P 8c31bcf6ceaa411dba57437f661a6917 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85642702871f48d2a4811e71cf09ec44" member_type: VOTER last_known_addr { host: "127.17.136.1" port: 39629 } } peers { permanent_uuid: "3f232ccfc16f4e63ab07b0a0a0ecdeb3" member_type: VOTER last_known_addr { host: "127.17.136.2" port: 34359 } } peers { permanent_uuid: "8c31bcf6ceaa411dba57437f661a6917" member_type: VOTER last_known_addr { host: "127.17.136.3" port: 38959 } }
I20260927 15:12:35.665779 25966 ts_tablet_manager.cc:1428] T 85238ff8a6274049ac1b3ce0d546518e P 8c31bcf6ceaa411dba57437f661a6917: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260927 15:12:35.666347 25965 tablet_bootstrap.cc:492] T 85238ff8a6274049ac1b3ce0d546518e P 3f232ccfc16f4e63ab07b0a0a0ecdeb3: No bootstrap required, opened a new log
I20260927 15:12:35.666443 25965 ts_tablet_manager.cc:1397] T 85238ff8a6274049ac1b3ce0d546518e P 3f232ccfc16f4e63ab07b0a0a0ecdeb3: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260927 15:12:35.666926 25965 raft_consensus.cc:348] T 85238ff8a6274049ac1b3ce0d546518e P 3f232ccfc16f4e63ab07b0a0a0ecdeb3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85642702871f48d2a4811e71cf09ec44" member_type: VOTER last_known_addr { host: "127.17.136.1" port: 39629 } } peers { permanent_uuid: "3f232ccfc16f4e63ab07b0a0a0ecdeb3" member_type: VOTER last_known_addr { host: "127.17.136.2" port: 34359 } } peers { permanent_uuid: "8c31bcf6ceaa411dba57437f661a6917" member_type: VOTER last_known_addr { host: "127.17.136.3" port: 38959 } }
I20260927 15:12:35.667052 25965 raft_consensus.cc:374] T 85238ff8a6274049ac1b3ce0d546518e P 3f232ccfc16f4e63ab07b0a0a0ecdeb3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:12:35.667088 25965 raft_consensus.cc:729] T 85238ff8a6274049ac1b3ce0d546518e P 3f232ccfc16f4e63ab07b0a0a0ecdeb3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f232ccfc16f4e63ab07b0a0a0ecdeb3, State: Initialized, Role: FOLLOWER
I20260927 15:12:35.667196 25965 consensus_queue.cc:260] T 85238ff8a6274049ac1b3ce0d546518e P 3f232ccfc16f4e63ab07b0a0a0ecdeb3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85642702871f48d2a4811e71cf09ec44" member_type: VOTER last_known_addr { host: "127.17.136.1" port: 39629 } } peers { permanent_uuid: "3f232ccfc16f4e63ab07b0a0a0ecdeb3" member_type: VOTER last_known_addr { host: "127.17.136.2" port: 34359 } } peers { permanent_uuid: "8c31bcf6ceaa411dba57437f661a6917" member_type: VOTER last_known_addr { host: "127.17.136.3" port: 38959 } }
I20260927 15:12:35.667493 25965 ts_tablet_manager.cc:1428] T 85238ff8a6274049ac1b3ce0d546518e P 3f232ccfc16f4e63ab07b0a0a0ecdeb3: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260927 15:12:35.936152 25970 raft_consensus.cc:482] T 85238ff8a6274049ac1b3ce0d546518e P 85642702871f48d2a4811e71cf09ec44 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:12:35.936290 25970 raft_consensus.cc:504] T 85238ff8a6274049ac1b3ce0d546518e P 85642702871f48d2a4811e71cf09ec44 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85642702871f48d2a4811e71cf09ec44" member_type: VOTER last_known_addr { host: "127.17.136.1" port: 39629 } } peers { permanent_uuid: "3f232ccfc16f4e63ab07b0a0a0ecdeb3" member_type: VOTER last_known_addr { host: "127.17.136.2" port: 34359 } } peers { permanent_uuid: "8c31bcf6ceaa411dba57437f661a6917" member_type: VOTER last_known_addr { host: "127.17.136.3" port: 38959 } }
I20260927 15:12:35.937412 25970 leader_election.cc:288] T 85238ff8a6274049ac1b3ce0d546518e P 85642702871f48d2a4811e71cf09ec44 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3f232ccfc16f4e63ab07b0a0a0ecdeb3 (127.17.136.2:34359), 8c31bcf6ceaa411dba57437f661a6917 (127.17.136.3:38959)
I20260927 15:12:35.942071 25960 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:35.938052 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.136.1:60843 (local address 127.17.136.2:34359)
0927 15:12:35.938168 (+ 116us) server_negotiation.cc:206] Beginning negotiation
0927 15:12:35.938172 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0927 15:12:35.938185 (+ 13us) server_negotiation.cc:407] Connection header received
0927 15:12:35.938230 (+ 45us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:12:35.938232 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:12:35.938275 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:12:35.938341 (+ 66us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0927 15:12:35.938656 (+ 315us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:35.939429 (+ 773us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:35.940933 (+ 1504us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:35.941531 (+ 598us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:35.941648 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:35.941699 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0927 15:12:35.941884 (+ 185us) server_negotiation.cc:299] Negotiation successful
0927 15:12:35.941963 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260927 15:12:35.942145 26039 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:35.937693 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.3:38959 (local address 127.17.136.1:54969)
0927 15:12:35.937956 (+ 263us) negotiation.cc:107] Waiting for socket to connect
0927 15:12:35.937969 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0927 15:12:35.938070 (+ 101us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0927 15:12:35.938291 (+ 221us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0927 15:12:35.938293 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0927 15:12:35.938308 (+ 15us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0927 15:12:35.938416 (+ 108us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:12:35.938423 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:12:35.939444 (+ 1021us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:12:35.939448 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:12:35.940812 (+ 1364us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:12:35.940824 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:12:35.941645 (+ 821us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:12:35.941649 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:12:35.941755 (+ 106us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:35.941788 (+ 33us) client_negotiation.cc:769] Sending connection context
0927 15:12:35.941861 (+ 73us) client_negotiation.cc:240] Negotiation successful
0927 15:12:35.941940 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":197,"mutex_wait_us":67,"thread_start_us":79,"threads_started":1}
I20260927 15:12:35.942175 26038 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:35.937639 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.2:34359 (local address 127.17.136.1:60843)
0927 15:12:35.937881 (+ 242us) negotiation.cc:107] Waiting for socket to connect
0927 15:12:35.937897 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0927 15:12:35.938018 (+ 121us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0927 15:12:35.938428 (+ 410us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0927 15:12:35.938431 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0927 15:12:35.938445 (+ 14us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0927 15:12:35.938553 (+ 108us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:12:35.938559 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:12:35.939515 (+ 956us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:12:35.939518 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:12:35.940813 (+ 1295us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:12:35.940823 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:12:35.941661 (+ 838us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:12:35.941665 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:12:35.941760 (+ 95us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:35.941787 (+ 27us) client_negotiation.cc:769] Sending connection context
0927 15:12:35.941861 (+ 74us) client_negotiation.cc:240] Negotiation successful
0927 15:12:35.941940 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":167,"mutex_wait_us":33,"thread_start_us":95,"threads_started":1}
I20260927 15:12:35.942458 25961 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:35.937772 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.136.1:54969 (local address 127.17.136.3:38959)
0927 15:12:35.937896 (+ 124us) server_negotiation.cc:206] Beginning negotiation
0927 15:12:35.937901 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0927 15:12:35.938040 (+ 139us) server_negotiation.cc:407] Connection header received
0927 15:12:35.938171 (+ 131us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:12:35.938174 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:12:35.938214 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:12:35.938270 (+ 56us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0927 15:12:35.938509 (+ 239us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:35.939331 (+ 822us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:35.940933 (+ 1602us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:35.941545 (+ 612us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:35.941648 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:35.941699 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0927 15:12:35.942255 (+ 556us) server_negotiation.cc:299] Negotiation successful
0927 15:12:35.942333 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260927 15:12:35.942800 25750 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "85238ff8a6274049ac1b3ce0d546518e" candidate_uuid: "85642702871f48d2a4811e71cf09ec44" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f232ccfc16f4e63ab07b0a0a0ecdeb3" is_pre_election: true
I20260927 15:12:35.942952 25750 raft_consensus.cc:2454] T 85238ff8a6274049ac1b3ce0d546518e P 3f232ccfc16f4e63ab07b0a0a0ecdeb3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85642702871f48d2a4811e71cf09ec44 in term 0.
I20260927 15:12:35.943030 25890 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "85238ff8a6274049ac1b3ce0d546518e" candidate_uuid: "85642702871f48d2a4811e71cf09ec44" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c31bcf6ceaa411dba57437f661a6917" is_pre_election: true
I20260927 15:12:35.943154 25890 raft_consensus.cc:2454] T 85238ff8a6274049ac1b3ce0d546518e P 8c31bcf6ceaa411dba57437f661a6917 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85642702871f48d2a4811e71cf09ec44 in term 0.
I20260927 15:12:35.943327 25541 leader_election.cc:302] T 85238ff8a6274049ac1b3ce0d546518e P 85642702871f48d2a4811e71cf09ec44 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f232ccfc16f4e63ab07b0a0a0ecdeb3, 85642702871f48d2a4811e71cf09ec44; no voters:
I20260927 15:12:35.943578 25970 raft_consensus.cc:2781] T 85238ff8a6274049ac1b3ce0d546518e P 85642702871f48d2a4811e71cf09ec44 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 15:12:35.943634 25970 raft_consensus.cc:482] T 85238ff8a6274049ac1b3ce0d546518e P 85642702871f48d2a4811e71cf09ec44 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 15:12:35.943674 25970 raft_consensus.cc:3037] T 85238ff8a6274049ac1b3ce0d546518e P 85642702871f48d2a4811e71cf09ec44 [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:12:35.944636 25970 raft_consensus.cc:504] T 85238ff8a6274049ac1b3ce0d546518e P 85642702871f48d2a4811e71cf09ec44 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85642702871f48d2a4811e71cf09ec44" member_type: VOTER last_known_addr { host: "127.17.136.1" port: 39629 } } peers { permanent_uuid: "3f232ccfc16f4e63ab07b0a0a0ecdeb3" member_type: VOTER last_known_addr { host: "127.17.136.2" port: 34359 } } peers { permanent_uuid: "8c31bcf6ceaa411dba57437f661a6917" member_type: VOTER last_known_addr { host: "127.17.136.3" port: 38959 } }
I20260927 15:12:35.944959 25970 leader_election.cc:288] T 85238ff8a6274049ac1b3ce0d546518e P 85642702871f48d2a4811e71cf09ec44 [CANDIDATE]: Term 1 election: Requested vote from peers 3f232ccfc16f4e63ab07b0a0a0ecdeb3 (127.17.136.2:34359), 8c31bcf6ceaa411dba57437f661a6917 (127.17.136.3:38959)
I20260927 15:12:35.945258 25890 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "85238ff8a6274049ac1b3ce0d546518e" candidate_uuid: "85642702871f48d2a4811e71cf09ec44" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c31bcf6ceaa411dba57437f661a6917"
I20260927 15:12:35.945258 25750 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "85238ff8a6274049ac1b3ce0d546518e" candidate_uuid: "85642702871f48d2a4811e71cf09ec44" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f232ccfc16f4e63ab07b0a0a0ecdeb3"
I20260927 15:12:35.945389 25890 raft_consensus.cc:3037] T 85238ff8a6274049ac1b3ce0d546518e P 8c31bcf6ceaa411dba57437f661a6917 [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:12:35.945399 25750 raft_consensus.cc:3037] T 85238ff8a6274049ac1b3ce0d546518e P 3f232ccfc16f4e63ab07b0a0a0ecdeb3 [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:12:35.946496 25890 raft_consensus.cc:2454] T 85238ff8a6274049ac1b3ce0d546518e P 8c31bcf6ceaa411dba57437f661a6917 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85642702871f48d2a4811e71cf09ec44 in term 1.
I20260927 15:12:35.946496 25750 raft_consensus.cc:2454] T 85238ff8a6274049ac1b3ce0d546518e P 3f232ccfc16f4e63ab07b0a0a0ecdeb3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85642702871f48d2a4811e71cf09ec44 in term 1.
I20260927 15:12:35.946766 25542 leader_election.cc:302] T 85238ff8a6274049ac1b3ce0d546518e P 85642702871f48d2a4811e71cf09ec44 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85642702871f48d2a4811e71cf09ec44, 8c31bcf6ceaa411dba57437f661a6917; no voters:
I20260927 15:12:35.946920 25970 raft_consensus.cc:2781] T 85238ff8a6274049ac1b3ce0d546518e P 85642702871f48d2a4811e71cf09ec44 [term 1 FOLLOWER]: Leader election won for term 1
I20260927 15:12:35.947114 25970 raft_consensus.cc:686] T 85238ff8a6274049ac1b3ce0d546518e P 85642702871f48d2a4811e71cf09ec44 [term 1 LEADER]: Becoming Leader. State: Replica: 85642702871f48d2a4811e71cf09ec44, State: Running, Role: LEADER
I20260927 15:12:35.947371 25970 consensus_queue.cc:237] T 85238ff8a6274049ac1b3ce0d546518e P 85642702871f48d2a4811e71cf09ec44 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85642702871f48d2a4811e71cf09ec44" member_type: VOTER last_known_addr { host: "127.17.136.1" port: 39629 } } peers { permanent_uuid: "3f232ccfc16f4e63ab07b0a0a0ecdeb3" member_type: VOTER last_known_addr { host: "127.17.136.2" port: 34359 } } peers { permanent_uuid: "8c31bcf6ceaa411dba57437f661a6917" member_type: VOTER last_known_addr { host: "127.17.136.3" port: 38959 } }
I20260927 15:12:35.949510 25452 catalog_manager.cc:5495] T 85238ff8a6274049ac1b3ce0d546518e P 85642702871f48d2a4811e71cf09ec44 reported cstate change: term changed from 0 to 1, leader changed from <none> to 85642702871f48d2a4811e71cf09ec44 (127.17.136.1). New cstate: current_term: 1 leader_uuid: "85642702871f48d2a4811e71cf09ec44" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85642702871f48d2a4811e71cf09ec44" member_type: VOTER last_known_addr { host: "127.17.136.1" port: 39629 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3f232ccfc16f4e63ab07b0a0a0ecdeb3" member_type: VOTER last_known_addr { host: "127.17.136.2" port: 34359 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c31bcf6ceaa411dba57437f661a6917" member_type: VOTER last_known_addr { host: "127.17.136.3" port: 38959 } health_report { overall_health: UNKNOWN } } }
I20260927 15:12:36.028106 26043 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:36.024817 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47110 (local address 127.17.136.1:39629)
0927 15:12:36.025086 (+ 269us) server_negotiation.cc:206] Beginning negotiation
0927 15:12:36.025092 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0927 15:12:36.025104 (+ 12us) server_negotiation.cc:407] Connection header received
0927 15:12:36.025175 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:12:36.025177 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:12:36.025229 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:12:36.025325 (+ 96us) server_negotiation.cc:226] Negotiated authn=TOKEN
0927 15:12:36.025482 (+ 157us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:36.025986 (+ 504us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:36.026765 (+ 779us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:36.027016 (+ 251us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:36.027090 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:36.027300 (+ 210us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0927 15:12:36.027752 (+ 452us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0927 15:12:36.027835 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0927 15:12:36.027910 (+ 75us) server_negotiation.cc:299] Negotiation successful
0927 15:12:36.027954 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":210,"thread_start_us":85,"threads_started":1}
I20260927 15:12:36.030397 25890 raft_consensus.cc:1261] T 85238ff8a6274049ac1b3ce0d546518e P 8c31bcf6ceaa411dba57437f661a6917 [term 1 FOLLOWER]: Refusing update from remote peer 85642702871f48d2a4811e71cf09ec44: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260927 15:12:36.030416 25750 raft_consensus.cc:1261] T 85238ff8a6274049ac1b3ce0d546518e P 3f232ccfc16f4e63ab07b0a0a0ecdeb3 [term 1 FOLLOWER]: Refusing update from remote peer 85642702871f48d2a4811e71cf09ec44: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260927 15:12:36.030876 26040 consensus_queue.cc:1035] T 85238ff8a6274049ac1b3ce0d546518e P 85642702871f48d2a4811e71cf09ec44 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c31bcf6ceaa411dba57437f661a6917" member_type: VOTER last_known_addr { host: "127.17.136.3" port: 38959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260927 15:12:36.031104 25970 consensus_queue.cc:1035] T 85238ff8a6274049ac1b3ce0d546518e P 85642702871f48d2a4811e71cf09ec44 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f232ccfc16f4e63ab07b0a0a0ecdeb3" member_type: VOTER last_known_addr { host: "127.17.136.2" port: 34359 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260927 15:12:36.041703 25453 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:42336:
table { table_name: "test-table" } modify_external_catalogs: true
I20260927 15:12:36.041844 25453 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:42336:
table { table_name: "test-table" } modify_external_catalogs: true
I20260927 15:12:36.043768 25453 catalog_manager.cc:5782] T 00000000000000000000000000000000 P e567bae41ac64f3aa35dce62bd53dc51: Sending DeleteTablet for 3 replicas of tablet 85238ff8a6274049ac1b3ce0d546518e
I20260927 15:12:36.044389 25590 tablet_service.cc:1514] Processing DeleteTablet for tablet 85238ff8a6274049ac1b3ce0d546518e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:12:36 UTC) from {username='oryx', principal='oryx/127.17.136.62@KRBTEST.COM'} at 127.0.0.1:47094
I20260927 15:12:36.044571 25730 tablet_service.cc:1514] Processing DeleteTablet for tablet 85238ff8a6274049ac1b3ce0d546518e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:12:36 UTC) from {username='oryx', principal='oryx/127.17.136.62@KRBTEST.COM'} at 127.0.0.1:59930
I20260927 15:12:36.044621 25988 tablet_replica.cc:330] T 85238ff8a6274049ac1b3ce0d546518e P 85642702871f48d2a4811e71cf09ec44: stopping tablet replica
I20260927 15:12:36.044724 25987 tablet_replica.cc:330] T 85238ff8a6274049ac1b3ce0d546518e P 3f232ccfc16f4e63ab07b0a0a0ecdeb3: stopping tablet replica
I20260927 15:12:36.044726 25988 raft_consensus.cc:2229] T 85238ff8a6274049ac1b3ce0d546518e P 85642702871f48d2a4811e71cf09ec44 [term 1 LEADER]: Raft consensus shutting down.
I20260927 15:12:36.044813 25987 raft_consensus.cc:2229] T 85238ff8a6274049ac1b3ce0d546518e P 3f232ccfc16f4e63ab07b0a0a0ecdeb3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260927 15:12:36.044937 25987 raft_consensus.cc:2258] T 85238ff8a6274049ac1b3ce0d546518e P 3f232ccfc16f4e63ab07b0a0a0ecdeb3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 15:12:36.045014 25988 raft_consensus.cc:2258] T 85238ff8a6274049ac1b3ce0d546518e P 85642702871f48d2a4811e71cf09ec44 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 15:12:36.045188 25867 tablet_service.cc:1514] Processing DeleteTablet for tablet 85238ff8a6274049ac1b3ce0d546518e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:12:36 UTC) from {username='oryx', principal='oryx/127.17.136.62@KRBTEST.COM'} at 127.0.0.1:56574
I20260927 15:12:36.045442 25986 tablet_replica.cc:330] T 85238ff8a6274049ac1b3ce0d546518e P 8c31bcf6ceaa411dba57437f661a6917: stopping tablet replica
I20260927 15:12:36.045545 25986 raft_consensus.cc:2229] T 85238ff8a6274049ac1b3ce0d546518e P 8c31bcf6ceaa411dba57437f661a6917 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260927 15:12:36.045562 25987 ts_tablet_manager.cc:1905] T 85238ff8a6274049ac1b3ce0d546518e P 3f232ccfc16f4e63ab07b0a0a0ecdeb3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:12:36.045660 25986 raft_consensus.cc:2258] T 85238ff8a6274049ac1b3ce0d546518e P 8c31bcf6ceaa411dba57437f661a6917 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 15:12:36.045807 25988 ts_tablet_manager.cc:1905] T 85238ff8a6274049ac1b3ce0d546518e P 85642702871f48d2a4811e71cf09ec44: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:12:36.046581 25986 ts_tablet_manager.cc:1905] T 85238ff8a6274049ac1b3ce0d546518e P 8c31bcf6ceaa411dba57437f661a6917: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:12:36.047843 25987 ts_tablet_manager.cc:1918] T 85238ff8a6274049ac1b3ce0d546518e P 3f232ccfc16f4e63ab07b0a0a0ecdeb3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260927 15:12:36.047906 25987 log.cc:1196] T 85238ff8a6274049ac1b3ce0d546518e P 3f232ccfc16f4e63ab07b0a0a0ecdeb3: Deleting WAL directory at /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790521920546562-17952-0/minicluster-data/ts-1/wal/wals/85238ff8a6274049ac1b3ce0d546518e
I20260927 15:12:36.048130 25987 ts_tablet_manager.cc:1939] T 85238ff8a6274049ac1b3ce0d546518e P 3f232ccfc16f4e63ab07b0a0a0ecdeb3: Deleting consensus metadata
I20260927 15:12:36.048153 25988 ts_tablet_manager.cc:1918] T 85238ff8a6274049ac1b3ce0d546518e P 85642702871f48d2a4811e71cf09ec44: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260927 15:12:36.048219 25988 log.cc:1196] T 85238ff8a6274049ac1b3ce0d546518e P 85642702871f48d2a4811e71cf09ec44: Deleting WAL directory at /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790521920546562-17952-0/minicluster-data/ts-0/wal/wals/85238ff8a6274049ac1b3ce0d546518e
I20260927 15:12:36.048491 25988 ts_tablet_manager.cc:1939] T 85238ff8a6274049ac1b3ce0d546518e P 85642702871f48d2a4811e71cf09ec44: Deleting consensus metadata
I20260927 15:12:36.048729 25986 ts_tablet_manager.cc:1918] T 85238ff8a6274049ac1b3ce0d546518e P 8c31bcf6ceaa411dba57437f661a6917: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260927 15:12:36.048777 25986 log.cc:1196] T 85238ff8a6274049ac1b3ce0d546518e P 8c31bcf6ceaa411dba57437f661a6917: Deleting WAL directory at /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790521920546562-17952-0/minicluster-data/ts-2/wal/wals/85238ff8a6274049ac1b3ce0d546518e
I20260927 15:12:36.048933 25986 ts_tablet_manager.cc:1939] T 85238ff8a6274049ac1b3ce0d546518e P 8c31bcf6ceaa411dba57437f661a6917: Deleting consensus metadata
I20260927 15:12:36.049175 25439 catalog_manager.cc:4841] TS 85642702871f48d2a4811e71cf09ec44 (127.17.136.1:39629): tablet 85238ff8a6274049ac1b3ce0d546518e (table test-table [id=6dacdcbf87a84a6bacd0cbd1d4c15b38]) successfully deleted
I20260927 15:12:36.049188 25453 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:42336:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260927 15:12:36.049693 25438 catalog_manager.cc:4841] TS 8c31bcf6ceaa411dba57437f661a6917 (127.17.136.3:38959): tablet 85238ff8a6274049ac1b3ce0d546518e (table test-table [id=6dacdcbf87a84a6bacd0cbd1d4c15b38]) successfully deleted
I20260927 15:12:36.049727 25437 catalog_manager.cc:4841] TS 3f232ccfc16f4e63ab07b0a0a0ecdeb3 (127.17.136.2:34359): tablet 85238ff8a6274049ac1b3ce0d546518e (table test-table [id=6dacdcbf87a84a6bacd0cbd1d4c15b38]) successfully deleted
W20260927 15:12:36.049979 25453 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:12:36.054064 25590 tablet_service.cc:1467] Processing CreateTablet for tablet 581d7fffb3144e11918bf72e3d0d88c1 (DEFAULT_TABLE table=test-table [id=2adde7be79714907b69023dd0d9c0e02]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:12:36.054307 25590 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 581d7fffb3144e11918bf72e3d0d88c1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:12:36.054271 25730 tablet_service.cc:1467] Processing CreateTablet for tablet 581d7fffb3144e11918bf72e3d0d88c1 (DEFAULT_TABLE table=test-table [id=2adde7be79714907b69023dd0d9c0e02]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:12:36.054504 25730 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 581d7fffb3144e11918bf72e3d0d88c1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:12:36.056476 25964 tablet_bootstrap.cc:492] T 581d7fffb3144e11918bf72e3d0d88c1 P 85642702871f48d2a4811e71cf09ec44: Bootstrap starting.
I20260927 15:12:36.056643 25867 tablet_service.cc:1467] Processing CreateTablet for tablet 581d7fffb3144e11918bf72e3d0d88c1 (DEFAULT_TABLE table=test-table [id=2adde7be79714907b69023dd0d9c0e02]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:12:36.056708 25965 tablet_bootstrap.cc:492] T 581d7fffb3144e11918bf72e3d0d88c1 P 3f232ccfc16f4e63ab07b0a0a0ecdeb3: Bootstrap starting.
I20260927 15:12:36.056877 25867 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 581d7fffb3144e11918bf72e3d0d88c1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:12:36.057380 25964 tablet_bootstrap.cc:654] T 581d7fffb3144e11918bf72e3d0d88c1 P 85642702871f48d2a4811e71cf09ec44: Neither blocks nor log segments found. Creating new log.
I20260927 15:12:36.057423 25965 tablet_bootstrap.cc:654] T 581d7fffb3144e11918bf72e3d0d88c1 P 3f232ccfc16f4e63ab07b0a0a0ecdeb3: Neither blocks nor log segments found. Creating new log.
I20260927 15:12:36.058679 25964 tablet_bootstrap.cc:492] T 581d7fffb3144e11918bf72e3d0d88c1 P 85642702871f48d2a4811e71cf09ec44: No bootstrap required, opened a new log
I20260927 15:12:36.058768 25964 ts_tablet_manager.cc:1397] T 581d7fffb3144e11918bf72e3d0d88c1 P 85642702871f48d2a4811e71cf09ec44: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260927 15:12:36.058893 25966 tablet_bootstrap.cc:492] T 581d7fffb3144e11918bf72e3d0d88c1 P 8c31bcf6ceaa411dba57437f661a6917: Bootstrap starting.
I20260927 15:12:36.059182 25964 raft_consensus.cc:348] T 581d7fffb3144e11918bf72e3d0d88c1 P 85642702871f48d2a4811e71cf09ec44 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85642702871f48d2a4811e71cf09ec44" member_type: VOTER last_known_addr { host: "127.17.136.1" port: 39629 } } peers { permanent_uuid: "3f232ccfc16f4e63ab07b0a0a0ecdeb3" member_type: VOTER last_known_addr { host: "127.17.136.2" port: 34359 } } peers { permanent_uuid: "8c31bcf6ceaa411dba57437f661a6917" member_type: VOTER last_known_addr { host: "127.17.136.3" port: 38959 } }
I20260927 15:12:36.059319 25964 raft_consensus.cc:374] T 581d7fffb3144e11918bf72e3d0d88c1 P 85642702871f48d2a4811e71cf09ec44 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:12:36.059348 25964 raft_consensus.cc:729] T 581d7fffb3144e11918bf72e3d0d88c1 P 85642702871f48d2a4811e71cf09ec44 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 85642702871f48d2a4811e71cf09ec44, State: Initialized, Role: FOLLOWER
I20260927 15:12:36.059458 25964 consensus_queue.cc:260] T 581d7fffb3144e11918bf72e3d0d88c1 P 85642702871f48d2a4811e71cf09ec44 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85642702871f48d2a4811e71cf09ec44" member_type: VOTER last_known_addr { host: "127.17.136.1" port: 39629 } } peers { permanent_uuid: "3f232ccfc16f4e63ab07b0a0a0ecdeb3" member_type: VOTER last_known_addr { host: "127.17.136.2" port: 34359 } } peers { permanent_uuid: "8c31bcf6ceaa411dba57437f661a6917" member_type: VOTER last_known_addr { host: "127.17.136.3" port: 38959 } }
I20260927 15:12:36.059664 25966 tablet_bootstrap.cc:654] T 581d7fffb3144e11918bf72e3d0d88c1 P 8c31bcf6ceaa411dba57437f661a6917: Neither blocks nor log segments found. Creating new log.
I20260927 15:12:36.059692 25964 ts_tablet_manager.cc:1428] T 581d7fffb3144e11918bf72e3d0d88c1 P 85642702871f48d2a4811e71cf09ec44: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260927 15:12:36.060681 25966 tablet_bootstrap.cc:492] T 581d7fffb3144e11918bf72e3d0d88c1 P 8c31bcf6ceaa411dba57437f661a6917: No bootstrap required, opened a new log
I20260927 15:12:36.060750 25966 ts_tablet_manager.cc:1397] T 581d7fffb3144e11918bf72e3d0d88c1 P 8c31bcf6ceaa411dba57437f661a6917: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260927 15:12:36.060765 25965 tablet_bootstrap.cc:492] T 581d7fffb3144e11918bf72e3d0d88c1 P 3f232ccfc16f4e63ab07b0a0a0ecdeb3: No bootstrap required, opened a new log
I20260927 15:12:36.060825 25965 ts_tablet_manager.cc:1397] T 581d7fffb3144e11918bf72e3d0d88c1 P 3f232ccfc16f4e63ab07b0a0a0ecdeb3: Time spent bootstrapping tablet: real 0.004s user 0.001s sys 0.000s
I20260927 15:12:36.061106 25966 raft_consensus.cc:348] T 581d7fffb3144e11918bf72e3d0d88c1 P 8c31bcf6ceaa411dba57437f661a6917 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85642702871f48d2a4811e71cf09ec44" member_type: VOTER last_known_addr { host: "127.17.136.1" port: 39629 } } peers { permanent_uuid: "3f232ccfc16f4e63ab07b0a0a0ecdeb3" member_type: VOTER last_known_addr { host: "127.17.136.2" port: 34359 } } peers { permanent_uuid: "8c31bcf6ceaa411dba57437f661a6917" member_type: VOTER last_known_addr { host: "127.17.136.3" port: 38959 } }
I20260927 15:12:36.061147 25965 raft_consensus.cc:348] T 581d7fffb3144e11918bf72e3d0d88c1 P 3f232ccfc16f4e63ab07b0a0a0ecdeb3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85642702871f48d2a4811e71cf09ec44" member_type: VOTER last_known_addr { host: "127.17.136.1" port: 39629 } } peers { permanent_uuid: "3f232ccfc16f4e63ab07b0a0a0ecdeb3" member_type: VOTER last_known_addr { host: "127.17.136.2" port: 34359 } } peers { permanent_uuid: "8c31bcf6ceaa411dba57437f661a6917" member_type: VOTER last_known_addr { host: "127.17.136.3" port: 38959 } }
I20260927 15:12:36.061203 25966 raft_consensus.cc:374] T 581d7fffb3144e11918bf72e3d0d88c1 P 8c31bcf6ceaa411dba57437f661a6917 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:12:36.061232 25965 raft_consensus.cc:374] T 581d7fffb3144e11918bf72e3d0d88c1 P 3f232ccfc16f4e63ab07b0a0a0ecdeb3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:12:36.061231 25966 raft_consensus.cc:729] T 581d7fffb3144e11918bf72e3d0d88c1 P 8c31bcf6ceaa411dba57437f661a6917 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8c31bcf6ceaa411dba57437f661a6917, State: Initialized, Role: FOLLOWER
I20260927 15:12:36.061261 25965 raft_consensus.cc:729] T 581d7fffb3144e11918bf72e3d0d88c1 P 3f232ccfc16f4e63ab07b0a0a0ecdeb3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f232ccfc16f4e63ab07b0a0a0ecdeb3, State: Initialized, Role: FOLLOWER
I20260927 15:12:36.061347 25966 consensus_queue.cc:260] T 581d7fffb3144e11918bf72e3d0d88c1 P 8c31bcf6ceaa411dba57437f661a6917 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85642702871f48d2a4811e71cf09ec44" member_type: VOTER last_known_addr { host: "127.17.136.1" port: 39629 } } peers { permanent_uuid: "3f232ccfc16f4e63ab07b0a0a0ecdeb3" member_type: VOTER last_known_addr { host: "127.17.136.2" port: 34359 } } peers { permanent_uuid: "8c31bcf6ceaa411dba57437f661a6917" member_type: VOTER last_known_addr { host: "127.17.136.3" port: 38959 } }
I20260927 15:12:36.061370 25965 consensus_queue.cc:260] T 581d7fffb3144e11918bf72e3d0d88c1 P 3f232ccfc16f4e63ab07b0a0a0ecdeb3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85642702871f48d2a4811e71cf09ec44" member_type: VOTER last_known_addr { host: "127.17.136.1" port: 39629 } } peers { permanent_uuid: "3f232ccfc16f4e63ab07b0a0a0ecdeb3" member_type: VOTER last_known_addr { host: "127.17.136.2" port: 34359 } } peers { permanent_uuid: "8c31bcf6ceaa411dba57437f661a6917" member_type: VOTER last_known_addr { host: "127.17.136.3" port: 38959 } }
I20260927 15:12:36.061599 25966 ts_tablet_manager.cc:1428] T 581d7fffb3144e11918bf72e3d0d88c1 P 8c31bcf6ceaa411dba57437f661a6917: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260927 15:12:36.061599 25965 ts_tablet_manager.cc:1428] T 581d7fffb3144e11918bf72e3d0d88c1 P 3f232ccfc16f4e63ab07b0a0a0ecdeb3: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260927 15:12:36.306232 26011 raft_consensus.cc:482] T 581d7fffb3144e11918bf72e3d0d88c1 P 8c31bcf6ceaa411dba57437f661a6917 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:12:36.306376 26011 raft_consensus.cc:504] T 581d7fffb3144e11918bf72e3d0d88c1 P 8c31bcf6ceaa411dba57437f661a6917 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85642702871f48d2a4811e71cf09ec44" member_type: VOTER last_known_addr { host: "127.17.136.1" port: 39629 } } peers { permanent_uuid: "3f232ccfc16f4e63ab07b0a0a0ecdeb3" member_type: VOTER last_known_addr { host: "127.17.136.2" port: 34359 } } peers { permanent_uuid: "8c31bcf6ceaa411dba57437f661a6917" member_type: VOTER last_known_addr { host: "127.17.136.3" port: 38959 } }
I20260927 15:12:36.306799 26011 leader_election.cc:288] T 581d7fffb3144e11918bf72e3d0d88c1 P 8c31bcf6ceaa411dba57437f661a6917 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 85642702871f48d2a4811e71cf09ec44 (127.17.136.1:39629), 3f232ccfc16f4e63ab07b0a0a0ecdeb3 (127.17.136.2:34359)
I20260927 15:12:36.307266 25750 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "581d7fffb3144e11918bf72e3d0d88c1" candidate_uuid: "8c31bcf6ceaa411dba57437f661a6917" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f232ccfc16f4e63ab07b0a0a0ecdeb3" is_pre_election: true
I20260927 15:12:36.307271 25610 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "581d7fffb3144e11918bf72e3d0d88c1" candidate_uuid: "8c31bcf6ceaa411dba57437f661a6917" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85642702871f48d2a4811e71cf09ec44" is_pre_election: true
I20260927 15:12:36.307440 25750 raft_consensus.cc:2454] T 581d7fffb3144e11918bf72e3d0d88c1 P 3f232ccfc16f4e63ab07b0a0a0ecdeb3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c31bcf6ceaa411dba57437f661a6917 in term 0.
I20260927 15:12:36.307423 25610 raft_consensus.cc:2454] T 581d7fffb3144e11918bf72e3d0d88c1 P 85642702871f48d2a4811e71cf09ec44 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c31bcf6ceaa411dba57437f661a6917 in term 0.
I20260927 15:12:36.307752 25821 leader_election.cc:302] T 581d7fffb3144e11918bf72e3d0d88c1 P 8c31bcf6ceaa411dba57437f661a6917 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 3f232ccfc16f4e63ab07b0a0a0ecdeb3, 85642702871f48d2a4811e71cf09ec44, 8c31bcf6ceaa411dba57437f661a6917; no voters:
I20260927 15:12:36.307930 26011 raft_consensus.cc:2781] T 581d7fffb3144e11918bf72e3d0d88c1 P 8c31bcf6ceaa411dba57437f661a6917 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 15:12:36.307993 26011 raft_consensus.cc:482] T 581d7fffb3144e11918bf72e3d0d88c1 P 8c31bcf6ceaa411dba57437f661a6917 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 15:12:36.308019 26011 raft_consensus.cc:3037] T 581d7fffb3144e11918bf72e3d0d88c1 P 8c31bcf6ceaa411dba57437f661a6917 [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:12:36.309082 26011 raft_consensus.cc:504] T 581d7fffb3144e11918bf72e3d0d88c1 P 8c31bcf6ceaa411dba57437f661a6917 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85642702871f48d2a4811e71cf09ec44" member_type: VOTER last_known_addr { host: "127.17.136.1" port: 39629 } } peers { permanent_uuid: "3f232ccfc16f4e63ab07b0a0a0ecdeb3" member_type: VOTER last_known_addr { host: "127.17.136.2" port: 34359 } } peers { permanent_uuid: "8c31bcf6ceaa411dba57437f661a6917" member_type: VOTER last_known_addr { host: "127.17.136.3" port: 38959 } }
I20260927 15:12:36.309393 26011 leader_election.cc:288] T 581d7fffb3144e11918bf72e3d0d88c1 P 8c31bcf6ceaa411dba57437f661a6917 [CANDIDATE]: Term 1 election: Requested vote from peers 85642702871f48d2a4811e71cf09ec44 (127.17.136.1:39629), 3f232ccfc16f4e63ab07b0a0a0ecdeb3 (127.17.136.2:34359)
I20260927 15:12:36.309712 25610 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "581d7fffb3144e11918bf72e3d0d88c1" candidate_uuid: "8c31bcf6ceaa411dba57437f661a6917" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85642702871f48d2a4811e71cf09ec44"
I20260927 15:12:36.309715 25750 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "581d7fffb3144e11918bf72e3d0d88c1" candidate_uuid: "8c31bcf6ceaa411dba57437f661a6917" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f232ccfc16f4e63ab07b0a0a0ecdeb3"
I20260927 15:12:36.309818 25750 raft_consensus.cc:3037] T 581d7fffb3144e11918bf72e3d0d88c1 P 3f232ccfc16f4e63ab07b0a0a0ecdeb3 [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:12:36.309823 25610 raft_consensus.cc:3037] T 581d7fffb3144e11918bf72e3d0d88c1 P 85642702871f48d2a4811e71cf09ec44 [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:12:36.310658 25610 raft_consensus.cc:2454] T 581d7fffb3144e11918bf72e3d0d88c1 P 85642702871f48d2a4811e71cf09ec44 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c31bcf6ceaa411dba57437f661a6917 in term 1.
I20260927 15:12:36.310734 25750 raft_consensus.cc:2454] T 581d7fffb3144e11918bf72e3d0d88c1 P 3f232ccfc16f4e63ab07b0a0a0ecdeb3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c31bcf6ceaa411dba57437f661a6917 in term 1.
I20260927 15:12:36.310921 25823 leader_election.cc:302] T 581d7fffb3144e11918bf72e3d0d88c1 P 8c31bcf6ceaa411dba57437f661a6917 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85642702871f48d2a4811e71cf09ec44, 8c31bcf6ceaa411dba57437f661a6917; no voters:
I20260927 15:12:36.311076 26011 raft_consensus.cc:2781] T 581d7fffb3144e11918bf72e3d0d88c1 P 8c31bcf6ceaa411dba57437f661a6917 [term 1 FOLLOWER]: Leader election won for term 1
I20260927 15:12:36.311234 26011 raft_consensus.cc:686] T 581d7fffb3144e11918bf72e3d0d88c1 P 8c31bcf6ceaa411dba57437f661a6917 [term 1 LEADER]: Becoming Leader. State: Replica: 8c31bcf6ceaa411dba57437f661a6917, State: Running, Role: LEADER
I20260927 15:12:36.311393 26011 consensus_queue.cc:237] T 581d7fffb3144e11918bf72e3d0d88c1 P 8c31bcf6ceaa411dba57437f661a6917 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85642702871f48d2a4811e71cf09ec44" member_type: VOTER last_known_addr { host: "127.17.136.1" port: 39629 } } peers { permanent_uuid: "3f232ccfc16f4e63ab07b0a0a0ecdeb3" member_type: VOTER last_known_addr { host: "127.17.136.2" port: 34359 } } peers { permanent_uuid: "8c31bcf6ceaa411dba57437f661a6917" member_type: VOTER last_known_addr { host: "127.17.136.3" port: 38959 } }
I20260927 15:12:36.312937 25453 catalog_manager.cc:5495] T 581d7fffb3144e11918bf72e3d0d88c1 P 8c31bcf6ceaa411dba57437f661a6917 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8c31bcf6ceaa411dba57437f661a6917 (127.17.136.3). New cstate: current_term: 1 leader_uuid: "8c31bcf6ceaa411dba57437f661a6917" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85642702871f48d2a4811e71cf09ec44" member_type: VOTER last_known_addr { host: "127.17.136.1" port: 39629 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f232ccfc16f4e63ab07b0a0a0ecdeb3" member_type: VOTER last_known_addr { host: "127.17.136.2" port: 34359 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c31bcf6ceaa411dba57437f661a6917" member_type: VOTER last_known_addr { host: "127.17.136.3" port: 38959 } health_report { overall_health: HEALTHY } } }
I20260927 15:12:36.359516 25961 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:36.357038 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56598 (local address 127.17.136.3:38959)
0927 15:12:36.357148 (+ 110us) server_negotiation.cc:206] Beginning negotiation
0927 15:12:36.357152 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0927 15:12:36.357164 (+ 12us) server_negotiation.cc:407] Connection header received
0927 15:12:36.357219 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:12:36.357221 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:12:36.357258 (+ 37us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:12:36.357309 (+ 51us) server_negotiation.cc:226] Negotiated authn=TOKEN
0927 15:12:36.357480 (+ 171us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:36.357966 (+ 486us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:36.358705 (+ 739us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:36.358912 (+ 207us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:36.358980 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:36.359168 (+ 188us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0927 15:12:36.359231 (+ 63us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0927 15:12:36.359292 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0927 15:12:36.359364 (+ 72us) server_negotiation.cc:299] Negotiation successful
0927 15:12:36.359406 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260927 15:12:36.367394 26055 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:36.364271 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.3:38959 (local address 127.17.136.3:57719)
0927 15:12:36.364515 (+ 244us) negotiation.cc:107] Waiting for socket to connect
0927 15:12:36.364536 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0927 15:12:36.364628 (+ 92us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0927 15:12:36.364807 (+ 179us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0927 15:12:36.364810 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0927 15:12:36.364817 (+ 7us) client_negotiation.cc:189] Negotiated authn=TOKEN
0927 15:12:36.364928 (+ 111us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:12:36.364934 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:12:36.365577 (+ 643us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:12:36.365580 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:12:36.366302 (+ 722us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:12:36.366312 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:12:36.366678 (+ 366us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:12:36.366681 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:12:36.366792 (+ 111us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:36.366812 (+ 20us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0927 15:12:36.367029 (+ 217us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0927 15:12:36.367034 (+ 5us) client_negotiation.cc:769] Sending connection context
0927 15:12:36.367110 (+ 76us) client_negotiation.cc:240] Negotiation successful
0927 15:12:36.367189 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":165,"mutex_wait_us":34,"thread_start_us":86,"threads_started":1}
I20260927 15:12:36.367401 25961 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:36.364411 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.136.3:57719 (local address 127.17.136.3:38959)
0927 15:12:36.364510 (+ 99us) server_negotiation.cc:206] Beginning negotiation
0927 15:12:36.364514 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0927 15:12:36.364594 (+ 80us) server_negotiation.cc:407] Connection header received
0927 15:12:36.364704 (+ 110us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:12:36.364707 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:12:36.364742 (+ 35us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:12:36.364795 (+ 53us) server_negotiation.cc:226] Negotiated authn=TOKEN
0927 15:12:36.365018 (+ 223us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:36.365481 (+ 463us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:36.366397 (+ 916us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:36.366589 (+ 192us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:36.366667 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:36.366899 (+ 232us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0927 15:12:36.366961 (+ 62us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0927 15:12:36.367014 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0927 15:12:36.367194 (+ 180us) server_negotiation.cc:299] Negotiation successful
0927 15:12:36.367242 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":38,"server-negotiator.queue_time_us":37}
I20260927 15:12:36.372223 25750 raft_consensus.cc:1261] T 581d7fffb3144e11918bf72e3d0d88c1 P 3f232ccfc16f4e63ab07b0a0a0ecdeb3 [term 1 FOLLOWER]: Refusing update from remote peer 8c31bcf6ceaa411dba57437f661a6917: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260927 15:12:36.372223 25610 raft_consensus.cc:1261] T 581d7fffb3144e11918bf72e3d0d88c1 P 85642702871f48d2a4811e71cf09ec44 [term 1 FOLLOWER]: Refusing update from remote peer 8c31bcf6ceaa411dba57437f661a6917: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260927 15:12:36.372558 26050 consensus_queue.cc:1035] T 581d7fffb3144e11918bf72e3d0d88c1 P 8c31bcf6ceaa411dba57437f661a6917 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f232ccfc16f4e63ab07b0a0a0ecdeb3" member_type: VOTER last_known_addr { host: "127.17.136.2" port: 34359 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260927 15:12:36.372704 26011 consensus_queue.cc:1035] T 581d7fffb3144e11918bf72e3d0d88c1 P 8c31bcf6ceaa411dba57437f661a6917 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85642702871f48d2a4811e71cf09ec44" member_type: VOTER last_known_addr { host: "127.17.136.1" port: 39629 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260927 15:12:36.402921 25451 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:42336:
table { table_name: "test-table" } modify_external_catalogs: true
I20260927 15:12:36.403075 25451 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:42336:
table { table_name: "test-table" } modify_external_catalogs: true
I20260927 15:12:36.405014 25451 catalog_manager.cc:5782] T 00000000000000000000000000000000 P e567bae41ac64f3aa35dce62bd53dc51: Sending DeleteTablet for 3 replicas of tablet 581d7fffb3144e11918bf72e3d0d88c1
I20260927 15:12:36.405544 25590 tablet_service.cc:1514] Processing DeleteTablet for tablet 581d7fffb3144e11918bf72e3d0d88c1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:12:36 UTC) from {username='oryx', principal='oryx/127.17.136.62@KRBTEST.COM'} at 127.0.0.1:47094
I20260927 15:12:36.405570 25867 tablet_service.cc:1514] Processing DeleteTablet for tablet 581d7fffb3144e11918bf72e3d0d88c1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:12:36 UTC) from {username='oryx', principal='oryx/127.17.136.62@KRBTEST.COM'} at 127.0.0.1:56574
I20260927 15:12:36.405596 25730 tablet_service.cc:1514] Processing DeleteTablet for tablet 581d7fffb3144e11918bf72e3d0d88c1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:12:36 UTC) from {username='oryx', principal='oryx/127.17.136.62@KRBTEST.COM'} at 127.0.0.1:59930
I20260927 15:12:36.405730 25988 tablet_replica.cc:330] T 581d7fffb3144e11918bf72e3d0d88c1 P 85642702871f48d2a4811e71cf09ec44: stopping tablet replica
I20260927 15:12:36.405800 25986 tablet_replica.cc:330] T 581d7fffb3144e11918bf72e3d0d88c1 P 8c31bcf6ceaa411dba57437f661a6917: stopping tablet replica
I20260927 15:12:36.405839 25988 raft_consensus.cc:2229] T 581d7fffb3144e11918bf72e3d0d88c1 P 85642702871f48d2a4811e71cf09ec44 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260927 15:12:36.405915 25987 tablet_replica.cc:330] T 581d7fffb3144e11918bf72e3d0d88c1 P 3f232ccfc16f4e63ab07b0a0a0ecdeb3: stopping tablet replica
I20260927 15:12:36.405917 25986 raft_consensus.cc:2229] T 581d7fffb3144e11918bf72e3d0d88c1 P 8c31bcf6ceaa411dba57437f661a6917 [term 1 LEADER]: Raft consensus shutting down.
I20260927 15:12:36.405973 25988 raft_consensus.cc:2258] T 581d7fffb3144e11918bf72e3d0d88c1 P 85642702871f48d2a4811e71cf09ec44 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 15:12:36.406024 25987 raft_consensus.cc:2229] T 581d7fffb3144e11918bf72e3d0d88c1 P 3f232ccfc16f4e63ab07b0a0a0ecdeb3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260927 15:12:36.406101 25986 raft_consensus.cc:2258] T 581d7fffb3144e11918bf72e3d0d88c1 P 8c31bcf6ceaa411dba57437f661a6917 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 15:12:36.406138 25987 raft_consensus.cc:2258] T 581d7fffb3144e11918bf72e3d0d88c1 P 3f232ccfc16f4e63ab07b0a0a0ecdeb3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 15:12:36.406770 17952 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu with pid 25525
I20260927 15:12:36.406800 25986 ts_tablet_manager.cc:1905] T 581d7fffb3144e11918bf72e3d0d88c1 P 8c31bcf6ceaa411dba57437f661a6917: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:12:36.407807 25987 ts_tablet_manager.cc:1905] T 581d7fffb3144e11918bf72e3d0d88c1 P 3f232ccfc16f4e63ab07b0a0a0ecdeb3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:12:36.410105 25987 ts_tablet_manager.cc:1918] T 581d7fffb3144e11918bf72e3d0d88c1 P 3f232ccfc16f4e63ab07b0a0a0ecdeb3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260927 15:12:36.410179 25987 log.cc:1196] T 581d7fffb3144e11918bf72e3d0d88c1 P 3f232ccfc16f4e63ab07b0a0a0ecdeb3: Deleting WAL directory at /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790521920546562-17952-0/minicluster-data/ts-1/wal/wals/581d7fffb3144e11918bf72e3d0d88c1
I20260927 15:12:36.410400 25987 ts_tablet_manager.cc:1939] T 581d7fffb3144e11918bf72e3d0d88c1 P 3f232ccfc16f4e63ab07b0a0a0ecdeb3: Deleting consensus metadata
I20260927 15:12:36.411012 25437 catalog_manager.cc:4841] TS 3f232ccfc16f4e63ab07b0a0a0ecdeb3 (127.17.136.2:34359): tablet 581d7fffb3144e11918bf72e3d0d88c1 (table test-table [id=2adde7be79714907b69023dd0d9c0e02]) successfully deleted
I20260927 15:12:36.413028 25986 ts_tablet_manager.cc:1918] T 581d7fffb3144e11918bf72e3d0d88c1 P 8c31bcf6ceaa411dba57437f661a6917: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260927 15:12:36.413107 25986 log.cc:1196] T 581d7fffb3144e11918bf72e3d0d88c1 P 8c31bcf6ceaa411dba57437f661a6917: Deleting WAL directory at /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790521920546562-17952-0/minicluster-data/ts-2/wal/wals/581d7fffb3144e11918bf72e3d0d88c1
I20260927 15:12:36.413327 25986 ts_tablet_manager.cc:1939] T 581d7fffb3144e11918bf72e3d0d88c1 P 8c31bcf6ceaa411dba57437f661a6917: Deleting consensus metadata
I20260927 15:12:36.413970 25438 catalog_manager.cc:4841] TS 8c31bcf6ceaa411dba57437f661a6917 (127.17.136.3:38959): tablet 581d7fffb3144e11918bf72e3d0d88c1 (table test-table [id=2adde7be79714907b69023dd0d9c0e02]) successfully deleted
W20260927 15:12:36.414564 25439 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.17.136.1:39629 (error 108)
I20260927 15:12:36.415289 17952 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu with pid 25665
I20260927 15:12:36.416010 26060 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:36.415229 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.1:39629 (local address 127.0.0.1:47114)
0927 15:12:36.415843 (+ 614us) negotiation.cc:107] Waiting for socket to connect
0927 15:12:36.415910 (+ 67us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.136.1:39629: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":544,"thread_start_us":52,"threads_started":1}
W20260927 15:12:36.416734 25439 catalog_manager.cc:4584] TS 85642702871f48d2a4811e71cf09ec44 (127.17.136.1:39629): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 581d7fffb3144e11918bf72e3d0d88c1: Network error: Client connection negotiation failed: client connection to 127.17.136.1:39629: connect: Connection refused (error 111)
I20260927 15:12:36.421002 17952 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu with pid 25805
I20260927 15:12:36.426504 17952 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu with pid 25421
2026-09-27T15:12:36Z chronyd exiting
[ OK ] SecurityITest.TestNonDefaultPrincipal (3405 ms)
[ RUN ] SecurityITest.TestNonExistentPrincipal
Loading random data
Initializing database '/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1790521920546562-17952-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 27 15:12:36 dist-test-slave-5s2t krb5kdc[26063](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 27 15:12:36 dist-test-slave-5s2t krb5kdc[26063](info): set up 2 sockets
Sep 27 15:12:36 dist-test-slave-5s2t krb5kdc[26063](info): commencing operation
krb5kdc: starting...
W20260927 15:12:37.379642 17952 mini_kdc.cc:121] Time spent starting KDC: real 0.932s user 0.005s sys 0.000s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1790521920546562-17952-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1790521920546562-17952-0/krb5kdc/test-user.keytab.
Sep 27 15:12:37 dist-test-slave-5s2t krb5kdc[26063](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790521957, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-27T15:12:37Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-27T15:12:37Z Disabled control of system clock
WARNING: no policy specified for kudu/127.17.136.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.136.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.136.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1790521920546562-17952-0/krb5kdc/kudu_127.17.136.62.keytab.
Entry for principal kudu/127.17.136.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1790521920546562-17952-0/krb5kdc/kudu_127.17.136.62.keytab.
I20260927 15:12:37.492213 17952 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu
/tmp/dist-test-taskiFOyeW/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1790521920546562-17952-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1790521920546562-17952-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1790521920546562-17952-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1790521920546562-17952-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.136.62:36315
--webserver_interface=127.17.136.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1790521920546562-17952-0/krb5kdc/kudu_127.17.136.62.keytab
--principal=kudu/127.17.136.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.136.20:37097
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.136.62:36315
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--principal=oryx with env {KRB5CCNAME=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1790521920546562-17952-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1790521920546562-17952-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1790521920546562-17952-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260927 15:12:37.598013 26076 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260927 15:12:37.598265 26076 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260927 15:12:37.598304 26076 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260927 15:12:37.602242 26076 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260927 15:12:37.602298 26076 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260927 15:12:37.602314 26076 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260927 15:12:37.602329 26076 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260927 15:12:37.602344 26076 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260927 15:12:37.607575 26076 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.136.20:37097
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1790521920546562-17952-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1790521920546562-17952-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.17.136.62:36315
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1790521920546562-17952-0/krb5kdc/kudu_127.17.136.62.keytab
--principal=oryx
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.136.62:36315
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1790521920546562-17952-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.17.136.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26076
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1790521920546562-17952-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 27 Sep 2026 14:27:13 UTC on ccycloud.quasar-psqrth.root.comops.site
build id 4676138
I20260927 15:12:37.608532 26076 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260927 15:12:37.609524 26076 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260927 15:12:37.617699 26081 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260927 15:12:37.617753 26076 server_base.cc:1034] running on GCE node
W20260927 15:12:37.617743 26082 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260927 15:12:37.617682 26084 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260927 15:12:37.618348 26076 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260927 15:12:37.619444 26076 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260927 15:12:37.620625 26076 hybrid_clock.cc:648] HybridClock initialized: now 1790521957620611 us; error 32 us; skew 500 ppm
Runtime error: kinit failed: unable to login from keytab: Keytab contains no suitable keys for oryx@KRBTEST.COM
2026-09-27T15:12:37Z chronyd exiting
[ OK ] SecurityITest.TestNonExistentPrincipal (1203 ms)
[ RUN ] SecurityITest.TestMismatchingPrincipals
Loading random data
Initializing database '/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790521920546562-17952-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 27 15:12:37 dist-test-slave-5s2t krb5kdc[26089](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 27 15:12:37 dist-test-slave-5s2t krb5kdc[26089](info): set up 2 sockets
Sep 27 15:12:37 dist-test-slave-5s2t krb5kdc[26089](info): commencing operation
krb5kdc: starting...
W20260927 15:12:38.587589 17952 mini_kdc.cc:121] Time spent starting KDC: real 0.937s user 0.000s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790521920546562-17952-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790521920546562-17952-0/krb5kdc/test-user.keytab.
Sep 27 15:12:38 dist-test-slave-5s2t krb5kdc[26089](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790521958, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-27T15:12:38Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-27T15:12:38Z Disabled control of system clock
WARNING: no policy specified for kudu/127.17.136.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.136.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.136.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790521920546562-17952-0/krb5kdc/kudu_127.17.136.62.keytab.
Entry for principal kudu/127.17.136.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790521920546562-17952-0/krb5kdc/kudu_127.17.136.62.keytab.
I20260927 15:12:38.698163 17952 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu
/tmp/dist-test-taskiFOyeW/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790521920546562-17952-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790521920546562-17952-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790521920546562-17952-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790521920546562-17952-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.136.62:41997
--webserver_interface=127.17.136.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790521920546562-17952-0/krb5kdc/kudu_127.17.136.62.keytab
--principal=kudu/127.17.136.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.136.20:39239
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.136.62:41997
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790521920546562-17952-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790521920546562-17952-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790521920546562-17952-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260927 15:12:38.803351 26102 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260927 15:12:38.803602 26102 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260927 15:12:38.803642 26102 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260927 15:12:38.807539 26102 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260927 15:12:38.807590 26102 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260927 15:12:38.807607 26102 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260927 15:12:38.807623 26102 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260927 15:12:38.807651 26102 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260927 15:12:38.812778 26102 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.136.20:39239
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790521920546562-17952-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790521920546562-17952-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.17.136.62:41997
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790521920546562-17952-0/krb5kdc/kudu_127.17.136.62.keytab
--principal=kudu/127.17.136.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.136.62:41997
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790521920546562-17952-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.17.136.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26102
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790521920546562-17952-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 27 Sep 2026 14:27:13 UTC on ccycloud.quasar-psqrth.root.comops.site
build id 4676138
I20260927 15:12:38.813759 26102 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260927 15:12:38.814721 26102 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260927 15:12:38.822669 26107 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260927 15:12:38.822696 26110 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260927 15:12:38.822808 26102 server_base.cc:1034] running on GCE node
W20260927 15:12:38.822687 26108 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260927 15:12:38.823505 26102 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260927 15:12:38.824558 26102 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260927 15:12:38.825719 26102 hybrid_clock.cc:648] HybridClock initialized: now 1790521958825693 us; error 37 us; skew 500 ppm
Sep 27 15:12:38 dist-test-slave-5s2t krb5kdc[26089](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790521958, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.136.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260927 15:12:38.828418 26102 init.cc:377] Logged in from keytab as kudu/127.17.136.62@KRBTEST.COM (short username kudu)
I20260927 15:12:38.829347 26102 webserver.cc:460] Webserver started at http://127.17.136.62:36367/ using document root <none> and password file <none>
I20260927 15:12:38.829875 26102 fs_manager.cc:359] Metadata directory not provided
I20260927 15:12:38.829943 26102 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260927 15:12:38.830149 26102 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260927 15:12:38.832228 26102 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790521920546562-17952-0/minicluster-data/master-0/data/instance:
uuid: "dc07700ae0a04e3597d206e8fa9ad7e1"
format_stamp: "Formatted at 2026-09-27 15:12:38 on dist-test-slave-5s2t"
server_key: "1e75c3594d4c31bf18d6dd57dd023e1d"
server_key_iv: "97b1d6bd43fc14c02c3fe606d5b9b4d6"
server_key_version: "encryptionkey@0"
I20260927 15:12:38.832767 26102 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790521920546562-17952-0/minicluster-data/master-0/wal/instance:
uuid: "dc07700ae0a04e3597d206e8fa9ad7e1"
format_stamp: "Formatted at 2026-09-27 15:12:38 on dist-test-slave-5s2t"
server_key: "1e75c3594d4c31bf18d6dd57dd023e1d"
server_key_iv: "97b1d6bd43fc14c02c3fe606d5b9b4d6"
server_key_version: "encryptionkey@0"
I20260927 15:12:38.836339 26102 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.001s sys 0.003s
I20260927 15:12:38.838641 26117 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260927 15:12:38.839900 26102 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260927 15:12:38.840014 26102 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790521920546562-17952-0/minicluster-data/master-0/data,/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790521920546562-17952-0/minicluster-data/master-0/wal
uuid: "dc07700ae0a04e3597d206e8fa9ad7e1"
format_stamp: "Formatted at 2026-09-27 15:12:38 on dist-test-slave-5s2t"
server_key: "1e75c3594d4c31bf18d6dd57dd023e1d"
server_key_iv: "97b1d6bd43fc14c02c3fe606d5b9b4d6"
server_key_version: "encryptionkey@0"
I20260927 15:12:38.840109 26102 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790521920546562-17952-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790521920546562-17952-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790521920546562-17952-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260927 15:12:38.860224 26102 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260927 15:12:38.862808 26102 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260927 15:12:38.862972 26102 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260927 15:12:38.869428 26102 rpc_server.cc:307] RPC server started. Bound to: 127.17.136.62:41997
I20260927 15:12:38.869451 26169 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.136.62:41997 every 8 connection(s)
I20260927 15:12:38.870337 26102 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790521920546562-17952-0/minicluster-data/master-0/data/info.pb
I20260927 15:12:38.872994 26170 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:12:38.873608 17952 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu as pid 26102
I20260927 15:12:38.873736 17952 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790521920546562-17952-0/minicluster-data/master-0/wal/instance
I20260927 15:12:38.874059 17952 external_mini_cluster.cc:1428] Setting key 345fe97367661b9532fcf77df7281437
I20260927 15:12:38.878965 26170 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P dc07700ae0a04e3597d206e8fa9ad7e1: Bootstrap starting.
I20260927 15:12:38.881537 26170 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P dc07700ae0a04e3597d206e8fa9ad7e1: Neither blocks nor log segments found. Creating new log.
I20260927 15:12:38.882342 26170 log.cc:824] T 00000000000000000000000000000000 P dc07700ae0a04e3597d206e8fa9ad7e1: Log is configured to *not* fsync() on all Append() calls
Sep 27 15:12:38 dist-test-slave-5s2t krb5kdc[26089](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790521958, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.136.62@KRBTEST.COM
I20260927 15:12:38.884179 26170 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P dc07700ae0a04e3597d206e8fa9ad7e1: No bootstrap required, opened a new log
I20260927 15:12:38.887243 26173 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:38.875394 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54082 (local address 127.17.136.62:41997)
0927 15:12:38.875774 (+ 380us) server_negotiation.cc:206] Beginning negotiation
0927 15:12:38.875787 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0927 15:12:38.875822 (+ 35us) server_negotiation.cc:407] Connection header received
0927 15:12:38.876442 (+ 620us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:12:38.876457 (+ 15us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:12:38.876768 (+ 311us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:12:38.877034 (+ 266us) server_negotiation.cc:226] Negotiated authn=SASL
0927 15:12:38.877843 (+ 809us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:38.878803 (+ 960us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:38.879959 (+ 1156us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:38.880425 (+ 466us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:38.880538 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:38.883139 (+ 2601us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0927 15:12:38.883144 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0927 15:12:38.883157 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0927 15:12:38.883181 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0927 15:12:38.884778 (+ 1597us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:12:38.885162 (+ 384us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:12:38.885167 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:12:38.885171 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:12:38.885272 (+ 101us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:12:38.885513 (+ 241us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:12:38.885516 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:12:38.885517 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:12:38.885870 (+ 353us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0927 15:12:38.886045 (+ 175us) server_negotiation.cc:1035] Waiting for connection context
0927 15:12:38.886296 (+ 251us) server_negotiation.cc:299] Negotiation successful
0927 15:12:38.886564 (+ 268us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":237,"thread_start_us":93,"threads_started":1}
I20260927 15:12:38.887517 26170 raft_consensus.cc:348] T 00000000000000000000000000000000 P dc07700ae0a04e3597d206e8fa9ad7e1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dc07700ae0a04e3597d206e8fa9ad7e1" member_type: VOTER last_known_addr { host: "127.17.136.62" port: 41997 } }
I20260927 15:12:38.887720 26170 raft_consensus.cc:374] T 00000000000000000000000000000000 P dc07700ae0a04e3597d206e8fa9ad7e1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:12:38.887773 26170 raft_consensus.cc:729] T 00000000000000000000000000000000 P dc07700ae0a04e3597d206e8fa9ad7e1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc07700ae0a04e3597d206e8fa9ad7e1, State: Initialized, Role: FOLLOWER
I20260927 15:12:38.888155 26170 consensus_queue.cc:260] T 00000000000000000000000000000000 P dc07700ae0a04e3597d206e8fa9ad7e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dc07700ae0a04e3597d206e8fa9ad7e1" member_type: VOTER last_known_addr { host: "127.17.136.62" port: 41997 } }
I20260927 15:12:38.888273 26170 raft_consensus.cc:388] T 00000000000000000000000000000000 P dc07700ae0a04e3597d206e8fa9ad7e1 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260927 15:12:38.888334 26170 raft_consensus.cc:482] T 00000000000000000000000000000000 P dc07700ae0a04e3597d206e8fa9ad7e1 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260927 15:12:38.888422 26170 raft_consensus.cc:3037] T 00000000000000000000000000000000 P dc07700ae0a04e3597d206e8fa9ad7e1 [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:12:38.889285 26170 raft_consensus.cc:504] T 00000000000000000000000000000000 P dc07700ae0a04e3597d206e8fa9ad7e1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dc07700ae0a04e3597d206e8fa9ad7e1" member_type: VOTER last_known_addr { host: "127.17.136.62" port: 41997 } }
I20260927 15:12:38.889595 26170 leader_election.cc:302] T 00000000000000000000000000000000 P dc07700ae0a04e3597d206e8fa9ad7e1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: dc07700ae0a04e3597d206e8fa9ad7e1; no voters:
I20260927 15:12:38.889832 26170 leader_election.cc:288] T 00000000000000000000000000000000 P dc07700ae0a04e3597d206e8fa9ad7e1 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260927 15:12:38.889926 26175 raft_consensus.cc:2781] T 00000000000000000000000000000000 P dc07700ae0a04e3597d206e8fa9ad7e1 [term 1 FOLLOWER]: Leader election won for term 1
I20260927 15:12:38.890132 26175 raft_consensus.cc:686] T 00000000000000000000000000000000 P dc07700ae0a04e3597d206e8fa9ad7e1 [term 1 LEADER]: Becoming Leader. State: Replica: dc07700ae0a04e3597d206e8fa9ad7e1, State: Running, Role: LEADER
I20260927 15:12:38.890461 26175 consensus_queue.cc:237] T 00000000000000000000000000000000 P dc07700ae0a04e3597d206e8fa9ad7e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dc07700ae0a04e3597d206e8fa9ad7e1" member_type: VOTER last_known_addr { host: "127.17.136.62" port: 41997 } }
I20260927 15:12:38.890954 26170 sys_catalog.cc:564] T 00000000000000000000000000000000 P dc07700ae0a04e3597d206e8fa9ad7e1 [sys.catalog]: configured and running, proceeding with master startup.
I20260927 15:12:38.892179 26177 sys_catalog.cc:455] T 00000000000000000000000000000000 P dc07700ae0a04e3597d206e8fa9ad7e1 [sys.catalog]: SysCatalogTable state changed. Reason: New leader dc07700ae0a04e3597d206e8fa9ad7e1. Latest consensus state: current_term: 1 leader_uuid: "dc07700ae0a04e3597d206e8fa9ad7e1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dc07700ae0a04e3597d206e8fa9ad7e1" member_type: VOTER last_known_addr { host: "127.17.136.62" port: 41997 } } }
I20260927 15:12:38.892275 26177 sys_catalog.cc:458] T 00000000000000000000000000000000 P dc07700ae0a04e3597d206e8fa9ad7e1 [sys.catalog]: This master's current role is: LEADER
I20260927 15:12:38.892544 26176 sys_catalog.cc:455] T 00000000000000000000000000000000 P dc07700ae0a04e3597d206e8fa9ad7e1 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "dc07700ae0a04e3597d206e8fa9ad7e1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dc07700ae0a04e3597d206e8fa9ad7e1" member_type: VOTER last_known_addr { host: "127.17.136.62" port: 41997 } } }
I20260927 15:12:38.892628 26176 sys_catalog.cc:458] T 00000000000000000000000000000000 P dc07700ae0a04e3597d206e8fa9ad7e1 [sys.catalog]: This master's current role is: LEADER
I20260927 15:12:38.892637 26184 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260927 15:12:38.895108 26184 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260927 15:12:38.900079 26184 catalog_manager.cc:1347] Generated new cluster ID: 107b94f9e85d43f998e20e804b58a7c8
I20260927 15:12:38.900127 26184 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260927 15:12:38.913076 26184 catalog_manager.cc:1370] Generated new certificate authority record
I20260927 15:12:38.913960 26184 catalog_manager.cc:1504] Loading token signing keys...
I20260927 15:12:38.922134 26184 catalog_manager.cc:5868] T 00000000000000000000000000000000 P dc07700ae0a04e3597d206e8fa9ad7e1: Generated new TSK 0
I20260927 15:12:38.922789 26184 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.17.136.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.136.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.136.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790521920546562-17952-0/krb5kdc/kudu_127.17.136.1.keytab.
Entry for principal kudu/127.17.136.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790521920546562-17952-0/krb5kdc/kudu_127.17.136.1.keytab.
I20260927 15:12:38.949967 17952 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu
/tmp/dist-test-taskiFOyeW/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790521920546562-17952-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790521920546562-17952-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790521920546562-17952-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790521920546562-17952-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.136.1:0
--local_ip_for_outbound_sockets=127.17.136.1
--webserver_interface=127.17.136.1
--webserver_port=0
--tserver_master_addrs=127.17.136.62:41997
--keytab_file=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790521920546562-17952-0/krb5kdc/kudu_127.17.136.1.keytab
--principal=kudu/127.17.136.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.136.20:39239
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790521920546562-17952-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790521920546562-17952-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790521920546562-17952-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260927 15:12:39.056907 26196 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260927 15:12:39.057137 26196 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260927 15:12:39.057179 26196 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260927 15:12:39.061055 26196 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260927 15:12:39.061105 26196 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260927 15:12:39.061169 26196 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.136.1
I20260927 15:12:39.066126 26196 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.136.20:39239
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790521920546562-17952-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790521920546562-17952-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790521920546562-17952-0/krb5kdc/kudu_127.17.136.1.keytab
--principal=kudu/127.17.136.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.136.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790521920546562-17952-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.17.136.1
--webserver_port=0
--tserver_master_addrs=127.17.136.62:41997
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26196
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.136.1
--log_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790521920546562-17952-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 27 Sep 2026 14:27:13 UTC on ccycloud.quasar-psqrth.root.comops.site
build id 4676138
I20260927 15:12:39.067049 26196 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260927 15:12:39.068010 26196 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260927 15:12:39.076972 26202 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260927 15:12:39.077071 26204 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260927 15:12:39.077188 26196 server_base.cc:1034] running on GCE node
W20260927 15:12:39.076942 26201 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260927 15:12:39.077642 26196 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260927 15:12:39.078203 26196 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260927 15:12:39.079313 26196 hybrid_clock.cc:648] HybridClock initialized: now 1790521959079288 us; error 36 us; skew 500 ppm
Sep 27 15:12:39 dist-test-slave-5s2t krb5kdc[26089](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790521959, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.136.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260927 15:12:39.081835 26196 init.cc:377] Logged in from keytab as kudu/127.17.136.1@KRBTEST.COM (short username kudu)
I20260927 15:12:39.082616 26196 webserver.cc:460] Webserver started at http://127.17.136.1:41505/ using document root <none> and password file <none>
I20260927 15:12:39.083104 26196 fs_manager.cc:359] Metadata directory not provided
I20260927 15:12:39.083159 26196 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260927 15:12:39.083375 26196 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260927 15:12:39.085283 26196 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790521920546562-17952-0/minicluster-data/ts-0/data/instance:
uuid: "af2399ea6fa64eab821e7cfa148ef077"
format_stamp: "Formatted at 2026-09-27 15:12:39 on dist-test-slave-5s2t"
server_key: "c0c9187e21ac055ffd1080d780812f9a"
server_key_iv: "ff4bb419ecfeeca8c98f034d4e1c9486"
server_key_version: "encryptionkey@0"
I20260927 15:12:39.085789 26196 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790521920546562-17952-0/minicluster-data/ts-0/wal/instance:
uuid: "af2399ea6fa64eab821e7cfa148ef077"
format_stamp: "Formatted at 2026-09-27 15:12:39 on dist-test-slave-5s2t"
server_key: "c0c9187e21ac055ffd1080d780812f9a"
server_key_iv: "ff4bb419ecfeeca8c98f034d4e1c9486"
server_key_version: "encryptionkey@0"
I20260927 15:12:39.089195 26196 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260927 15:12:39.091414 26211 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260927 15:12:39.092651 26196 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260927 15:12:39.092747 26196 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790521920546562-17952-0/minicluster-data/ts-0/data,/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790521920546562-17952-0/minicluster-data/ts-0/wal
uuid: "af2399ea6fa64eab821e7cfa148ef077"
format_stamp: "Formatted at 2026-09-27 15:12:39 on dist-test-slave-5s2t"
server_key: "c0c9187e21ac055ffd1080d780812f9a"
server_key_iv: "ff4bb419ecfeeca8c98f034d4e1c9486"
server_key_version: "encryptionkey@0"
I20260927 15:12:39.092832 26196 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790521920546562-17952-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790521920546562-17952-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790521920546562-17952-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260927 15:12:39.105257 26196 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260927 15:12:39.107690 26196 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260927 15:12:39.107842 26196 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260927 15:12:39.108352 26196 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260927 15:12:39.109089 26196 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260927 15:12:39.109133 26196 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260927 15:12:39.109182 26196 ts_tablet_manager.cc:610] Registered 0 tablets
I20260927 15:12:39.109210 26196 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260927 15:12:39.117195 26196 rpc_server.cc:307] RPC server started. Bound to: 127.17.136.1:39131
I20260927 15:12:39.117223 26324 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.136.1:39131 every 8 connection(s)
I20260927 15:12:39.117990 26196 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790521920546562-17952-0/minicluster-data/ts-0/data/info.pb
I20260927 15:12:39.125778 17952 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu as pid 26196
I20260927 15:12:39.125893 17952 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790521920546562-17952-0/minicluster-data/ts-0/wal/instance
I20260927 15:12:39.126224 17952 external_mini_cluster.cc:1428] Setting key eae332540b862f75d73aaafdaaab05b0
Sep 27 15:12:39 dist-test-slave-5s2t krb5kdc[26089](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790521959, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.136.1@KRBTEST.COM for kudu/127.17.136.62@KRBTEST.COM
I20260927 15:12:39.130815 26173 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:39.119607 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.136.1:36089 (local address 127.17.136.62:41997)
0927 15:12:39.119731 (+ 124us) server_negotiation.cc:206] Beginning negotiation
0927 15:12:39.119734 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0927 15:12:39.120703 (+ 969us) server_negotiation.cc:407] Connection header received
0927 15:12:39.121552 (+ 849us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:12:39.121556 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:12:39.121611 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:12:39.121681 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0927 15:12:39.122793 (+ 1112us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:39.123347 (+ 554us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:39.124444 (+ 1097us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:39.124676 (+ 232us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:39.124761 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:39.127222 (+ 2461us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0927 15:12:39.127227 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0927 15:12:39.127230 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0927 15:12:39.127280 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0927 15:12:39.128734 (+ 1454us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:12:39.129369 (+ 635us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:12:39.129372 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:12:39.129374 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:12:39.129457 (+ 83us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:12:39.129776 (+ 319us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:12:39.129778 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:12:39.129780 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:12:39.129933 (+ 153us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0927 15:12:39.130012 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0927 15:12:39.130538 (+ 526us) server_negotiation.cc:299] Negotiation successful
0927 15:12:39.130661 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260927 15:12:39.131537 26327 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:39.119962 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.62:41997 (local address 127.17.136.1:36089)
0927 15:12:39.120562 (+ 600us) negotiation.cc:107] Waiting for socket to connect
0927 15:12:39.120601 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0927 15:12:39.121352 (+ 751us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0927 15:12:39.121855 (+ 503us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0927 15:12:39.121861 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0927 15:12:39.122202 (+ 341us) client_negotiation.cc:189] Negotiated authn=SASL
0927 15:12:39.122649 (+ 447us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:12:39.122661 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:12:39.123454 (+ 793us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:12:39.123458 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:12:39.124329 (+ 871us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:12:39.124338 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:12:39.124805 (+ 467us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:12:39.124809 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:12:39.124968 (+ 159us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:39.125447 (+ 479us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0927 15:12:39.125472 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0927 15:12:39.127061 (+ 1589us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0927 15:12:39.128886 (+ 1825us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0927 15:12:39.128892 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0927 15:12:39.128907 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0927 15:12:39.129269 (+ 362us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0927 15:12:39.129536 (+ 267us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0927 15:12:39.129538 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0927 15:12:39.129540 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0927 15:12:39.129700 (+ 160us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0927 15:12:39.130025 (+ 325us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0927 15:12:39.130030 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0927 15:12:39.130308 (+ 278us) client_negotiation.cc:769] Sending connection context
0927 15:12:39.130472 (+ 164us) client_negotiation.cc:240] Negotiation successful
0927 15:12:39.130700 (+ 228us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":423,"thread_start_us":102,"threads_started":1}
I20260927 15:12:39.132826 26325 heartbeater.cc:347] Connected to a master server at 127.17.136.62:41997
I20260927 15:12:39.133045 26325 heartbeater.cc:464] Registering TS with master...
I20260927 15:12:39.133481 26325 heartbeater.cc:511] Master 127.17.136.62:41997 requested a full tablet report, sending...
I20260927 15:12:39.135020 26134 ts_manager.cc:194] Registered new tserver with Master: af2399ea6fa64eab821e7cfa148ef077 (127.17.136.1:39131)
WARNING: no policy specified for kudu/127.17.136.2@KRBTEST.COM; defaulting to no policy
I20260927 15:12:39.136183 26134 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.136.1@KRBTEST.COM'} at 127.17.136.1:36089
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.136.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.136.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790521920546562-17952-0/krb5kdc/kudu_127.17.136.2.keytab.
Entry for principal kudu/127.17.136.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790521920546562-17952-0/krb5kdc/kudu_127.17.136.2.keytab.
I20260927 15:12:39.151371 17952 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu
/tmp/dist-test-taskiFOyeW/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790521920546562-17952-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790521920546562-17952-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790521920546562-17952-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790521920546562-17952-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.136.2:0
--local_ip_for_outbound_sockets=127.17.136.2
--webserver_interface=127.17.136.2
--webserver_port=0
--tserver_master_addrs=127.17.136.62:41997
--keytab_file=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790521920546562-17952-0/krb5kdc/kudu_127.17.136.2.keytab
--principal=kudu/127.17.136.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.136.20:39239
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790521920546562-17952-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790521920546562-17952-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790521920546562-17952-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260927 15:12:39.256249 26330 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260927 15:12:39.256500 26330 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260927 15:12:39.256546 26330 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260927 15:12:39.260643 26330 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260927 15:12:39.260701 26330 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260927 15:12:39.260771 26330 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.136.2
I20260927 15:12:39.265920 26330 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.136.20:39239
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790521920546562-17952-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790521920546562-17952-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790521920546562-17952-0/krb5kdc/kudu_127.17.136.2.keytab
--principal=kudu/127.17.136.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.136.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790521920546562-17952-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.17.136.2
--webserver_port=0
--tserver_master_addrs=127.17.136.62:41997
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26330
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.136.2
--log_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790521920546562-17952-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 27 Sep 2026 14:27:13 UTC on ccycloud.quasar-psqrth.root.comops.site
build id 4676138
I20260927 15:12:39.266851 26330 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260927 15:12:39.267810 26330 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260927 15:12:39.276785 26336 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260927 15:12:39.276798 26335 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260927 15:12:39.276769 26338 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260927 15:12:39.277061 26330 server_base.cc:1034] running on GCE node
I20260927 15:12:39.277406 26330 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260927 15:12:39.277980 26330 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260927 15:12:39.279134 26330 hybrid_clock.cc:648] HybridClock initialized: now 1790521959279116 us; error 29 us; skew 500 ppm
Sep 27 15:12:39 dist-test-slave-5s2t krb5kdc[26089](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790521959, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.136.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260927 15:12:39.281673 26330 init.cc:377] Logged in from keytab as kudu/127.17.136.2@KRBTEST.COM (short username kudu)
I20260927 15:12:39.282405 26330 webserver.cc:460] Webserver started at http://127.17.136.2:44943/ using document root <none> and password file <none>
I20260927 15:12:39.282891 26330 fs_manager.cc:359] Metadata directory not provided
I20260927 15:12:39.282946 26330 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260927 15:12:39.283103 26330 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260927 15:12:39.285022 26330 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790521920546562-17952-0/minicluster-data/ts-1/data/instance:
uuid: "5cd0f58aacc149f1be8a106ed88044ed"
format_stamp: "Formatted at 2026-09-27 15:12:39 on dist-test-slave-5s2t"
server_key: "577839d1571216068a2241036bc8ec65"
server_key_iv: "6d6cafe299aa97607e6a447fcf1977c0"
server_key_version: "encryptionkey@0"
I20260927 15:12:39.285497 26330 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790521920546562-17952-0/minicluster-data/ts-1/wal/instance:
uuid: "5cd0f58aacc149f1be8a106ed88044ed"
format_stamp: "Formatted at 2026-09-27 15:12:39 on dist-test-slave-5s2t"
server_key: "577839d1571216068a2241036bc8ec65"
server_key_iv: "6d6cafe299aa97607e6a447fcf1977c0"
server_key_version: "encryptionkey@0"
I20260927 15:12:39.288836 26330 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260927 15:12:39.291008 26345 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260927 15:12:39.292196 26330 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260927 15:12:39.292284 26330 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790521920546562-17952-0/minicluster-data/ts-1/data,/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790521920546562-17952-0/minicluster-data/ts-1/wal
uuid: "5cd0f58aacc149f1be8a106ed88044ed"
format_stamp: "Formatted at 2026-09-27 15:12:39 on dist-test-slave-5s2t"
server_key: "577839d1571216068a2241036bc8ec65"
server_key_iv: "6d6cafe299aa97607e6a447fcf1977c0"
server_key_version: "encryptionkey@0"
I20260927 15:12:39.292356 26330 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790521920546562-17952-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790521920546562-17952-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790521920546562-17952-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260927 15:12:39.318109 26330 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260927 15:12:39.321197 26330 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260927 15:12:39.321344 26330 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260927 15:12:39.321861 26330 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260927 15:12:39.322618 26330 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260927 15:12:39.322659 26330 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260927 15:12:39.322695 26330 ts_tablet_manager.cc:610] Registered 0 tablets
I20260927 15:12:39.322715 26330 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260927 15:12:39.330590 26330 rpc_server.cc:307] RPC server started. Bound to: 127.17.136.2:35561
I20260927 15:12:39.330615 26458 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.136.2:35561 every 8 connection(s)
I20260927 15:12:39.331470 26330 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790521920546562-17952-0/minicluster-data/ts-1/data/info.pb
I20260927 15:12:39.336505 17952 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu as pid 26330
I20260927 15:12:39.336612 17952 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790521920546562-17952-0/minicluster-data/ts-1/wal/instance
I20260927 15:12:39.336871 17952 external_mini_cluster.cc:1428] Setting key 7d5213fb7d383c2ca0086b2941e2c64f
Sep 27 15:12:39 dist-test-slave-5s2t krb5kdc[26089](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790521959, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.136.2@KRBTEST.COM for kudu/127.17.136.62@KRBTEST.COM
I20260927 15:12:39.344354 26173 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:39.333099 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.136.2:37015 (local address 127.17.136.62:41997)
0927 15:12:39.333222 (+ 123us) server_negotiation.cc:206] Beginning negotiation
0927 15:12:39.333226 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0927 15:12:39.334217 (+ 991us) server_negotiation.cc:407] Connection header received
0927 15:12:39.335001 (+ 784us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:12:39.335003 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:12:39.335047 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:12:39.335114 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0927 15:12:39.336165 (+ 1051us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:39.336713 (+ 548us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:39.337911 (+ 1198us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:39.338210 (+ 299us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:39.338291 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:39.340919 (+ 2628us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0927 15:12:39.340922 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0927 15:12:39.340924 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0927 15:12:39.340949 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0927 15:12:39.342396 (+ 1447us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:12:39.342836 (+ 440us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:12:39.342840 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:12:39.342842 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:12:39.342933 (+ 91us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:12:39.343243 (+ 310us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:12:39.343264 (+ 21us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:12:39.343266 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:12:39.343485 (+ 219us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0927 15:12:39.343611 (+ 126us) server_negotiation.cc:1035] Waiting for connection context
0927 15:12:39.344051 (+ 440us) server_negotiation.cc:299] Negotiation successful
0927 15:12:39.344192 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260927 15:12:39.345100 26461 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:39.333453 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.62:41997 (local address 127.17.136.2:37015)
0927 15:12:39.334080 (+ 627us) negotiation.cc:107] Waiting for socket to connect
0927 15:12:39.334117 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0927 15:12:39.334831 (+ 714us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0927 15:12:39.335270 (+ 439us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0927 15:12:39.335276 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0927 15:12:39.335609 (+ 333us) client_negotiation.cc:189] Negotiated authn=SASL
0927 15:12:39.336053 (+ 444us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:12:39.336065 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:12:39.336822 (+ 757us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:12:39.336825 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:12:39.337794 (+ 969us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:12:39.337803 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:12:39.338348 (+ 545us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:12:39.338352 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:12:39.338533 (+ 181us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:39.339065 (+ 532us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0927 15:12:39.339082 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0927 15:12:39.340764 (+ 1682us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0927 15:12:39.342497 (+ 1733us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0927 15:12:39.342502 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0927 15:12:39.342513 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0927 15:12:39.342746 (+ 233us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0927 15:12:39.343024 (+ 278us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0927 15:12:39.343027 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0927 15:12:39.343029 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0927 15:12:39.343162 (+ 133us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0927 15:12:39.343608 (+ 446us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0927 15:12:39.343613 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0927 15:12:39.343829 (+ 216us) client_negotiation.cc:769] Sending connection context
0927 15:12:39.343985 (+ 156us) client_negotiation.cc:240] Negotiation successful
0927 15:12:39.344248 (+ 263us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":456,"thread_start_us":122,"threads_started":1}
WARNING: no policy specified for kudu/127.17.136.3@KRBTEST.COM; defaulting to no policy
I20260927 15:12:39.346131 26459 heartbeater.cc:347] Connected to a master server at 127.17.136.62:41997
I20260927 15:12:39.346355 26459 heartbeater.cc:464] Registering TS with master...
I20260927 15:12:39.346801 26459 heartbeater.cc:511] Master 127.17.136.62:41997 requested a full tablet report, sending...
I20260927 15:12:39.347783 26134 ts_manager.cc:194] Registered new tserver with Master: 5cd0f58aacc149f1be8a106ed88044ed (127.17.136.2:35561)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.136.3@KRBTEST.COM" created.
I20260927 15:12:39.348448 26134 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.136.2@KRBTEST.COM'} at 127.17.136.2:37015
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.136.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790521920546562-17952-0/krb5kdc/kudu_127.17.136.3.keytab.
Entry for principal kudu/127.17.136.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790521920546562-17952-0/krb5kdc/kudu_127.17.136.3.keytab.
I20260927 15:12:39.361562 17952 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu
/tmp/dist-test-taskiFOyeW/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790521920546562-17952-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790521920546562-17952-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790521920546562-17952-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790521920546562-17952-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.136.3:0
--local_ip_for_outbound_sockets=127.17.136.3
--webserver_interface=127.17.136.3
--webserver_port=0
--tserver_master_addrs=127.17.136.62:41997
--keytab_file=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790521920546562-17952-0/krb5kdc/kudu_127.17.136.3.keytab
--principal=kudu/127.17.136.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.136.20:39239
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790521920546562-17952-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790521920546562-17952-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790521920546562-17952-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260927 15:12:39.467465 26464 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260927 15:12:39.467700 26464 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260927 15:12:39.467756 26464 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260927 15:12:39.471689 26464 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260927 15:12:39.471742 26464 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260927 15:12:39.471817 26464 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.136.3
I20260927 15:12:39.476898 26464 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.136.20:39239
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790521920546562-17952-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790521920546562-17952-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790521920546562-17952-0/krb5kdc/kudu_127.17.136.3.keytab
--principal=kudu/127.17.136.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.136.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790521920546562-17952-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.17.136.3
--webserver_port=0
--tserver_master_addrs=127.17.136.62:41997
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26464
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.136.3
--log_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790521920546562-17952-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 27 Sep 2026 14:27:13 UTC on ccycloud.quasar-psqrth.root.comops.site
build id 4676138
I20260927 15:12:39.477829 26464 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260927 15:12:39.478767 26464 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260927 15:12:39.487671 26469 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260927 15:12:39.487696 26470 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260927 15:12:39.487702 26472 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260927 15:12:39.487884 26464 server_base.cc:1034] running on GCE node
I20260927 15:12:39.488313 26464 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260927 15:12:39.488900 26464 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260927 15:12:39.490058 26464 hybrid_clock.cc:648] HybridClock initialized: now 1790521959490043 us; error 28 us; skew 500 ppm
Sep 27 15:12:39 dist-test-slave-5s2t krb5kdc[26089](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790521959, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.136.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260927 15:12:39.492650 26464 init.cc:377] Logged in from keytab as kudu/127.17.136.3@KRBTEST.COM (short username kudu)
I20260927 15:12:39.493485 26464 webserver.cc:460] Webserver started at http://127.17.136.3:45817/ using document root <none> and password file <none>
I20260927 15:12:39.493991 26464 fs_manager.cc:359] Metadata directory not provided
I20260927 15:12:39.494050 26464 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260927 15:12:39.494231 26464 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260927 15:12:39.496279 26464 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790521920546562-17952-0/minicluster-data/ts-2/data/instance:
uuid: "475b3b8b69054c77b681c0386fa3b612"
format_stamp: "Formatted at 2026-09-27 15:12:39 on dist-test-slave-5s2t"
server_key: "4b65e0049ea022680ba7fe5901bf9aed"
server_key_iv: "fd1aed3b5a4a36afa3c2bca807abe505"
server_key_version: "encryptionkey@0"
I20260927 15:12:39.496817 26464 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790521920546562-17952-0/minicluster-data/ts-2/wal/instance:
uuid: "475b3b8b69054c77b681c0386fa3b612"
format_stamp: "Formatted at 2026-09-27 15:12:39 on dist-test-slave-5s2t"
server_key: "4b65e0049ea022680ba7fe5901bf9aed"
server_key_iv: "fd1aed3b5a4a36afa3c2bca807abe505"
server_key_version: "encryptionkey@0"
I20260927 15:12:39.500274 26464 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260927 15:12:39.502444 26479 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260927 15:12:39.503592 26464 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260927 15:12:39.503682 26464 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790521920546562-17952-0/minicluster-data/ts-2/data,/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790521920546562-17952-0/minicluster-data/ts-2/wal
uuid: "475b3b8b69054c77b681c0386fa3b612"
format_stamp: "Formatted at 2026-09-27 15:12:39 on dist-test-slave-5s2t"
server_key: "4b65e0049ea022680ba7fe5901bf9aed"
server_key_iv: "fd1aed3b5a4a36afa3c2bca807abe505"
server_key_version: "encryptionkey@0"
I20260927 15:12:39.503767 26464 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790521920546562-17952-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790521920546562-17952-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790521920546562-17952-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260927 15:12:39.544862 26464 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260927 15:12:39.547691 26464 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260927 15:12:39.547861 26464 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260927 15:12:39.548426 26464 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260927 15:12:39.549217 26464 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260927 15:12:39.549263 26464 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260927 15:12:39.549305 26464 ts_tablet_manager.cc:610] Registered 0 tablets
I20260927 15:12:39.549333 26464 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260927 15:12:39.557363 26464 rpc_server.cc:307] RPC server started. Bound to: 127.17.136.3:45417
I20260927 15:12:39.557394 26592 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.136.3:45417 every 8 connection(s)
I20260927 15:12:39.558205 26464 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790521920546562-17952-0/minicluster-data/ts-2/data/info.pb
Sep 27 15:12:39 dist-test-slave-5s2t krb5kdc[26089](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790521959, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.136.3@KRBTEST.COM for kudu/127.17.136.62@KRBTEST.COM
I20260927 15:12:39.566998 17952 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu as pid 26464
I20260927 15:12:39.567118 17952 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790521920546562-17952-0/minicluster-data/ts-2/wal/instance
I20260927 15:12:39.567458 17952 external_mini_cluster.cc:1428] Setting key 614fca2eb48a0842218dd4732b95b0c7
I20260927 15:12:39.570567 26173 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:39.559896 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.136.3:58093 (local address 127.17.136.62:41997)
0927 15:12:39.560020 (+ 124us) server_negotiation.cc:206] Beginning negotiation
0927 15:12:39.560023 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0927 15:12:39.561003 (+ 980us) server_negotiation.cc:407] Connection header received
0927 15:12:39.561806 (+ 803us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:12:39.561808 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:12:39.561853 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:12:39.561922 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0927 15:12:39.563170 (+ 1248us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:39.563706 (+ 536us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:39.564810 (+ 1104us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:39.565022 (+ 212us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:39.565088 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:39.567422 (+ 2334us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0927 15:12:39.567425 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0927 15:12:39.567427 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0927 15:12:39.567452 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0927 15:12:39.568850 (+ 1398us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:12:39.569386 (+ 536us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:12:39.569389 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:12:39.569391 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:12:39.569475 (+ 84us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:12:39.569738 (+ 263us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:12:39.569740 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:12:39.569741 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:12:39.569893 (+ 152us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0927 15:12:39.569968 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0927 15:12:39.570369 (+ 401us) server_negotiation.cc:299] Negotiation successful
0927 15:12:39.570455 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260927 15:12:39.571403 26595 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:39.560266 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.62:41997 (local address 127.17.136.3:58093)
0927 15:12:39.560863 (+ 597us) negotiation.cc:107] Waiting for socket to connect
0927 15:12:39.560903 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0927 15:12:39.561633 (+ 730us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0927 15:12:39.562079 (+ 446us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0927 15:12:39.562086 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0927 15:12:39.562412 (+ 326us) client_negotiation.cc:189] Negotiated authn=SASL
0927 15:12:39.563025 (+ 613us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:12:39.563039 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:12:39.563836 (+ 797us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:12:39.563839 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:12:39.564711 (+ 872us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:12:39.564720 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:12:39.565125 (+ 405us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:12:39.565127 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:12:39.565256 (+ 129us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:39.565746 (+ 490us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0927 15:12:39.565761 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0927 15:12:39.567276 (+ 1515us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0927 15:12:39.568949 (+ 1673us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0927 15:12:39.568963 (+ 14us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0927 15:12:39.568977 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0927 15:12:39.569301 (+ 324us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0927 15:12:39.569550 (+ 249us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0927 15:12:39.569552 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0927 15:12:39.569553 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0927 15:12:39.569675 (+ 122us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0927 15:12:39.569981 (+ 306us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0927 15:12:39.569985 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0927 15:12:39.570194 (+ 209us) client_negotiation.cc:769] Sending connection context
0927 15:12:39.570336 (+ 142us) client_negotiation.cc:240] Negotiation successful
0927 15:12:39.570566 (+ 230us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":419,"thread_start_us":105,"threads_started":1}
I20260927 15:12:39.572350 26593 heartbeater.cc:347] Connected to a master server at 127.17.136.62:41997
I20260927 15:12:39.572559 26593 heartbeater.cc:464] Registering TS with master...
I20260927 15:12:39.573005 26593 heartbeater.cc:511] Master 127.17.136.62:41997 requested a full tablet report, sending...
I20260927 15:12:39.573891 26134 ts_manager.cc:194] Registered new tserver with Master: 475b3b8b69054c77b681c0386fa3b612 (127.17.136.3:45417)
I20260927 15:12:39.574385 26134 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.136.3@KRBTEST.COM'} at 127.17.136.3:58093
I20260927 15:12:39.580758 17952 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
WARNING: no policy specified for oryx/127.17.136.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.17.136.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.17.136.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790521920546562-17952-0/krb5kdc/oryx_127.17.136.1.keytab.
Entry for principal oryx/127.17.136.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790521920546562-17952-0/krb5kdc/oryx_127.17.136.1.keytab.
WARNING: no policy specified for oryx/127.17.136.2@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.17.136.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.17.136.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790521920546562-17952-0/krb5kdc/oryx_127.17.136.2.keytab.
Entry for principal oryx/127.17.136.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790521920546562-17952-0/krb5kdc/oryx_127.17.136.2.keytab.
WARNING: no policy specified for oryx/127.17.136.3@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.17.136.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.17.136.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790521920546562-17952-0/krb5kdc/oryx_127.17.136.3.keytab.
Entry for principal oryx/127.17.136.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790521920546562-17952-0/krb5kdc/oryx_127.17.136.3.keytab.
I20260927 15:12:39.642326 17952 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu with pid 26196
I20260927 15:12:39.646893 17952 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu with pid 26330
I20260927 15:12:39.650976 17952 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu with pid 26464
I20260927 15:12:39.655053 17952 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu with pid 26102
I20260927 15:12:39.659519 17952 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu
/tmp/dist-test-taskiFOyeW/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790521920546562-17952-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790521920546562-17952-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790521920546562-17952-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790521920546562-17952-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.136.62:41997
--webserver_interface=127.17.136.62
--webserver_port=36367
--keytab_file=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790521920546562-17952-0/krb5kdc/kudu_127.17.136.62.keytab
--principal=kudu/127.17.136.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.136.20:39239
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.136.62:41997
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790521920546562-17952-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790521920546562-17952-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790521920546562-17952-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260927 15:12:39.762452 26602 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260927 15:12:39.762705 26602 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260927 15:12:39.762759 26602 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260927 15:12:39.766696 26602 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260927 15:12:39.766753 26602 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260927 15:12:39.766781 26602 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260927 15:12:39.766803 26602 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260927 15:12:39.766831 26602 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260927 15:12:39.771963 26602 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.136.20:39239
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790521920546562-17952-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790521920546562-17952-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.17.136.62:41997
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790521920546562-17952-0/krb5kdc/kudu_127.17.136.62.keytab
--principal=kudu/127.17.136.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.136.62:41997
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790521920546562-17952-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.17.136.62
--webserver_port=36367
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26602
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790521920546562-17952-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 27 Sep 2026 14:27:13 UTC on ccycloud.quasar-psqrth.root.comops.site
build id 4676138
I20260927 15:12:39.773013 26602 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260927 15:12:39.774014 26602 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260927 15:12:39.782095 26607 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260927 15:12:39.782071 26610 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260927 15:12:39.782063 26608 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260927 15:12:39.782420 26602 server_base.cc:1034] running on GCE node
I20260927 15:12:39.782969 26602 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260927 15:12:39.784107 26602 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260927 15:12:39.785254 26602 hybrid_clock.cc:648] HybridClock initialized: now 1790521959785245 us; error 39 us; skew 500 ppm
Sep 27 15:12:39 dist-test-slave-5s2t krb5kdc[26089](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790521959, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.136.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260927 15:12:39.787952 26602 init.cc:377] Logged in from keytab as kudu/127.17.136.62@KRBTEST.COM (short username kudu)
I20260927 15:12:39.788919 26602 webserver.cc:460] Webserver started at http://127.17.136.62:36367/ using document root <none> and password file <none>
I20260927 15:12:39.789459 26602 fs_manager.cc:359] Metadata directory not provided
I20260927 15:12:39.789541 26602 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260927 15:12:39.793438 26602 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.000s sys 0.004s
I20260927 15:12:39.795595 26617 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260927 15:12:39.796758 26602 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260927 15:12:39.796913 26602 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790521920546562-17952-0/minicluster-data/master-0/data,/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790521920546562-17952-0/minicluster-data/master-0/wal
uuid: "dc07700ae0a04e3597d206e8fa9ad7e1"
format_stamp: "Formatted at 2026-09-27 15:12:38 on dist-test-slave-5s2t"
server_key: "1e75c3594d4c31bf18d6dd57dd023e1d"
server_key_iv: "97b1d6bd43fc14c02c3fe606d5b9b4d6"
server_key_version: "encryptionkey@0"
I20260927 15:12:39.797432 26602 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790521920546562-17952-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790521920546562-17952-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790521920546562-17952-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260927 15:12:39.811805 26602 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260927 15:12:39.814466 26602 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260927 15:12:39.814637 26602 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260927 15:12:39.821576 26602 rpc_server.cc:307] RPC server started. Bound to: 127.17.136.62:41997
I20260927 15:12:39.821589 26669 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.136.62:41997 every 8 connection(s)
I20260927 15:12:39.822592 26602 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790521920546562-17952-0/minicluster-data/master-0/data/info.pb
I20260927 15:12:39.824555 17952 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu as pid 26602
I20260927 15:12:39.824940 17952 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu
/tmp/dist-test-taskiFOyeW/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790521920546562-17952-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790521920546562-17952-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790521920546562-17952-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790521920546562-17952-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.136.1:39131
--local_ip_for_outbound_sockets=127.17.136.1
--tserver_master_addrs=127.17.136.62:41997
--webserver_port=41505
--webserver_interface=127.17.136.1
--keytab_file=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790521920546562-17952-0/krb5kdc/kudu_127.17.136.1.keytab
--principal=kudu/127.17.136.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.136.20:39239
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.17.136.1
--keytab_file=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790521920546562-17952-0/krb5kdc/oryx_127.17.136.1.keytab with env {KRB5CCNAME=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790521920546562-17952-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790521920546562-17952-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790521920546562-17952-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260927 15:12:39.826648 26670 sys_catalog.cc:263] Verifying existing consensus state
I20260927 15:12:39.828243 26670 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P dc07700ae0a04e3597d206e8fa9ad7e1: Bootstrap starting.
I20260927 15:12:39.843559 26670 log.cc:824] T 00000000000000000000000000000000 P dc07700ae0a04e3597d206e8fa9ad7e1: Log is configured to *not* fsync() on all Append() calls
I20260927 15:12:39.849704 26670 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P dc07700ae0a04e3597d206e8fa9ad7e1: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260927 15:12:39.849997 26670 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P dc07700ae0a04e3597d206e8fa9ad7e1: Bootstrap complete.
I20260927 15:12:39.854087 26670 raft_consensus.cc:348] T 00000000000000000000000000000000 P dc07700ae0a04e3597d206e8fa9ad7e1 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dc07700ae0a04e3597d206e8fa9ad7e1" member_type: VOTER last_known_addr { host: "127.17.136.62" port: 41997 } }
I20260927 15:12:39.854467 26670 raft_consensus.cc:729] T 00000000000000000000000000000000 P dc07700ae0a04e3597d206e8fa9ad7e1 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc07700ae0a04e3597d206e8fa9ad7e1, State: Initialized, Role: FOLLOWER
I20260927 15:12:39.854889 26670 consensus_queue.cc:260] T 00000000000000000000000000000000 P dc07700ae0a04e3597d206e8fa9ad7e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dc07700ae0a04e3597d206e8fa9ad7e1" member_type: VOTER last_known_addr { host: "127.17.136.62" port: 41997 } }
I20260927 15:12:39.855003 26670 raft_consensus.cc:388] T 00000000000000000000000000000000 P dc07700ae0a04e3597d206e8fa9ad7e1 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260927 15:12:39.855065 26670 raft_consensus.cc:482] T 00000000000000000000000000000000 P dc07700ae0a04e3597d206e8fa9ad7e1 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260927 15:12:39.855152 26670 raft_consensus.cc:3037] T 00000000000000000000000000000000 P dc07700ae0a04e3597d206e8fa9ad7e1 [term 1 FOLLOWER]: Advancing to term 2
I20260927 15:12:39.856900 26670 raft_consensus.cc:504] T 00000000000000000000000000000000 P dc07700ae0a04e3597d206e8fa9ad7e1 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dc07700ae0a04e3597d206e8fa9ad7e1" member_type: VOTER last_known_addr { host: "127.17.136.62" port: 41997 } }
I20260927 15:12:39.857188 26670 leader_election.cc:302] T 00000000000000000000000000000000 P dc07700ae0a04e3597d206e8fa9ad7e1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: dc07700ae0a04e3597d206e8fa9ad7e1; no voters:
I20260927 15:12:39.857463 26670 leader_election.cc:288] T 00000000000000000000000000000000 P dc07700ae0a04e3597d206e8fa9ad7e1 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260927 15:12:39.857600 26674 raft_consensus.cc:2781] T 00000000000000000000000000000000 P dc07700ae0a04e3597d206e8fa9ad7e1 [term 2 FOLLOWER]: Leader election won for term 2
I20260927 15:12:39.857892 26674 raft_consensus.cc:686] T 00000000000000000000000000000000 P dc07700ae0a04e3597d206e8fa9ad7e1 [term 2 LEADER]: Becoming Leader. State: Replica: dc07700ae0a04e3597d206e8fa9ad7e1, State: Running, Role: LEADER
I20260927 15:12:39.858223 26674 consensus_queue.cc:237] T 00000000000000000000000000000000 P dc07700ae0a04e3597d206e8fa9ad7e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dc07700ae0a04e3597d206e8fa9ad7e1" member_type: VOTER last_known_addr { host: "127.17.136.62" port: 41997 } }
I20260927 15:12:39.858706 26670 sys_catalog.cc:564] T 00000000000000000000000000000000 P dc07700ae0a04e3597d206e8fa9ad7e1 [sys.catalog]: configured and running, proceeding with master startup.
I20260927 15:12:39.859604 26675 sys_catalog.cc:455] T 00000000000000000000000000000000 P dc07700ae0a04e3597d206e8fa9ad7e1 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "dc07700ae0a04e3597d206e8fa9ad7e1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dc07700ae0a04e3597d206e8fa9ad7e1" member_type: VOTER last_known_addr { host: "127.17.136.62" port: 41997 } } }
I20260927 15:12:39.859725 26675 sys_catalog.cc:458] T 00000000000000000000000000000000 P dc07700ae0a04e3597d206e8fa9ad7e1 [sys.catalog]: This master's current role is: LEADER
I20260927 15:12:39.859985 26676 sys_catalog.cc:455] T 00000000000000000000000000000000 P dc07700ae0a04e3597d206e8fa9ad7e1 [sys.catalog]: SysCatalogTable state changed. Reason: New leader dc07700ae0a04e3597d206e8fa9ad7e1. Latest consensus state: current_term: 2 leader_uuid: "dc07700ae0a04e3597d206e8fa9ad7e1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dc07700ae0a04e3597d206e8fa9ad7e1" member_type: VOTER last_known_addr { host: "127.17.136.62" port: 41997 } } }
I20260927 15:12:39.860065 26676 sys_catalog.cc:458] T 00000000000000000000000000000000 P dc07700ae0a04e3597d206e8fa9ad7e1 [sys.catalog]: This master's current role is: LEADER
I20260927 15:12:39.860562 26683 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260927 15:12:39.863207 26683 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260927 15:12:39.863773 26683 catalog_manager.cc:1259] Loaded cluster ID: 107b94f9e85d43f998e20e804b58a7c8
I20260927 15:12:39.863843 26683 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260927 15:12:39.865507 26683 catalog_manager.cc:1504] Loading token signing keys...
I20260927 15:12:39.866079 26683 catalog_manager.cc:5879] T 00000000000000000000000000000000 P dc07700ae0a04e3597d206e8fa9ad7e1: Loaded TSK: 0
I20260927 15:12:39.867010 26683 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260927 15:12:39.957582 26672 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260927 15:12:39.957885 26672 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260927 15:12:39.957953 26672 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260927 15:12:39.963707 26672 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260927 15:12:39.963783 26672 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260927 15:12:39.963866 26672 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.136.1
I20260927 15:12:39.971293 26672 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.136.20:39239
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790521920546562-17952-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790521920546562-17952-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790521920546562-17952-0/krb5kdc/oryx_127.17.136.1.keytab
--principal=oryx/127.17.136.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.136.1:39131
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790521920546562-17952-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.17.136.1
--webserver_port=41505
--tserver_master_addrs=127.17.136.62:41997
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26672
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.136.1
--log_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790521920546562-17952-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 27 Sep 2026 14:27:13 UTC on ccycloud.quasar-psqrth.root.comops.site
build id 4676138
I20260927 15:12:39.972653 26672 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260927 15:12:39.973969 26672 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260927 15:12:39.984494 26697 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260927 15:12:39.984454 26696 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260927 15:12:39.984592 26672 server_base.cc:1034] running on GCE node
W20260927 15:12:39.984762 26699 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260927 15:12:39.985145 26672 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260927 15:12:39.985740 26672 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260927 15:12:39.986898 26672 hybrid_clock.cc:648] HybridClock initialized: now 1790521959986877 us; error 51 us; skew 500 ppm
Sep 27 15:12:39 dist-test-slave-5s2t krb5kdc[26089](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790521959, etypes {rep=17 tkt=17 ses=17}, oryx/127.17.136.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260927 15:12:39.989519 26672 init.cc:377] Logged in from keytab as oryx/127.17.136.1@KRBTEST.COM (short username oryx)
I20260927 15:12:39.990383 26672 webserver.cc:460] Webserver started at http://127.17.136.1:41505/ using document root <none> and password file <none>
I20260927 15:12:39.990887 26672 fs_manager.cc:359] Metadata directory not provided
I20260927 15:12:39.990963 26672 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260927 15:12:39.994776 26672 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.000s sys 0.002s
I20260927 15:12:39.996795 26706 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260927 15:12:39.998013 26672 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260927 15:12:39.998111 26672 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790521920546562-17952-0/minicluster-data/ts-0/data,/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790521920546562-17952-0/minicluster-data/ts-0/wal
uuid: "af2399ea6fa64eab821e7cfa148ef077"
format_stamp: "Formatted at 2026-09-27 15:12:39 on dist-test-slave-5s2t"
server_key: "c0c9187e21ac055ffd1080d780812f9a"
server_key_iv: "ff4bb419ecfeeca8c98f034d4e1c9486"
server_key_version: "encryptionkey@0"
I20260927 15:12:39.998608 26672 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790521920546562-17952-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790521920546562-17952-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790521920546562-17952-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260927 15:12:40.014822 26672 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260927 15:12:40.017761 26672 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260927 15:12:40.017927 26672 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260927 15:12:40.018468 26672 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260927 15:12:40.019287 26672 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260927 15:12:40.019333 26672 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260927 15:12:40.019385 26672 ts_tablet_manager.cc:610] Registered 0 tablets
I20260927 15:12:40.019410 26672 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260927 15:12:40.028198 26672 rpc_server.cc:307] RPC server started. Bound to: 127.17.136.1:39131
I20260927 15:12:40.028234 26819 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.136.1:39131 every 8 connection(s)
I20260927 15:12:40.029176 26672 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790521920546562-17952-0/minicluster-data/ts-0/data/info.pb
I20260927 15:12:40.030635 17952 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu as pid 26672
I20260927 15:12:40.031095 17952 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu
/tmp/dist-test-taskiFOyeW/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790521920546562-17952-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790521920546562-17952-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790521920546562-17952-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790521920546562-17952-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.136.2:35561
--local_ip_for_outbound_sockets=127.17.136.2
--tserver_master_addrs=127.17.136.62:41997
--webserver_port=44943
--webserver_interface=127.17.136.2
--keytab_file=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790521920546562-17952-0/krb5kdc/kudu_127.17.136.2.keytab
--principal=kudu/127.17.136.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.136.20:39239
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.17.136.2
--keytab_file=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790521920546562-17952-0/krb5kdc/oryx_127.17.136.2.keytab with env {KRB5CCNAME=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790521920546562-17952-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790521920546562-17952-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790521920546562-17952-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Sep 27 15:12:40 dist-test-slave-5s2t krb5kdc[26089](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.136.1@KRBTEST.COM for oryx/127.17.136.62@KRBTEST.COM, Server not found in Kerberos database
Sep 27 15:12:40 dist-test-slave-5s2t krb5kdc[26089](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.136.1@KRBTEST.COM for oryx/127.17.136.62@KRBTEST.COM, Server not found in Kerberos database
I20260927 15:12:40.043215 26823 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:40.031595 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.62:41997 (local address 127.17.136.1:45767)
0927 15:12:40.032576 (+ 981us) negotiation.cc:107] Waiting for socket to connect
0927 15:12:40.032627 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0927 15:12:40.033561 (+ 934us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0927 15:12:40.034605 (+ 1044us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0927 15:12:40.034614 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0927 15:12:40.035012 (+ 398us) client_negotiation.cc:189] Negotiated authn=SASL
0927 15:12:40.035634 (+ 622us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:12:40.035652 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:12:40.036948 (+ 1296us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:12:40.036980 (+ 32us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:12:40.038347 (+ 1367us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:12:40.038359 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:12:40.039044 (+ 685us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:12:40.039049 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:12:40.039272 (+ 223us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:40.039844 (+ 572us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0927 15:12:40.039864 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0927 15:12:40.042256 (+ 2392us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.136.62:41997: Server oryx/127.17.136.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":783,"thread_start_us":116,"threads_started":1}
W20260927 15:12:40.043206 26822 negotiation.cc:337] Failed RPC negotiation. Trace:
0927 15:12:40.031361 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.136.1:45767 (local address 127.17.136.62:41997)
0927 15:12:40.032097 (+ 736us) server_negotiation.cc:206] Beginning negotiation
0927 15:12:40.032116 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0927 15:12:40.032744 (+ 628us) server_negotiation.cc:407] Connection header received
0927 15:12:40.033926 (+ 1182us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:12:40.033937 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:12:40.034221 (+ 284us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:12:40.034521 (+ 300us) server_negotiation.cc:226] Negotiated authn=SASL
0927 15:12:40.035796 (+ 1275us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:40.036817 (+ 1021us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:40.038457 (+ 1640us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:40.038889 (+ 432us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:40.039008 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:40.042482 (+ 3474us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.136.1:45767: BlockingRecv error: recv got EOF from 127.17.136.1:45767 (error 108)
Metrics: {"server-negotiator.queue_time_us":589,"thread_start_us":121,"threads_started":1}
W20260927 15:12:40.043984 26820 heartbeater.cc:644] Failed to heartbeat to 127.17.136.62:41997 (0 consecutive failures): Not authorized: Failed to ping master at 127.17.136.62:41997: Client connection negotiation failed: client connection to 127.17.136.62:41997: Server oryx/127.17.136.62@KRBTEST.COM not found in Kerberos database
Sep 27 15:12:40 dist-test-slave-5s2t krb5kdc[26089](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.136.1@KRBTEST.COM for oryx/127.17.136.62@KRBTEST.COM, Server not found in Kerberos database
Sep 27 15:12:40 dist-test-slave-5s2t krb5kdc[26089](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.136.1@KRBTEST.COM for oryx/127.17.136.62@KRBTEST.COM, Server not found in Kerberos database
I20260927 15:12:40.048866 26823 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:40.044377 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.62:41997 (local address 127.17.136.1:50643)
0927 15:12:40.044475 (+ 98us) negotiation.cc:107] Waiting for socket to connect
0927 15:12:40.044488 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0927 15:12:40.044561 (+ 73us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0927 15:12:40.044775 (+ 214us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0927 15:12:40.044778 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0927 15:12:40.044911 (+ 133us) client_negotiation.cc:189] Negotiated authn=SASL
0927 15:12:40.045007 (+ 96us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:12:40.045012 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:12:40.045685 (+ 673us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:12:40.045688 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:12:40.046213 (+ 525us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:12:40.046220 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:12:40.046644 (+ 424us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:12:40.046648 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:12:40.046729 (+ 81us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:40.047151 (+ 422us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0927 15:12:40.047162 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0927 15:12:40.048749 (+ 1587us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.136.62:41997: Server oryx/127.17.136.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":28}
W20260927 15:12:40.048938 26822 negotiation.cc:337] Failed RPC negotiation. Trace:
0927 15:12:40.044448 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.136.1:50643 (local address 127.17.136.62:41997)
0927 15:12:40.044546 (+ 98us) server_negotiation.cc:206] Beginning negotiation
0927 15:12:40.044549 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0927 15:12:40.044561 (+ 12us) server_negotiation.cc:407] Connection header received
0927 15:12:40.044646 (+ 85us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:12:40.044648 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:12:40.044689 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:12:40.044753 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0927 15:12:40.045103 (+ 350us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:40.045594 (+ 491us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:40.046311 (+ 717us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:40.046554 (+ 243us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:40.046635 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:40.048853 (+ 2218us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.136.1:50643: BlockingRecv error: recv got EOF from 127.17.136.1:50643 (error 108)
Metrics: {"server-negotiator.queue_time_us":42}
Sep 27 15:12:40 dist-test-slave-5s2t krb5kdc[26089](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.136.1@KRBTEST.COM for oryx/127.17.136.62@KRBTEST.COM, Server not found in Kerberos database
Sep 27 15:12:40 dist-test-slave-5s2t krb5kdc[26089](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.136.1@KRBTEST.COM for oryx/127.17.136.62@KRBTEST.COM, Server not found in Kerberos database
I20260927 15:12:40.053658 26823 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:40.049367 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.62:41997 (local address 127.17.136.1:52639)
0927 15:12:40.049478 (+ 111us) negotiation.cc:107] Waiting for socket to connect
0927 15:12:40.049490 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0927 15:12:40.049556 (+ 66us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0927 15:12:40.049797 (+ 241us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0927 15:12:40.049800 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0927 15:12:40.049925 (+ 125us) client_negotiation.cc:189] Negotiated authn=SASL
0927 15:12:40.049986 (+ 61us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:12:40.049990 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:12:40.050620 (+ 630us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:12:40.050624 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:12:40.051118 (+ 494us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:12:40.051125 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:12:40.051553 (+ 428us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:12:40.051556 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:12:40.051627 (+ 71us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:40.052032 (+ 405us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0927 15:12:40.052042 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0927 15:12:40.053548 (+ 1506us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.136.62:41997: Server oryx/127.17.136.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":38}
W20260927 15:12:40.053812 26820 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260927 15:12:40.053894 26822 negotiation.cc:337] Failed RPC negotiation. Trace:
0927 15:12:40.049527 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.136.1:52639 (local address 127.17.136.62:41997)
0927 15:12:40.049638 (+ 111us) server_negotiation.cc:206] Beginning negotiation
0927 15:12:40.049641 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0927 15:12:40.049651 (+ 10us) server_negotiation.cc:407] Connection header received
0927 15:12:40.049676 (+ 25us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:12:40.049677 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:12:40.049715 (+ 38us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:12:40.049774 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0927 15:12:40.050077 (+ 303us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:40.050532 (+ 455us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:40.051214 (+ 682us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:40.051453 (+ 239us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:40.051534 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:40.053669 (+ 2135us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.136.1:52639: BlockingRecv error: recv got EOF from 127.17.136.1:52639 (error 108)
Metrics: {"server-negotiator.queue_time_us":41}
W20260927 15:12:40.140136 26824 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260927 15:12:40.140365 26824 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260927 15:12:40.140419 26824 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260927 15:12:40.144300 26824 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260927 15:12:40.144352 26824 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260927 15:12:40.144428 26824 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.136.2
I20260927 15:12:40.149489 26824 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.136.20:39239
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790521920546562-17952-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790521920546562-17952-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790521920546562-17952-0/krb5kdc/oryx_127.17.136.2.keytab
--principal=oryx/127.17.136.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.136.2:35561
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790521920546562-17952-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.17.136.2
--webserver_port=44943
--tserver_master_addrs=127.17.136.62:41997
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26824
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.136.2
--log_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790521920546562-17952-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 27 Sep 2026 14:27:13 UTC on ccycloud.quasar-psqrth.root.comops.site
build id 4676138
I20260927 15:12:40.150454 26824 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260927 15:12:40.151427 26824 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260927 15:12:40.160334 26832 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260927 15:12:40.160422 26829 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260927 15:12:40.160326 26830 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260927 15:12:40.160458 26824 server_base.cc:1034] running on GCE node
I20260927 15:12:40.161017 26824 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260927 15:12:40.161651 26824 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260927 15:12:40.162798 26824 hybrid_clock.cc:648] HybridClock initialized: now 1790521960162768 us; error 47 us; skew 500 ppm
Sep 27 15:12:40 dist-test-slave-5s2t krb5kdc[26089](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790521960, etypes {rep=17 tkt=17 ses=17}, oryx/127.17.136.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260927 15:12:40.165549 26824 init.cc:377] Logged in from keytab as oryx/127.17.136.2@KRBTEST.COM (short username oryx)
I20260927 15:12:40.166357 26824 webserver.cc:460] Webserver started at http://127.17.136.2:44943/ using document root <none> and password file <none>
I20260927 15:12:40.166873 26824 fs_manager.cc:359] Metadata directory not provided
I20260927 15:12:40.166945 26824 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260927 15:12:40.170616 26824 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.002s sys 0.000s
I20260927 15:12:40.172560 26839 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260927 15:12:40.173720 26824 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260927 15:12:40.173825 26824 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790521920546562-17952-0/minicluster-data/ts-1/data,/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790521920546562-17952-0/minicluster-data/ts-1/wal
uuid: "5cd0f58aacc149f1be8a106ed88044ed"
format_stamp: "Formatted at 2026-09-27 15:12:39 on dist-test-slave-5s2t"
server_key: "577839d1571216068a2241036bc8ec65"
server_key_iv: "6d6cafe299aa97607e6a447fcf1977c0"
server_key_version: "encryptionkey@0"
I20260927 15:12:40.174311 26824 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790521920546562-17952-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790521920546562-17952-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790521920546562-17952-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260927 15:12:40.186683 26824 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260927 15:12:40.189185 26824 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260927 15:12:40.189337 26824 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260927 15:12:40.189841 26824 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260927 15:12:40.190590 26824 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260927 15:12:40.190634 26824 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260927 15:12:40.190682 26824 ts_tablet_manager.cc:610] Registered 0 tablets
I20260927 15:12:40.190711 26824 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260927 15:12:40.198567 26824 rpc_server.cc:307] RPC server started. Bound to: 127.17.136.2:35561
I20260927 15:12:40.198611 26952 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.136.2:35561 every 8 connection(s)
I20260927 15:12:40.199538 26824 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790521920546562-17952-0/minicluster-data/ts-1/data/info.pb
Sep 27 15:12:40 dist-test-slave-5s2t krb5kdc[26089](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.136.2@KRBTEST.COM for oryx/127.17.136.62@KRBTEST.COM, Server not found in Kerberos database
Sep 27 15:12:40 dist-test-slave-5s2t krb5kdc[26089](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.136.2@KRBTEST.COM for oryx/127.17.136.62@KRBTEST.COM, Server not found in Kerberos database
I20260927 15:12:40.208820 17952 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu as pid 26824
I20260927 15:12:40.209192 17952 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu
/tmp/dist-test-taskiFOyeW/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790521920546562-17952-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790521920546562-17952-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790521920546562-17952-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790521920546562-17952-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.136.3:45417
--local_ip_for_outbound_sockets=127.17.136.3
--tserver_master_addrs=127.17.136.62:41997
--webserver_port=45817
--webserver_interface=127.17.136.3
--keytab_file=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790521920546562-17952-0/krb5kdc/kudu_127.17.136.3.keytab
--principal=kudu/127.17.136.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.136.20:39239
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.17.136.3
--keytab_file=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790521920546562-17952-0/krb5kdc/oryx_127.17.136.3.keytab with env {KRB5CCNAME=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790521920546562-17952-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790521920546562-17952-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790521920546562-17952-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260927 15:12:40.209368 26822 negotiation.cc:337] Failed RPC negotiation. Trace:
0927 15:12:40.201215 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.136.2:46889 (local address 127.17.136.62:41997)
0927 15:12:40.201341 (+ 126us) server_negotiation.cc:206] Beginning negotiation
0927 15:12:40.201345 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0927 15:12:40.202413 (+ 1068us) server_negotiation.cc:407] Connection header received
0927 15:12:40.203277 (+ 864us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:12:40.203281 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:12:40.203338 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:12:40.203407 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0927 15:12:40.204503 (+ 1096us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:40.205009 (+ 506us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:40.206080 (+ 1071us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:40.206286 (+ 206us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:40.206368 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:40.209251 (+ 2883us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.136.2:46889: BlockingRecv error: recv got EOF from 127.17.136.2:46889 (error 108)
Metrics: {"server-negotiator.queue_time_us":44}
I20260927 15:12:40.209918 26955 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:40.201677 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.62:41997 (local address 127.17.136.2:46889)
0927 15:12:40.202279 (+ 602us) negotiation.cc:107] Waiting for socket to connect
0927 15:12:40.202319 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0927 15:12:40.203077 (+ 758us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0927 15:12:40.203577 (+ 500us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0927 15:12:40.203584 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0927 15:12:40.203913 (+ 329us) client_negotiation.cc:189] Negotiated authn=SASL
0927 15:12:40.204367 (+ 454us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:12:40.204380 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:12:40.205116 (+ 736us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:12:40.205119 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:12:40.205972 (+ 853us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:12:40.205981 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:12:40.206411 (+ 430us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:12:40.206414 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:12:40.206569 (+ 155us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:40.207043 (+ 474us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0927 15:12:40.207058 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0927 15:12:40.209125 (+ 2067us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.136.62:41997: Server oryx/127.17.136.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":421,"thread_start_us":106,"threads_started":1}
W20260927 15:12:40.210398 26953 heartbeater.cc:644] Failed to heartbeat to 127.17.136.62:41997 (0 consecutive failures): Not authorized: Failed to ping master at 127.17.136.62:41997: Client connection negotiation failed: client connection to 127.17.136.62:41997: Server oryx/127.17.136.62@KRBTEST.COM not found in Kerberos database
Sep 27 15:12:40 dist-test-slave-5s2t krb5kdc[26089](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.136.2@KRBTEST.COM for oryx/127.17.136.62@KRBTEST.COM, Server not found in Kerberos database
Sep 27 15:12:40 dist-test-slave-5s2t krb5kdc[26089](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.136.2@KRBTEST.COM for oryx/127.17.136.62@KRBTEST.COM, Server not found in Kerberos database
I20260927 15:12:40.215768 26955 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:40.210797 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.62:41997 (local address 127.17.136.2:57749)
0927 15:12:40.210890 (+ 93us) negotiation.cc:107] Waiting for socket to connect
0927 15:12:40.210904 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0927 15:12:40.210975 (+ 71us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0927 15:12:40.211168 (+ 193us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0927 15:12:40.211171 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0927 15:12:40.211336 (+ 165us) client_negotiation.cc:189] Negotiated authn=SASL
0927 15:12:40.211414 (+ 78us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:12:40.211419 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:12:40.212116 (+ 697us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:12:40.212119 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:12:40.212945 (+ 826us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:12:40.212956 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:12:40.213338 (+ 382us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:12:40.213342 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:12:40.213432 (+ 90us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:40.213837 (+ 405us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0927 15:12:40.213851 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0927 15:12:40.215652 (+ 1801us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.136.62:41997: Server oryx/127.17.136.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":27}
W20260927 15:12:40.215852 26822 negotiation.cc:337] Failed RPC negotiation. Trace:
0927 15:12:40.210867 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.136.2:57749 (local address 127.17.136.62:41997)
0927 15:12:40.210981 (+ 114us) server_negotiation.cc:206] Beginning negotiation
0927 15:12:40.210985 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0927 15:12:40.210997 (+ 12us) server_negotiation.cc:407] Connection header received
0927 15:12:40.211051 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:12:40.211054 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:12:40.211089 (+ 35us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:12:40.211146 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0927 15:12:40.211550 (+ 404us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:40.212024 (+ 474us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:40.213049 (+ 1025us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:40.213243 (+ 194us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:40.213314 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:40.215760 (+ 2446us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.136.2:57749: BlockingRecv error: recv got EOF from 127.17.136.2:57749 (error 108)
Metrics: {"server-negotiator.queue_time_us":42}
Sep 27 15:12:40 dist-test-slave-5s2t krb5kdc[26089](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.136.2@KRBTEST.COM for oryx/127.17.136.62@KRBTEST.COM, Server not found in Kerberos database
Sep 27 15:12:40 dist-test-slave-5s2t krb5kdc[26089](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.136.2@KRBTEST.COM for oryx/127.17.136.62@KRBTEST.COM, Server not found in Kerberos database
I20260927 15:12:40.220887 26955 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:40.216321 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.62:41997 (local address 127.17.136.2:50947)
0927 15:12:40.216454 (+ 133us) negotiation.cc:107] Waiting for socket to connect
0927 15:12:40.216467 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0927 15:12:40.216526 (+ 59us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0927 15:12:40.216723 (+ 197us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0927 15:12:40.216724 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0927 15:12:40.216833 (+ 109us) client_negotiation.cc:189] Negotiated authn=SASL
0927 15:12:40.216893 (+ 60us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:12:40.216896 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:12:40.217795 (+ 899us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:12:40.217797 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:12:40.218287 (+ 490us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:12:40.218292 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:12:40.218787 (+ 495us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:12:40.218789 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:12:40.218838 (+ 49us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:40.219216 (+ 378us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0927 15:12:40.219226 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0927 15:12:40.220775 (+ 1549us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.136.62:41997: Server oryx/127.17.136.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":79}
W20260927 15:12:40.221086 26953 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260927 15:12:40.221195 26822 negotiation.cc:337] Failed RPC negotiation. Trace:
0927 15:12:40.216419 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.136.2:50947 (local address 127.17.136.62:41997)
0927 15:12:40.216543 (+ 124us) server_negotiation.cc:206] Beginning negotiation
0927 15:12:40.216547 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0927 15:12:40.216561 (+ 14us) server_negotiation.cc:407] Connection header received
0927 15:12:40.216595 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:12:40.216597 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:12:40.216636 (+ 39us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:12:40.216717 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0927 15:12:40.216983 (+ 266us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:40.217709 (+ 726us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:40.218380 (+ 671us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:40.218697 (+ 317us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:40.218799 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:40.220869 (+ 2070us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.136.2:50947: BlockingRecv error: recv got EOF from 127.17.136.2:50947 (error 108)
Metrics: {"server-negotiator.queue_time_us":53}
W20260927 15:12:40.316536 26956 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260927 15:12:40.316865 26956 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260927 15:12:40.316924 26956 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260927 15:12:40.322050 26956 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260927 15:12:40.322124 26956 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260927 15:12:40.322203 26956 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.136.3
I20260927 15:12:40.327735 26956 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.136.20:39239
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790521920546562-17952-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790521920546562-17952-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790521920546562-17952-0/krb5kdc/oryx_127.17.136.3.keytab
--principal=oryx/127.17.136.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.136.3:45417
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790521920546562-17952-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.17.136.3
--webserver_port=45817
--tserver_master_addrs=127.17.136.62:41997
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26956
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.136.3
--log_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790521920546562-17952-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 27 Sep 2026 14:27:13 UTC on ccycloud.quasar-psqrth.root.comops.site
build id 4676138
I20260927 15:12:40.328725 26956 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260927 15:12:40.329676 26956 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260927 15:12:40.338467 26962 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260927 15:12:40.338467 26961 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260927 15:12:40.338603 26956 server_base.cc:1034] running on GCE node
W20260927 15:12:40.338492 26964 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260927 15:12:40.339094 26956 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260927 15:12:40.339687 26956 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260927 15:12:40.340832 26956 hybrid_clock.cc:648] HybridClock initialized: now 1790521960340805 us; error 39 us; skew 500 ppm
Sep 27 15:12:40 dist-test-slave-5s2t krb5kdc[26089](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790521960, etypes {rep=17 tkt=17 ses=17}, oryx/127.17.136.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260927 15:12:40.343324 26956 init.cc:377] Logged in from keytab as oryx/127.17.136.3@KRBTEST.COM (short username oryx)
I20260927 15:12:40.344115 26956 webserver.cc:460] Webserver started at http://127.17.136.3:45817/ using document root <none> and password file <none>
I20260927 15:12:40.344635 26956 fs_manager.cc:359] Metadata directory not provided
I20260927 15:12:40.344709 26956 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260927 15:12:40.348206 26956 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.003s sys 0.000s
I20260927 15:12:40.350003 26971 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260927 15:12:40.351097 26956 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260927 15:12:40.351200 26956 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790521920546562-17952-0/minicluster-data/ts-2/data,/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790521920546562-17952-0/minicluster-data/ts-2/wal
uuid: "475b3b8b69054c77b681c0386fa3b612"
format_stamp: "Formatted at 2026-09-27 15:12:39 on dist-test-slave-5s2t"
server_key: "4b65e0049ea022680ba7fe5901bf9aed"
server_key_iv: "fd1aed3b5a4a36afa3c2bca807abe505"
server_key_version: "encryptionkey@0"
I20260927 15:12:40.351745 26956 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790521920546562-17952-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790521920546562-17952-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790521920546562-17952-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260927 15:12:40.365095 26956 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260927 15:12:40.367697 26956 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260927 15:12:40.367849 26956 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260927 15:12:40.368381 26956 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260927 15:12:40.369123 26956 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260927 15:12:40.369166 26956 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260927 15:12:40.369217 26956 ts_tablet_manager.cc:610] Registered 0 tablets
I20260927 15:12:40.369243 26956 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260927 15:12:40.377143 26956 rpc_server.cc:307] RPC server started. Bound to: 127.17.136.3:45417
I20260927 15:12:40.377193 27084 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.136.3:45417 every 8 connection(s)
I20260927 15:12:40.378093 26956 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790521920546562-17952-0/minicluster-data/ts-2/data/info.pb
I20260927 15:12:40.384841 17952 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu as pid 26956
Sep 27 15:12:40 dist-test-slave-5s2t krb5kdc[26089](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.136.3@KRBTEST.COM for oryx/127.17.136.62@KRBTEST.COM, Server not found in Kerberos database
Sep 27 15:12:40 dist-test-slave-5s2t krb5kdc[26089](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.136.3@KRBTEST.COM for oryx/127.17.136.62@KRBTEST.COM, Server not found in Kerberos database
W20260927 15:12:40.388087 26822 negotiation.cc:337] Failed RPC negotiation. Trace:
0927 15:12:40.379677 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.136.3:37493 (local address 127.17.136.62:41997)
0927 15:12:40.379787 (+ 110us) server_negotiation.cc:206] Beginning negotiation
0927 15:12:40.379790 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0927 15:12:40.380749 (+ 959us) server_negotiation.cc:407] Connection header received
0927 15:12:40.381583 (+ 834us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:12:40.381586 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:12:40.381640 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:12:40.381711 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0927 15:12:40.382804 (+ 1093us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:40.383356 (+ 552us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:40.384461 (+ 1105us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:40.384717 (+ 256us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:40.384835 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:40.387969 (+ 3134us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.136.3:37493: BlockingRecv error: recv got EOF from 127.17.136.3:37493 (error 108)
Metrics: {"server-negotiator.queue_time_us":36}
I20260927 15:12:40.388605 27087 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:40.380036 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.62:41997 (local address 127.17.136.3:37493)
0927 15:12:40.380615 (+ 579us) negotiation.cc:107] Waiting for socket to connect
0927 15:12:40.380654 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0927 15:12:40.381389 (+ 735us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0927 15:12:40.381880 (+ 491us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0927 15:12:40.381887 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0927 15:12:40.382224 (+ 337us) client_negotiation.cc:189] Negotiated authn=SASL
0927 15:12:40.382671 (+ 447us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:12:40.382683 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:12:40.383471 (+ 788us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:12:40.383474 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:12:40.384343 (+ 869us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:12:40.384352 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:12:40.384893 (+ 541us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:12:40.384896 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:12:40.385080 (+ 184us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:40.385654 (+ 574us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0927 15:12:40.385674 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0927 15:12:40.387846 (+ 2172us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.136.62:41997: Server oryx/127.17.136.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":407,"thread_start_us":98,"threads_started":1}
W20260927 15:12:40.389056 27085 heartbeater.cc:644] Failed to heartbeat to 127.17.136.62:41997 (0 consecutive failures): Not authorized: Failed to ping master at 127.17.136.62:41997: Client connection negotiation failed: client connection to 127.17.136.62:41997: Server oryx/127.17.136.62@KRBTEST.COM not found in Kerberos database
Sep 27 15:12:40 dist-test-slave-5s2t krb5kdc[26089](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.136.3@KRBTEST.COM for oryx/127.17.136.62@KRBTEST.COM, Server not found in Kerberos database
Sep 27 15:12:40 dist-test-slave-5s2t krb5kdc[26089](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.136.3@KRBTEST.COM for oryx/127.17.136.62@KRBTEST.COM, Server not found in Kerberos database
I20260927 15:12:40.393877 27089 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:40.385828 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58178 (local address 127.17.136.62:41997)
0927 15:12:40.386059 (+ 231us) server_negotiation.cc:206] Beginning negotiation
0927 15:12:40.386062 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0927 15:12:40.386072 (+ 10us) server_negotiation.cc:407] Connection header received
0927 15:12:40.386098 (+ 26us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:12:40.386100 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:12:40.386132 (+ 32us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:12:40.386205 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0927 15:12:40.386895 (+ 690us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:40.387484 (+ 589us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:40.388483 (+ 999us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:40.388698 (+ 215us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:40.388778 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:40.390377 (+ 1599us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0927 15:12:40.390382 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0927 15:12:40.390395 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0927 15:12:40.390420 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0927 15:12:40.391991 (+ 1571us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:12:40.392375 (+ 384us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:12:40.392380 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:12:40.392385 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:12:40.392497 (+ 112us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:12:40.392747 (+ 250us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:12:40.392750 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:12:40.392751 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:12:40.393100 (+ 349us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0927 15:12:40.393238 (+ 138us) server_negotiation.cc:1035] Waiting for connection context
0927 15:12:40.393524 (+ 286us) server_negotiation.cc:299] Negotiation successful
0927 15:12:40.393726 (+ 202us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":170,"thread_start_us":90,"threads_started":1}
I20260927 15:12:40.394275 27087 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:40.389468 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.62:41997 (local address 127.17.136.3:49593)
0927 15:12:40.389565 (+ 97us) negotiation.cc:107] Waiting for socket to connect
0927 15:12:40.389578 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0927 15:12:40.389645 (+ 67us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0927 15:12:40.389843 (+ 198us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0927 15:12:40.389845 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0927 15:12:40.389991 (+ 146us) client_negotiation.cc:189] Negotiated authn=SASL
0927 15:12:40.390097 (+ 106us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:12:40.390103 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:12:40.390710 (+ 607us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:12:40.390713 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:12:40.391419 (+ 706us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:12:40.391428 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:12:40.391833 (+ 405us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:12:40.391836 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:12:40.391918 (+ 82us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:40.392273 (+ 355us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0927 15:12:40.392287 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0927 15:12:40.394173 (+ 1886us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.136.62:41997: Server oryx/127.17.136.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":28}
W20260927 15:12:40.394433 26822 negotiation.cc:337] Failed RPC negotiation. Trace:
0927 15:12:40.389525 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.136.3:49593 (local address 127.17.136.62:41997)
0927 15:12:40.389629 (+ 104us) server_negotiation.cc:206] Beginning negotiation
0927 15:12:40.389632 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0927 15:12:40.389643 (+ 11us) server_negotiation.cc:407] Connection header received
0927 15:12:40.389723 (+ 80us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:12:40.389725 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:12:40.389754 (+ 29us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:12:40.389813 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0927 15:12:40.390183 (+ 370us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:40.390631 (+ 448us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:40.391528 (+ 897us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:40.391746 (+ 218us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:40.391825 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:40.394314 (+ 2489us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.136.3:49593: BlockingRecv error: recv got EOF from 127.17.136.3:49593 (error 108)
Metrics: {"server-negotiator.queue_time_us":52}
Sep 27 15:12:40 dist-test-slave-5s2t krb5kdc[26089](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.136.3@KRBTEST.COM for oryx/127.17.136.62@KRBTEST.COM, Server not found in Kerberos database
Sep 27 15:12:40 dist-test-slave-5s2t krb5kdc[26089](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.136.3@KRBTEST.COM for oryx/127.17.136.62@KRBTEST.COM, Server not found in Kerberos database
I20260927 15:12:40.399338 27087 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:40.394920 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.62:41997 (local address 127.17.136.3:38793)
0927 15:12:40.395005 (+ 85us) negotiation.cc:107] Waiting for socket to connect
0927 15:12:40.395019 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0927 15:12:40.395083 (+ 64us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0927 15:12:40.395354 (+ 271us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0927 15:12:40.395356 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0927 15:12:40.395469 (+ 113us) client_negotiation.cc:189] Negotiated authn=SASL
0927 15:12:40.395535 (+ 66us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:12:40.395540 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:12:40.396357 (+ 817us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:12:40.396359 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:12:40.396926 (+ 567us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:12:40.396934 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:12:40.397350 (+ 416us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:12:40.397352 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:12:40.397403 (+ 51us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:40.397747 (+ 344us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0927 15:12:40.397756 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0927 15:12:40.399225 (+ 1469us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.136.62:41997: Server oryx/127.17.136.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":27}
W20260927 15:12:40.399518 27085 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260927 15:12:40.399528 27089 negotiation.cc:337] Failed RPC negotiation. Trace:
0927 15:12:40.394993 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.136.3:38793 (local address 127.17.136.62:41997)
0927 15:12:40.395111 (+ 118us) server_negotiation.cc:206] Beginning negotiation
0927 15:12:40.395116 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0927 15:12:40.395130 (+ 14us) server_negotiation.cc:407] Connection header received
0927 15:12:40.395165 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:12:40.395168 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:12:40.395207 (+ 39us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:12:40.395339 (+ 132us) server_negotiation.cc:226] Negotiated authn=SASL
0927 15:12:40.395635 (+ 296us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:40.396258 (+ 623us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:40.397035 (+ 777us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:40.397247 (+ 212us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:40.397352 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:40.399419 (+ 2067us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.136.3:38793: BlockingRecv error: recv got EOF from 127.17.136.3:38793 (error 108)
Metrics: {"server-negotiator.queue_time_us":60}
Sep 27 15:12:41 dist-test-slave-5s2t krb5kdc[26089](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.136.1@KRBTEST.COM for oryx/127.17.136.62@KRBTEST.COM, Server not found in Kerberos database
Sep 27 15:12:41 dist-test-slave-5s2t krb5kdc[26089](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.136.1@KRBTEST.COM for oryx/127.17.136.62@KRBTEST.COM, Server not found in Kerberos database
I20260927 15:12:41.059316 27090 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:41.054351 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.62:41997 (local address 127.17.136.1:53539)
0927 15:12:41.054599 (+ 248us) negotiation.cc:107] Waiting for socket to connect
0927 15:12:41.054611 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0927 15:12:41.054695 (+ 84us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0927 15:12:41.054921 (+ 226us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0927 15:12:41.054923 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0927 15:12:41.055094 (+ 171us) client_negotiation.cc:189] Negotiated authn=SASL
0927 15:12:41.055208 (+ 114us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:12:41.055215 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:12:41.055987 (+ 772us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:12:41.055990 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:12:41.056552 (+ 562us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:12:41.056560 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:12:41.056924 (+ 364us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:12:41.056926 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:12:41.057000 (+ 74us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:41.057419 (+ 419us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0927 15:12:41.057430 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0927 15:12:41.059156 (+ 1726us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.136.62:41997: Server oryx/127.17.136.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":174,"thread_start_us":71,"threads_started":1}
W20260927 15:12:41.059425 27091 negotiation.cc:337] Failed RPC negotiation. Trace:
0927 15:12:41.054392 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.136.1:53539 (local address 127.17.136.62:41997)
0927 15:12:41.054640 (+ 248us) server_negotiation.cc:206] Beginning negotiation
0927 15:12:41.054643 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0927 15:12:41.054656 (+ 13us) server_negotiation.cc:407] Connection header received
0927 15:12:41.054773 (+ 117us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:12:41.054775 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:12:41.054816 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:12:41.054889 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0927 15:12:41.055333 (+ 444us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:41.055875 (+ 542us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:41.056634 (+ 759us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:41.056844 (+ 210us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:41.056913 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:41.059314 (+ 2401us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.136.1:53539: BlockingRecv error: recv got EOF from 127.17.136.1:53539 (error 108)
Metrics: {"server-negotiator.queue_time_us":179,"thread_start_us":89,"threads_started":1}
Sep 27 15:12:41 dist-test-slave-5s2t krb5kdc[26089](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.136.2@KRBTEST.COM for oryx/127.17.136.62@KRBTEST.COM, Server not found in Kerberos database
Sep 27 15:12:41 dist-test-slave-5s2t krb5kdc[26089](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.136.2@KRBTEST.COM for oryx/127.17.136.62@KRBTEST.COM, Server not found in Kerberos database
I20260927 15:12:41.226840 27092 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:41.221688 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.62:41997 (local address 127.17.136.2:48821)
0927 15:12:41.222000 (+ 312us) negotiation.cc:107] Waiting for socket to connect
0927 15:12:41.222015 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0927 15:12:41.222136 (+ 121us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0927 15:12:41.222382 (+ 246us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0927 15:12:41.222385 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0927 15:12:41.222602 (+ 217us) client_negotiation.cc:189] Negotiated authn=SASL
0927 15:12:41.222742 (+ 140us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:12:41.222751 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:12:41.223612 (+ 861us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:12:41.223615 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:12:41.224184 (+ 569us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:12:41.224192 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:12:41.224551 (+ 359us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:12:41.224553 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:12:41.224618 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:41.225054 (+ 436us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0927 15:12:41.225064 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0927 15:12:41.226699 (+ 1635us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.136.62:41997: Server oryx/127.17.136.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":182,"thread_start_us":83,"threads_started":1}
W20260927 15:12:41.226912 27091 negotiation.cc:337] Failed RPC negotiation. Trace:
0927 15:12:41.222020 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.136.2:48821 (local address 127.17.136.62:41997)
0927 15:12:41.222159 (+ 139us) server_negotiation.cc:206] Beginning negotiation
0927 15:12:41.222163 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0927 15:12:41.222177 (+ 14us) server_negotiation.cc:407] Connection header received
0927 15:12:41.222220 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:12:41.222222 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:12:41.222269 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:12:41.222348 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0927 15:12:41.222858 (+ 510us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:41.223523 (+ 665us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:41.224269 (+ 746us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:41.224476 (+ 207us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:41.224542 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:41.226818 (+ 2276us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.136.2:48821: BlockingRecv error: recv got EOF from 127.17.136.2:48821 (error 108)
Metrics: {"server-negotiator.queue_time_us":41}
Sep 27 15:12:41 dist-test-slave-5s2t krb5kdc[26089](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.136.3@KRBTEST.COM for oryx/127.17.136.62@KRBTEST.COM, Server not found in Kerberos database
Sep 27 15:12:41 dist-test-slave-5s2t krb5kdc[26089](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.136.3@KRBTEST.COM for oryx/127.17.136.62@KRBTEST.COM, Server not found in Kerberos database
I20260927 15:12:41.405359 27093 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:41.400050 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.62:41997 (local address 127.17.136.3:39841)
0927 15:12:41.400274 (+ 224us) negotiation.cc:107] Waiting for socket to connect
0927 15:12:41.400288 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0927 15:12:41.400386 (+ 98us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0927 15:12:41.400601 (+ 215us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0927 15:12:41.400603 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0927 15:12:41.400765 (+ 162us) client_negotiation.cc:189] Negotiated authn=SASL
0927 15:12:41.400875 (+ 110us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:12:41.400882 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:12:41.401618 (+ 736us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:12:41.401621 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:12:41.402215 (+ 594us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:12:41.402224 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:12:41.402665 (+ 441us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:12:41.402669 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:12:41.402749 (+ 80us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:41.403342 (+ 593us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0927 15:12:41.403354 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0927 15:12:41.405225 (+ 1871us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.136.62:41997: Server oryx/127.17.136.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":155,"thread_start_us":62,"threads_started":1}
W20260927 15:12:41.405445 27091 negotiation.cc:337] Failed RPC negotiation. Trace:
0927 15:12:41.400117 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.136.3:39841 (local address 127.17.136.62:41997)
0927 15:12:41.400264 (+ 147us) server_negotiation.cc:206] Beginning negotiation
0927 15:12:41.400269 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0927 15:12:41.400353 (+ 84us) server_negotiation.cc:407] Connection header received
0927 15:12:41.400463 (+ 110us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:12:41.400465 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:12:41.400512 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:12:41.400575 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0927 15:12:41.400980 (+ 405us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:41.401527 (+ 547us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:41.402307 (+ 780us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:41.402536 (+ 229us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:41.402614 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:41.405351 (+ 2737us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.136.3:39841: BlockingRecv error: recv got EOF from 127.17.136.3:39841 (error 108)
Metrics: {"server-negotiator.queue_time_us":60}
Sep 27 15:12:42 dist-test-slave-5s2t krb5kdc[26089](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.136.1@KRBTEST.COM for oryx/127.17.136.62@KRBTEST.COM, Server not found in Kerberos database
Sep 27 15:12:42 dist-test-slave-5s2t krb5kdc[26089](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.136.1@KRBTEST.COM for oryx/127.17.136.62@KRBTEST.COM, Server not found in Kerberos database
I20260927 15:12:42.068917 27094 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:42.060057 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.62:41997 (local address 127.17.136.1:56165)
0927 15:12:42.060312 (+ 255us) negotiation.cc:107] Waiting for socket to connect
0927 15:12:42.060326 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0927 15:12:42.060444 (+ 118us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0927 15:12:42.060663 (+ 219us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0927 15:12:42.060665 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0927 15:12:42.060856 (+ 191us) client_negotiation.cc:189] Negotiated authn=SASL
0927 15:12:42.060954 (+ 98us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:12:42.060960 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:12:42.061691 (+ 731us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:12:42.061694 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:12:42.062331 (+ 637us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:12:42.062342 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:12:42.062773 (+ 431us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:12:42.062776 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:12:42.062851 (+ 75us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:42.067079 (+ 4228us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0927 15:12:42.067091 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0927 15:12:42.068783 (+ 1692us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.136.62:41997: Server oryx/127.17.136.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":177,"thread_start_us":81,"threads_started":1}
W20260927 15:12:42.069034 27095 negotiation.cc:337] Failed RPC negotiation. Trace:
0927 15:12:42.060110 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.136.1:56165 (local address 127.17.136.62:41997)
0927 15:12:42.060341 (+ 231us) server_negotiation.cc:206] Beginning negotiation
0927 15:12:42.060346 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0927 15:12:42.060391 (+ 45us) server_negotiation.cc:407] Connection header received
0927 15:12:42.060519 (+ 128us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:12:42.060521 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:12:42.060564 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:12:42.060639 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0927 15:12:42.061057 (+ 418us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:42.061589 (+ 532us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:42.062444 (+ 855us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:42.062676 (+ 232us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:42.062761 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:42.068912 (+ 6151us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.136.1:56165: BlockingRecv error: recv got EOF from 127.17.136.1:56165 (error 108)
Metrics: {"server-negotiator.queue_time_us":163,"thread_start_us":78,"threads_started":1}
Sep 27 15:12:42 dist-test-slave-5s2t krb5kdc[26089](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.136.2@KRBTEST.COM for oryx/127.17.136.62@KRBTEST.COM, Server not found in Kerberos database
Sep 27 15:12:42 dist-test-slave-5s2t krb5kdc[26089](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.136.2@KRBTEST.COM for oryx/127.17.136.62@KRBTEST.COM, Server not found in Kerberos database
I20260927 15:12:42.232568 27096 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:42.227613 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.62:41997 (local address 127.17.136.2:45403)
0927 15:12:42.227859 (+ 246us) negotiation.cc:107] Waiting for socket to connect
0927 15:12:42.227872 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0927 15:12:42.227983 (+ 111us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0927 15:12:42.228167 (+ 184us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0927 15:12:42.228169 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0927 15:12:42.228329 (+ 160us) client_negotiation.cc:189] Negotiated authn=SASL
0927 15:12:42.228423 (+ 94us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:12:42.228428 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:12:42.229102 (+ 674us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:12:42.229104 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:12:42.229652 (+ 548us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:12:42.229658 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:12:42.230002 (+ 344us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:12:42.230004 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:12:42.230059 (+ 55us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:42.230485 (+ 426us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0927 15:12:42.230494 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0927 15:12:42.232405 (+ 1911us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.136.62:41997: Server oryx/127.17.136.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":173,"thread_start_us":93,"threads_started":1}
W20260927 15:12:42.232654 27095 negotiation.cc:337] Failed RPC negotiation. Trace:
0927 15:12:42.227656 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.136.2:45403 (local address 127.17.136.62:41997)
0927 15:12:42.227790 (+ 134us) server_negotiation.cc:206] Beginning negotiation
0927 15:12:42.227794 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0927 15:12:42.227922 (+ 128us) server_negotiation.cc:407] Connection header received
0927 15:12:42.228048 (+ 126us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:12:42.228051 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:12:42.228093 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:12:42.228153 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0927 15:12:42.228500 (+ 347us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:42.229024 (+ 524us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:42.229730 (+ 706us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:42.229930 (+ 200us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:42.229995 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:42.232538 (+ 2543us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.136.2:45403: BlockingRecv error: recv got EOF from 127.17.136.2:45403 (error 108)
Metrics: {"server-negotiator.queue_time_us":50}
Sep 27 15:12:42 dist-test-slave-5s2t krb5kdc[26089](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.136.3@KRBTEST.COM for oryx/127.17.136.62@KRBTEST.COM, Server not found in Kerberos database
Sep 27 15:12:42 dist-test-slave-5s2t krb5kdc[26089](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.136.3@KRBTEST.COM for oryx/127.17.136.62@KRBTEST.COM, Server not found in Kerberos database
I20260927 15:12:42.411077 27097 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:42.406023 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.62:41997 (local address 127.17.136.3:43931)
0927 15:12:42.406289 (+ 266us) negotiation.cc:107] Waiting for socket to connect
0927 15:12:42.406304 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0927 15:12:42.406409 (+ 105us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0927 15:12:42.406636 (+ 227us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0927 15:12:42.406639 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0927 15:12:42.406823 (+ 184us) client_negotiation.cc:189] Negotiated authn=SASL
0927 15:12:42.406913 (+ 90us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:12:42.406918 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:12:42.407667 (+ 749us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:12:42.407671 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:12:42.408228 (+ 557us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:12:42.408235 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:12:42.408633 (+ 398us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:12:42.408636 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:12:42.408718 (+ 82us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:42.409200 (+ 482us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0927 15:12:42.409213 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0927 15:12:42.410909 (+ 1696us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.136.62:41997: Server oryx/127.17.136.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":189,"thread_start_us":96,"threads_started":1}
W20260927 15:12:42.411158 27095 negotiation.cc:337] Failed RPC negotiation. Trace:
0927 15:12:42.406162 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.136.3:43931 (local address 127.17.136.62:41997)
0927 15:12:42.406290 (+ 128us) server_negotiation.cc:206] Beginning negotiation
0927 15:12:42.406294 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0927 15:12:42.406362 (+ 68us) server_negotiation.cc:407] Connection header received
0927 15:12:42.406491 (+ 129us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:12:42.406494 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:12:42.406541 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:12:42.406601 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0927 15:12:42.407011 (+ 410us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:42.407569 (+ 558us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:42.408327 (+ 758us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:42.408540 (+ 213us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:42.408624 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:42.411049 (+ 2425us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.136.3:43931: BlockingRecv error: recv got EOF from 127.17.136.3:43931 (error 108)
Metrics: {"server-negotiator.queue_time_us":50}
Sep 27 15:12:43 dist-test-slave-5s2t krb5kdc[26089](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.136.1@KRBTEST.COM for oryx/127.17.136.62@KRBTEST.COM, Server not found in Kerberos database
Sep 27 15:12:43 dist-test-slave-5s2t krb5kdc[26089](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.136.1@KRBTEST.COM for oryx/127.17.136.62@KRBTEST.COM, Server not found in Kerberos database
I20260927 15:12:43.074772 27098 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:43.069633 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.62:41997 (local address 127.17.136.1:38983)
0927 15:12:43.069866 (+ 233us) negotiation.cc:107] Waiting for socket to connect
0927 15:12:43.069878 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0927 15:12:43.069965 (+ 87us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0927 15:12:43.070172 (+ 207us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0927 15:12:43.070174 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0927 15:12:43.070338 (+ 164us) client_negotiation.cc:189] Negotiated authn=SASL
0927 15:12:43.070446 (+ 108us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:12:43.070451 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:12:43.071130 (+ 679us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:12:43.071132 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:12:43.071794 (+ 662us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:12:43.071804 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:12:43.072201 (+ 397us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:12:43.072203 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:12:43.072261 (+ 58us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:43.072747 (+ 486us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0927 15:12:43.072759 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0927 15:12:43.074628 (+ 1869us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.136.62:41997: Server oryx/127.17.136.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":158,"thread_start_us":64,"threads_started":1}
W20260927 15:12:43.074868 27099 negotiation.cc:337] Failed RPC negotiation. Trace:
0927 15:12:43.069691 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.136.1:38983 (local address 127.17.136.62:41997)
0927 15:12:43.069897 (+ 206us) server_negotiation.cc:206] Beginning negotiation
0927 15:12:43.069900 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0927 15:12:43.069914 (+ 14us) server_negotiation.cc:407] Connection header received
0927 15:12:43.070038 (+ 124us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:12:43.070040 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:12:43.070079 (+ 39us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:12:43.070150 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0927 15:12:43.070527 (+ 377us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:43.071034 (+ 507us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:43.071898 (+ 864us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:43.072122 (+ 224us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:43.072191 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:43.074757 (+ 2566us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.136.1:38983: BlockingRecv error: recv got EOF from 127.17.136.1:38983 (error 108)
Metrics: {"server-negotiator.queue_time_us":145,"thread_start_us":64,"threads_started":1}
Sep 27 15:12:43 dist-test-slave-5s2t krb5kdc[26089](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.136.2@KRBTEST.COM for oryx/127.17.136.62@KRBTEST.COM, Server not found in Kerberos database
Sep 27 15:12:43 dist-test-slave-5s2t krb5kdc[26089](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.136.2@KRBTEST.COM for oryx/127.17.136.62@KRBTEST.COM, Server not found in Kerberos database
I20260927 15:12:43.238598 27100 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:43.233476 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.62:41997 (local address 127.17.136.2:36689)
0927 15:12:43.233718 (+ 242us) negotiation.cc:107] Waiting for socket to connect
0927 15:12:43.233734 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0927 15:12:43.233856 (+ 122us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0927 15:12:43.234132 (+ 276us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0927 15:12:43.234135 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0927 15:12:43.234343 (+ 208us) client_negotiation.cc:189] Negotiated authn=SASL
0927 15:12:43.234460 (+ 117us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:12:43.234468 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:12:43.235330 (+ 862us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:12:43.235334 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:12:43.235899 (+ 565us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:12:43.235907 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:12:43.236275 (+ 368us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:12:43.236277 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:12:43.236336 (+ 59us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:43.236779 (+ 443us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0927 15:12:43.236789 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0927 15:12:43.238474 (+ 1685us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.136.62:41997: Server oryx/127.17.136.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":166,"thread_start_us":69,"threads_started":1}
W20260927 15:12:43.238680 27099 negotiation.cc:337] Failed RPC negotiation. Trace:
0927 15:12:43.233552 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.136.2:36689 (local address 127.17.136.62:41997)
0927 15:12:43.233687 (+ 135us) server_negotiation.cc:206] Beginning negotiation
0927 15:12:43.233692 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0927 15:12:43.233809 (+ 117us) server_negotiation.cc:407] Connection header received
0927 15:12:43.233948 (+ 139us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:12:43.233951 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:12:43.234003 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:12:43.234093 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0927 15:12:43.234571 (+ 478us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:43.235199 (+ 628us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:43.235991 (+ 792us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:43.236200 (+ 209us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:43.236266 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:43.238579 (+ 2313us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.136.2:36689: BlockingRecv error: recv got EOF from 127.17.136.2:36689 (error 108)
Metrics: {"server-negotiator.queue_time_us":54}
Sep 27 15:12:43 dist-test-slave-5s2t krb5kdc[26089](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.136.3@KRBTEST.COM for oryx/127.17.136.62@KRBTEST.COM, Server not found in Kerberos database
Sep 27 15:12:43 dist-test-slave-5s2t krb5kdc[26089](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.136.3@KRBTEST.COM for oryx/127.17.136.62@KRBTEST.COM, Server not found in Kerberos database
I20260927 15:12:43.416711 27101 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:43.411794 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.62:41997 (local address 127.17.136.3:58113)
0927 15:12:43.412043 (+ 249us) negotiation.cc:107] Waiting for socket to connect
0927 15:12:43.412056 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0927 15:12:43.412149 (+ 93us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0927 15:12:43.412343 (+ 194us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0927 15:12:43.412345 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0927 15:12:43.412508 (+ 163us) client_negotiation.cc:189] Negotiated authn=SASL
0927 15:12:43.412599 (+ 91us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:12:43.412604 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:12:43.413262 (+ 658us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:12:43.413264 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:12:43.413812 (+ 548us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:12:43.413819 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:12:43.414157 (+ 338us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:12:43.414159 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:12:43.414214 (+ 55us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:43.414664 (+ 450us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0927 15:12:43.414675 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0927 15:12:43.416565 (+ 1890us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.136.62:41997: Server oryx/127.17.136.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":181,"thread_start_us":78,"threads_started":1}
W20260927 15:12:43.416786 27099 negotiation.cc:337] Failed RPC negotiation. Trace:
0927 15:12:43.411833 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.136.3:58113 (local address 127.17.136.62:41997)
0927 15:12:43.411964 (+ 131us) server_negotiation.cc:206] Beginning negotiation
0927 15:12:43.411967 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0927 15:12:43.412116 (+ 149us) server_negotiation.cc:407] Connection header received
0927 15:12:43.412211 (+ 95us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:12:43.412213 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:12:43.412257 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:12:43.412320 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0927 15:12:43.412683 (+ 363us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:43.413187 (+ 504us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:43.413890 (+ 703us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:43.414086 (+ 196us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:43.414147 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:43.416691 (+ 2544us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.136.3:58113: BlockingRecv error: recv got EOF from 127.17.136.3:58113 (error 108)
Metrics: {"server-negotiator.queue_time_us":55}
Sep 27 15:12:44 dist-test-slave-5s2t krb5kdc[26089](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.136.1@KRBTEST.COM for oryx/127.17.136.62@KRBTEST.COM, Server not found in Kerberos database
Sep 27 15:12:44 dist-test-slave-5s2t krb5kdc[26089](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.136.1@KRBTEST.COM for oryx/127.17.136.62@KRBTEST.COM, Server not found in Kerberos database
I20260927 15:12:44.080632 27102 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:44.075606 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.62:41997 (local address 127.17.136.1:40211)
0927 15:12:44.075875 (+ 269us) negotiation.cc:107] Waiting for socket to connect
0927 15:12:44.075888 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0927 15:12:44.075974 (+ 86us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0927 15:12:44.076180 (+ 206us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0927 15:12:44.076182 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0927 15:12:44.076346 (+ 164us) client_negotiation.cc:189] Negotiated authn=SASL
0927 15:12:44.076461 (+ 115us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:12:44.076467 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:12:44.077146 (+ 679us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:12:44.077149 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:12:44.077727 (+ 578us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:12:44.077736 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:12:44.078176 (+ 440us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:12:44.078179 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:12:44.078243 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:44.078723 (+ 480us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0927 15:12:44.078735 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0927 15:12:44.080488 (+ 1753us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.136.62:41997: Server oryx/127.17.136.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":200,"thread_start_us":69,"threads_started":1}
W20260927 15:12:44.080726 27103 negotiation.cc:337] Failed RPC negotiation. Trace:
0927 15:12:44.075676 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.136.1:40211 (local address 127.17.136.62:41997)
0927 15:12:44.075923 (+ 247us) server_negotiation.cc:206] Beginning negotiation
0927 15:12:44.075928 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0927 15:12:44.075942 (+ 14us) server_negotiation.cc:407] Connection header received
0927 15:12:44.076041 (+ 99us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:12:44.076043 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:12:44.076083 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:12:44.076159 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0927 15:12:44.076545 (+ 386us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:44.077063 (+ 518us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:44.077840 (+ 777us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:44.078073 (+ 233us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:44.078154 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:44.080617 (+ 2463us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.136.1:40211: BlockingRecv error: recv got EOF from 127.17.136.1:40211 (error 108)
Metrics: {"server-negotiator.queue_time_us":174,"thread_start_us":81,"threads_started":1}
Sep 27 15:12:44 dist-test-slave-5s2t krb5kdc[26089](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.136.2@KRBTEST.COM for oryx/127.17.136.62@KRBTEST.COM, Server not found in Kerberos database
Sep 27 15:12:44 dist-test-slave-5s2t krb5kdc[26089](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.136.2@KRBTEST.COM for oryx/127.17.136.62@KRBTEST.COM, Server not found in Kerberos database
I20260927 15:12:44.244277 27104 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:44.239280 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.62:41997 (local address 127.17.136.2:40759)
0927 15:12:44.239529 (+ 249us) negotiation.cc:107] Waiting for socket to connect
0927 15:12:44.239542 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0927 15:12:44.239638 (+ 96us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0927 15:12:44.239836 (+ 198us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0927 15:12:44.239838 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0927 15:12:44.240001 (+ 163us) client_negotiation.cc:189] Negotiated authn=SASL
0927 15:12:44.240096 (+ 95us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:12:44.240101 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:12:44.240789 (+ 688us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:12:44.240791 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:12:44.241326 (+ 535us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:12:44.241332 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:12:44.241840 (+ 508us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:12:44.241845 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:12:44.241928 (+ 83us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:44.242502 (+ 574us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0927 15:12:44.242514 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0927 15:12:44.244163 (+ 1649us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.136.62:41997: Server oryx/127.17.136.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":177,"thread_start_us":71,"threads_started":1}
W20260927 15:12:44.244469 27103 negotiation.cc:337] Failed RPC negotiation. Trace:
0927 15:12:44.239349 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.136.2:40759 (local address 127.17.136.62:41997)
0927 15:12:44.239470 (+ 121us) server_negotiation.cc:206] Beginning negotiation
0927 15:12:44.239474 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0927 15:12:44.239601 (+ 127us) server_negotiation.cc:407] Connection header received
0927 15:12:44.239703 (+ 102us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:12:44.239704 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:12:44.239746 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:12:44.239810 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0927 15:12:44.240172 (+ 362us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:44.240711 (+ 539us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:44.241415 (+ 704us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:44.241734 (+ 319us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:44.241833 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:44.244349 (+ 2516us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.136.2:40759: BlockingRecv error: recv got EOF from 127.17.136.2:40759 (error 108)
Metrics: {"server-negotiator.queue_time_us":30}
Sep 27 15:12:44 dist-test-slave-5s2t krb5kdc[26089](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.136.3@KRBTEST.COM for oryx/127.17.136.62@KRBTEST.COM, Server not found in Kerberos database
Sep 27 15:12:44 dist-test-slave-5s2t krb5kdc[26089](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.136.3@KRBTEST.COM for oryx/127.17.136.62@KRBTEST.COM, Server not found in Kerberos database
I20260927 15:12:44.422190 27105 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:44.417447 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.62:41997 (local address 127.17.136.3:48563)
0927 15:12:44.417679 (+ 232us) negotiation.cc:107] Waiting for socket to connect
0927 15:12:44.417691 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0927 15:12:44.417783 (+ 92us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0927 15:12:44.418006 (+ 223us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0927 15:12:44.418008 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0927 15:12:44.418168 (+ 160us) client_negotiation.cc:189] Negotiated authn=SASL
0927 15:12:44.418260 (+ 92us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:12:44.418265 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:12:44.418913 (+ 648us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:12:44.418930 (+ 17us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:12:44.419545 (+ 615us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:12:44.419552 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:12:44.419955 (+ 403us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:12:44.419957 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:12:44.420016 (+ 59us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:44.420425 (+ 409us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0927 15:12:44.420435 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0927 15:12:44.422045 (+ 1610us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.136.62:41997: Server oryx/127.17.136.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":164,"thread_start_us":66,"threads_started":1}
W20260927 15:12:44.422269 27103 negotiation.cc:337] Failed RPC negotiation. Trace:
0927 15:12:44.417500 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.136.3:48563 (local address 127.17.136.62:41997)
0927 15:12:44.417645 (+ 145us) server_negotiation.cc:206] Beginning negotiation
0927 15:12:44.417650 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0927 15:12:44.417747 (+ 97us) server_negotiation.cc:407] Connection header received
0927 15:12:44.417855 (+ 108us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:12:44.417857 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:12:44.417901 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:12:44.417983 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0927 15:12:44.418336 (+ 353us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:44.418841 (+ 505us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:44.419628 (+ 787us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:44.419834 (+ 206us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:44.419904 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:44.422171 (+ 2267us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.136.3:48563: BlockingRecv error: recv got EOF from 127.17.136.3:48563 (error 108)
Metrics: {"server-negotiator.queue_time_us":56}
Sep 27 15:12:45 dist-test-slave-5s2t krb5kdc[26089](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.136.1@KRBTEST.COM for oryx/127.17.136.62@KRBTEST.COM, Server not found in Kerberos database
Sep 27 15:12:45 dist-test-slave-5s2t krb5kdc[26089](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.136.1@KRBTEST.COM for oryx/127.17.136.62@KRBTEST.COM, Server not found in Kerberos database
I20260927 15:12:45.086755 27106 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:45.081400 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.62:41997 (local address 127.17.136.1:34489)
0927 15:12:45.081655 (+ 255us) negotiation.cc:107] Waiting for socket to connect
0927 15:12:45.081672 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0927 15:12:45.081752 (+ 80us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0927 15:12:45.081994 (+ 242us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0927 15:12:45.081997 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0927 15:12:45.082209 (+ 212us) client_negotiation.cc:189] Negotiated authn=SASL
0927 15:12:45.082308 (+ 99us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:12:45.082315 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:12:45.083072 (+ 757us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:12:45.083075 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:12:45.083689 (+ 614us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:12:45.083698 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:12:45.084098 (+ 400us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:12:45.084101 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:12:45.084168 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:45.084620 (+ 452us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0927 15:12:45.084631 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0927 15:12:45.086644 (+ 2013us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.136.62:41997: Server oryx/127.17.136.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":173,"thread_start_us":71,"threads_started":1}
W20260927 15:12:45.086898 27107 negotiation.cc:337] Failed RPC negotiation. Trace:
0927 15:12:45.081494 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.136.1:34489 (local address 127.17.136.62:41997)
0927 15:12:45.081751 (+ 257us) server_negotiation.cc:206] Beginning negotiation
0927 15:12:45.081754 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0927 15:12:45.081767 (+ 13us) server_negotiation.cc:407] Connection header received
0927 15:12:45.081819 (+ 52us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:12:45.081821 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:12:45.081858 (+ 37us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:12:45.081932 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0927 15:12:45.082443 (+ 511us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:45.082969 (+ 526us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:45.083786 (+ 817us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:45.084005 (+ 219us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:45.084075 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:45.086769 (+ 2694us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.136.1:34489: BlockingRecv error: recv got EOF from 127.17.136.1:34489 (error 108)
Metrics: {"server-negotiator.queue_time_us":191,"thread_start_us":100,"threads_started":1}
Sep 27 15:12:45 dist-test-slave-5s2t krb5kdc[26089](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.136.2@KRBTEST.COM for oryx/127.17.136.62@KRBTEST.COM, Server not found in Kerberos database
Sep 27 15:12:45 dist-test-slave-5s2t krb5kdc[26089](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.136.2@KRBTEST.COM for oryx/127.17.136.62@KRBTEST.COM, Server not found in Kerberos database
I20260927 15:12:45.250375 27108 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:45.245036 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.62:41997 (local address 127.17.136.2:50667)
0927 15:12:45.245273 (+ 237us) negotiation.cc:107] Waiting for socket to connect
0927 15:12:45.245286 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0927 15:12:45.245378 (+ 92us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0927 15:12:45.245692 (+ 314us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0927 15:12:45.245699 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0927 15:12:45.245886 (+ 187us) client_negotiation.cc:189] Negotiated authn=SASL
0927 15:12:45.246004 (+ 118us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:12:45.246014 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:12:45.246888 (+ 874us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:12:45.246891 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:12:45.247581 (+ 690us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:12:45.247592 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:12:45.248016 (+ 424us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:12:45.248019 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:12:45.248078 (+ 59us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:45.248547 (+ 469us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0927 15:12:45.248557 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0927 15:12:45.250258 (+ 1701us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.136.62:41997: Server oryx/127.17.136.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":163,"thread_start_us":68,"threads_started":1}
W20260927 15:12:45.250541 27107 negotiation.cc:337] Failed RPC negotiation. Trace:
0927 15:12:45.245170 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.136.2:50667 (local address 127.17.136.62:41997)
0927 15:12:45.245289 (+ 119us) server_negotiation.cc:206] Beginning negotiation
0927 15:12:45.245292 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0927 15:12:45.245354 (+ 62us) server_negotiation.cc:407] Connection header received
0927 15:12:45.245517 (+ 163us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:12:45.245519 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:12:45.245570 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:12:45.245655 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0927 15:12:45.246117 (+ 462us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:45.246774 (+ 657us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:45.247695 (+ 921us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:45.247924 (+ 229us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:45.248006 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:45.250417 (+ 2411us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.136.2:50667: BlockingRecv error: recv got EOF from 127.17.136.2:50667 (error 108)
Metrics: {"server-negotiator.queue_time_us":44}
Sep 27 15:12:45 dist-test-slave-5s2t krb5kdc[26089](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.136.3@KRBTEST.COM for oryx/127.17.136.62@KRBTEST.COM, Server not found in Kerberos database
Sep 27 15:12:45 dist-test-slave-5s2t krb5kdc[26089](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.136.3@KRBTEST.COM for oryx/127.17.136.62@KRBTEST.COM, Server not found in Kerberos database
I20260927 15:12:45.427829 27109 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:45.422913 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.62:41997 (local address 127.17.136.3:34601)
0927 15:12:45.423163 (+ 250us) negotiation.cc:107] Waiting for socket to connect
0927 15:12:45.423177 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0927 15:12:45.423293 (+ 116us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0927 15:12:45.423503 (+ 210us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0927 15:12:45.423505 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0927 15:12:45.423735 (+ 230us) client_negotiation.cc:189] Negotiated authn=SASL
0927 15:12:45.423828 (+ 93us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:12:45.423834 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:12:45.424564 (+ 730us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:12:45.424566 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:12:45.425113 (+ 547us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:12:45.425119 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:12:45.425466 (+ 347us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:12:45.425468 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:12:45.425523 (+ 55us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:45.425966 (+ 443us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0927 15:12:45.425977 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0927 15:12:45.427714 (+ 1737us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.136.62:41997: Server oryx/127.17.136.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":180,"thread_start_us":80,"threads_started":1}
W20260927 15:12:45.427953 27107 negotiation.cc:337] Failed RPC negotiation. Trace:
0927 15:12:45.423005 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.136.3:34601 (local address 127.17.136.62:41997)
0927 15:12:45.423163 (+ 158us) server_negotiation.cc:206] Beginning negotiation
0927 15:12:45.423167 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0927 15:12:45.423239 (+ 72us) server_negotiation.cc:407] Connection header received
0927 15:12:45.423368 (+ 129us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:12:45.423370 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:12:45.423415 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:12:45.423478 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0927 15:12:45.423932 (+ 454us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:45.424472 (+ 540us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:45.425189 (+ 717us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:45.425393 (+ 204us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:45.425457 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:45.427846 (+ 2389us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.136.3:34601: BlockingRecv error: recv got EOF from 127.17.136.3:34601 (error 108)
Metrics: {"server-negotiator.queue_time_us":67}
Sep 27 15:12:46 dist-test-slave-5s2t krb5kdc[26089](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.136.1@KRBTEST.COM for oryx/127.17.136.62@KRBTEST.COM, Server not found in Kerberos database
Sep 27 15:12:46 dist-test-slave-5s2t krb5kdc[26089](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.136.1@KRBTEST.COM for oryx/127.17.136.62@KRBTEST.COM, Server not found in Kerberos database
I20260927 15:12:46.092335 27110 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:46.087441 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.62:41997 (local address 127.17.136.1:41153)
0927 15:12:46.087678 (+ 237us) negotiation.cc:107] Waiting for socket to connect
0927 15:12:46.087691 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0927 15:12:46.087787 (+ 96us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0927 15:12:46.088009 (+ 222us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0927 15:12:46.088010 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0927 15:12:46.088181 (+ 171us) client_negotiation.cc:189] Negotiated authn=SASL
0927 15:12:46.088272 (+ 91us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:12:46.088277 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:12:46.088978 (+ 701us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:12:46.088981 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:12:46.089532 (+ 551us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:12:46.089538 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:12:46.089942 (+ 404us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:12:46.089945 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:12:46.090002 (+ 57us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:46.090449 (+ 447us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0927 15:12:46.090459 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0927 15:12:46.092191 (+ 1732us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.136.62:41997: Server oryx/127.17.136.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":162,"thread_start_us":69,"threads_started":1}
W20260927 15:12:46.092430 27111 negotiation.cc:337] Failed RPC negotiation. Trace:
0927 15:12:46.087467 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.136.1:41153 (local address 127.17.136.62:41997)
0927 15:12:46.087680 (+ 213us) server_negotiation.cc:206] Beginning negotiation
0927 15:12:46.087684 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0927 15:12:46.087739 (+ 55us) server_negotiation.cc:407] Connection header received
0927 15:12:46.087855 (+ 116us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:12:46.087857 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:12:46.087896 (+ 39us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:12:46.087986 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0927 15:12:46.088349 (+ 363us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:46.088876 (+ 527us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:46.089634 (+ 758us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:46.089858 (+ 224us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:46.089948 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:46.092319 (+ 2371us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.136.1:41153: BlockingRecv error: recv got EOF from 127.17.136.1:41153 (error 108)
Metrics: {"server-negotiator.queue_time_us":148,"thread_start_us":63,"threads_started":1}
Sep 27 15:12:46 dist-test-slave-5s2t krb5kdc[26089](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.136.2@KRBTEST.COM for oryx/127.17.136.62@KRBTEST.COM, Server not found in Kerberos database
Sep 27 15:12:46 dist-test-slave-5s2t krb5kdc[26089](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.136.2@KRBTEST.COM for oryx/127.17.136.62@KRBTEST.COM, Server not found in Kerberos database
I20260927 15:12:46.256304 27112 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:46.251075 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.62:41997 (local address 127.17.136.2:55765)
0927 15:12:46.251345 (+ 270us) negotiation.cc:107] Waiting for socket to connect
0927 15:12:46.251359 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0927 15:12:46.251463 (+ 104us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0927 15:12:46.251715 (+ 252us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0927 15:12:46.251718 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0927 15:12:46.251893 (+ 175us) client_negotiation.cc:189] Negotiated authn=SASL
0927 15:12:46.251995 (+ 102us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:12:46.252000 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:12:46.252770 (+ 770us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:12:46.252774 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:12:46.253323 (+ 549us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:12:46.253330 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:12:46.253796 (+ 466us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:12:46.253801 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:12:46.253884 (+ 83us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:46.254387 (+ 503us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0927 15:12:46.254399 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0927 15:12:46.256188 (+ 1789us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.136.62:41997: Server oryx/127.17.136.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":160,"thread_start_us":65,"threads_started":1}
W20260927 15:12:46.256392 27111 negotiation.cc:337] Failed RPC negotiation. Trace:
0927 15:12:46.251191 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.136.2:55765 (local address 127.17.136.62:41997)
0927 15:12:46.251352 (+ 161us) server_negotiation.cc:206] Beginning negotiation
0927 15:12:46.251356 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0927 15:12:46.251423 (+ 67us) server_negotiation.cc:407] Connection header received
0927 15:12:46.251543 (+ 120us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:12:46.251545 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:12:46.251586 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:12:46.251651 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0927 15:12:46.252123 (+ 472us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:46.252673 (+ 550us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:46.253434 (+ 761us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:46.253680 (+ 246us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:46.253770 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:46.256298 (+ 2528us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.136.2:55765: BlockingRecv error: recv got EOF from 127.17.136.2:55765 (error 108)
Metrics: {"server-negotiator.queue_time_us":78}
Sep 27 15:12:46 dist-test-slave-5s2t krb5kdc[26089](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.136.3@KRBTEST.COM for oryx/127.17.136.62@KRBTEST.COM, Server not found in Kerberos database
Sep 27 15:12:46 dist-test-slave-5s2t krb5kdc[26089](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.136.3@KRBTEST.COM for oryx/127.17.136.62@KRBTEST.COM, Server not found in Kerberos database
I20260927 15:12:46.433677 27113 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:46.428548 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.62:41997 (local address 127.17.136.3:52977)
0927 15:12:46.428819 (+ 271us) negotiation.cc:107] Waiting for socket to connect
0927 15:12:46.428832 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0927 15:12:46.428949 (+ 117us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0927 15:12:46.429163 (+ 214us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0927 15:12:46.429165 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0927 15:12:46.429333 (+ 168us) client_negotiation.cc:189] Negotiated authn=SASL
0927 15:12:46.429432 (+ 99us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:12:46.429437 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:12:46.430124 (+ 687us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:12:46.430126 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:12:46.430687 (+ 561us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:12:46.430695 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:12:46.431190 (+ 495us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:12:46.431193 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:12:46.431276 (+ 83us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:46.431741 (+ 465us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0927 15:12:46.431752 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0927 15:12:46.433532 (+ 1780us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.136.62:41997: Server oryx/127.17.136.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":201,"thread_start_us":80,"threads_started":1}
W20260927 15:12:46.433758 27111 negotiation.cc:337] Failed RPC negotiation. Trace:
0927 15:12:46.428627 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.136.3:52977 (local address 127.17.136.62:41997)
0927 15:12:46.428781 (+ 154us) server_negotiation.cc:206] Beginning negotiation
0927 15:12:46.428785 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0927 15:12:46.428890 (+ 105us) server_negotiation.cc:407] Connection header received
0927 15:12:46.429019 (+ 129us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:12:46.429021 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:12:46.429066 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:12:46.429126 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0927 15:12:46.429512 (+ 386us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:46.430040 (+ 528us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:46.430855 (+ 815us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:46.431094 (+ 239us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:46.431184 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:46.433661 (+ 2477us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.136.3:52977: BlockingRecv error: recv got EOF from 127.17.136.3:52977 (error 108)
Metrics: {"server-negotiator.queue_time_us":63}
Sep 27 15:12:47 dist-test-slave-5s2t krb5kdc[26089](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.136.1@KRBTEST.COM for oryx/127.17.136.62@KRBTEST.COM, Server not found in Kerberos database
Sep 27 15:12:47 dist-test-slave-5s2t krb5kdc[26089](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.136.1@KRBTEST.COM for oryx/127.17.136.62@KRBTEST.COM, Server not found in Kerberos database
I20260927 15:12:47.101912 27114 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:47.093211 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.62:41997 (local address 127.17.136.1:47133)
0927 15:12:47.093562 (+ 351us) negotiation.cc:107] Waiting for socket to connect
0927 15:12:47.093575 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0927 15:12:47.093670 (+ 95us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0927 15:12:47.093907 (+ 237us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0927 15:12:47.093910 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0927 15:12:47.094093 (+ 183us) client_negotiation.cc:189] Negotiated authn=SASL
0927 15:12:47.094194 (+ 101us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:12:47.094201 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:12:47.095040 (+ 839us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:12:47.095044 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:12:47.095640 (+ 596us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:12:47.095649 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:12:47.096191 (+ 542us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:12:47.096194 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:12:47.096259 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:47.100088 (+ 3829us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0927 15:12:47.100099 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0927 15:12:47.101799 (+ 1700us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.136.62:41997: Server oryx/127.17.136.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":285,"thread_start_us":82,"threads_started":1}
W20260927 15:12:47.102090 27115 negotiation.cc:337] Failed RPC negotiation. Trace:
0927 15:12:47.093275 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.136.1:47133 (local address 127.17.136.62:41997)
0927 15:12:47.093513 (+ 238us) server_negotiation.cc:206] Beginning negotiation
0927 15:12:47.093517 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0927 15:12:47.093635 (+ 118us) server_negotiation.cc:407] Connection header received
0927 15:12:47.093740 (+ 105us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:12:47.093742 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:12:47.093784 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:12:47.093861 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0927 15:12:47.094311 (+ 450us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:47.094932 (+ 621us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:47.095731 (+ 799us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:47.096096 (+ 365us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:47.096177 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:47.101956 (+ 5779us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.136.1:47133: BlockingRecv error: recv got EOF from 127.17.136.1:47133 (error 108)
Metrics: {"server-negotiator.queue_time_us":165,"thread_start_us":61,"threads_started":1}
Sep 27 15:12:47 dist-test-slave-5s2t krb5kdc[26089](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.136.2@KRBTEST.COM for oryx/127.17.136.62@KRBTEST.COM, Server not found in Kerberos database
Sep 27 15:12:47 dist-test-slave-5s2t krb5kdc[26089](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.136.2@KRBTEST.COM for oryx/127.17.136.62@KRBTEST.COM, Server not found in Kerberos database
I20260927 15:12:47.262018 27116 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:47.257030 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.62:41997 (local address 127.17.136.2:39749)
0927 15:12:47.257324 (+ 294us) negotiation.cc:107] Waiting for socket to connect
0927 15:12:47.257337 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0927 15:12:47.257438 (+ 101us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0927 15:12:47.257632 (+ 194us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0927 15:12:47.257634 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0927 15:12:47.257806 (+ 172us) client_negotiation.cc:189] Negotiated authn=SASL
0927 15:12:47.257895 (+ 89us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:12:47.257900 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:12:47.258631 (+ 731us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:12:47.258635 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:12:47.259283 (+ 648us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:12:47.259296 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:12:47.259708 (+ 412us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:12:47.259711 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:12:47.259777 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:47.260236 (+ 459us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0927 15:12:47.260247 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0927 15:12:47.261902 (+ 1655us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.136.62:41997: Server oryx/127.17.136.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":224,"thread_start_us":79,"threads_started":1}
W20260927 15:12:47.262127 27115 negotiation.cc:337] Failed RPC negotiation. Trace:
0927 15:12:47.257105 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.136.2:39749 (local address 127.17.136.62:41997)
0927 15:12:47.257236 (+ 131us) server_negotiation.cc:206] Beginning negotiation
0927 15:12:47.257239 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0927 15:12:47.257392 (+ 153us) server_negotiation.cc:407] Connection header received
0927 15:12:47.257507 (+ 115us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:12:47.257509 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:12:47.257549 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:12:47.257612 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0927 15:12:47.257976 (+ 364us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:47.258532 (+ 556us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:47.259376 (+ 844us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:47.259629 (+ 253us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:47.259702 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:47.262030 (+ 2328us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.136.2:39749: BlockingRecv error: recv got EOF from 127.17.136.2:39749 (error 108)
Metrics: {"server-negotiator.queue_time_us":48}
Sep 27 15:12:47 dist-test-slave-5s2t krb5kdc[26089](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.136.3@KRBTEST.COM for oryx/127.17.136.62@KRBTEST.COM, Server not found in Kerberos database
Sep 27 15:12:47 dist-test-slave-5s2t krb5kdc[26089](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.136.3@KRBTEST.COM for oryx/127.17.136.62@KRBTEST.COM, Server not found in Kerberos database
I20260927 15:12:47.439370 27117 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:47.434486 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.62:41997 (local address 127.17.136.3:49979)
0927 15:12:47.434766 (+ 280us) negotiation.cc:107] Waiting for socket to connect
0927 15:12:47.434781 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0927 15:12:47.434892 (+ 111us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0927 15:12:47.435149 (+ 257us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0927 15:12:47.435152 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0927 15:12:47.435400 (+ 248us) client_negotiation.cc:189] Negotiated authn=SASL
0927 15:12:47.435516 (+ 116us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:12:47.435522 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:12:47.436220 (+ 698us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:12:47.436222 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:12:47.436778 (+ 556us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:12:47.436785 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:12:47.437128 (+ 343us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:12:47.437130 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:12:47.437189 (+ 59us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:47.437611 (+ 422us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0927 15:12:47.437622 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0927 15:12:47.439230 (+ 1608us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.136.62:41997: Server oryx/127.17.136.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":198,"thread_start_us":74,"threads_started":1}
W20260927 15:12:47.439527 27115 negotiation.cc:337] Failed RPC negotiation. Trace:
0927 15:12:47.434543 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.136.3:49979 (local address 127.17.136.62:41997)
0927 15:12:47.434660 (+ 117us) server_negotiation.cc:206] Beginning negotiation
0927 15:12:47.434665 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0927 15:12:47.434850 (+ 185us) server_negotiation.cc:407] Connection header received
0927 15:12:47.434984 (+ 134us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:12:47.434987 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:12:47.435045 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:12:47.435107 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0927 15:12:47.435610 (+ 503us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:47.436134 (+ 524us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:47.436854 (+ 720us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:47.437056 (+ 202us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:47.437119 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:47.439379 (+ 2260us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.136.3:49979: BlockingRecv error: recv got EOF from 127.17.136.3:49979 (error 108)
Metrics: {"server-negotiator.queue_time_us":39}
Sep 27 15:12:48 dist-test-slave-5s2t krb5kdc[26089](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.136.1@KRBTEST.COM for oryx/127.17.136.62@KRBTEST.COM, Server not found in Kerberos database
Sep 27 15:12:48 dist-test-slave-5s2t krb5kdc[26089](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.136.1@KRBTEST.COM for oryx/127.17.136.62@KRBTEST.COM, Server not found in Kerberos database
I20260927 15:12:48.107816 27118 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:48.102622 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.62:41997 (local address 127.17.136.1:45539)
0927 15:12:48.102874 (+ 252us) negotiation.cc:107] Waiting for socket to connect
0927 15:12:48.102889 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0927 15:12:48.102987 (+ 98us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0927 15:12:48.103202 (+ 215us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0927 15:12:48.103204 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0927 15:12:48.103434 (+ 230us) client_negotiation.cc:189] Negotiated authn=SASL
0927 15:12:48.103532 (+ 98us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:12:48.103538 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:12:48.104258 (+ 720us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:12:48.104260 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:12:48.104918 (+ 658us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:12:48.104930 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:12:48.105521 (+ 591us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:12:48.105524 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:12:48.105610 (+ 86us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:48.106049 (+ 439us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0927 15:12:48.106060 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0927 15:12:48.107706 (+ 1646us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.136.62:41997: Server oryx/127.17.136.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":176,"thread_start_us":74,"threads_started":1}
W20260927 15:12:48.107963 27119 negotiation.cc:337] Failed RPC negotiation. Trace:
0927 15:12:48.102751 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.136.1:45539 (local address 127.17.136.62:41997)
0927 15:12:48.102983 (+ 232us) server_negotiation.cc:206] Beginning negotiation
0927 15:12:48.102986 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0927 15:12:48.102999 (+ 13us) server_negotiation.cc:407] Connection header received
0927 15:12:48.103050 (+ 51us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:12:48.103052 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:12:48.103091 (+ 39us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:12:48.103177 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0927 15:12:48.103632 (+ 455us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:48.104180 (+ 548us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:48.105024 (+ 844us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:48.105291 (+ 267us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:48.105369 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:48.107825 (+ 2456us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.136.1:45539: BlockingRecv error: recv got EOF from 127.17.136.1:45539 (error 108)
Metrics: {"server-negotiator.queue_time_us":169,"thread_start_us":60,"threads_started":1}
Sep 27 15:12:48 dist-test-slave-5s2t krb5kdc[26089](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.136.2@KRBTEST.COM for oryx/127.17.136.62@KRBTEST.COM, Server not found in Kerberos database
Sep 27 15:12:48 dist-test-slave-5s2t krb5kdc[26089](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.136.2@KRBTEST.COM for oryx/127.17.136.62@KRBTEST.COM, Server not found in Kerberos database
I20260927 15:12:48.268088 27120 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:48.262724 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.62:41997 (local address 127.17.136.2:55913)
0927 15:12:48.262989 (+ 265us) negotiation.cc:107] Waiting for socket to connect
0927 15:12:48.263002 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0927 15:12:48.263102 (+ 100us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0927 15:12:48.263341 (+ 239us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0927 15:12:48.263343 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0927 15:12:48.263523 (+ 180us) client_negotiation.cc:189] Negotiated authn=SASL
0927 15:12:48.263619 (+ 96us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:12:48.263625 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:12:48.264598 (+ 973us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:12:48.264602 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:12:48.265147 (+ 545us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:12:48.265155 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:12:48.265568 (+ 413us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:12:48.265572 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:12:48.265652 (+ 80us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:48.266125 (+ 473us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0927 15:12:48.266135 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0927 15:12:48.267976 (+ 1841us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.136.62:41997: Server oryx/127.17.136.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":193,"thread_start_us":90,"threads_started":1}
W20260927 15:12:48.268218 27119 negotiation.cc:337] Failed RPC negotiation. Trace:
0927 15:12:48.262784 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.136.2:55913 (local address 127.17.136.62:41997)
0927 15:12:48.262944 (+ 160us) server_negotiation.cc:206] Beginning negotiation
0927 15:12:48.262949 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0927 15:12:48.263066 (+ 117us) server_negotiation.cc:407] Connection header received
0927 15:12:48.263175 (+ 109us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:12:48.263177 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:12:48.263221 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:12:48.263305 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0927 15:12:48.263726 (+ 421us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:48.264491 (+ 765us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:48.265254 (+ 763us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:48.265470 (+ 216us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:48.265552 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:48.268112 (+ 2560us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.136.2:55913: BlockingRecv error: recv got EOF from 127.17.136.2:55913 (error 108)
Metrics: {"server-negotiator.queue_time_us":48}
Sep 27 15:12:48 dist-test-slave-5s2t krb5kdc[26089](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.136.3@KRBTEST.COM for oryx/127.17.136.62@KRBTEST.COM, Server not found in Kerberos database
Sep 27 15:12:48 dist-test-slave-5s2t krb5kdc[26089](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.136.3@KRBTEST.COM for oryx/127.17.136.62@KRBTEST.COM, Server not found in Kerberos database
I20260927 15:12:48.445114 27121 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:48.440145 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.62:41997 (local address 127.17.136.3:41917)
0927 15:12:48.440443 (+ 298us) negotiation.cc:107] Waiting for socket to connect
0927 15:12:48.440455 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0927 15:12:48.440560 (+ 105us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0927 15:12:48.440781 (+ 221us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0927 15:12:48.440784 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0927 15:12:48.440989 (+ 205us) client_negotiation.cc:189] Negotiated authn=SASL
0927 15:12:48.441085 (+ 96us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:12:48.441090 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:12:48.441803 (+ 713us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:12:48.441806 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:12:48.442367 (+ 561us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:12:48.442374 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:12:48.442776 (+ 402us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:12:48.442780 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:12:48.442859 (+ 79us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:48.443331 (+ 472us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0927 15:12:48.443342 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0927 15:12:48.445001 (+ 1659us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.136.62:41997: Server oryx/127.17.136.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":203,"thread_start_us":99,"threads_started":1}
W20260927 15:12:48.445312 27119 negotiation.cc:337] Failed RPC negotiation. Trace:
0927 15:12:48.440218 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.136.3:41917 (local address 127.17.136.62:41997)
0927 15:12:48.440341 (+ 123us) server_negotiation.cc:206] Beginning negotiation
0927 15:12:48.440346 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0927 15:12:48.440522 (+ 176us) server_negotiation.cc:407] Connection header received
0927 15:12:48.440636 (+ 114us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:12:48.440639 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:12:48.440686 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:12:48.440748 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0927 15:12:48.441197 (+ 449us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:48.441706 (+ 509us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:48.442471 (+ 765us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:48.442682 (+ 211us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:48.442766 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:48.445175 (+ 2409us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.136.3:41917: BlockingRecv error: recv got EOF from 127.17.136.3:41917 (error 108)
Metrics: {"server-negotiator.queue_time_us":40}
Sep 27 15:12:49 dist-test-slave-5s2t krb5kdc[26089](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.136.1@KRBTEST.COM for oryx/127.17.136.62@KRBTEST.COM, Server not found in Kerberos database
Sep 27 15:12:49 dist-test-slave-5s2t krb5kdc[26089](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.136.1@KRBTEST.COM for oryx/127.17.136.62@KRBTEST.COM, Server not found in Kerberos database
I20260927 15:12:49.113481 27122 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:49.108458 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.62:41997 (local address 127.17.136.1:59927)
0927 15:12:49.108709 (+ 251us) negotiation.cc:107] Waiting for socket to connect
0927 15:12:49.108721 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0927 15:12:49.108804 (+ 83us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0927 15:12:49.109072 (+ 268us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0927 15:12:49.109074 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0927 15:12:49.109241 (+ 167us) client_negotiation.cc:189] Negotiated authn=SASL
0927 15:12:49.109334 (+ 93us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:12:49.109339 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:12:49.110092 (+ 753us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:12:49.110094 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:12:49.110639 (+ 545us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:12:49.110646 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:12:49.111041 (+ 395us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:12:49.111044 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:12:49.111100 (+ 56us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:49.111612 (+ 512us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0927 15:12:49.111623 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0927 15:12:49.113336 (+ 1713us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.136.62:41997: Server oryx/127.17.136.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":178,"thread_start_us":83,"threads_started":1}
W20260927 15:12:49.113570 27123 negotiation.cc:337] Failed RPC negotiation. Trace:
0927 15:12:49.108558 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.136.1:59927 (local address 127.17.136.62:41997)
0927 15:12:49.108769 (+ 211us) server_negotiation.cc:206] Beginning negotiation
0927 15:12:49.108772 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0927 15:12:49.108785 (+ 13us) server_negotiation.cc:407] Connection header received
0927 15:12:49.108919 (+ 134us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:12:49.108922 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:12:49.108970 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:12:49.109049 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0927 15:12:49.109419 (+ 370us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:49.109996 (+ 577us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:49.110720 (+ 724us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:49.110963 (+ 243us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:49.111036 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:49.113456 (+ 2420us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.136.1:59927: BlockingRecv error: recv got EOF from 127.17.136.1:59927 (error 108)
Metrics: {"server-negotiator.queue_time_us":148,"thread_start_us":70,"threads_started":1}
Sep 27 15:12:49 dist-test-slave-5s2t krb5kdc[26089](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.136.2@KRBTEST.COM for oryx/127.17.136.62@KRBTEST.COM, Server not found in Kerberos database
Sep 27 15:12:49 dist-test-slave-5s2t krb5kdc[26089](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.136.2@KRBTEST.COM for oryx/127.17.136.62@KRBTEST.COM, Server not found in Kerberos database
I20260927 15:12:49.273459 27124 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:49.268763 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.62:41997 (local address 127.17.136.2:45595)
0927 15:12:49.269013 (+ 250us) negotiation.cc:107] Waiting for socket to connect
0927 15:12:49.269025 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0927 15:12:49.269121 (+ 96us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0927 15:12:49.269299 (+ 178us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0927 15:12:49.269301 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0927 15:12:49.269476 (+ 175us) client_negotiation.cc:189] Negotiated authn=SASL
0927 15:12:49.269570 (+ 94us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:12:49.269576 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:12:49.270234 (+ 658us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:12:49.270236 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:12:49.270793 (+ 557us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:12:49.270799 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:12:49.271149 (+ 350us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:12:49.271151 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:12:49.271207 (+ 56us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:49.271671 (+ 464us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0927 15:12:49.271682 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0927 15:12:49.273345 (+ 1663us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.136.62:41997: Server oryx/127.17.136.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":180,"thread_start_us":83,"threads_started":1}
W20260927 15:12:49.273603 27123 negotiation.cc:337] Failed RPC negotiation. Trace:
0927 15:12:49.268828 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.136.2:45595 (local address 127.17.136.62:41997)
0927 15:12:49.268984 (+ 156us) server_negotiation.cc:206] Beginning negotiation
0927 15:12:49.268989 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0927 15:12:49.269083 (+ 94us) server_negotiation.cc:407] Connection header received
0927 15:12:49.269183 (+ 100us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:12:49.269185 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:12:49.269227 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:12:49.269285 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0927 15:12:49.269647 (+ 362us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:49.270159 (+ 512us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:49.270870 (+ 711us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:49.271076 (+ 206us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:49.271140 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:49.273485 (+ 2345us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.136.2:45595: BlockingRecv error: recv got EOF from 127.17.136.2:45595 (error 108)
Metrics: {"server-negotiator.queue_time_us":62}
Sep 27 15:12:49 dist-test-slave-5s2t krb5kdc[26089](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.136.3@KRBTEST.COM for oryx/127.17.136.62@KRBTEST.COM, Server not found in Kerberos database
Sep 27 15:12:49 dist-test-slave-5s2t krb5kdc[26089](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.136.3@KRBTEST.COM for oryx/127.17.136.62@KRBTEST.COM, Server not found in Kerberos database
I20260927 15:12:49.451318 27125 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:49.445873 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.62:41997 (local address 127.17.136.3:57415)
0927 15:12:49.446112 (+ 239us) negotiation.cc:107] Waiting for socket to connect
0927 15:12:49.446125 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0927 15:12:49.446220 (+ 95us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0927 15:12:49.446459 (+ 239us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0927 15:12:49.446461 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0927 15:12:49.446626 (+ 165us) client_negotiation.cc:189] Negotiated authn=SASL
0927 15:12:49.446718 (+ 92us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:12:49.446723 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:12:49.447615 (+ 892us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:12:49.447619 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:12:49.448262 (+ 643us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:12:49.448274 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:12:49.448705 (+ 431us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:12:49.448709 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:12:49.448792 (+ 83us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:49.449277 (+ 485us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0927 15:12:49.449289 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0927 15:12:49.451120 (+ 1831us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.136.62:41997: Server oryx/127.17.136.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":170,"thread_start_us":74,"threads_started":1}
W20260927 15:12:49.451372 27123 negotiation.cc:337] Failed RPC negotiation. Trace:
0927 15:12:49.445970 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.136.3:57415 (local address 127.17.136.62:41997)
0927 15:12:49.446086 (+ 116us) server_negotiation.cc:206] Beginning negotiation
0927 15:12:49.446089 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0927 15:12:49.446183 (+ 94us) server_negotiation.cc:407] Connection header received
0927 15:12:49.446289 (+ 106us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:12:49.446292 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:12:49.446344 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:12:49.446426 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0927 15:12:49.446840 (+ 414us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:49.447482 (+ 642us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:49.448371 (+ 889us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:49.448602 (+ 231us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:49.448688 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:49.451274 (+ 2586us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.136.3:57415: BlockingRecv error: recv got EOF from 127.17.136.3:57415 (error 108)
Metrics: {"server-negotiator.queue_time_us":42}
Sep 27 15:12:50 dist-test-slave-5s2t krb5kdc[26089](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.136.1@KRBTEST.COM for oryx/127.17.136.62@KRBTEST.COM, Server not found in Kerberos database
Sep 27 15:12:50 dist-test-slave-5s2t krb5kdc[26089](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.136.1@KRBTEST.COM for oryx/127.17.136.62@KRBTEST.COM, Server not found in Kerberos database
I20260927 15:12:50.119123 27126 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:50.114216 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.62:41997 (local address 127.17.136.1:58229)
0927 15:12:50.114454 (+ 238us) negotiation.cc:107] Waiting for socket to connect
0927 15:12:50.114466 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0927 15:12:50.114548 (+ 82us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0927 15:12:50.114760 (+ 212us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0927 15:12:50.114762 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0927 15:12:50.114959 (+ 197us) client_negotiation.cc:189] Negotiated authn=SASL
0927 15:12:50.115052 (+ 93us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:12:50.115057 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:12:50.115774 (+ 717us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:12:50.115777 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:12:50.116348 (+ 571us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:12:50.116356 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:12:50.116738 (+ 382us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:12:50.116740 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:12:50.116797 (+ 57us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:50.117294 (+ 497us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0927 15:12:50.117305 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0927 15:12:50.118976 (+ 1671us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.136.62:41997: Server oryx/127.17.136.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":162,"thread_start_us":66,"threads_started":1}
W20260927 15:12:50.119270 27127 negotiation.cc:337] Failed RPC negotiation. Trace:
0927 15:12:50.114295 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.136.1:58229 (local address 127.17.136.62:41997)
0927 15:12:50.114524 (+ 229us) server_negotiation.cc:206] Beginning negotiation
0927 15:12:50.114528 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0927 15:12:50.114541 (+ 13us) server_negotiation.cc:407] Connection header received
0927 15:12:50.114621 (+ 80us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:12:50.114623 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:12:50.114661 (+ 38us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:12:50.114735 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0927 15:12:50.115148 (+ 413us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:50.115700 (+ 552us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:50.116444 (+ 744us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:50.116659 (+ 215us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:50.116730 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:50.119122 (+ 2392us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.136.1:58229: BlockingRecv error: recv got EOF from 127.17.136.1:58229 (error 108)
Metrics: {"server-negotiator.queue_time_us":153,"thread_start_us":64,"threads_started":1}
Sep 27 15:12:50 dist-test-slave-5s2t krb5kdc[26089](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.136.2@KRBTEST.COM for oryx/127.17.136.62@KRBTEST.COM, Server not found in Kerberos database
Sep 27 15:12:50 dist-test-slave-5s2t krb5kdc[26089](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.136.2@KRBTEST.COM for oryx/127.17.136.62@KRBTEST.COM, Server not found in Kerberos database
I20260927 15:12:50.279386 27128 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:50.274169 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.62:41997 (local address 127.17.136.2:41127)
0927 15:12:50.274421 (+ 252us) negotiation.cc:107] Waiting for socket to connect
0927 15:12:50.274434 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0927 15:12:50.274533 (+ 99us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0927 15:12:50.274757 (+ 224us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0927 15:12:50.274760 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0927 15:12:50.274955 (+ 195us) client_negotiation.cc:189] Negotiated authn=SASL
0927 15:12:50.275047 (+ 92us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:12:50.275053 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:12:50.275817 (+ 764us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:12:50.275821 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:12:50.276366 (+ 545us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:12:50.276373 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:12:50.276781 (+ 408us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:12:50.276784 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:12:50.276857 (+ 73us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:50.277356 (+ 499us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0927 15:12:50.277367 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0927 15:12:50.279224 (+ 1857us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.136.62:41997: Server oryx/127.17.136.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":174,"thread_start_us":77,"threads_started":1}
W20260927 15:12:50.279474 27127 negotiation.cc:337] Failed RPC negotiation. Trace:
0927 15:12:50.274232 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.136.2:41127 (local address 127.17.136.62:41997)
0927 15:12:50.274378 (+ 146us) server_negotiation.cc:206] Beginning negotiation
0927 15:12:50.274382 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0927 15:12:50.274498 (+ 116us) server_negotiation.cc:407] Connection header received
0927 15:12:50.274617 (+ 119us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:12:50.274619 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:12:50.274664 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:12:50.274729 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0927 15:12:50.275158 (+ 429us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:50.275716 (+ 558us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:50.276468 (+ 752us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:50.276688 (+ 220us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:50.276770 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:50.279368 (+ 2598us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.136.2:41127: BlockingRecv error: recv got EOF from 127.17.136.2:41127 (error 108)
Metrics: {"server-negotiator.queue_time_us":47}
Sep 27 15:12:50 dist-test-slave-5s2t krb5kdc[26089](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.136.3@KRBTEST.COM for oryx/127.17.136.62@KRBTEST.COM, Server not found in Kerberos database
Sep 27 15:12:50 dist-test-slave-5s2t krb5kdc[26089](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.136.3@KRBTEST.COM for oryx/127.17.136.62@KRBTEST.COM, Server not found in Kerberos database
I20260927 15:12:50.456878 27129 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:50.452060 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.62:41997 (local address 127.17.136.3:42031)
0927 15:12:50.452290 (+ 230us) negotiation.cc:107] Waiting for socket to connect
0927 15:12:50.452303 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0927 15:12:50.452391 (+ 88us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0927 15:12:50.452598 (+ 207us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0927 15:12:50.452600 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0927 15:12:50.452765 (+ 165us) client_negotiation.cc:189] Negotiated authn=SASL
0927 15:12:50.452861 (+ 96us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:12:50.452866 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:12:50.453558 (+ 692us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:12:50.453560 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:12:50.454138 (+ 578us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:12:50.454145 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:12:50.454513 (+ 368us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:12:50.454515 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:12:50.454576 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:50.455050 (+ 474us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0927 15:12:50.455061 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0927 15:12:50.456762 (+ 1701us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.136.62:41997: Server oryx/127.17.136.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":160,"thread_start_us":65,"threads_started":1}
W20260927 15:12:50.456987 27127 negotiation.cc:337] Failed RPC negotiation. Trace:
0927 15:12:50.452187 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.136.3:42031 (local address 127.17.136.62:41997)
0927 15:12:50.452297 (+ 110us) server_negotiation.cc:206] Beginning negotiation
0927 15:12:50.452300 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0927 15:12:50.452358 (+ 58us) server_negotiation.cc:407] Connection header received
0927 15:12:50.452474 (+ 116us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:12:50.452476 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:12:50.452519 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:12:50.452575 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0927 15:12:50.452962 (+ 387us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:50.453481 (+ 519us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:50.454215 (+ 734us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:50.454432 (+ 217us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:50.454499 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:50.456891 (+ 2392us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.136.3:42031: BlockingRecv error: recv got EOF from 127.17.136.3:42031 (error 108)
Metrics: {"server-negotiator.queue_time_us":42}
Sep 27 15:12:51 dist-test-slave-5s2t krb5kdc[26089](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.136.1@KRBTEST.COM for oryx/127.17.136.62@KRBTEST.COM, Server not found in Kerberos database
Sep 27 15:12:51 dist-test-slave-5s2t krb5kdc[26089](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.136.1@KRBTEST.COM for oryx/127.17.136.62@KRBTEST.COM, Server not found in Kerberos database
I20260927 15:12:51.124763 27130 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:51.120007 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.62:41997 (local address 127.17.136.1:57679)
0927 15:12:51.120261 (+ 254us) negotiation.cc:107] Waiting for socket to connect
0927 15:12:51.120274 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0927 15:12:51.120358 (+ 84us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0927 15:12:51.120563 (+ 205us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0927 15:12:51.120565 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0927 15:12:51.120730 (+ 165us) client_negotiation.cc:189] Negotiated authn=SASL
0927 15:12:51.120819 (+ 89us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:12:51.120823 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:12:51.121528 (+ 705us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:12:51.121531 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:12:51.122093 (+ 562us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:12:51.122100 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:12:51.122461 (+ 361us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:12:51.122463 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:12:51.122518 (+ 55us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:51.122987 (+ 469us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0927 15:12:51.122998 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0927 15:12:51.124653 (+ 1655us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.136.62:41997: Server oryx/127.17.136.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":179,"thread_start_us":78,"threads_started":1}
W20260927 15:12:51.124886 27131 negotiation.cc:337] Failed RPC negotiation. Trace:
0927 15:12:51.120065 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.136.1:57679 (local address 127.17.136.62:41997)
0927 15:12:51.120299 (+ 234us) server_negotiation.cc:206] Beginning negotiation
0927 15:12:51.120302 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0927 15:12:51.120315 (+ 13us) server_negotiation.cc:407] Connection header received
0927 15:12:51.120424 (+ 109us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:12:51.120426 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:12:51.120472 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:12:51.120541 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0927 15:12:51.120913 (+ 372us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:51.121442 (+ 529us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:51.122173 (+ 731us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:51.122385 (+ 212us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:51.122453 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:51.124772 (+ 2319us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.136.1:57679: BlockingRecv error: recv got EOF from 127.17.136.1:57679 (error 108)
Metrics: {"server-negotiator.queue_time_us":168,"thread_start_us":70,"threads_started":1}
Sep 27 15:12:51 dist-test-slave-5s2t krb5kdc[26089](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.136.2@KRBTEST.COM for oryx/127.17.136.62@KRBTEST.COM, Server not found in Kerberos database
Sep 27 15:12:51 dist-test-slave-5s2t krb5kdc[26089](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.136.2@KRBTEST.COM for oryx/127.17.136.62@KRBTEST.COM, Server not found in Kerberos database
I20260927 15:12:51.285197 27132 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:51.280030 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.62:41997 (local address 127.17.136.2:52109)
0927 15:12:51.280324 (+ 294us) negotiation.cc:107] Waiting for socket to connect
0927 15:12:51.280340 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0927 15:12:51.280456 (+ 116us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0927 15:12:51.280697 (+ 241us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0927 15:12:51.280700 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0927 15:12:51.280903 (+ 203us) client_negotiation.cc:189] Negotiated authn=SASL
0927 15:12:51.280993 (+ 90us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:12:51.280998 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:12:51.281737 (+ 739us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:12:51.281741 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:12:51.282305 (+ 564us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:12:51.282313 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:12:51.282736 (+ 423us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:12:51.282739 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:12:51.282828 (+ 89us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:51.283330 (+ 502us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0927 15:12:51.283344 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0927 15:12:51.285068 (+ 1724us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.136.62:41997: Server oryx/127.17.136.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":222,"thread_start_us":85,"threads_started":1}
W20260927 15:12:51.285290 27131 negotiation.cc:337] Failed RPC negotiation. Trace:
0927 15:12:51.280130 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.136.2:52109 (local address 127.17.136.62:41997)
0927 15:12:51.280326 (+ 196us) server_negotiation.cc:206] Beginning negotiation
0927 15:12:51.280330 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0927 15:12:51.280399 (+ 69us) server_negotiation.cc:407] Connection header received
0927 15:12:51.280544 (+ 145us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:12:51.280547 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:12:51.280595 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:12:51.280657 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0927 15:12:51.281102 (+ 445us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:51.281637 (+ 535us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:51.282412 (+ 775us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:51.282640 (+ 228us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:51.282723 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:51.285193 (+ 2470us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.136.2:52109: BlockingRecv error: recv got EOF from 127.17.136.2:52109 (error 108)
Metrics: {"server-negotiator.queue_time_us":69}
Sep 27 15:12:51 dist-test-slave-5s2t krb5kdc[26089](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.136.3@KRBTEST.COM for oryx/127.17.136.62@KRBTEST.COM, Server not found in Kerberos database
Sep 27 15:12:51 dist-test-slave-5s2t krb5kdc[26089](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.136.3@KRBTEST.COM for oryx/127.17.136.62@KRBTEST.COM, Server not found in Kerberos database
I20260927 15:12:51.462764 27133 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:51.457623 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.62:41997 (local address 127.17.136.3:40165)
0927 15:12:51.457855 (+ 232us) negotiation.cc:107] Waiting for socket to connect
0927 15:12:51.457868 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0927 15:12:51.457978 (+ 110us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0927 15:12:51.458187 (+ 209us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0927 15:12:51.458189 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0927 15:12:51.458415 (+ 226us) client_negotiation.cc:189] Negotiated authn=SASL
0927 15:12:51.458521 (+ 106us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:12:51.458527 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:12:51.459425 (+ 898us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:12:51.459429 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:12:51.460085 (+ 656us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:12:51.460096 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:12:51.460494 (+ 398us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:12:51.460497 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:12:51.460556 (+ 59us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:51.461018 (+ 462us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0927 15:12:51.461029 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0927 15:12:51.462651 (+ 1622us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.136.62:41997: Server oryx/127.17.136.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":160,"thread_start_us":63,"threads_started":1}
W20260927 15:12:51.462903 27131 negotiation.cc:337] Failed RPC negotiation. Trace:
0927 15:12:51.457708 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.136.3:40165 (local address 127.17.136.62:41997)
0927 15:12:51.457846 (+ 138us) server_negotiation.cc:206] Beginning negotiation
0927 15:12:51.457850 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0927 15:12:51.457952 (+ 102us) server_negotiation.cc:407] Connection header received
0927 15:12:51.458051 (+ 99us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:12:51.458053 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:12:51.458098 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:12:51.458162 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0927 15:12:51.458630 (+ 468us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:51.459230 (+ 600us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:51.460193 (+ 963us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:51.460406 (+ 213us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:51.460483 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:51.462784 (+ 2301us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.136.3:40165: BlockingRecv error: recv got EOF from 127.17.136.3:40165 (error 108)
Metrics: {"server-negotiator.queue_time_us":55}
Sep 27 15:12:52 dist-test-slave-5s2t krb5kdc[26089](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.136.1@KRBTEST.COM for oryx/127.17.136.62@KRBTEST.COM, Server not found in Kerberos database
Sep 27 15:12:52 dist-test-slave-5s2t krb5kdc[26089](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.136.1@KRBTEST.COM for oryx/127.17.136.62@KRBTEST.COM, Server not found in Kerberos database
I20260927 15:12:52.134107 27134 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:52.125499 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.62:41997 (local address 127.17.136.1:41239)
0927 15:12:52.125766 (+ 267us) negotiation.cc:107] Waiting for socket to connect
0927 15:12:52.125778 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0927 15:12:52.125865 (+ 87us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0927 15:12:52.126106 (+ 241us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0927 15:12:52.126108 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0927 15:12:52.126283 (+ 175us) client_negotiation.cc:189] Negotiated authn=SASL
0927 15:12:52.126375 (+ 92us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:12:52.126380 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:12:52.127061 (+ 681us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:12:52.127063 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:12:52.127678 (+ 615us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:12:52.127687 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:12:52.128083 (+ 396us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:12:52.128085 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:12:52.128138 (+ 53us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:52.132294 (+ 4156us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0927 15:12:52.132307 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0927 15:12:52.133991 (+ 1684us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.136.62:41997: Server oryx/127.17.136.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":191,"thread_start_us":94,"threads_started":1}
W20260927 15:12:52.134258 27135 negotiation.cc:337] Failed RPC negotiation. Trace:
0927 15:12:52.125607 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.136.1:41239 (local address 127.17.136.62:41997)
0927 15:12:52.125830 (+ 223us) server_negotiation.cc:206] Beginning negotiation
0927 15:12:52.125833 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0927 15:12:52.125847 (+ 14us) server_negotiation.cc:407] Connection header received
0927 15:12:52.125973 (+ 126us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:12:52.125975 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:12:52.126017 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:12:52.126092 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0927 15:12:52.126455 (+ 363us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:52.126982 (+ 527us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:52.127777 (+ 795us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:52.128003 (+ 226us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:52.128077 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:52.134124 (+ 6047us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.136.1:41239: BlockingRecv error: recv got EOF from 127.17.136.1:41239 (error 108)
Metrics: {"server-negotiator.queue_time_us":159,"thread_start_us":53,"threads_started":1}
Sep 27 15:12:52 dist-test-slave-5s2t krb5kdc[26089](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.136.2@KRBTEST.COM for oryx/127.17.136.62@KRBTEST.COM, Server not found in Kerberos database
Sep 27 15:12:52 dist-test-slave-5s2t krb5kdc[26089](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.136.2@KRBTEST.COM for oryx/127.17.136.62@KRBTEST.COM, Server not found in Kerberos database
I20260927 15:12:52.291540 27136 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:52.286012 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.62:41997 (local address 127.17.136.2:35089)
0927 15:12:52.286278 (+ 266us) negotiation.cc:107] Waiting for socket to connect
0927 15:12:52.286292 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0927 15:12:52.286404 (+ 112us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0927 15:12:52.286635 (+ 231us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0927 15:12:52.286638 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0927 15:12:52.286823 (+ 185us) client_negotiation.cc:189] Negotiated authn=SASL
0927 15:12:52.286922 (+ 99us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:12:52.286927 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:12:52.287786 (+ 859us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:12:52.287789 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:12:52.288438 (+ 649us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:12:52.288448 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:12:52.288996 (+ 548us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:12:52.289000 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:12:52.289081 (+ 81us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:52.289638 (+ 557us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0927 15:12:52.289652 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0927 15:12:52.291413 (+ 1761us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.136.62:41997: Server oryx/127.17.136.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":193,"thread_start_us":82,"threads_started":1}
W20260927 15:12:52.291646 27135 negotiation.cc:337] Failed RPC negotiation. Trace:
0927 15:12:52.286110 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.136.2:35089 (local address 127.17.136.62:41997)
0927 15:12:52.286271 (+ 161us) server_negotiation.cc:206] Beginning negotiation
0927 15:12:52.286275 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0927 15:12:52.286357 (+ 82us) server_negotiation.cc:407] Connection header received
0927 15:12:52.286494 (+ 137us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:12:52.286497 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:12:52.286541 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:12:52.286607 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0927 15:12:52.287025 (+ 418us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:52.287678 (+ 653us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:52.288559 (+ 881us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:52.288863 (+ 304us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:52.288957 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:52.291546 (+ 2589us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.136.2:35089: BlockingRecv error: recv got EOF from 127.17.136.2:35089 (error 108)
Metrics: {"server-negotiator.queue_time_us":64}
Sep 27 15:12:52 dist-test-slave-5s2t krb5kdc[26089](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.136.3@KRBTEST.COM for oryx/127.17.136.62@KRBTEST.COM, Server not found in Kerberos database
Sep 27 15:12:52 dist-test-slave-5s2t krb5kdc[26089](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.136.3@KRBTEST.COM for oryx/127.17.136.62@KRBTEST.COM, Server not found in Kerberos database
I20260927 15:12:52.468340 27137 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:52.463452 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.62:41997 (local address 127.17.136.3:45839)
0927 15:12:52.463683 (+ 231us) negotiation.cc:107] Waiting for socket to connect
0927 15:12:52.463696 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0927 15:12:52.463791 (+ 95us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0927 15:12:52.464011 (+ 220us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0927 15:12:52.464013 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0927 15:12:52.464187 (+ 174us) client_negotiation.cc:189] Negotiated authn=SASL
0927 15:12:52.464283 (+ 96us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:12:52.464288 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:12:52.465036 (+ 748us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:12:52.465040 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:12:52.465611 (+ 571us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:12:52.465618 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:12:52.466018 (+ 400us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:12:52.466020 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:12:52.466080 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:52.466533 (+ 453us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0927 15:12:52.466544 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0927 15:12:52.468226 (+ 1682us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.136.62:41997: Server oryx/127.17.136.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":163,"thread_start_us":66,"threads_started":1}
W20260927 15:12:52.468497 27135 negotiation.cc:337] Failed RPC negotiation. Trace:
0927 15:12:52.463499 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.136.3:45839 (local address 127.17.136.62:41997)
0927 15:12:52.463616 (+ 117us) server_negotiation.cc:206] Beginning negotiation
0927 15:12:52.463620 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0927 15:12:52.463756 (+ 136us) server_negotiation.cc:407] Connection header received
0927 15:12:52.463873 (+ 117us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:12:52.463875 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:12:52.463927 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:12:52.463985 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0927 15:12:52.464424 (+ 439us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:52.464951 (+ 527us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:52.465703 (+ 752us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:52.465926 (+ 223us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:52.466001 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:52.468354 (+ 2353us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.136.3:45839: BlockingRecv error: recv got EOF from 127.17.136.3:45839 (error 108)
Metrics: {"server-negotiator.queue_time_us":42}
Sep 27 15:12:53 dist-test-slave-5s2t krb5kdc[26089](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.136.1@KRBTEST.COM for oryx/127.17.136.62@KRBTEST.COM, Server not found in Kerberos database
Sep 27 15:12:53 dist-test-slave-5s2t krb5kdc[26089](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.136.1@KRBTEST.COM for oryx/127.17.136.62@KRBTEST.COM, Server not found in Kerberos database
I20260927 15:12:53.139772 27138 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:53.134811 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.62:41997 (local address 127.17.136.1:52091)
0927 15:12:53.135069 (+ 258us) negotiation.cc:107] Waiting for socket to connect
0927 15:12:53.135083 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0927 15:12:53.135169 (+ 86us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0927 15:12:53.135417 (+ 248us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0927 15:12:53.135419 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0927 15:12:53.135591 (+ 172us) client_negotiation.cc:189] Negotiated authn=SASL
0927 15:12:53.135683 (+ 92us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:12:53.135688 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:12:53.136350 (+ 662us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:12:53.136352 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:12:53.136929 (+ 577us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:12:53.136936 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:12:53.137318 (+ 382us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:12:53.137321 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:12:53.137379 (+ 58us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:53.137828 (+ 449us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0927 15:12:53.137839 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0927 15:12:53.139612 (+ 1773us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.136.62:41997: Server oryx/127.17.136.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":172,"thread_start_us":82,"threads_started":1}
W20260927 15:12:53.139859 27139 negotiation.cc:337] Failed RPC negotiation. Trace:
0927 15:12:53.134870 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.136.1:52091 (local address 127.17.136.62:41997)
0927 15:12:53.135152 (+ 282us) server_negotiation.cc:206] Beginning negotiation
0927 15:12:53.135156 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0927 15:12:53.135169 (+ 13us) server_negotiation.cc:407] Connection header received
0927 15:12:53.135266 (+ 97us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:12:53.135268 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:12:53.135310 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:12:53.135381 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0927 15:12:53.135764 (+ 383us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:53.136276 (+ 512us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:53.137018 (+ 742us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:53.137235 (+ 217us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:53.137306 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:53.139745 (+ 2439us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.136.1:52091: BlockingRecv error: recv got EOF from 127.17.136.1:52091 (error 108)
Metrics: {"server-negotiator.queue_time_us":217,"thread_start_us":89,"threads_started":1}
Sep 27 15:12:53 dist-test-slave-5s2t krb5kdc[26089](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.136.2@KRBTEST.COM for oryx/127.17.136.62@KRBTEST.COM, Server not found in Kerberos database
Sep 27 15:12:53 dist-test-slave-5s2t krb5kdc[26089](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.136.2@KRBTEST.COM for oryx/127.17.136.62@KRBTEST.COM, Server not found in Kerberos database
I20260927 15:12:53.297894 27140 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:53.292288 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.62:41997 (local address 127.17.136.2:38537)
0927 15:12:53.292579 (+ 291us) negotiation.cc:107] Waiting for socket to connect
0927 15:12:53.292592 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0927 15:12:53.292707 (+ 115us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0927 15:12:53.292990 (+ 283us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0927 15:12:53.292993 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0927 15:12:53.293172 (+ 179us) client_negotiation.cc:189] Negotiated authn=SASL
0927 15:12:53.293274 (+ 102us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:12:53.293281 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:12:53.294083 (+ 802us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:12:53.294086 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:12:53.294657 (+ 571us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:12:53.294665 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:12:53.295195 (+ 530us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:12:53.295198 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:12:53.295307 (+ 109us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:53.295830 (+ 523us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0927 15:12:53.295842 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0927 15:12:53.297771 (+ 1929us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.136.62:41997: Server oryx/127.17.136.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":215,"thread_start_us":112,"threads_started":1}
W20260927 15:12:53.298069 27139 negotiation.cc:337] Failed RPC negotiation. Trace:
0927 15:12:53.292416 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.136.2:38537 (local address 127.17.136.62:41997)
0927 15:12:53.292543 (+ 127us) server_negotiation.cc:206] Beginning negotiation
0927 15:12:53.292547 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0927 15:12:53.292665 (+ 118us) server_negotiation.cc:407] Connection header received
0927 15:12:53.292787 (+ 122us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:12:53.292789 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:12:53.292835 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:12:53.292897 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0927 15:12:53.293427 (+ 530us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:53.293959 (+ 532us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:53.294810 (+ 851us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:53.295054 (+ 244us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:53.295140 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:53.297949 (+ 2809us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.136.2:38537: BlockingRecv error: recv got EOF from 127.17.136.2:38537 (error 108)
Metrics: {"server-negotiator.queue_time_us":39}
Sep 27 15:12:53 dist-test-slave-5s2t krb5kdc[26089](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.136.3@KRBTEST.COM for oryx/127.17.136.62@KRBTEST.COM, Server not found in Kerberos database
Sep 27 15:12:53 dist-test-slave-5s2t krb5kdc[26089](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.136.3@KRBTEST.COM for oryx/127.17.136.62@KRBTEST.COM, Server not found in Kerberos database
I20260927 15:12:53.473804 27141 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:53.468971 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.62:41997 (local address 127.17.136.3:50487)
0927 15:12:53.469196 (+ 225us) negotiation.cc:107] Waiting for socket to connect
0927 15:12:53.469215 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0927 15:12:53.469306 (+ 91us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0927 15:12:53.469513 (+ 207us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0927 15:12:53.469515 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0927 15:12:53.469680 (+ 165us) client_negotiation.cc:189] Negotiated authn=SASL
0927 15:12:53.469771 (+ 91us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:12:53.469776 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:12:53.470453 (+ 677us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:12:53.470455 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:12:53.471036 (+ 581us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:12:53.471043 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:12:53.471522 (+ 479us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:12:53.471525 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:12:53.471589 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:53.472045 (+ 456us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0927 15:12:53.472056 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0927 15:12:53.473683 (+ 1627us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.136.62:41997: Server oryx/127.17.136.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":158,"thread_start_us":61,"threads_started":1}
W20260927 15:12:53.473948 27139 negotiation.cc:337] Failed RPC negotiation. Trace:
0927 15:12:53.469037 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.136.3:50487 (local address 127.17.136.62:41997)
0927 15:12:53.469149 (+ 112us) server_negotiation.cc:206] Beginning negotiation
0927 15:12:53.469153 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0927 15:12:53.469271 (+ 118us) server_negotiation.cc:407] Connection header received
0927 15:12:53.469372 (+ 101us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:12:53.469374 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:12:53.469417 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:12:53.469491 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0927 15:12:53.469847 (+ 356us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:53.470365 (+ 518us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:53.471118 (+ 753us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:53.471416 (+ 298us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:53.471517 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:53.473801 (+ 2284us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.136.3:50487: BlockingRecv error: recv got EOF from 127.17.136.3:50487 (error 108)
Metrics: {"server-negotiator.queue_time_us":40}
Sep 27 15:12:54 dist-test-slave-5s2t krb5kdc[26089](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.136.1@KRBTEST.COM for oryx/127.17.136.62@KRBTEST.COM, Server not found in Kerberos database
Sep 27 15:12:54 dist-test-slave-5s2t krb5kdc[26089](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.136.1@KRBTEST.COM for oryx/127.17.136.62@KRBTEST.COM, Server not found in Kerberos database
I20260927 15:12:54.150718 27142 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:54.140472 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.62:41997 (local address 127.17.136.1:42695)
0927 15:12:54.140712 (+ 240us) negotiation.cc:107] Waiting for socket to connect
0927 15:12:54.140725 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0927 15:12:54.140809 (+ 84us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0927 15:12:54.141015 (+ 206us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0927 15:12:54.141016 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0927 15:12:54.141184 (+ 168us) client_negotiation.cc:189] Negotiated authn=SASL
0927 15:12:54.141278 (+ 94us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:12:54.141283 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:12:54.142005 (+ 722us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:12:54.142008 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:12:54.142577 (+ 569us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:12:54.142584 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:12:54.142981 (+ 397us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:12:54.142984 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:12:54.143061 (+ 77us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:54.143610 (+ 549us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0927 15:12:54.143626 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0927 15:12:54.150554 (+ 6928us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.136.62:41997: Server oryx/127.17.136.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":168,"thread_start_us":70,"threads_started":1}
W20260927 15:12:54.150801 27143 negotiation.cc:337] Failed RPC negotiation. Trace:
0927 15:12:54.140536 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.136.1:42695 (local address 127.17.136.62:41997)
0927 15:12:54.140793 (+ 257us) server_negotiation.cc:206] Beginning negotiation
0927 15:12:54.140796 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0927 15:12:54.140808 (+ 12us) server_negotiation.cc:407] Connection header received
0927 15:12:54.140872 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:12:54.140874 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:12:54.140917 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:12:54.140988 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0927 15:12:54.141358 (+ 370us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:54.141924 (+ 566us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:54.142674 (+ 750us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:54.142895 (+ 221us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:54.142989 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:54.150690 (+ 7701us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.136.1:42695: BlockingRecv error: recv got EOF from 127.17.136.1:42695 (error 108)
Metrics: {"server-negotiator.queue_time_us":197,"thread_start_us":60,"threads_started":1}
Sep 27 15:12:54 dist-test-slave-5s2t krb5kdc[26089](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.136.2@KRBTEST.COM for oryx/127.17.136.62@KRBTEST.COM, Server not found in Kerberos database
Sep 27 15:12:54 dist-test-slave-5s2t krb5kdc[26089](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.136.2@KRBTEST.COM for oryx/127.17.136.62@KRBTEST.COM, Server not found in Kerberos database
I20260927 15:12:54.303797 27144 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:54.298659 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.62:41997 (local address 127.17.136.2:35979)
0927 15:12:54.298921 (+ 262us) negotiation.cc:107] Waiting for socket to connect
0927 15:12:54.298934 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0927 15:12:54.299026 (+ 92us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0927 15:12:54.299300 (+ 274us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0927 15:12:54.299303 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0927 15:12:54.299506 (+ 203us) client_negotiation.cc:189] Negotiated authn=SASL
0927 15:12:54.299602 (+ 96us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:12:54.299608 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:12:54.300340 (+ 732us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:12:54.300343 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:12:54.300927 (+ 584us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:12:54.300936 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:12:54.301347 (+ 411us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:12:54.301350 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:12:54.301430 (+ 80us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:54.301854 (+ 424us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0927 15:12:54.301865 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0927 15:12:54.303682 (+ 1817us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.136.62:41997: Server oryx/127.17.136.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":189,"thread_start_us":79,"threads_started":1}
W20260927 15:12:54.303937 27143 negotiation.cc:337] Failed RPC negotiation. Trace:
0927 15:12:54.298747 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.136.2:35979 (local address 127.17.136.62:41997)
0927 15:12:54.298870 (+ 123us) server_negotiation.cc:206] Beginning negotiation
0927 15:12:54.298874 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0927 15:12:54.298993 (+ 119us) server_negotiation.cc:407] Connection header received
0927 15:12:54.299141 (+ 148us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:12:54.299144 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:12:54.299192 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:12:54.299278 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0927 15:12:54.299706 (+ 428us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:54.300232 (+ 526us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:54.301029 (+ 797us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:54.301256 (+ 227us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:54.301332 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:54.303816 (+ 2484us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.136.2:35979: BlockingRecv error: recv got EOF from 127.17.136.2:35979 (error 108)
Metrics: {"server-negotiator.queue_time_us":41}
Sep 27 15:12:54 dist-test-slave-5s2t krb5kdc[26089](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.136.3@KRBTEST.COM for oryx/127.17.136.62@KRBTEST.COM, Server not found in Kerberos database
Sep 27 15:12:54 dist-test-slave-5s2t krb5kdc[26089](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.136.3@KRBTEST.COM for oryx/127.17.136.62@KRBTEST.COM, Server not found in Kerberos database
I20260927 15:12:54.479437 27145 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:54.474472 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.62:41997 (local address 127.17.136.3:58227)
0927 15:12:54.474735 (+ 263us) negotiation.cc:107] Waiting for socket to connect
0927 15:12:54.474750 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0927 15:12:54.474853 (+ 103us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0927 15:12:54.475070 (+ 217us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0927 15:12:54.475072 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0927 15:12:54.475236 (+ 164us) client_negotiation.cc:189] Negotiated authn=SASL
0927 15:12:54.475357 (+ 121us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:12:54.475362 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:12:54.476087 (+ 725us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:12:54.476090 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:12:54.476677 (+ 587us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:12:54.476686 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:12:54.477082 (+ 396us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:12:54.477085 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:12:54.477143 (+ 58us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:54.477629 (+ 486us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0927 15:12:54.477640 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0927 15:12:54.479296 (+ 1656us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.136.62:41997: Server oryx/127.17.136.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":184,"thread_start_us":74,"threads_started":1}
W20260927 15:12:54.479521 27143 negotiation.cc:337] Failed RPC negotiation. Trace:
0927 15:12:54.474564 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.136.3:58227 (local address 127.17.136.62:41997)
0927 15:12:54.474704 (+ 140us) server_negotiation.cc:206] Beginning negotiation
0927 15:12:54.474709 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0927 15:12:54.474804 (+ 95us) server_negotiation.cc:407] Connection header received
0927 15:12:54.474937 (+ 133us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:12:54.474940 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:12:54.474986 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:12:54.475041 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0927 15:12:54.475459 (+ 418us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:54.475980 (+ 521us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:54.476779 (+ 799us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:54.476999 (+ 220us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:54.477075 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:54.479427 (+ 2352us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.136.3:58227: BlockingRecv error: recv got EOF from 127.17.136.3:58227 (error 108)
Metrics: {"server-negotiator.queue_time_us":53}
Sep 27 15:12:55 dist-test-slave-5s2t krb5kdc[26089](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.136.1@KRBTEST.COM for oryx/127.17.136.62@KRBTEST.COM, Server not found in Kerberos database
Sep 27 15:12:55 dist-test-slave-5s2t krb5kdc[26089](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.136.1@KRBTEST.COM for oryx/127.17.136.62@KRBTEST.COM, Server not found in Kerberos database
I20260927 15:12:55.156839 27146 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:55.151648 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.62:41997 (local address 127.17.136.1:48101)
0927 15:12:55.151937 (+ 289us) negotiation.cc:107] Waiting for socket to connect
0927 15:12:55.151951 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0927 15:12:55.152039 (+ 88us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0927 15:12:55.152254 (+ 215us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0927 15:12:55.152256 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0927 15:12:55.152445 (+ 189us) client_negotiation.cc:189] Negotiated authn=SASL
0927 15:12:55.152540 (+ 95us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:12:55.152545 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:12:55.153265 (+ 720us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:12:55.153267 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:12:55.153870 (+ 603us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:12:55.153878 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:12:55.154299 (+ 421us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:12:55.154303 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:12:55.154404 (+ 101us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:55.154933 (+ 529us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0927 15:12:55.154944 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0927 15:12:55.156724 (+ 1780us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.136.62:41997: Server oryx/127.17.136.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":211,"thread_start_us":138,"threads_started":1}
W20260927 15:12:55.156986 27147 negotiation.cc:337] Failed RPC negotiation. Trace:
0927 15:12:55.151759 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.136.1:48101 (local address 127.17.136.62:41997)
0927 15:12:55.152009 (+ 250us) server_negotiation.cc:206] Beginning negotiation
0927 15:12:55.152013 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0927 15:12:55.152026 (+ 13us) server_negotiation.cc:407] Connection header received
0927 15:12:55.152119 (+ 93us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:12:55.152121 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:12:55.152160 (+ 39us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:12:55.152225 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0927 15:12:55.152644 (+ 419us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:55.153180 (+ 536us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:55.153975 (+ 795us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:55.154198 (+ 223us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:55.154309 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:55.156857 (+ 2548us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.136.1:48101: BlockingRecv error: recv got EOF from 127.17.136.1:48101 (error 108)
Metrics: {"server-negotiator.queue_time_us":186,"thread_start_us":76,"threads_started":1}
Sep 27 15:12:55 dist-test-slave-5s2t krb5kdc[26089](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.136.2@KRBTEST.COM for oryx/127.17.136.62@KRBTEST.COM, Server not found in Kerberos database
Sep 27 15:12:55 dist-test-slave-5s2t krb5kdc[26089](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.136.2@KRBTEST.COM for oryx/127.17.136.62@KRBTEST.COM, Server not found in Kerberos database
I20260927 15:12:55.309279 27148 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:55.304583 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.62:41997 (local address 127.17.136.2:48733)
0927 15:12:55.304820 (+ 237us) negotiation.cc:107] Waiting for socket to connect
0927 15:12:55.304833 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0927 15:12:55.304929 (+ 96us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0927 15:12:55.305152 (+ 223us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0927 15:12:55.305154 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0927 15:12:55.305324 (+ 170us) client_negotiation.cc:189] Negotiated authn=SASL
0927 15:12:55.305438 (+ 114us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:12:55.305444 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:12:55.306115 (+ 671us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:12:55.306117 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:12:55.306674 (+ 557us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:12:55.306681 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:12:55.307049 (+ 368us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:12:55.307051 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:12:55.307106 (+ 55us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:55.307561 (+ 455us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0927 15:12:55.307572 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0927 15:12:55.309158 (+ 1586us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.136.62:41997: Server oryx/127.17.136.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":164,"thread_start_us":67,"threads_started":1}
W20260927 15:12:55.309424 27147 negotiation.cc:337] Failed RPC negotiation. Trace:
0927 15:12:55.304641 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.136.2:48733 (local address 127.17.136.62:41997)
0927 15:12:55.304772 (+ 131us) server_negotiation.cc:206] Beginning negotiation
0927 15:12:55.304776 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0927 15:12:55.304894 (+ 118us) server_negotiation.cc:407] Connection header received
0927 15:12:55.305012 (+ 118us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:12:55.305015 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:12:55.305061 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:12:55.305128 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0927 15:12:55.305527 (+ 399us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:55.306039 (+ 512us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:55.306757 (+ 718us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:55.306971 (+ 214us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:55.307040 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:55.309289 (+ 2249us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.136.2:48733: BlockingRecv error: recv got EOF from 127.17.136.2:48733 (error 108)
Metrics: {"server-negotiator.queue_time_us":46}
I20260927 15:12:55.390656 17952 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu with pid 26672
I20260927 15:12:55.395507 17952 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu with pid 26824
I20260927 15:12:55.399824 17952 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu with pid 26956
I20260927 15:12:55.403987 17952 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu with pid 26602
2026-09-27T15:12:55Z chronyd exiting
[ OK ] SecurityITest.TestMismatchingPrincipals (17772 ms)
[ RUN ] SecurityITest.TestRequireAuthenticationInsecureCluster
2026-09-27T15:12:55Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-27T15:12:55Z Disabled control of system clock
I20260927 15:12:55.431386 17952 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu
/tmp/dist-test-taskiFOyeW/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790521920546562-17952-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790521920546562-17952-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790521920546562-17952-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790521920546562-17952-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.136.62:38555
--webserver_interface=127.17.136.62
--webserver_port=0
--builtin_ntp_servers=127.17.136.20:39111
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.136.62:38555
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {}
W20260927 15:12:55.537086 27152 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260927 15:12:55.537355 27152 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260927 15:12:55.537387 27152 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260927 15:12:55.541417 27152 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260927 15:12:55.541487 27152 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260927 15:12:55.541502 27152 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260927 15:12:55.541518 27152 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260927 15:12:55.541546 27152 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260927 15:12:55.546330 27152 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.136.20:39111
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790521920546562-17952-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790521920546562-17952-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.17.136.62:38555
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.136.62:38555
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790521920546562-17952-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.17.136.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27152
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790521920546562-17952-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 27 Sep 2026 14:27:13 UTC on ccycloud.quasar-psqrth.root.comops.site
build id 4676138
I20260927 15:12:55.547390 27152 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260927 15:12:55.548727 27152 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260927 15:12:55.556850 27152 server_base.cc:1034] running on GCE node
W20260927 15:12:55.556810 27157 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260927 15:12:55.556797 27160 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260927 15:12:55.556814 27158 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260927 15:12:55.557560 27152 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260927 15:12:55.558586 27152 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260927 15:12:55.559731 27152 hybrid_clock.cc:648] HybridClock initialized: now 1790521975559716 us; error 27 us; skew 500 ppm
I20260927 15:12:55.561417 27152 webserver.cc:460] Webserver started at http://127.17.136.62:38803/ using document root <none> and password file <none>
I20260927 15:12:55.561947 27152 fs_manager.cc:359] Metadata directory not provided
I20260927 15:12:55.562006 27152 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260927 15:12:55.562201 27152 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260927 15:12:55.564394 27152 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790521920546562-17952-0/minicluster-data/master-0/data/instance:
uuid: "0deea74164b94923ac258451d40a1474"
format_stamp: "Formatted at 2026-09-27 15:12:55 on dist-test-slave-5s2t"
server_key: "ffb17d6e564dd108bca7ace9e7e7dfb8"
server_key_iv: "d1fdad1a1668194c3b2195dc34e0f9b6"
server_key_version: "encryptionkey@0"
I20260927 15:12:55.565079 27152 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790521920546562-17952-0/minicluster-data/master-0/wal/instance:
uuid: "0deea74164b94923ac258451d40a1474"
format_stamp: "Formatted at 2026-09-27 15:12:55 on dist-test-slave-5s2t"
server_key: "ffb17d6e564dd108bca7ace9e7e7dfb8"
server_key_iv: "d1fdad1a1668194c3b2195dc34e0f9b6"
server_key_version: "encryptionkey@0"
I20260927 15:12:55.568722 27152 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260927 15:12:55.571120 27166 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260927 15:12:55.572387 27152 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260927 15:12:55.572507 27152 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790521920546562-17952-0/minicluster-data/master-0/data,/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790521920546562-17952-0/minicluster-data/master-0/wal
uuid: "0deea74164b94923ac258451d40a1474"
format_stamp: "Formatted at 2026-09-27 15:12:55 on dist-test-slave-5s2t"
server_key: "ffb17d6e564dd108bca7ace9e7e7dfb8"
server_key_iv: "d1fdad1a1668194c3b2195dc34e0f9b6"
server_key_version: "encryptionkey@0"
I20260927 15:12:55.572607 27152 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790521920546562-17952-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790521920546562-17952-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790521920546562-17952-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260927 15:12:55.587637 27152 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260927 15:12:55.588263 27152 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260927 15:12:55.588426 27152 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260927 15:12:55.594718 27152 rpc_server.cc:307] RPC server started. Bound to: 127.17.136.62:38555
I20260927 15:12:55.594775 27218 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.136.62:38555 every 8 connection(s)
I20260927 15:12:55.595661 27152 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790521920546562-17952-0/minicluster-data/master-0/data/info.pb
I20260927 15:12:55.596323 17952 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu as pid 27152
I20260927 15:12:55.596431 17952 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790521920546562-17952-0/minicluster-data/master-0/wal/instance
I20260927 15:12:55.596674 17952 external_mini_cluster.cc:1428] Setting key d59b57447c67fb22968d86c3cdcdf592
I20260927 15:12:55.599097 27219 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:12:55.605522 27219 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0deea74164b94923ac258451d40a1474: Bootstrap starting.
I20260927 15:12:55.606606 27222 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:55.598021 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37478 (local address 127.17.136.62:38555)
0927 15:12:55.598677 (+ 656us) server_negotiation.cc:206] Beginning negotiation
0927 15:12:55.598696 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0927 15:12:55.598739 (+ 43us) server_negotiation.cc:407] Connection header received
0927 15:12:55.599596 (+ 857us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:12:55.599618 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:12:55.600092 (+ 474us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:12:55.600443 (+ 351us) server_negotiation.cc:226] Negotiated authn=SASL
0927 15:12:55.600871 (+ 428us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:55.602312 (+ 1441us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:55.603174 (+ 862us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:55.603845 (+ 671us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:55.603994 (+ 149us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:55.604706 (+ 712us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0927 15:12:55.604712 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0927 15:12:55.604725 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0927 15:12:55.605179 (+ 454us) server_negotiation.cc:922] calling sasl_server_start()
0927 15:12:55.605247 (+ 68us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0927 15:12:55.605272 (+ 25us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0927 15:12:55.605402 (+ 130us) server_negotiation.cc:1035] Waiting for connection context
0927 15:12:55.605490 (+ 88us) server_negotiation.cc:299] Negotiation successful
0927 15:12:55.605741 (+ 251us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":273,"thread_start_us":111,"threads_started":1}
I20260927 15:12:55.608053 27219 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 0deea74164b94923ac258451d40a1474: Neither blocks nor log segments found. Creating new log.
I20260927 15:12:55.608774 27219 log.cc:824] T 00000000000000000000000000000000 P 0deea74164b94923ac258451d40a1474: Log is configured to *not* fsync() on all Append() calls
I20260927 15:12:55.610533 27219 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0deea74164b94923ac258451d40a1474: No bootstrap required, opened a new log
I20260927 15:12:55.614012 27219 raft_consensus.cc:348] T 00000000000000000000000000000000 P 0deea74164b94923ac258451d40a1474 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0deea74164b94923ac258451d40a1474" member_type: VOTER last_known_addr { host: "127.17.136.62" port: 38555 } }
I20260927 15:12:55.614243 27219 raft_consensus.cc:374] T 00000000000000000000000000000000 P 0deea74164b94923ac258451d40a1474 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:12:55.614283 27219 raft_consensus.cc:729] T 00000000000000000000000000000000 P 0deea74164b94923ac258451d40a1474 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0deea74164b94923ac258451d40a1474, State: Initialized, Role: FOLLOWER
I20260927 15:12:55.614688 27219 consensus_queue.cc:260] T 00000000000000000000000000000000 P 0deea74164b94923ac258451d40a1474 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0deea74164b94923ac258451d40a1474" member_type: VOTER last_known_addr { host: "127.17.136.62" port: 38555 } }
I20260927 15:12:55.614802 27219 raft_consensus.cc:388] T 00000000000000000000000000000000 P 0deea74164b94923ac258451d40a1474 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260927 15:12:55.614840 27219 raft_consensus.cc:482] T 00000000000000000000000000000000 P 0deea74164b94923ac258451d40a1474 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260927 15:12:55.614936 27219 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 0deea74164b94923ac258451d40a1474 [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:12:55.615880 27219 raft_consensus.cc:504] T 00000000000000000000000000000000 P 0deea74164b94923ac258451d40a1474 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0deea74164b94923ac258451d40a1474" member_type: VOTER last_known_addr { host: "127.17.136.62" port: 38555 } }
I20260927 15:12:55.616205 27219 leader_election.cc:302] T 00000000000000000000000000000000 P 0deea74164b94923ac258451d40a1474 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 0deea74164b94923ac258451d40a1474; no voters:
I20260927 15:12:55.616515 27219 leader_election.cc:288] T 00000000000000000000000000000000 P 0deea74164b94923ac258451d40a1474 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260927 15:12:55.616616 27224 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 0deea74164b94923ac258451d40a1474 [term 1 FOLLOWER]: Leader election won for term 1
I20260927 15:12:55.616837 27224 raft_consensus.cc:686] T 00000000000000000000000000000000 P 0deea74164b94923ac258451d40a1474 [term 1 LEADER]: Becoming Leader. State: Replica: 0deea74164b94923ac258451d40a1474, State: Running, Role: LEADER
I20260927 15:12:55.617136 27224 consensus_queue.cc:237] T 00000000000000000000000000000000 P 0deea74164b94923ac258451d40a1474 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0deea74164b94923ac258451d40a1474" member_type: VOTER last_known_addr { host: "127.17.136.62" port: 38555 } }
I20260927 15:12:55.617692 27219 sys_catalog.cc:564] T 00000000000000000000000000000000 P 0deea74164b94923ac258451d40a1474 [sys.catalog]: configured and running, proceeding with master startup.
I20260927 15:12:55.618637 27225 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0deea74164b94923ac258451d40a1474 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "0deea74164b94923ac258451d40a1474" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0deea74164b94923ac258451d40a1474" member_type: VOTER last_known_addr { host: "127.17.136.62" port: 38555 } } }
I20260927 15:12:55.618754 27225 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0deea74164b94923ac258451d40a1474 [sys.catalog]: This master's current role is: LEADER
I20260927 15:12:55.618978 27226 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0deea74164b94923ac258451d40a1474 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0deea74164b94923ac258451d40a1474. Latest consensus state: current_term: 1 leader_uuid: "0deea74164b94923ac258451d40a1474" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0deea74164b94923ac258451d40a1474" member_type: VOTER last_known_addr { host: "127.17.136.62" port: 38555 } } }
I20260927 15:12:55.619052 27226 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0deea74164b94923ac258451d40a1474 [sys.catalog]: This master's current role is: LEADER
I20260927 15:12:55.619083 27233 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260927 15:12:55.622089 27233 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260927 15:12:55.627221 27233 catalog_manager.cc:1347] Generated new cluster ID: 8c6a76f04b984db69f0b3daba1e89604
I20260927 15:12:55.627324 27233 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260927 15:12:55.650287 27233 catalog_manager.cc:1370] Generated new certificate authority record
I20260927 15:12:55.651274 27233 catalog_manager.cc:1504] Loading token signing keys...
I20260927 15:12:55.660724 27233 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 0deea74164b94923ac258451d40a1474: Generated new TSK 0
I20260927 15:12:55.661412 27233 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260927 15:12:55.668171 17952 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu
/tmp/dist-test-taskiFOyeW/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790521920546562-17952-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790521920546562-17952-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790521920546562-17952-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790521920546562-17952-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.136.1:0
--local_ip_for_outbound_sockets=127.17.136.1
--webserver_interface=127.17.136.1
--webserver_port=0
--tserver_master_addrs=127.17.136.62:38555
--builtin_ntp_servers=127.17.136.20:39111
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
W20260927 15:12:55.774049 27243 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260927 15:12:55.774315 27243 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260927 15:12:55.774353 27243 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260927 15:12:55.778455 27243 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260927 15:12:55.778512 27243 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260927 15:12:55.778575 27243 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.136.1
I20260927 15:12:55.783387 27243 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.136.20:39111
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790521920546562-17952-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790521920546562-17952-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.136.1:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790521920546562-17952-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.17.136.1
--webserver_port=0
--tserver_master_addrs=127.17.136.62:38555
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27243
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.136.1
--log_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790521920546562-17952-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 27 Sep 2026 14:27:13 UTC on ccycloud.quasar-psqrth.root.comops.site
build id 4676138
I20260927 15:12:55.784447 27243 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260927 15:12:55.785784 27243 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260927 15:12:55.794926 27249 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260927 15:12:55.794919 27248 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260927 15:12:55.795014 27251 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260927 15:12:55.795213 27243 server_base.cc:1034] running on GCE node
I20260927 15:12:55.795681 27243 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260927 15:12:55.796257 27243 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260927 15:12:55.797405 27243 hybrid_clock.cc:648] HybridClock initialized: now 1790521975797385 us; error 31 us; skew 500 ppm
I20260927 15:12:55.799130 27243 webserver.cc:460] Webserver started at http://127.17.136.1:43669/ using document root <none> and password file <none>
I20260927 15:12:55.799685 27243 fs_manager.cc:359] Metadata directory not provided
I20260927 15:12:55.799742 27243 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260927 15:12:55.799901 27243 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260927 15:12:55.801797 27243 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790521920546562-17952-0/minicluster-data/ts-0/data/instance:
uuid: "7bec4e317bb34a2080c7c9e0746054a4"
format_stamp: "Formatted at 2026-09-27 15:12:55 on dist-test-slave-5s2t"
server_key: "32abcc0c8b41ef842a1b4604ac604758"
server_key_iv: "50e4f82b467d7e74846fdeb366d2993e"
server_key_version: "encryptionkey@0"
I20260927 15:12:55.802275 27243 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790521920546562-17952-0/minicluster-data/ts-0/wal/instance:
uuid: "7bec4e317bb34a2080c7c9e0746054a4"
format_stamp: "Formatted at 2026-09-27 15:12:55 on dist-test-slave-5s2t"
server_key: "32abcc0c8b41ef842a1b4604ac604758"
server_key_iv: "50e4f82b467d7e74846fdeb366d2993e"
server_key_version: "encryptionkey@0"
I20260927 15:12:55.805725 27243 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.001s sys 0.004s
I20260927 15:12:55.808084 27257 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260927 15:12:55.809293 27243 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260927 15:12:55.809381 27243 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790521920546562-17952-0/minicluster-data/ts-0/data,/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790521920546562-17952-0/minicluster-data/ts-0/wal
uuid: "7bec4e317bb34a2080c7c9e0746054a4"
format_stamp: "Formatted at 2026-09-27 15:12:55 on dist-test-slave-5s2t"
server_key: "32abcc0c8b41ef842a1b4604ac604758"
server_key_iv: "50e4f82b467d7e74846fdeb366d2993e"
server_key_version: "encryptionkey@0"
I20260927 15:12:55.809470 27243 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790521920546562-17952-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790521920546562-17952-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790521920546562-17952-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260927 15:12:55.835899 27243 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260927 15:12:55.836560 27243 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260927 15:12:55.836704 27243 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260927 15:12:55.837222 27243 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260927 15:12:55.838150 27243 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260927 15:12:55.838195 27243 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260927 15:12:55.838234 27243 ts_tablet_manager.cc:610] Registered 0 tablets
I20260927 15:12:55.838251 27243 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260927 15:12:55.846010 27243 rpc_server.cc:307] RPC server started. Bound to: 127.17.136.1:38045
I20260927 15:12:55.846045 27370 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.136.1:38045 every 8 connection(s)
I20260927 15:12:55.846858 27243 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790521920546562-17952-0/minicluster-data/ts-0/data/info.pb
I20260927 15:12:55.854322 17952 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu as pid 27243
I20260927 15:12:55.854471 17952 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790521920546562-17952-0/minicluster-data/ts-0/wal/instance
I20260927 15:12:55.854796 17952 external_mini_cluster.cc:1428] Setting key 1881e626a16bc5ae00316c2e864a6d72
I20260927 15:12:55.856091 27222 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:55.848594 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.136.1:47911 (local address 127.17.136.62:38555)
0927 15:12:55.848754 (+ 160us) server_negotiation.cc:206] Beginning negotiation
0927 15:12:55.848759 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0927 15:12:55.849772 (+ 1013us) server_negotiation.cc:407] Connection header received
0927 15:12:55.851219 (+ 1447us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:12:55.851227 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:12:55.851304 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:12:55.851381 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0927 15:12:55.852300 (+ 919us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:55.852834 (+ 534us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:55.854026 (+ 1192us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:55.854249 (+ 223us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:55.854329 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:55.855598 (+ 1269us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0927 15:12:55.855602 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0927 15:12:55.855605 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0927 15:12:55.855618 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0927 15:12:55.855641 (+ 23us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0927 15:12:55.855650 (+ 9us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0927 15:12:55.855715 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0927 15:12:55.855858 (+ 143us) server_negotiation.cc:299] Negotiation successful
0927 15:12:55.855953 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260927 15:12:55.856904 17952 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu
/tmp/dist-test-taskiFOyeW/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790521920546562-17952-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790521920546562-17952-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790521920546562-17952-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790521920546562-17952-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.136.2:0
--local_ip_for_outbound_sockets=127.17.136.2
--webserver_interface=127.17.136.2
--webserver_port=0
--tserver_master_addrs=127.17.136.62:38555
--builtin_ntp_servers=127.17.136.20:39111
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
I20260927 15:12:55.857177 27373 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:55.849018 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.62:38555 (local address 127.17.136.1:47911)
0927 15:12:55.849628 (+ 610us) negotiation.cc:107] Waiting for socket to connect
0927 15:12:55.849666 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0927 15:12:55.851013 (+ 1347us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0927 15:12:55.851566 (+ 553us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0927 15:12:55.851573 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0927 15:12:55.851656 (+ 83us) client_negotiation.cc:189] Negotiated authn=SASL
0927 15:12:55.852171 (+ 515us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:12:55.852183 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:12:55.852969 (+ 786us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:12:55.852972 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:12:55.853898 (+ 926us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:12:55.853907 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:12:55.854410 (+ 503us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:12:55.854415 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:12:55.854633 (+ 218us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:55.855301 (+ 668us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0927 15:12:55.855304 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0927 15:12:55.855350 (+ 46us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0927 15:12:55.855437 (+ 87us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0927 15:12:55.855731 (+ 294us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0927 15:12:55.855738 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0927 15:12:55.855742 (+ 4us) client_negotiation.cc:769] Sending connection context
0927 15:12:55.855839 (+ 97us) client_negotiation.cc:240] Negotiation successful
0927 15:12:55.856107 (+ 268us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":235,"thread_start_us":106,"threads_started":1}
I20260927 15:12:55.858289 27371 heartbeater.cc:347] Connected to a master server at 127.17.136.62:38555
I20260927 15:12:55.858527 27371 heartbeater.cc:464] Registering TS with master...
I20260927 15:12:55.859017 27371 heartbeater.cc:511] Master 127.17.136.62:38555 requested a full tablet report, sending...
I20260927 15:12:55.860484 27183 ts_manager.cc:194] Registered new tserver with Master: 7bec4e317bb34a2080c7c9e0746054a4 (127.17.136.1:38045)
I20260927 15:12:55.861570 27183 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.17.136.1:47911
W20260927 15:12:55.964979 27374 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260927 15:12:55.965237 27374 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260927 15:12:55.965274 27374 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260927 15:12:55.969311 27374 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260927 15:12:55.969373 27374 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260927 15:12:55.969434 27374 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.136.2
I20260927 15:12:55.974229 27374 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.136.20:39111
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790521920546562-17952-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790521920546562-17952-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.136.2:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790521920546562-17952-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.17.136.2
--webserver_port=0
--tserver_master_addrs=127.17.136.62:38555
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27374
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.136.2
--log_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790521920546562-17952-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 27 Sep 2026 14:27:13 UTC on ccycloud.quasar-psqrth.root.comops.site
build id 4676138
I20260927 15:12:55.975360 27374 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260927 15:12:55.976765 27374 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260927 15:12:55.986038 27380 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260927 15:12:55.986074 27379 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260927 15:12:55.986099 27374 server_base.cc:1034] running on GCE node
W20260927 15:12:55.986049 27382 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260927 15:12:55.986721 27374 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260927 15:12:55.987329 27374 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260927 15:12:55.988476 27374 hybrid_clock.cc:648] HybridClock initialized: now 1790521975988457 us; error 31 us; skew 500 ppm
I20260927 15:12:55.990160 27374 webserver.cc:460] Webserver started at http://127.17.136.2:33087/ using document root <none> and password file <none>
I20260927 15:12:55.990698 27374 fs_manager.cc:359] Metadata directory not provided
I20260927 15:12:55.990757 27374 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260927 15:12:55.990949 27374 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260927 15:12:55.992955 27374 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790521920546562-17952-0/minicluster-data/ts-1/data/instance:
uuid: "a77319482d7e48d197781a694ece0ccb"
format_stamp: "Formatted at 2026-09-27 15:12:55 on dist-test-slave-5s2t"
server_key: "76e2879632fdbea6774117935cabd350"
server_key_iv: "186730645f8075087b5a1f496cd41730"
server_key_version: "encryptionkey@0"
I20260927 15:12:55.993458 27374 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790521920546562-17952-0/minicluster-data/ts-1/wal/instance:
uuid: "a77319482d7e48d197781a694ece0ccb"
format_stamp: "Formatted at 2026-09-27 15:12:55 on dist-test-slave-5s2t"
server_key: "76e2879632fdbea6774117935cabd350"
server_key_iv: "186730645f8075087b5a1f496cd41730"
server_key_version: "encryptionkey@0"
I20260927 15:12:55.996843 27374 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260927 15:12:55.999161 27388 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260927 15:12:56.000355 27374 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260927 15:12:56.000454 27374 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790521920546562-17952-0/minicluster-data/ts-1/data,/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790521920546562-17952-0/minicluster-data/ts-1/wal
uuid: "a77319482d7e48d197781a694ece0ccb"
format_stamp: "Formatted at 2026-09-27 15:12:55 on dist-test-slave-5s2t"
server_key: "76e2879632fdbea6774117935cabd350"
server_key_iv: "186730645f8075087b5a1f496cd41730"
server_key_version: "encryptionkey@0"
I20260927 15:12:56.000542 27374 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790521920546562-17952-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790521920546562-17952-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790521920546562-17952-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260927 15:12:56.019524 27374 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260927 15:12:56.020177 27374 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260927 15:12:56.020321 27374 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260927 15:12:56.020877 27374 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260927 15:12:56.021777 27374 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260927 15:12:56.021822 27374 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260927 15:12:56.021862 27374 ts_tablet_manager.cc:610] Registered 0 tablets
I20260927 15:12:56.021881 27374 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260927 15:12:56.029949 27374 rpc_server.cc:307] RPC server started. Bound to: 127.17.136.2:34545
I20260927 15:12:56.029989 27501 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.136.2:34545 every 8 connection(s)
I20260927 15:12:56.030849 27374 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790521920546562-17952-0/minicluster-data/ts-1/data/info.pb
I20260927 15:12:56.032919 17952 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu as pid 27374
I20260927 15:12:56.033020 17952 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790521920546562-17952-0/minicluster-data/ts-1/wal/instance
I20260927 15:12:56.033284 17952 external_mini_cluster.cc:1428] Setting key 5cc8adbc18d7948c5d6b3db97681f97a
I20260927 15:12:56.035132 17952 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu
/tmp/dist-test-taskiFOyeW/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790521920546562-17952-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790521920546562-17952-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790521920546562-17952-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790521920546562-17952-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.136.3:0
--local_ip_for_outbound_sockets=127.17.136.3
--webserver_interface=127.17.136.3
--webserver_port=0
--tserver_master_addrs=127.17.136.62:38555
--builtin_ntp_servers=127.17.136.20:39111
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
I20260927 15:12:56.040501 27222 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:56.032581 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.136.2:40273 (local address 127.17.136.62:38555)
0927 15:12:56.032733 (+ 152us) server_negotiation.cc:206] Beginning negotiation
0927 15:12:56.032738 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0927 15:12:56.033847 (+ 1109us) server_negotiation.cc:407] Connection header received
0927 15:12:56.035313 (+ 1466us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:12:56.035316 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:12:56.035367 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:12:56.035447 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0927 15:12:56.036623 (+ 1176us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:56.037381 (+ 758us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:56.038502 (+ 1121us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:56.038835 (+ 333us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:56.038944 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:56.040020 (+ 1076us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0927 15:12:56.040024 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0927 15:12:56.040027 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0927 15:12:56.040043 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0927 15:12:56.040066 (+ 23us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0927 15:12:56.040077 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0927 15:12:56.040155 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0927 15:12:56.040263 (+ 108us) server_negotiation.cc:299] Negotiation successful
0927 15:12:56.040334 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260927 15:12:56.041317 27504 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:56.032990 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.62:38555 (local address 127.17.136.2:40273)
0927 15:12:56.033698 (+ 708us) negotiation.cc:107] Waiting for socket to connect
0927 15:12:56.033749 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0927 15:12:56.035102 (+ 1353us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0927 15:12:56.035674 (+ 572us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0927 15:12:56.035683 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0927 15:12:56.035790 (+ 107us) client_negotiation.cc:189] Negotiated authn=SASL
0927 15:12:56.036471 (+ 681us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:12:56.036493 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:12:56.037507 (+ 1014us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:12:56.037509 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:12:56.038383 (+ 874us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:12:56.038391 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:12:56.038986 (+ 595us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:12:56.038989 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:12:56.039130 (+ 141us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:56.039754 (+ 624us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0927 15:12:56.039755 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0927 15:12:56.039795 (+ 40us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0927 15:12:56.039862 (+ 67us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0927 15:12:56.040150 (+ 288us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0927 15:12:56.040154 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0927 15:12:56.040158 (+ 4us) client_negotiation.cc:769] Sending connection context
0927 15:12:56.040244 (+ 86us) client_negotiation.cc:240] Negotiation successful
0927 15:12:56.040470 (+ 226us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":259,"thread_start_us":102,"threads_started":1}
I20260927 15:12:56.042418 27502 heartbeater.cc:347] Connected to a master server at 127.17.136.62:38555
I20260927 15:12:56.042637 27502 heartbeater.cc:464] Registering TS with master...
I20260927 15:12:56.043138 27502 heartbeater.cc:511] Master 127.17.136.62:38555 requested a full tablet report, sending...
I20260927 15:12:56.044114 27183 ts_manager.cc:194] Registered new tserver with Master: a77319482d7e48d197781a694ece0ccb (127.17.136.2:34545)
I20260927 15:12:56.044667 27183 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.17.136.2:40273
W20260927 15:12:56.142956 27505 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260927 15:12:56.143221 27505 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260927 15:12:56.143283 27505 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260927 15:12:56.147215 27505 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260927 15:12:56.147315 27505 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260927 15:12:56.147384 27505 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.136.3
I20260927 15:12:56.152093 27505 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.136.20:39111
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790521920546562-17952-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790521920546562-17952-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.136.3:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790521920546562-17952-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.17.136.3
--webserver_port=0
--tserver_master_addrs=127.17.136.62:38555
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27505
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.136.3
--log_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790521920546562-17952-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 27 Sep 2026 14:27:13 UTC on ccycloud.quasar-psqrth.root.comops.site
build id 4676138
I20260927 15:12:56.153126 27505 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260927 15:12:56.154455 27505 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260927 15:12:56.163779 27513 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260927 15:12:56.163938 27510 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260927 15:12:56.163857 27505 server_base.cc:1034] running on GCE node
W20260927 15:12:56.163813 27511 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260927 15:12:56.164359 27505 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260927 15:12:56.164978 27505 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260927 15:12:56.166137 27505 hybrid_clock.cc:648] HybridClock initialized: now 1790521976166117 us; error 32 us; skew 500 ppm
I20260927 15:12:56.167965 27505 webserver.cc:460] Webserver started at http://127.17.136.3:40913/ using document root <none> and password file <none>
I20260927 15:12:56.168515 27505 fs_manager.cc:359] Metadata directory not provided
I20260927 15:12:56.168581 27505 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260927 15:12:56.168767 27505 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260927 15:12:56.170809 27505 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790521920546562-17952-0/minicluster-data/ts-2/data/instance:
uuid: "1ad8e96bfa634cc39d7bf9e0297a542a"
format_stamp: "Formatted at 2026-09-27 15:12:56 on dist-test-slave-5s2t"
server_key: "a7a50a0e07a8b592e1ab109d8779f3da"
server_key_iv: "e8a8b7e3cf2b5fbb366bb892b010988f"
server_key_version: "encryptionkey@0"
I20260927 15:12:56.171402 27505 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790521920546562-17952-0/minicluster-data/ts-2/wal/instance:
uuid: "1ad8e96bfa634cc39d7bf9e0297a542a"
format_stamp: "Formatted at 2026-09-27 15:12:56 on dist-test-slave-5s2t"
server_key: "a7a50a0e07a8b592e1ab109d8779f3da"
server_key_iv: "e8a8b7e3cf2b5fbb366bb892b010988f"
server_key_version: "encryptionkey@0"
I20260927 15:12:56.175318 27505 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20260927 15:12:56.177889 27519 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260927 15:12:56.179092 27505 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.000s sys 0.002s
I20260927 15:12:56.179196 27505 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790521920546562-17952-0/minicluster-data/ts-2/data,/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790521920546562-17952-0/minicluster-data/ts-2/wal
uuid: "1ad8e96bfa634cc39d7bf9e0297a542a"
format_stamp: "Formatted at 2026-09-27 15:12:56 on dist-test-slave-5s2t"
server_key: "a7a50a0e07a8b592e1ab109d8779f3da"
server_key_iv: "e8a8b7e3cf2b5fbb366bb892b010988f"
server_key_version: "encryptionkey@0"
I20260927 15:12:56.179329 27505 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790521920546562-17952-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790521920546562-17952-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790521920546562-17952-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260927 15:12:56.197880 27505 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260927 15:12:56.198549 27505 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260927 15:12:56.198709 27505 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260927 15:12:56.199313 27505 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260927 15:12:56.200234 27505 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260927 15:12:56.200279 27505 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260927 15:12:56.200331 27505 ts_tablet_manager.cc:610] Registered 0 tablets
I20260927 15:12:56.200361 27505 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260927 15:12:56.208630 27505 rpc_server.cc:307] RPC server started. Bound to: 127.17.136.3:39715
I20260927 15:12:56.208657 27632 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.136.3:39715 every 8 connection(s)
I20260927 15:12:56.209515 27505 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790521920546562-17952-0/minicluster-data/ts-2/data/info.pb
I20260927 15:12:56.210980 17952 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu as pid 27505
I20260927 15:12:56.211071 17952 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790521920546562-17952-0/minicluster-data/ts-2/wal/instance
I20260927 15:12:56.211378 17952 external_mini_cluster.cc:1428] Setting key 8d8f20242d829fb8cb813ab7ad53d9f0
I20260927 15:12:56.218412 27222 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:56.211265 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.136.3:58635 (local address 127.17.136.62:38555)
0927 15:12:56.211433 (+ 168us) server_negotiation.cc:206] Beginning negotiation
0927 15:12:56.211438 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0927 15:12:56.212705 (+ 1267us) server_negotiation.cc:407] Connection header received
0927 15:12:56.214269 (+ 1564us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:12:56.214271 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:12:56.214320 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:12:56.214377 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0927 15:12:56.215209 (+ 832us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:56.215762 (+ 553us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:56.216835 (+ 1073us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:56.217035 (+ 200us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:56.217098 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:56.218048 (+ 950us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0927 15:12:56.218051 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0927 15:12:56.218053 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0927 15:12:56.218063 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0927 15:12:56.218081 (+ 18us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0927 15:12:56.218088 (+ 7us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0927 15:12:56.218140 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0927 15:12:56.218241 (+ 101us) server_negotiation.cc:299] Negotiation successful
0927 15:12:56.218285 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260927 15:12:56.219360 27635 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:56.211746 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.62:38555 (local address 127.17.136.3:58635)
0927 15:12:56.212548 (+ 802us) negotiation.cc:107] Waiting for socket to connect
0927 15:12:56.212607 (+ 59us) client_negotiation.cc:174] Beginning negotiation
0927 15:12:56.214071 (+ 1464us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0927 15:12:56.214527 (+ 456us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0927 15:12:56.214534 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0927 15:12:56.214619 (+ 85us) client_negotiation.cc:189] Negotiated authn=SASL
0927 15:12:56.215109 (+ 490us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:12:56.215120 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:12:56.215863 (+ 743us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:12:56.215866 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:12:56.216750 (+ 884us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:12:56.216759 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:12:56.217135 (+ 376us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:12:56.217137 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:12:56.217270 (+ 133us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:56.217786 (+ 516us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0927 15:12:56.217787 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0927 15:12:56.217826 (+ 39us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0927 15:12:56.217921 (+ 95us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0927 15:12:56.218146 (+ 225us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0927 15:12:56.218150 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0927 15:12:56.218154 (+ 4us) client_negotiation.cc:769] Sending connection context
0927 15:12:56.218236 (+ 82us) client_negotiation.cc:240] Negotiation successful
0927 15:12:56.218466 (+ 230us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":261,"thread_start_us":109,"threads_started":1}
I20260927 15:12:56.220356 27633 heartbeater.cc:347] Connected to a master server at 127.17.136.62:38555
I20260927 15:12:56.220580 27633 heartbeater.cc:464] Registering TS with master...
I20260927 15:12:56.221091 27633 heartbeater.cc:511] Master 127.17.136.62:38555 requested a full tablet report, sending...
I20260927 15:12:56.221995 27183 ts_manager.cc:194] Registered new tserver with Master: 1ad8e96bfa634cc39d7bf9e0297a542a (127.17.136.3:39715)
I20260927 15:12:56.222538 27183 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.17.136.3:58635
I20260927 15:12:56.224974 17952 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260927 15:12:56.227576 27222 negotiation.cc:337] Failed RPC negotiation. Trace:
0927 15:12:56.226710 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37480 (local address 127.17.136.62:38555)
0927 15:12:56.226825 (+ 115us) server_negotiation.cc:206] Beginning negotiation
0927 15:12:56.226829 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0927 15:12:56.226982 (+ 153us) server_negotiation.cc:407] Connection header received
0927 15:12:56.227085 (+ 103us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:12:56.227088 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:12:56.227127 (+ 39us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:12:56.227190 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0927 15:12:56.227465 (+ 275us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:37480: BlockingRecv error: recv got EOF from 127.0.0.1:37480 (error 108)
Metrics: {"server-negotiator.queue_time_us":41}
I20260927 15:12:56.227670 17952 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu with pid 27243
I20260927 15:12:56.232043 17952 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu with pid 27374
I20260927 15:12:56.236254 17952 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu with pid 27505
I20260927 15:12:56.240494 17952 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu with pid 27152
2026-09-27T15:12:56Z chronyd exiting
[ OK ] SecurityITest.TestRequireAuthenticationInsecureCluster (835 ms)
[ RUN ] SecurityITest.TestRequireEncryptionInsecureCluster
2026-09-27T15:12:56Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-27T15:12:56Z Disabled control of system clock
I20260927 15:12:56.266674 17952 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu
/tmp/dist-test-taskiFOyeW/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790521920546562-17952-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790521920546562-17952-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790521920546562-17952-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790521920546562-17952-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.136.62:36807
--webserver_interface=127.17.136.62
--webserver_port=0
--builtin_ntp_servers=127.17.136.20:41647
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.136.62:36807
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260927 15:12:56.373622 27644 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260927 15:12:56.373926 27644 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260927 15:12:56.373970 27644 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260927 15:12:56.378383 27644 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260927 15:12:56.378453 27644 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260927 15:12:56.378468 27644 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260927 15:12:56.378484 27644 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260927 15:12:56.378497 27644 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260927 15:12:56.383412 27644 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.136.20:41647
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790521920546562-17952-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790521920546562-17952-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.17.136.62:36807
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.136.62:36807
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790521920546562-17952-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.17.136.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27644
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790521920546562-17952-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 27 Sep 2026 14:27:13 UTC on ccycloud.quasar-psqrth.root.comops.site
build id 4676138
I20260927 15:12:56.384447 27644 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260927 15:12:56.385725 27644 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260927 15:12:56.393780 27649 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260927 15:12:56.393802 27652 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260927 15:12:56.393780 27650 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260927 15:12:56.393904 27644 server_base.cc:1034] running on GCE node
I20260927 15:12:56.394623 27644 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260927 15:12:56.395749 27644 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260927 15:12:56.396917 27644 hybrid_clock.cc:648] HybridClock initialized: now 1790521976396898 us; error 33 us; skew 500 ppm
I20260927 15:12:56.398686 27644 webserver.cc:460] Webserver started at http://127.17.136.62:37613/ using document root <none> and password file <none>
I20260927 15:12:56.399304 27644 fs_manager.cc:359] Metadata directory not provided
I20260927 15:12:56.399379 27644 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260927 15:12:56.399580 27644 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260927 15:12:56.401592 27644 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790521920546562-17952-0/minicluster-data/master-0/data/instance:
uuid: "0c0c19ad993b4aa98b70475be1be46b4"
format_stamp: "Formatted at 2026-09-27 15:12:56 on dist-test-slave-5s2t"
server_key: "54a9ea190f08e0af73a403d960da485a"
server_key_iv: "323df90bb665de294d07d5f5b9987171"
server_key_version: "encryptionkey@0"
I20260927 15:12:56.402102 27644 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790521920546562-17952-0/minicluster-data/master-0/wal/instance:
uuid: "0c0c19ad993b4aa98b70475be1be46b4"
format_stamp: "Formatted at 2026-09-27 15:12:56 on dist-test-slave-5s2t"
server_key: "54a9ea190f08e0af73a403d960da485a"
server_key_iv: "323df90bb665de294d07d5f5b9987171"
server_key_version: "encryptionkey@0"
I20260927 15:12:56.405648 27644 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260927 15:12:56.407856 27658 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260927 15:12:56.409104 27644 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260927 15:12:56.409212 27644 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790521920546562-17952-0/minicluster-data/master-0/data,/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790521920546562-17952-0/minicluster-data/master-0/wal
uuid: "0c0c19ad993b4aa98b70475be1be46b4"
format_stamp: "Formatted at 2026-09-27 15:12:56 on dist-test-slave-5s2t"
server_key: "54a9ea190f08e0af73a403d960da485a"
server_key_iv: "323df90bb665de294d07d5f5b9987171"
server_key_version: "encryptionkey@0"
I20260927 15:12:56.409320 27644 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790521920546562-17952-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790521920546562-17952-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790521920546562-17952-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260927 15:12:56.413863 27644 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260927 15:12:56.414498 27644 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260927 15:12:56.414659 27644 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260927 15:12:56.420975 27644 rpc_server.cc:307] RPC server started. Bound to: 127.17.136.62:36807
I20260927 15:12:56.421008 27710 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.136.62:36807 every 8 connection(s)
I20260927 15:12:56.421859 27644 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790521920546562-17952-0/minicluster-data/master-0/data/info.pb
I20260927 15:12:56.424929 27711 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:12:56.430166 27711 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0c0c19ad993b4aa98b70475be1be46b4: Bootstrap starting.
I20260927 15:12:56.431733 17952 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu as pid 27644
I20260927 15:12:56.431847 17952 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790521920546562-17952-0/minicluster-data/master-0/wal/instance
I20260927 15:12:56.432098 17952 external_mini_cluster.cc:1428] Setting key 7e83c0332522ca85598e29f34af06270
I20260927 15:12:56.432634 27711 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 0c0c19ad993b4aa98b70475be1be46b4: Neither blocks nor log segments found. Creating new log.
I20260927 15:12:56.433461 27711 log.cc:824] T 00000000000000000000000000000000 P 0c0c19ad993b4aa98b70475be1be46b4: Log is configured to *not* fsync() on all Append() calls
I20260927 15:12:56.435317 27711 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0c0c19ad993b4aa98b70475be1be46b4: No bootstrap required, opened a new log
I20260927 15:12:56.437052 27714 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:56.433170 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45870 (local address 127.17.136.62:36807)
0927 15:12:56.433851 (+ 681us) server_negotiation.cc:206] Beginning negotiation
0927 15:12:56.433866 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0927 15:12:56.433923 (+ 57us) server_negotiation.cc:407] Connection header received
0927 15:12:56.434537 (+ 614us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:12:56.434555 (+ 18us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:12:56.434836 (+ 281us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:12:56.435149 (+ 313us) server_negotiation.cc:226] Negotiated authn=SASL
0927 15:12:56.435848 (+ 699us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0927 15:12:56.435853 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0927 15:12:56.435864 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0927 15:12:56.435873 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0927 15:12:56.435931 (+ 58us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0927 15:12:56.435947 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0927 15:12:56.436037 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0927 15:12:56.436150 (+ 113us) server_negotiation.cc:299] Negotiation successful
0927 15:12:56.436381 (+ 231us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":323,"thread_start_us":141,"threads_started":1}
I20260927 15:12:56.439006 27711 raft_consensus.cc:348] T 00000000000000000000000000000000 P 0c0c19ad993b4aa98b70475be1be46b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0c0c19ad993b4aa98b70475be1be46b4" member_type: VOTER last_known_addr { host: "127.17.136.62" port: 36807 } }
I20260927 15:12:56.439229 27711 raft_consensus.cc:374] T 00000000000000000000000000000000 P 0c0c19ad993b4aa98b70475be1be46b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:12:56.439301 27711 raft_consensus.cc:729] T 00000000000000000000000000000000 P 0c0c19ad993b4aa98b70475be1be46b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c0c19ad993b4aa98b70475be1be46b4, State: Initialized, Role: FOLLOWER
I20260927 15:12:56.439709 27711 consensus_queue.cc:260] T 00000000000000000000000000000000 P 0c0c19ad993b4aa98b70475be1be46b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0c0c19ad993b4aa98b70475be1be46b4" member_type: VOTER last_known_addr { host: "127.17.136.62" port: 36807 } }
I20260927 15:12:56.439838 27711 raft_consensus.cc:388] T 00000000000000000000000000000000 P 0c0c19ad993b4aa98b70475be1be46b4 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260927 15:12:56.439898 27711 raft_consensus.cc:482] T 00000000000000000000000000000000 P 0c0c19ad993b4aa98b70475be1be46b4 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260927 15:12:56.439987 27711 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 0c0c19ad993b4aa98b70475be1be46b4 [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:12:56.440832 27711 raft_consensus.cc:504] T 00000000000000000000000000000000 P 0c0c19ad993b4aa98b70475be1be46b4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0c0c19ad993b4aa98b70475be1be46b4" member_type: VOTER last_known_addr { host: "127.17.136.62" port: 36807 } }
I20260927 15:12:56.441155 27711 leader_election.cc:302] T 00000000000000000000000000000000 P 0c0c19ad993b4aa98b70475be1be46b4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 0c0c19ad993b4aa98b70475be1be46b4; no voters:
I20260927 15:12:56.441442 27711 leader_election.cc:288] T 00000000000000000000000000000000 P 0c0c19ad993b4aa98b70475be1be46b4 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260927 15:12:56.441525 27716 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 0c0c19ad993b4aa98b70475be1be46b4 [term 1 FOLLOWER]: Leader election won for term 1
I20260927 15:12:56.441731 27716 raft_consensus.cc:686] T 00000000000000000000000000000000 P 0c0c19ad993b4aa98b70475be1be46b4 [term 1 LEADER]: Becoming Leader. State: Replica: 0c0c19ad993b4aa98b70475be1be46b4, State: Running, Role: LEADER
I20260927 15:12:56.442050 27716 consensus_queue.cc:237] T 00000000000000000000000000000000 P 0c0c19ad993b4aa98b70475be1be46b4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0c0c19ad993b4aa98b70475be1be46b4" member_type: VOTER last_known_addr { host: "127.17.136.62" port: 36807 } }
I20260927 15:12:56.442586 27711 sys_catalog.cc:564] T 00000000000000000000000000000000 P 0c0c19ad993b4aa98b70475be1be46b4 [sys.catalog]: configured and running, proceeding with master startup.
I20260927 15:12:56.443686 27718 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0c0c19ad993b4aa98b70475be1be46b4 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0c0c19ad993b4aa98b70475be1be46b4. Latest consensus state: current_term: 1 leader_uuid: "0c0c19ad993b4aa98b70475be1be46b4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0c0c19ad993b4aa98b70475be1be46b4" member_type: VOTER last_known_addr { host: "127.17.136.62" port: 36807 } } }
I20260927 15:12:56.443722 27717 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0c0c19ad993b4aa98b70475be1be46b4 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "0c0c19ad993b4aa98b70475be1be46b4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0c0c19ad993b4aa98b70475be1be46b4" member_type: VOTER last_known_addr { host: "127.17.136.62" port: 36807 } } }
I20260927 15:12:56.443802 27718 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0c0c19ad993b4aa98b70475be1be46b4 [sys.catalog]: This master's current role is: LEADER
I20260927 15:12:56.443810 27717 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0c0c19ad993b4aa98b70475be1be46b4 [sys.catalog]: This master's current role is: LEADER
I20260927 15:12:56.444159 27725 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260927 15:12:56.447186 27725 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260927 15:12:56.452479 27725 catalog_manager.cc:1347] Generated new cluster ID: 955582e0c9244a3888024f4e9331de1a
I20260927 15:12:56.452546 27725 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260927 15:12:56.474717 27725 catalog_manager.cc:1370] Generated new certificate authority record
I20260927 15:12:56.475063 27725 catalog_manager.cc:1504] Loading token signing keys...
I20260927 15:12:56.480751 27725 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 0c0c19ad993b4aa98b70475be1be46b4: Generated new TSK 0
I20260927 15:12:56.481413 27725 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260927 15:12:56.489600 17952 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu
/tmp/dist-test-taskiFOyeW/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790521920546562-17952-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790521920546562-17952-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790521920546562-17952-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790521920546562-17952-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.136.1:0
--local_ip_for_outbound_sockets=127.17.136.1
--webserver_interface=127.17.136.1
--webserver_port=0
--tserver_master_addrs=127.17.136.62:36807
--builtin_ntp_servers=127.17.136.20:41647
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260927 15:12:56.596357 27735 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260927 15:12:56.596586 27735 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260927 15:12:56.596628 27735 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260927 15:12:56.600556 27735 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260927 15:12:56.600601 27735 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260927 15:12:56.600662 27735 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.136.1
I20260927 15:12:56.605334 27735 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.136.20:41647
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790521920546562-17952-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790521920546562-17952-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.136.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790521920546562-17952-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.17.136.1
--webserver_port=0
--tserver_master_addrs=127.17.136.62:36807
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27735
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.136.1
--log_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790521920546562-17952-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 27 Sep 2026 14:27:13 UTC on ccycloud.quasar-psqrth.root.comops.site
build id 4676138
I20260927 15:12:56.606285 27735 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260927 15:12:56.607575 27735 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260927 15:12:56.616672 27741 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260927 15:12:56.616693 27740 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260927 15:12:56.616741 27735 server_base.cc:1034] running on GCE node
W20260927 15:12:56.616679 27743 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260927 15:12:56.617231 27735 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260927 15:12:56.617883 27735 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260927 15:12:56.619063 27735 hybrid_clock.cc:648] HybridClock initialized: now 1790521976619043 us; error 30 us; skew 500 ppm
I20260927 15:12:56.620746 27735 webserver.cc:460] Webserver started at http://127.17.136.1:43009/ using document root <none> and password file <none>
I20260927 15:12:56.621277 27735 fs_manager.cc:359] Metadata directory not provided
I20260927 15:12:56.621338 27735 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260927 15:12:56.621531 27735 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260927 15:12:56.623505 27735 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790521920546562-17952-0/minicluster-data/ts-0/data/instance:
uuid: "c9abcf65093945d6a40311148da2229b"
format_stamp: "Formatted at 2026-09-27 15:12:56 on dist-test-slave-5s2t"
server_key: "f872c9a76ca739c04b24ed95a1143399"
server_key_iv: "d41b7bf5d9d32204a2964ae3a9edab35"
server_key_version: "encryptionkey@0"
I20260927 15:12:56.624015 27735 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790521920546562-17952-0/minicluster-data/ts-0/wal/instance:
uuid: "c9abcf65093945d6a40311148da2229b"
format_stamp: "Formatted at 2026-09-27 15:12:56 on dist-test-slave-5s2t"
server_key: "f872c9a76ca739c04b24ed95a1143399"
server_key_iv: "d41b7bf5d9d32204a2964ae3a9edab35"
server_key_version: "encryptionkey@0"
I20260927 15:12:56.627322 27735 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260927 15:12:56.629585 27749 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260927 15:12:56.630685 27735 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260927 15:12:56.630781 27735 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790521920546562-17952-0/minicluster-data/ts-0/data,/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790521920546562-17952-0/minicluster-data/ts-0/wal
uuid: "c9abcf65093945d6a40311148da2229b"
format_stamp: "Formatted at 2026-09-27 15:12:56 on dist-test-slave-5s2t"
server_key: "f872c9a76ca739c04b24ed95a1143399"
server_key_iv: "d41b7bf5d9d32204a2964ae3a9edab35"
server_key_version: "encryptionkey@0"
I20260927 15:12:56.630868 27735 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790521920546562-17952-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790521920546562-17952-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790521920546562-17952-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260927 15:12:56.635010 27735 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260927 15:12:56.635560 27735 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260927 15:12:56.635699 27735 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260927 15:12:56.636166 27735 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260927 15:12:56.636963 27735 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260927 15:12:56.637006 27735 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260927 15:12:56.637053 27735 ts_tablet_manager.cc:610] Registered 0 tablets
I20260927 15:12:56.637079 27735 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260927 15:12:56.645036 27735 rpc_server.cc:307] RPC server started. Bound to: 127.17.136.1:40201
I20260927 15:12:56.645071 27862 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.136.1:40201 every 8 connection(s)
I20260927 15:12:56.645875 27735 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790521920546562-17952-0/minicluster-data/ts-0/data/info.pb
I20260927 15:12:56.651605 27714 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:56.647554 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.136.1:60691 (local address 127.17.136.62:36807)
0927 15:12:56.647685 (+ 131us) server_negotiation.cc:206] Beginning negotiation
0927 15:12:56.647689 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0927 15:12:56.648725 (+ 1036us) server_negotiation.cc:407] Connection header received
0927 15:12:56.649976 (+ 1251us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:12:56.649979 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:12:56.650022 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:12:56.650093 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0927 15:12:56.651133 (+ 1040us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0927 15:12:56.651136 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0927 15:12:56.651139 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0927 15:12:56.651151 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0927 15:12:56.651172 (+ 21us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0927 15:12:56.651180 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0927 15:12:56.651273 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0927 15:12:56.651417 (+ 144us) server_negotiation.cc:299] Negotiation successful
0927 15:12:56.651461 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260927 15:12:56.652427 27865 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:56.647944 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.62:36807 (local address 127.17.136.1:60691)
0927 15:12:56.648577 (+ 633us) negotiation.cc:107] Waiting for socket to connect
0927 15:12:56.648617 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0927 15:12:56.649772 (+ 1155us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0927 15:12:56.650247 (+ 475us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0927 15:12:56.650253 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0927 15:12:56.650338 (+ 85us) client_negotiation.cc:189] Negotiated authn=SASL
0927 15:12:56.650882 (+ 544us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0927 15:12:56.650884 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0927 15:12:56.650923 (+ 39us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0927 15:12:56.650990 (+ 67us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0927 15:12:56.651284 (+ 294us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0927 15:12:56.651292 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0927 15:12:56.651298 (+ 6us) client_negotiation.cc:769] Sending connection context
0927 15:12:56.651449 (+ 151us) client_negotiation.cc:240] Negotiation successful
0927 15:12:56.651693 (+ 244us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":235,"thread_start_us":96,"threads_started":1}
I20260927 15:12:56.653602 27863 heartbeater.cc:347] Connected to a master server at 127.17.136.62:36807
I20260927 15:12:56.653818 27863 heartbeater.cc:464] Registering TS with master...
I20260927 15:12:56.654196 27863 heartbeater.cc:511] Master 127.17.136.62:36807 requested a full tablet report, sending...
I20260927 15:12:56.655517 17952 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu as pid 27735
I20260927 15:12:56.655629 17952 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790521920546562-17952-0/minicluster-data/ts-0/wal/instance
I20260927 15:12:56.655658 27675 ts_manager.cc:194] Registered new tserver with Master: c9abcf65093945d6a40311148da2229b (127.17.136.1:40201)
I20260927 15:12:56.655964 17952 external_mini_cluster.cc:1428] Setting key d258e38d468d13ea610ec7bf8b3e19b3
I20260927 15:12:56.657784 17952 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu
/tmp/dist-test-taskiFOyeW/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790521920546562-17952-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790521920546562-17952-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790521920546562-17952-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790521920546562-17952-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.136.2:0
--local_ip_for_outbound_sockets=127.17.136.2
--webserver_interface=127.17.136.2
--webserver_port=0
--tserver_master_addrs=127.17.136.62:36807
--builtin_ntp_servers=127.17.136.20:41647
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260927 15:12:56.762724 27866 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260927 15:12:56.762966 27866 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260927 15:12:56.763006 27866 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260927 15:12:56.766898 27866 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260927 15:12:56.766954 27866 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260927 15:12:56.767015 27866 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.136.2
I20260927 15:12:56.771682 27866 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.136.20:41647
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790521920546562-17952-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790521920546562-17952-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.136.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790521920546562-17952-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.17.136.2
--webserver_port=0
--tserver_master_addrs=127.17.136.62:36807
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27866
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.136.2
--log_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790521920546562-17952-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 27 Sep 2026 14:27:13 UTC on ccycloud.quasar-psqrth.root.comops.site
build id 4676138
I20260927 15:12:56.772786 27866 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260927 15:12:56.774220 27866 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260927 15:12:56.783561 27866 server_base.cc:1034] running on GCE node
W20260927 15:12:56.783504 27872 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260927 15:12:56.783504 27871 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260927 15:12:56.783504 27874 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260927 15:12:56.784137 27866 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260927 15:12:56.784804 27866 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260927 15:12:56.785956 27866 hybrid_clock.cc:648] HybridClock initialized: now 1790521976785938 us; error 31 us; skew 500 ppm
I20260927 15:12:56.787822 27866 webserver.cc:460] Webserver started at http://127.17.136.2:44137/ using document root <none> and password file <none>
I20260927 15:12:56.788360 27866 fs_manager.cc:359] Metadata directory not provided
I20260927 15:12:56.788434 27866 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260927 15:12:56.788626 27866 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260927 15:12:56.790668 27866 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790521920546562-17952-0/minicluster-data/ts-1/data/instance:
uuid: "94cf3ab530164bb88b011b16073a467e"
format_stamp: "Formatted at 2026-09-27 15:12:56 on dist-test-slave-5s2t"
server_key: "2601b81886fbc708fcbe17a1a8569fe4"
server_key_iv: "009e50f404e35ce20d636e2c96fe890b"
server_key_version: "encryptionkey@0"
I20260927 15:12:56.791182 27866 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790521920546562-17952-0/minicluster-data/ts-1/wal/instance:
uuid: "94cf3ab530164bb88b011b16073a467e"
format_stamp: "Formatted at 2026-09-27 15:12:56 on dist-test-slave-5s2t"
server_key: "2601b81886fbc708fcbe17a1a8569fe4"
server_key_iv: "009e50f404e35ce20d636e2c96fe890b"
server_key_version: "encryptionkey@0"
I20260927 15:12:56.794664 27866 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.000s
I20260927 15:12:56.797086 27880 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260927 15:12:56.798203 27866 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.000s sys 0.002s
I20260927 15:12:56.798302 27866 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790521920546562-17952-0/minicluster-data/ts-1/data,/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790521920546562-17952-0/minicluster-data/ts-1/wal
uuid: "94cf3ab530164bb88b011b16073a467e"
format_stamp: "Formatted at 2026-09-27 15:12:56 on dist-test-slave-5s2t"
server_key: "2601b81886fbc708fcbe17a1a8569fe4"
server_key_iv: "009e50f404e35ce20d636e2c96fe890b"
server_key_version: "encryptionkey@0"
I20260927 15:12:56.798408 27866 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790521920546562-17952-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790521920546562-17952-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790521920546562-17952-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260927 15:12:56.802695 27866 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260927 15:12:56.803328 27866 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260927 15:12:56.803483 27866 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260927 15:12:56.803977 27866 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260927 15:12:56.804836 27866 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260927 15:12:56.804879 27866 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260927 15:12:56.804929 27866 ts_tablet_manager.cc:610] Registered 0 tablets
I20260927 15:12:56.804957 27866 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260927 15:12:56.812829 27866 rpc_server.cc:307] RPC server started. Bound to: 127.17.136.2:40749
I20260927 15:12:56.812897 27993 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.136.2:40749 every 8 connection(s)
I20260927 15:12:56.813781 27866 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790521920546562-17952-0/minicluster-data/ts-1/data/info.pb
I20260927 15:12:56.819393 27714 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:56.815586 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.136.2:54241 (local address 127.17.136.62:36807)
0927 15:12:56.815738 (+ 152us) server_negotiation.cc:206] Beginning negotiation
0927 15:12:56.815743 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0927 15:12:56.816772 (+ 1029us) server_negotiation.cc:407] Connection header received
0927 15:12:56.818001 (+ 1229us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:12:56.818004 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:12:56.818039 (+ 35us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:12:56.818099 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0927 15:12:56.819030 (+ 931us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0927 15:12:56.819033 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0927 15:12:56.819035 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0927 15:12:56.819046 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0927 15:12:56.819065 (+ 19us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0927 15:12:56.819072 (+ 7us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0927 15:12:56.819140 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0927 15:12:56.819223 (+ 83us) server_negotiation.cc:299] Negotiation successful
0927 15:12:56.819283 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260927 15:12:56.820231 27996 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:56.816020 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.62:36807 (local address 127.17.136.2:54241)
0927 15:12:56.816642 (+ 622us) negotiation.cc:107] Waiting for socket to connect
0927 15:12:56.816681 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0927 15:12:56.817801 (+ 1120us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0927 15:12:56.818242 (+ 441us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0927 15:12:56.818249 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0927 15:12:56.818335 (+ 86us) client_negotiation.cc:189] Negotiated authn=SASL
0927 15:12:56.818793 (+ 458us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0927 15:12:56.818794 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0927 15:12:56.818831 (+ 37us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0927 15:12:56.818909 (+ 78us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0927 15:12:56.819129 (+ 220us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0927 15:12:56.819134 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0927 15:12:56.819137 (+ 3us) client_negotiation.cc:769] Sending connection context
0927 15:12:56.819275 (+ 138us) client_negotiation.cc:240] Negotiation successful
0927 15:12:56.819488 (+ 213us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":229,"thread_start_us":96,"threads_started":1}
I20260927 15:12:56.821250 27994 heartbeater.cc:347] Connected to a master server at 127.17.136.62:36807
I20260927 15:12:56.821456 27994 heartbeater.cc:464] Registering TS with master...
I20260927 15:12:56.821823 27994 heartbeater.cc:511] Master 127.17.136.62:36807 requested a full tablet report, sending...
I20260927 15:12:56.822772 27674 ts_manager.cc:194] Registered new tserver with Master: 94cf3ab530164bb88b011b16073a467e (127.17.136.2:40749)
I20260927 15:12:56.823094 17952 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu as pid 27866
I20260927 15:12:56.823205 17952 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790521920546562-17952-0/minicluster-data/ts-1/wal/instance
I20260927 15:12:56.823498 17952 external_mini_cluster.cc:1428] Setting key 0c2b9232acd1ed22d6943d8b827cb5ce
I20260927 15:12:56.825160 17952 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu
/tmp/dist-test-taskiFOyeW/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790521920546562-17952-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790521920546562-17952-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790521920546562-17952-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790521920546562-17952-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.136.3:0
--local_ip_for_outbound_sockets=127.17.136.3
--webserver_interface=127.17.136.3
--webserver_port=0
--tserver_master_addrs=127.17.136.62:36807
--builtin_ntp_servers=127.17.136.20:41647
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260927 15:12:56.932049 27997 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260927 15:12:56.932309 27997 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260927 15:12:56.932365 27997 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260927 15:12:56.936508 27997 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260927 15:12:56.936581 27997 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260927 15:12:56.936663 27997 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.136.3
I20260927 15:12:56.941509 27997 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.136.20:41647
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790521920546562-17952-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790521920546562-17952-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.136.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790521920546562-17952-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.17.136.3
--webserver_port=0
--tserver_master_addrs=127.17.136.62:36807
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27997
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.136.3
--log_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790521920546562-17952-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 27 Sep 2026 14:27:13 UTC on ccycloud.quasar-psqrth.root.comops.site
build id 4676138
I20260927 15:12:56.942629 27997 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260927 15:12:56.944093 27997 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260927 15:12:56.953068 28003 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260927 15:12:56.953068 28002 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260927 15:12:56.953229 27997 server_base.cc:1034] running on GCE node
W20260927 15:12:56.953102 28005 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260927 15:12:56.953656 27997 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260927 15:12:56.954212 27997 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260927 15:12:56.955338 27997 hybrid_clock.cc:648] HybridClock initialized: now 1790521976955316 us; error 33 us; skew 500 ppm
I20260927 15:12:56.957033 27997 webserver.cc:460] Webserver started at http://127.17.136.3:46113/ using document root <none> and password file <none>
I20260927 15:12:56.957556 27997 fs_manager.cc:359] Metadata directory not provided
I20260927 15:12:56.957610 27997 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260927 15:12:56.957768 27997 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260927 15:12:56.959713 27997 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790521920546562-17952-0/minicluster-data/ts-2/data/instance:
uuid: "4b94996699804a9aab657a3bfa17dde8"
format_stamp: "Formatted at 2026-09-27 15:12:56 on dist-test-slave-5s2t"
server_key: "644b30424a102286a803c28acbf05d31"
server_key_iv: "0588b4102c727f49b913f3be62714679"
server_key_version: "encryptionkey@0"
I20260927 15:12:56.960189 27997 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790521920546562-17952-0/minicluster-data/ts-2/wal/instance:
uuid: "4b94996699804a9aab657a3bfa17dde8"
format_stamp: "Formatted at 2026-09-27 15:12:56 on dist-test-slave-5s2t"
server_key: "644b30424a102286a803c28acbf05d31"
server_key_iv: "0588b4102c727f49b913f3be62714679"
server_key_version: "encryptionkey@0"
I20260927 15:12:56.963624 27997 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.000s
I20260927 15:12:56.966045 28011 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260927 15:12:56.967294 27997 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260927 15:12:56.967402 27997 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790521920546562-17952-0/minicluster-data/ts-2/data,/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790521920546562-17952-0/minicluster-data/ts-2/wal
uuid: "4b94996699804a9aab657a3bfa17dde8"
format_stamp: "Formatted at 2026-09-27 15:12:56 on dist-test-slave-5s2t"
server_key: "644b30424a102286a803c28acbf05d31"
server_key_iv: "0588b4102c727f49b913f3be62714679"
server_key_version: "encryptionkey@0"
I20260927 15:12:56.967499 27997 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790521920546562-17952-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790521920546562-17952-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790521920546562-17952-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260927 15:12:56.971838 27997 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260927 15:12:56.972419 27997 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260927 15:12:56.972574 27997 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260927 15:12:56.973090 27997 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260927 15:12:56.973980 27997 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260927 15:12:56.974025 27997 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260927 15:12:56.974080 27997 ts_tablet_manager.cc:610] Registered 0 tablets
I20260927 15:12:56.974107 27997 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260927 15:12:56.982460 27997 rpc_server.cc:307] RPC server started. Bound to: 127.17.136.3:40699
I20260927 15:12:56.982486 28124 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.136.3:40699 every 8 connection(s)
I20260927 15:12:56.983374 27997 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790521920546562-17952-0/minicluster-data/ts-2/data/info.pb
I20260927 15:12:56.989013 27714 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:56.985025 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.136.3:44045 (local address 127.17.136.62:36807)
0927 15:12:56.985139 (+ 114us) server_negotiation.cc:206] Beginning negotiation
0927 15:12:56.985142 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0927 15:12:56.986175 (+ 1033us) server_negotiation.cc:407] Connection header received
0927 15:12:56.987477 (+ 1302us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:12:56.987480 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:12:56.987523 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:12:56.987592 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0927 15:12:56.988602 (+ 1010us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0927 15:12:56.988606 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0927 15:12:56.988609 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0927 15:12:56.988621 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0927 15:12:56.988643 (+ 22us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0927 15:12:56.988651 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0927 15:12:56.988724 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0927 15:12:56.988841 (+ 117us) server_negotiation.cc:299] Negotiation successful
0927 15:12:56.988883 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260927 15:12:56.989861 28127 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:56.985400 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.62:36807 (local address 127.17.136.3:44045)
0927 15:12:56.986029 (+ 629us) negotiation.cc:107] Waiting for socket to connect
0927 15:12:56.986070 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0927 15:12:56.987233 (+ 1163us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0927 15:12:56.987757 (+ 524us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0927 15:12:56.987764 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0927 15:12:56.987851 (+ 87us) client_negotiation.cc:189] Negotiated authn=SASL
0927 15:12:56.988357 (+ 506us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0927 15:12:56.988358 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0927 15:12:56.988398 (+ 40us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0927 15:12:56.988465 (+ 67us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0927 15:12:56.988715 (+ 250us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0927 15:12:56.988722 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0927 15:12:56.988727 (+ 5us) client_negotiation.cc:769] Sending connection context
0927 15:12:56.988876 (+ 149us) client_negotiation.cc:240] Negotiation successful
0927 15:12:56.989109 (+ 233us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":235,"thread_start_us":96,"threads_started":1}
I20260927 15:12:56.990445 17952 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu as pid 27997
I20260927 15:12:56.990530 17952 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790521920546562-17952-0/minicluster-data/ts-2/wal/instance
I20260927 15:12:56.990803 17952 external_mini_cluster.cc:1428] Setting key 4e611a68603a08ac8229e8a0e1da771b
I20260927 15:12:56.990993 28125 heartbeater.cc:347] Connected to a master server at 127.17.136.62:36807
I20260927 15:12:56.991212 28125 heartbeater.cc:464] Registering TS with master...
I20260927 15:12:56.991712 28125 heartbeater.cc:511] Master 127.17.136.62:36807 requested a full tablet report, sending...
I20260927 15:12:56.992717 27674 ts_manager.cc:194] Registered new tserver with Master: 4b94996699804a9aab657a3bfa17dde8 (127.17.136.3:40699)
I20260927 15:12:57.004357 17952 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260927 15:12:57.007505 27714 negotiation.cc:337] Failed RPC negotiation. Trace:
0927 15:12:57.006560 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45886 (local address 127.17.136.62:36807)
0927 15:12:57.006730 (+ 170us) server_negotiation.cc:206] Beginning negotiation
0927 15:12:57.006734 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0927 15:12:57.006886 (+ 152us) server_negotiation.cc:407] Connection header received
0927 15:12:57.007011 (+ 125us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:12:57.007014 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:12:57.007051 (+ 37us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:12:57.007122 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0927 15:12:57.007379 (+ 257us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:45886: BlockingRecv error: recv got EOF from 127.0.0.1:45886 (error 108)
Metrics: {"server-negotiator.queue_time_us":55}
I20260927 15:12:57.008034 17952 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu with pid 27735
I20260927 15:12:57.012838 17952 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu with pid 27866
I20260927 15:12:57.017361 17952 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu with pid 27997
I20260927 15:12:57.021704 17952 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu with pid 27644
2026-09-27T15:12:57Z chronyd exiting
[ OK ] SecurityITest.TestRequireEncryptionInsecureCluster (780 ms)
[ RUN ] SecurityITest.TestRequireAuthenticationSecureCluster
Loading random data
Initializing database '/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790521920546562-17952-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 27 15:12:57 dist-test-slave-5s2t krb5kdc[28135](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 27 15:12:57 dist-test-slave-5s2t krb5kdc[28135](info): set up 2 sockets
Sep 27 15:12:57 dist-test-slave-5s2t krb5kdc[28135](info): commencing operation
krb5kdc: starting...
W20260927 15:12:57.967880 17952 mini_kdc.cc:121] Time spent starting KDC: real 0.928s user 0.004s sys 0.001s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790521920546562-17952-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790521920546562-17952-0/krb5kdc/test-user.keytab.
Sep 27 15:12:58 dist-test-slave-5s2t krb5kdc[28135](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790521978, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-27T15:12:58Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-27T15:12:58Z Disabled control of system clock
WARNING: no policy specified for kudu/127.17.136.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.136.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.136.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790521920546562-17952-0/krb5kdc/kudu_127.17.136.62.keytab.
Entry for principal kudu/127.17.136.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790521920546562-17952-0/krb5kdc/kudu_127.17.136.62.keytab.
I20260927 15:12:58.092144 17952 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu
/tmp/dist-test-taskiFOyeW/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790521920546562-17952-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790521920546562-17952-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790521920546562-17952-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790521920546562-17952-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.136.62:35395
--webserver_interface=127.17.136.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790521920546562-17952-0/krb5kdc/kudu_127.17.136.62.keytab
--principal=kudu/127.17.136.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.136.20:41631
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.136.62:35395
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790521920546562-17952-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790521920546562-17952-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790521920546562-17952-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260927 15:12:58.198627 28148 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260927 15:12:58.198911 28148 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260927 15:12:58.198971 28148 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260927 15:12:58.202947 28148 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260927 15:12:58.203016 28148 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260927 15:12:58.203043 28148 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260927 15:12:58.203063 28148 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260927 15:12:58.203084 28148 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260927 15:12:58.208453 28148 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.136.20:41631
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790521920546562-17952-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790521920546562-17952-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.17.136.62:35395
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790521920546562-17952-0/krb5kdc/kudu_127.17.136.62.keytab
--principal=kudu/127.17.136.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.136.62:35395
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790521920546562-17952-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.17.136.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28148
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790521920546562-17952-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 27 Sep 2026 14:27:13 UTC on ccycloud.quasar-psqrth.root.comops.site
build id 4676138
I20260927 15:12:58.209494 28148 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260927 15:12:58.210489 28148 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260927 15:12:58.219151 28154 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260927 15:12:58.219152 28153 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260927 15:12:58.219218 28148 server_base.cc:1034] running on GCE node
W20260927 15:12:58.219152 28156 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260927 15:12:58.219998 28148 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260927 15:12:58.221079 28148 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260927 15:12:58.222239 28148 hybrid_clock.cc:648] HybridClock initialized: now 1790521978222225 us; error 25 us; skew 500 ppm
Sep 27 15:12:58 dist-test-slave-5s2t krb5kdc[28135](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790521978, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.136.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260927 15:12:58.224771 28148 init.cc:377] Logged in from keytab as kudu/127.17.136.62@KRBTEST.COM (short username kudu)
I20260927 15:12:58.225610 28148 webserver.cc:460] Webserver started at http://127.17.136.62:43779/ using document root <none> and password file <none>
I20260927 15:12:58.226115 28148 fs_manager.cc:359] Metadata directory not provided
I20260927 15:12:58.226168 28148 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260927 15:12:58.226329 28148 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260927 15:12:58.228272 28148 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790521920546562-17952-0/minicluster-data/master-0/data/instance:
uuid: "7d96ebf51d8f4cecbae3d882730b4f41"
format_stamp: "Formatted at 2026-09-27 15:12:58 on dist-test-slave-5s2t"
server_key: "92432337ae5d7ad57651d0437e2d1ae6"
server_key_iv: "f1881c8f90b2ae3a01f43bb2537b403b"
server_key_version: "encryptionkey@0"
I20260927 15:12:58.228749 28148 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790521920546562-17952-0/minicluster-data/master-0/wal/instance:
uuid: "7d96ebf51d8f4cecbae3d882730b4f41"
format_stamp: "Formatted at 2026-09-27 15:12:58 on dist-test-slave-5s2t"
server_key: "92432337ae5d7ad57651d0437e2d1ae6"
server_key_iv: "f1881c8f90b2ae3a01f43bb2537b403b"
server_key_version: "encryptionkey@0"
I20260927 15:12:58.232187 28148 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.001s
I20260927 15:12:58.234426 28163 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260927 15:12:58.235630 28148 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260927 15:12:58.235728 28148 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790521920546562-17952-0/minicluster-data/master-0/data,/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790521920546562-17952-0/minicluster-data/master-0/wal
uuid: "7d96ebf51d8f4cecbae3d882730b4f41"
format_stamp: "Formatted at 2026-09-27 15:12:58 on dist-test-slave-5s2t"
server_key: "92432337ae5d7ad57651d0437e2d1ae6"
server_key_iv: "f1881c8f90b2ae3a01f43bb2537b403b"
server_key_version: "encryptionkey@0"
I20260927 15:12:58.235817 28148 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790521920546562-17952-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790521920546562-17952-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790521920546562-17952-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260927 15:12:58.258900 28148 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260927 15:12:58.261838 28148 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260927 15:12:58.262017 28148 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260927 15:12:58.268602 28148 rpc_server.cc:307] RPC server started. Bound to: 127.17.136.62:35395
I20260927 15:12:58.268831 28215 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.136.62:35395 every 8 connection(s)
I20260927 15:12:58.269539 28148 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790521920546562-17952-0/minicluster-data/master-0/data/info.pb
I20260927 15:12:58.272200 28216 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:12:58.277629 28216 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7d96ebf51d8f4cecbae3d882730b4f41: Bootstrap starting.
I20260927 15:12:58.277694 17952 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu as pid 28148
I20260927 15:12:58.277810 17952 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790521920546562-17952-0/minicluster-data/master-0/wal/instance
I20260927 15:12:58.278101 17952 external_mini_cluster.cc:1428] Setting key b869091d847750ff5c7bfa69540730cc
I20260927 15:12:58.280215 28216 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 7d96ebf51d8f4cecbae3d882730b4f41: Neither blocks nor log segments found. Creating new log.
I20260927 15:12:58.280900 28216 log.cc:824] T 00000000000000000000000000000000 P 7d96ebf51d8f4cecbae3d882730b4f41: Log is configured to *not* fsync() on all Append() calls
I20260927 15:12:58.282619 28216 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7d96ebf51d8f4cecbae3d882730b4f41: No bootstrap required, opened a new log
I20260927 15:12:58.286055 28216 raft_consensus.cc:348] T 00000000000000000000000000000000 P 7d96ebf51d8f4cecbae3d882730b4f41 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7d96ebf51d8f4cecbae3d882730b4f41" member_type: VOTER last_known_addr { host: "127.17.136.62" port: 35395 } }
I20260927 15:12:58.286329 28216 raft_consensus.cc:374] T 00000000000000000000000000000000 P 7d96ebf51d8f4cecbae3d882730b4f41 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:12:58.286393 28216 raft_consensus.cc:729] T 00000000000000000000000000000000 P 7d96ebf51d8f4cecbae3d882730b4f41 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7d96ebf51d8f4cecbae3d882730b4f41, State: Initialized, Role: FOLLOWER
Sep 27 15:12:58 dist-test-slave-5s2t krb5kdc[28135](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790521978, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.136.62@KRBTEST.COM
I20260927 15:12:58.286813 28216 consensus_queue.cc:260] T 00000000000000000000000000000000 P 7d96ebf51d8f4cecbae3d882730b4f41 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7d96ebf51d8f4cecbae3d882730b4f41" member_type: VOTER last_known_addr { host: "127.17.136.62" port: 35395 } }
I20260927 15:12:58.286931 28216 raft_consensus.cc:388] T 00000000000000000000000000000000 P 7d96ebf51d8f4cecbae3d882730b4f41 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260927 15:12:58.286988 28216 raft_consensus.cc:482] T 00000000000000000000000000000000 P 7d96ebf51d8f4cecbae3d882730b4f41 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260927 15:12:58.287075 28216 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 7d96ebf51d8f4cecbae3d882730b4f41 [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:12:58.288059 28216 raft_consensus.cc:504] T 00000000000000000000000000000000 P 7d96ebf51d8f4cecbae3d882730b4f41 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7d96ebf51d8f4cecbae3d882730b4f41" member_type: VOTER last_known_addr { host: "127.17.136.62" port: 35395 } }
I20260927 15:12:58.288378 28216 leader_election.cc:302] T 00000000000000000000000000000000 P 7d96ebf51d8f4cecbae3d882730b4f41 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 7d96ebf51d8f4cecbae3d882730b4f41; no voters:
I20260927 15:12:58.288650 28216 leader_election.cc:288] T 00000000000000000000000000000000 P 7d96ebf51d8f4cecbae3d882730b4f41 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260927 15:12:58.288723 28221 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 7d96ebf51d8f4cecbae3d882730b4f41 [term 1 FOLLOWER]: Leader election won for term 1
I20260927 15:12:58.288966 28221 raft_consensus.cc:686] T 00000000000000000000000000000000 P 7d96ebf51d8f4cecbae3d882730b4f41 [term 1 LEADER]: Becoming Leader. State: Replica: 7d96ebf51d8f4cecbae3d882730b4f41, State: Running, Role: LEADER
I20260927 15:12:58.289306 28221 consensus_queue.cc:237] T 00000000000000000000000000000000 P 7d96ebf51d8f4cecbae3d882730b4f41 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7d96ebf51d8f4cecbae3d882730b4f41" member_type: VOTER last_known_addr { host: "127.17.136.62" port: 35395 } }
I20260927 15:12:58.289909 28216 sys_catalog.cc:564] T 00000000000000000000000000000000 P 7d96ebf51d8f4cecbae3d882730b4f41 [sys.catalog]: configured and running, proceeding with master startup.
I20260927 15:12:58.290901 28222 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7d96ebf51d8f4cecbae3d882730b4f41 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "7d96ebf51d8f4cecbae3d882730b4f41" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7d96ebf51d8f4cecbae3d882730b4f41" member_type: VOTER last_known_addr { host: "127.17.136.62" port: 35395 } } }
I20260927 15:12:58.291019 28222 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7d96ebf51d8f4cecbae3d882730b4f41 [sys.catalog]: This master's current role is: LEADER
I20260927 15:12:58.291311 28223 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7d96ebf51d8f4cecbae3d882730b4f41 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7d96ebf51d8f4cecbae3d882730b4f41. Latest consensus state: current_term: 1 leader_uuid: "7d96ebf51d8f4cecbae3d882730b4f41" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7d96ebf51d8f4cecbae3d882730b4f41" member_type: VOTER last_known_addr { host: "127.17.136.62" port: 35395 } } }
I20260927 15:12:58.291429 28223 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7d96ebf51d8f4cecbae3d882730b4f41 [sys.catalog]: This master's current role is: LEADER
I20260927 15:12:58.292286 28230 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260927 15:12:58.292297 28219 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:58.279454 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53458 (local address 127.17.136.62:35395)
0927 15:12:58.279854 (+ 400us) server_negotiation.cc:206] Beginning negotiation
0927 15:12:58.279869 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0927 15:12:58.279911 (+ 42us) server_negotiation.cc:407] Connection header received
0927 15:12:58.280554 (+ 643us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:12:58.280572 (+ 18us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:12:58.280916 (+ 344us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:12:58.281236 (+ 320us) server_negotiation.cc:226] Negotiated authn=SASL
0927 15:12:58.282001 (+ 765us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:58.283006 (+ 1005us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:58.283845 (+ 839us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:58.284312 (+ 467us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:58.284451 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:58.286955 (+ 2504us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0927 15:12:58.286961 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0927 15:12:58.286979 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0927 15:12:58.287010 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0927 15:12:58.288661 (+ 1651us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:12:58.289146 (+ 485us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:12:58.289151 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:12:58.289157 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:12:58.289280 (+ 123us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:12:58.289540 (+ 260us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:12:58.289543 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:12:58.289545 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:12:58.289971 (+ 426us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0927 15:12:58.290143 (+ 172us) server_negotiation.cc:1035] Waiting for connection context
0927 15:12:58.290844 (+ 701us) server_negotiation.cc:299] Negotiation successful
0927 15:12:58.291137 (+ 293us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":267,"thread_start_us":126,"threads_started":1}
I20260927 15:12:58.295002 28230 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260927 15:12:58.300735 28230 catalog_manager.cc:1347] Generated new cluster ID: ca60c2a01e274b5497054733da2afaad
I20260927 15:12:58.300793 28230 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260927 15:12:58.307999 28230 catalog_manager.cc:1370] Generated new certificate authority record
I20260927 15:12:58.308854 28230 catalog_manager.cc:1504] Loading token signing keys...
I20260927 15:12:58.313774 28230 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 7d96ebf51d8f4cecbae3d882730b4f41: Generated new TSK 0
I20260927 15:12:58.314383 28230 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.17.136.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.136.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.136.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790521920546562-17952-0/krb5kdc/kudu_127.17.136.1.keytab.
Entry for principal kudu/127.17.136.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790521920546562-17952-0/krb5kdc/kudu_127.17.136.1.keytab.
I20260927 15:12:58.346562 17952 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu
/tmp/dist-test-taskiFOyeW/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790521920546562-17952-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790521920546562-17952-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790521920546562-17952-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790521920546562-17952-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.136.1:0
--local_ip_for_outbound_sockets=127.17.136.1
--webserver_interface=127.17.136.1
--webserver_port=0
--tserver_master_addrs=127.17.136.62:35395
--keytab_file=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790521920546562-17952-0/krb5kdc/kudu_127.17.136.1.keytab
--principal=kudu/127.17.136.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.136.20:41631
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790521920546562-17952-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790521920546562-17952-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790521920546562-17952-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260927 15:12:58.454927 28242 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260927 15:12:58.455279 28242 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260927 15:12:58.455348 28242 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260927 15:12:58.459506 28242 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260927 15:12:58.459585 28242 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260927 15:12:58.459650 28242 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.136.1
I20260927 15:12:58.465195 28242 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.136.20:41631
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790521920546562-17952-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790521920546562-17952-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790521920546562-17952-0/krb5kdc/kudu_127.17.136.1.keytab
--principal=kudu/127.17.136.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.136.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790521920546562-17952-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.17.136.1
--webserver_port=0
--tserver_master_addrs=127.17.136.62:35395
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28242
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.136.1
--log_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790521920546562-17952-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 27 Sep 2026 14:27:13 UTC on ccycloud.quasar-psqrth.root.comops.site
build id 4676138
I20260927 15:12:58.466279 28242 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260927 15:12:58.467290 28242 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260927 15:12:58.477130 28242 server_base.cc:1034] running on GCE node
W20260927 15:12:58.477070 28248 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260927 15:12:58.477099 28250 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260927 15:12:58.477075 28247 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260927 15:12:58.477726 28242 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260927 15:12:58.478410 28242 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260927 15:12:58.479562 28242 hybrid_clock.cc:648] HybridClock initialized: now 1790521978479539 us; error 34 us; skew 500 ppm
Sep 27 15:12:58 dist-test-slave-5s2t krb5kdc[28135](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790521978, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.136.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260927 15:12:58.482187 28242 init.cc:377] Logged in from keytab as kudu/127.17.136.1@KRBTEST.COM (short username kudu)
I20260927 15:12:58.483024 28242 webserver.cc:460] Webserver started at http://127.17.136.1:46653/ using document root <none> and password file <none>
I20260927 15:12:58.483592 28242 fs_manager.cc:359] Metadata directory not provided
I20260927 15:12:58.483654 28242 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260927 15:12:58.483841 28242 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260927 15:12:58.485823 28242 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790521920546562-17952-0/minicluster-data/ts-0/data/instance:
uuid: "48290a1312ff4155b464c68a706bbeff"
format_stamp: "Formatted at 2026-09-27 15:12:58 on dist-test-slave-5s2t"
server_key: "bf68fa6ba631bb0f49f5d14f05c9d64b"
server_key_iv: "55aee49209c0a885c11c6b3262338346"
server_key_version: "encryptionkey@0"
I20260927 15:12:58.486334 28242 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790521920546562-17952-0/minicluster-data/ts-0/wal/instance:
uuid: "48290a1312ff4155b464c68a706bbeff"
format_stamp: "Formatted at 2026-09-27 15:12:58 on dist-test-slave-5s2t"
server_key: "bf68fa6ba631bb0f49f5d14f05c9d64b"
server_key_iv: "55aee49209c0a885c11c6b3262338346"
server_key_version: "encryptionkey@0"
I20260927 15:12:58.489948 28242 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.004s
I20260927 15:12:58.492388 28257 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260927 15:12:58.493585 28242 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260927 15:12:58.493686 28242 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790521920546562-17952-0/minicluster-data/ts-0/data,/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790521920546562-17952-0/minicluster-data/ts-0/wal
uuid: "48290a1312ff4155b464c68a706bbeff"
format_stamp: "Formatted at 2026-09-27 15:12:58 on dist-test-slave-5s2t"
server_key: "bf68fa6ba631bb0f49f5d14f05c9d64b"
server_key_iv: "55aee49209c0a885c11c6b3262338346"
server_key_version: "encryptionkey@0"
I20260927 15:12:58.493788 28242 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790521920546562-17952-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790521920546562-17952-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790521920546562-17952-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260927 15:12:58.519740 28242 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260927 15:12:58.522424 28242 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260927 15:12:58.522593 28242 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260927 15:12:58.523159 28242 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260927 15:12:58.524034 28242 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260927 15:12:58.524077 28242 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260927 15:12:58.524118 28242 ts_tablet_manager.cc:610] Registered 0 tablets
I20260927 15:12:58.524147 28242 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260927 15:12:58.532303 28242 rpc_server.cc:307] RPC server started. Bound to: 127.17.136.1:43971
I20260927 15:12:58.532364 28370 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.136.1:43971 every 8 connection(s)
I20260927 15:12:58.533200 28242 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790521920546562-17952-0/minicluster-data/ts-0/data/info.pb
I20260927 15:12:58.542407 17952 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu as pid 28242
Sep 27 15:12:58 dist-test-slave-5s2t krb5kdc[28135](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790521978, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.136.1@KRBTEST.COM for kudu/127.17.136.62@KRBTEST.COM
I20260927 15:12:58.542534 17952 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790521920546562-17952-0/minicluster-data/ts-0/wal/instance
I20260927 15:12:58.542795 17952 external_mini_cluster.cc:1428] Setting key 9542d0418c1b912563dffb652fe3fc61
I20260927 15:12:58.546532 28219 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:58.535026 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.136.1:54937 (local address 127.17.136.62:35395)
0927 15:12:58.535168 (+ 142us) server_negotiation.cc:206] Beginning negotiation
0927 15:12:58.535173 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0927 15:12:58.536159 (+ 986us) server_negotiation.cc:407] Connection header received
0927 15:12:58.537517 (+ 1358us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:12:58.537520 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:12:58.537568 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:12:58.537641 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0927 15:12:58.538791 (+ 1150us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:58.539418 (+ 627us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:58.540511 (+ 1093us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:58.540737 (+ 226us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:58.540811 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:58.543077 (+ 2266us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0927 15:12:58.543081 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0927 15:12:58.543083 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0927 15:12:58.543109 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0927 15:12:58.544651 (+ 1542us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:12:58.545126 (+ 475us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:12:58.545129 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:12:58.545131 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:12:58.545211 (+ 80us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:12:58.545489 (+ 278us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:12:58.545493 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:12:58.545495 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:12:58.545678 (+ 183us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0927 15:12:58.545760 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0927 15:12:58.546238 (+ 478us) server_negotiation.cc:299] Negotiation successful
0927 15:12:58.546355 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260927 15:12:58.547379 28373 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:58.535497 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.62:35395 (local address 127.17.136.1:54937)
0927 15:12:58.535997 (+ 500us) negotiation.cc:107] Waiting for socket to connect
0927 15:12:58.536043 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0927 15:12:58.537305 (+ 1262us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0927 15:12:58.537784 (+ 479us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0927 15:12:58.537791 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0927 15:12:58.538172 (+ 381us) client_negotiation.cc:189] Negotiated authn=SASL
0927 15:12:58.538669 (+ 497us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:12:58.538682 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:12:58.539517 (+ 835us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:12:58.539520 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:12:58.540425 (+ 905us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:12:58.540433 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:12:58.540848 (+ 415us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:12:58.540850 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:12:58.540985 (+ 135us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:58.541519 (+ 534us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0927 15:12:58.541535 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0927 15:12:58.542911 (+ 1376us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0927 15:12:58.544762 (+ 1851us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0927 15:12:58.544766 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0927 15:12:58.544779 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0927 15:12:58.545047 (+ 268us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0927 15:12:58.545285 (+ 238us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0927 15:12:58.545287 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0927 15:12:58.545288 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0927 15:12:58.545410 (+ 122us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0927 15:12:58.545771 (+ 361us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0927 15:12:58.545778 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0927 15:12:58.546022 (+ 244us) client_negotiation.cc:769] Sending connection context
0927 15:12:58.546185 (+ 163us) client_negotiation.cc:240] Negotiation successful
0927 15:12:58.546506 (+ 321us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":299,"thread_start_us":144,"threads_started":1}
I20260927 15:12:58.548568 28371 heartbeater.cc:347] Connected to a master server at 127.17.136.62:35395
I20260927 15:12:58.548810 28371 heartbeater.cc:464] Registering TS with master...
I20260927 15:12:58.549381 28371 heartbeater.cc:511] Master 127.17.136.62:35395 requested a full tablet report, sending...
I20260927 15:12:58.551021 28177 ts_manager.cc:194] Registered new tserver with Master: 48290a1312ff4155b464c68a706bbeff (127.17.136.1:43971)
WARNING: no policy specified for kudu/127.17.136.2@KRBTEST.COM; defaulting to no policy
I20260927 15:12:58.552583 28177 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.136.1@KRBTEST.COM'} at 127.17.136.1:54937
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.136.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.136.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790521920546562-17952-0/krb5kdc/kudu_127.17.136.2.keytab.
Entry for principal kudu/127.17.136.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790521920546562-17952-0/krb5kdc/kudu_127.17.136.2.keytab.
I20260927 15:12:58.568037 17952 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu
/tmp/dist-test-taskiFOyeW/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790521920546562-17952-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790521920546562-17952-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790521920546562-17952-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790521920546562-17952-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.136.2:0
--local_ip_for_outbound_sockets=127.17.136.2
--webserver_interface=127.17.136.2
--webserver_port=0
--tserver_master_addrs=127.17.136.62:35395
--keytab_file=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790521920546562-17952-0/krb5kdc/kudu_127.17.136.2.keytab
--principal=kudu/127.17.136.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.136.20:41631
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790521920546562-17952-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790521920546562-17952-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790521920546562-17952-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260927 15:12:58.674291 28376 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260927 15:12:58.674527 28376 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260927 15:12:58.674567 28376 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260927 15:12:58.678463 28376 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260927 15:12:58.678511 28376 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260927 15:12:58.678566 28376 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.136.2
I20260927 15:12:58.683549 28376 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.136.20:41631
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790521920546562-17952-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790521920546562-17952-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790521920546562-17952-0/krb5kdc/kudu_127.17.136.2.keytab
--principal=kudu/127.17.136.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.136.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790521920546562-17952-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.17.136.2
--webserver_port=0
--tserver_master_addrs=127.17.136.62:35395
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28376
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.136.2
--log_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790521920546562-17952-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 27 Sep 2026 14:27:13 UTC on ccycloud.quasar-psqrth.root.comops.site
build id 4676138
I20260927 15:12:58.684424 28376 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260927 15:12:58.685313 28376 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260927 15:12:58.694432 28382 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260927 15:12:58.694447 28381 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260927 15:12:58.694445 28384 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260927 15:12:58.694692 28376 server_base.cc:1034] running on GCE node
I20260927 15:12:58.695091 28376 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260927 15:12:58.695758 28376 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260927 15:12:58.696915 28376 hybrid_clock.cc:648] HybridClock initialized: now 1790521978696896 us; error 34 us; skew 500 ppm
Sep 27 15:12:58 dist-test-slave-5s2t krb5kdc[28135](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790521978, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.136.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260927 15:12:58.699625 28376 init.cc:377] Logged in from keytab as kudu/127.17.136.2@KRBTEST.COM (short username kudu)
I20260927 15:12:58.700421 28376 webserver.cc:460] Webserver started at http://127.17.136.2:41025/ using document root <none> and password file <none>
I20260927 15:12:58.700930 28376 fs_manager.cc:359] Metadata directory not provided
I20260927 15:12:58.700986 28376 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260927 15:12:58.701145 28376 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260927 15:12:58.703037 28376 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790521920546562-17952-0/minicluster-data/ts-1/data/instance:
uuid: "a43c2c57d3404887ac836da246bdff48"
format_stamp: "Formatted at 2026-09-27 15:12:58 on dist-test-slave-5s2t"
server_key: "352c96922abf8913ab901ed132241c6b"
server_key_iv: "64a9488d4e86febf05972c5e3650112f"
server_key_version: "encryptionkey@0"
I20260927 15:12:58.703570 28376 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790521920546562-17952-0/minicluster-data/ts-1/wal/instance:
uuid: "a43c2c57d3404887ac836da246bdff48"
format_stamp: "Formatted at 2026-09-27 15:12:58 on dist-test-slave-5s2t"
server_key: "352c96922abf8913ab901ed132241c6b"
server_key_iv: "64a9488d4e86febf05972c5e3650112f"
server_key_version: "encryptionkey@0"
I20260927 15:12:58.706853 28376 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.000s
I20260927 15:12:58.709085 28391 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260927 15:12:58.710170 28376 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.000s sys 0.002s
I20260927 15:12:58.710261 28376 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790521920546562-17952-0/minicluster-data/ts-1/data,/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790521920546562-17952-0/minicluster-data/ts-1/wal
uuid: "a43c2c57d3404887ac836da246bdff48"
format_stamp: "Formatted at 2026-09-27 15:12:58 on dist-test-slave-5s2t"
server_key: "352c96922abf8913ab901ed132241c6b"
server_key_iv: "64a9488d4e86febf05972c5e3650112f"
server_key_version: "encryptionkey@0"
I20260927 15:12:58.710350 28376 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790521920546562-17952-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790521920546562-17952-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790521920546562-17952-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260927 15:12:58.750147 28376 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260927 15:12:58.753319 28376 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260927 15:12:58.753505 28376 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260927 15:12:58.754038 28376 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260927 15:12:58.754788 28376 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260927 15:12:58.754832 28376 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260927 15:12:58.754871 28376 ts_tablet_manager.cc:610] Registered 0 tablets
I20260927 15:12:58.754892 28376 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260927 15:12:58.762668 28376 rpc_server.cc:307] RPC server started. Bound to: 127.17.136.2:38597
I20260927 15:12:58.762703 28504 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.136.2:38597 every 8 connection(s)
I20260927 15:12:58.763512 28376 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790521920546562-17952-0/minicluster-data/ts-1/data/info.pb
I20260927 15:12:58.763758 17952 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu as pid 28376
I20260927 15:12:58.763893 17952 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790521920546562-17952-0/minicluster-data/ts-1/wal/instance
I20260927 15:12:58.764241 17952 external_mini_cluster.cc:1428] Setting key 1f06bcb80095a33981ba34fb180e3641
WARNING: no policy specified for kudu/127.17.136.3@KRBTEST.COM; defaulting to no policy
Sep 27 15:12:58 dist-test-slave-5s2t krb5kdc[28135](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790521978, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.136.2@KRBTEST.COM for kudu/127.17.136.62@KRBTEST.COM
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.136.3@KRBTEST.COM" created.
I20260927 15:12:58.777002 28219 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:58.765280 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.136.2:45883 (local address 127.17.136.62:35395)
0927 15:12:58.765404 (+ 124us) server_negotiation.cc:206] Beginning negotiation
0927 15:12:58.765409 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0927 15:12:58.766337 (+ 928us) server_negotiation.cc:407] Connection header received
0927 15:12:58.767698 (+ 1361us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:12:58.767702 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:12:58.767753 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:12:58.767824 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0927 15:12:58.768959 (+ 1135us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:58.769557 (+ 598us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:58.770658 (+ 1101us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:58.770880 (+ 222us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:58.770965 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:58.773494 (+ 2529us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0927 15:12:58.773496 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0927 15:12:58.773499 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0927 15:12:58.773523 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0927 15:12:58.774850 (+ 1327us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:12:58.775370 (+ 520us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:12:58.775373 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:12:58.775374 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:12:58.775451 (+ 77us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:12:58.775862 (+ 411us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:12:58.775866 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:12:58.775868 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:12:58.776113 (+ 245us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0927 15:12:58.776203 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0927 15:12:58.776706 (+ 503us) server_negotiation.cc:299] Negotiation successful
0927 15:12:58.776835 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260927 15:12:58.777935 28507 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:58.765722 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.62:35395 (local address 127.17.136.2:45883)
0927 15:12:58.766196 (+ 474us) negotiation.cc:107] Waiting for socket to connect
0927 15:12:58.766241 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0927 15:12:58.767506 (+ 1265us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0927 15:12:58.768010 (+ 504us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0927 15:12:58.768017 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0927 15:12:58.768361 (+ 344us) client_negotiation.cc:189] Negotiated authn=SASL
0927 15:12:58.768823 (+ 462us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:12:58.768836 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:12:58.769670 (+ 834us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:12:58.769673 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:12:58.770543 (+ 870us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:12:58.770552 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:12:58.771010 (+ 458us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:12:58.771014 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:12:58.771168 (+ 154us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:58.771753 (+ 585us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0927 15:12:58.771769 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0927 15:12:58.773315 (+ 1546us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0927 15:12:58.774961 (+ 1646us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0927 15:12:58.774967 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0927 15:12:58.774985 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0927 15:12:58.775278 (+ 293us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0927 15:12:58.775542 (+ 264us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0927 15:12:58.775546 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0927 15:12:58.775548 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0927 15:12:58.775743 (+ 195us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0927 15:12:58.776203 (+ 460us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0927 15:12:58.776208 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0927 15:12:58.776471 (+ 263us) client_negotiation.cc:769] Sending connection context
0927 15:12:58.776628 (+ 157us) client_negotiation.cc:240] Negotiation successful
0927 15:12:58.776897 (+ 269us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":291,"thread_start_us":133,"threads_started":1}
I20260927 15:12:58.779085 28505 heartbeater.cc:347] Connected to a master server at 127.17.136.62:35395
I20260927 15:12:58.779345 28505 heartbeater.cc:464] Registering TS with master...
I20260927 15:12:58.779816 28505 heartbeater.cc:511] Master 127.17.136.62:35395 requested a full tablet report, sending...
I20260927 15:12:58.780830 28177 ts_manager.cc:194] Registered new tserver with Master: a43c2c57d3404887ac836da246bdff48 (127.17.136.2:38597)
I20260927 15:12:58.781406 28177 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.136.2@KRBTEST.COM'} at 127.17.136.2:45883
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.136.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790521920546562-17952-0/krb5kdc/kudu_127.17.136.3.keytab.
Entry for principal kudu/127.17.136.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790521920546562-17952-0/krb5kdc/kudu_127.17.136.3.keytab.
I20260927 15:12:58.791658 17952 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu
/tmp/dist-test-taskiFOyeW/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790521920546562-17952-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790521920546562-17952-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790521920546562-17952-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790521920546562-17952-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.136.3:0
--local_ip_for_outbound_sockets=127.17.136.3
--webserver_interface=127.17.136.3
--webserver_port=0
--tserver_master_addrs=127.17.136.62:35395
--keytab_file=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790521920546562-17952-0/krb5kdc/kudu_127.17.136.3.keytab
--principal=kudu/127.17.136.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.136.20:41631
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790521920546562-17952-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790521920546562-17952-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790521920546562-17952-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260927 15:12:58.898170 28510 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260927 15:12:58.898451 28510 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260927 15:12:58.898494 28510 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260927 15:12:58.902494 28510 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260927 15:12:58.902550 28510 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260927 15:12:58.902607 28510 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.136.3
I20260927 15:12:58.907866 28510 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.136.20:41631
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790521920546562-17952-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790521920546562-17952-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790521920546562-17952-0/krb5kdc/kudu_127.17.136.3.keytab
--principal=kudu/127.17.136.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.136.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790521920546562-17952-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.17.136.3
--webserver_port=0
--tserver_master_addrs=127.17.136.62:35395
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28510
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.136.3
--log_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790521920546562-17952-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 27 Sep 2026 14:27:13 UTC on ccycloud.quasar-psqrth.root.comops.site
build id 4676138
I20260927 15:12:58.908823 28510 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260927 15:12:58.909750 28510 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260927 15:12:58.918825 28515 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260927 15:12:58.918787 28516 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260927 15:12:58.918803 28518 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260927 15:12:58.918923 28510 server_base.cc:1034] running on GCE node
I20260927 15:12:58.919474 28510 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260927 15:12:58.920046 28510 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260927 15:12:58.921185 28510 hybrid_clock.cc:648] HybridClock initialized: now 1790521978921165 us; error 30 us; skew 500 ppm
Sep 27 15:12:58 dist-test-slave-5s2t krb5kdc[28135](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790521978, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.136.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260927 15:12:58.923679 28510 init.cc:377] Logged in from keytab as kudu/127.17.136.3@KRBTEST.COM (short username kudu)
I20260927 15:12:58.924531 28510 webserver.cc:460] Webserver started at http://127.17.136.3:43549/ using document root <none> and password file <none>
I20260927 15:12:58.925067 28510 fs_manager.cc:359] Metadata directory not provided
I20260927 15:12:58.925135 28510 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260927 15:12:58.925345 28510 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260927 15:12:58.927352 28510 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790521920546562-17952-0/minicluster-data/ts-2/data/instance:
uuid: "17c763cce26b4209ad4ee6633b014ccf"
format_stamp: "Formatted at 2026-09-27 15:12:58 on dist-test-slave-5s2t"
server_key: "faabf3044d3bd94de164e893cce2674c"
server_key_iv: "1644d268cd6a7add702de50dd4d25457"
server_key_version: "encryptionkey@0"
I20260927 15:12:58.927896 28510 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790521920546562-17952-0/minicluster-data/ts-2/wal/instance:
uuid: "17c763cce26b4209ad4ee6633b014ccf"
format_stamp: "Formatted at 2026-09-27 15:12:58 on dist-test-slave-5s2t"
server_key: "faabf3044d3bd94de164e893cce2674c"
server_key_iv: "1644d268cd6a7add702de50dd4d25457"
server_key_version: "encryptionkey@0"
I20260927 15:12:58.931511 28510 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.000s
I20260927 15:12:58.933889 28525 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260927 15:12:58.935068 28510 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260927 15:12:58.935179 28510 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790521920546562-17952-0/minicluster-data/ts-2/data,/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790521920546562-17952-0/minicluster-data/ts-2/wal
uuid: "17c763cce26b4209ad4ee6633b014ccf"
format_stamp: "Formatted at 2026-09-27 15:12:58 on dist-test-slave-5s2t"
server_key: "faabf3044d3bd94de164e893cce2674c"
server_key_iv: "1644d268cd6a7add702de50dd4d25457"
server_key_version: "encryptionkey@0"
I20260927 15:12:58.935305 28510 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790521920546562-17952-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790521920546562-17952-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790521920546562-17952-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260927 15:12:58.954658 28510 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260927 15:12:58.957311 28510 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260927 15:12:58.957489 28510 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260927 15:12:58.958060 28510 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260927 15:12:58.958846 28510 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260927 15:12:58.958894 28510 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260927 15:12:58.958946 28510 ts_tablet_manager.cc:610] Registered 0 tablets
I20260927 15:12:58.958976 28510 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260927 15:12:58.966892 28510 rpc_server.cc:307] RPC server started. Bound to: 127.17.136.3:37807
I20260927 15:12:58.966928 28638 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.136.3:37807 every 8 connection(s)
I20260927 15:12:58.967792 28510 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790521920546562-17952-0/minicluster-data/ts-2/data/info.pb
Sep 27 15:12:58 dist-test-slave-5s2t krb5kdc[28135](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790521978, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.136.3@KRBTEST.COM for kudu/127.17.136.62@KRBTEST.COM
I20260927 15:12:58.977656 17952 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu as pid 28510
I20260927 15:12:58.977756 17952 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790521920546562-17952-0/minicluster-data/ts-2/wal/instance
I20260927 15:12:58.978029 17952 external_mini_cluster.cc:1428] Setting key d081d92e6711f367cb4ec2b9e6c84d66
I20260927 15:12:58.980612 28219 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:58.969498 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.136.3:52247 (local address 127.17.136.62:35395)
0927 15:12:58.969631 (+ 133us) server_negotiation.cc:206] Beginning negotiation
0927 15:12:58.969635 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0927 15:12:58.970411 (+ 776us) server_negotiation.cc:407] Connection header received
0927 15:12:58.971815 (+ 1404us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:12:58.971818 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:12:58.971871 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:12:58.971943 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0927 15:12:58.973077 (+ 1134us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:58.973604 (+ 527us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:58.974729 (+ 1125us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:58.974946 (+ 217us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:58.975035 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:58.977424 (+ 2389us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0927 15:12:58.977428 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0927 15:12:58.977430 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0927 15:12:58.977456 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0927 15:12:58.978755 (+ 1299us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:12:58.979208 (+ 453us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:12:58.979212 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:12:58.979214 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:12:58.979324 (+ 110us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:12:58.979635 (+ 311us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:12:58.979638 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:12:58.979640 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:12:58.979863 (+ 223us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0927 15:12:58.979941 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0927 15:12:58.980399 (+ 458us) server_negotiation.cc:299] Negotiation successful
0927 15:12:58.980493 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260927 15:12:58.981478 28641 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:58.969834 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.62:35395 (local address 127.17.136.3:52247)
0927 15:12:58.970263 (+ 429us) negotiation.cc:107] Waiting for socket to connect
0927 15:12:58.970304 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0927 15:12:58.971611 (+ 1307us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0927 15:12:58.972116 (+ 505us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0927 15:12:58.972123 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0927 15:12:58.972464 (+ 341us) client_negotiation.cc:189] Negotiated authn=SASL
0927 15:12:58.972939 (+ 475us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:12:58.972953 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:12:58.973718 (+ 765us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:12:58.973721 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:12:58.974614 (+ 893us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:12:58.974623 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:12:58.975083 (+ 460us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:12:58.975087 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:12:58.975288 (+ 201us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:58.975809 (+ 521us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0927 15:12:58.975825 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0927 15:12:58.977255 (+ 1430us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0927 15:12:58.978859 (+ 1604us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0927 15:12:58.978865 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0927 15:12:58.978888 (+ 23us) client_negotiation.cc:760] calling sasl_client_step()
0927 15:12:58.979121 (+ 233us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0927 15:12:58.979417 (+ 296us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0927 15:12:58.979419 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0927 15:12:58.979421 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0927 15:12:58.979556 (+ 135us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0927 15:12:58.979957 (+ 401us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0927 15:12:58.979964 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0927 15:12:58.980199 (+ 235us) client_negotiation.cc:769] Sending connection context
0927 15:12:58.980355 (+ 156us) client_negotiation.cc:240] Negotiation successful
0927 15:12:58.980618 (+ 263us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":253,"thread_start_us":105,"threads_started":1}
I20260927 15:12:58.982504 28639 heartbeater.cc:347] Connected to a master server at 127.17.136.62:35395
I20260927 15:12:58.982712 28639 heartbeater.cc:464] Registering TS with master...
I20260927 15:12:58.983156 28639 heartbeater.cc:511] Master 127.17.136.62:35395 requested a full tablet report, sending...
I20260927 15:12:58.984100 28177 ts_manager.cc:194] Registered new tserver with Master: 17c763cce26b4209ad4ee6633b014ccf (127.17.136.3:37807)
I20260927 15:12:58.984620 28177 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.136.3@KRBTEST.COM'} at 127.17.136.3:52247
I20260927 15:12:58.991374 17952 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260927 15:12:58.999931 28219 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:58.993131 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53468 (local address 127.17.136.62:35395)
0927 15:12:58.993239 (+ 108us) server_negotiation.cc:206] Beginning negotiation
0927 15:12:58.993244 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0927 15:12:58.993401 (+ 157us) server_negotiation.cc:407] Connection header received
0927 15:12:58.993509 (+ 108us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:12:58.993512 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:12:58.993552 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:12:58.993609 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0927 15:12:58.994260 (+ 651us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:58.994759 (+ 499us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:58.995564 (+ 805us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:58.995774 (+ 210us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:58.995878 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:58.997081 (+ 1203us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0927 15:12:58.997085 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0927 15:12:58.997088 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0927 15:12:58.997111 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0927 15:12:58.998433 (+ 1322us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:12:58.998786 (+ 353us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:12:58.998789 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:12:58.998791 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:12:58.998864 (+ 73us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:12:58.999089 (+ 225us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:12:58.999092 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:12:58.999094 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:12:58.999356 (+ 262us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0927 15:12:58.999475 (+ 119us) server_negotiation.cc:1035] Waiting for connection context
0927 15:12:58.999685 (+ 210us) server_negotiation.cc:299] Negotiation successful
0927 15:12:58.999786 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260927 15:12:59.002419 28177 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:53468:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:12:59.005357 28177 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:12:59.019737 28651 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:59.014829 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35396 (local address 127.17.136.3:37807)
0927 15:12:59.015200 (+ 371us) server_negotiation.cc:206] Beginning negotiation
0927 15:12:59.015212 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0927 15:12:59.015575 (+ 363us) server_negotiation.cc:407] Connection header received
0927 15:12:59.015686 (+ 111us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:12:59.015692 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:12:59.015908 (+ 216us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:12:59.016048 (+ 140us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0927 15:12:59.016332 (+ 284us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:59.017440 (+ 1108us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:59.018541 (+ 1101us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:59.019099 (+ 558us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:59.019198 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:59.019370 (+ 172us) server_negotiation.cc:1035] Waiting for connection context
0927 15:12:59.019494 (+ 124us) server_negotiation.cc:299] Negotiation successful
0927 15:12:59.019587 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":262,"thread_start_us":158,"threads_started":1}
I20260927 15:12:59.019733 28652 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:59.015235 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.3:37807 (local address 127.0.0.1:35396)
0927 15:12:59.015465 (+ 230us) negotiation.cc:107] Waiting for socket to connect
0927 15:12:59.015477 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0927 15:12:59.015574 (+ 97us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0927 15:12:59.016050 (+ 476us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0927 15:12:59.016055 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0927 15:12:59.016077 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0927 15:12:59.016214 (+ 137us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:12:59.016221 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:12:59.017555 (+ 1334us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:12:59.017558 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:12:59.018434 (+ 876us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:12:59.018442 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:12:59.019189 (+ 747us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:12:59.019192 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:12:59.019322 (+ 130us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:59.019362 (+ 40us) client_negotiation.cc:769] Sending connection context
0927 15:12:59.019470 (+ 108us) client_negotiation.cc:240] Negotiation successful
0927 15:12:59.019579 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":170,"thread_start_us":85,"threads_started":1}
I20260927 15:12:59.021255 28650 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:59.014687 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.2:38597 (local address 127.0.0.1:41632)
0927 15:12:59.015041 (+ 354us) negotiation.cc:107] Waiting for socket to connect
0927 15:12:59.015096 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0927 15:12:59.015233 (+ 137us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0927 15:12:59.016432 (+ 1199us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0927 15:12:59.016436 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0927 15:12:59.016454 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0927 15:12:59.016554 (+ 100us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:12:59.016560 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:12:59.017871 (+ 1311us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:12:59.017874 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:12:59.019003 (+ 1129us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:12:59.019011 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:12:59.020889 (+ 1878us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:12:59.020893 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:12:59.020978 (+ 85us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:59.020999 (+ 21us) client_negotiation.cc:769] Sending connection context
0927 15:12:59.021067 (+ 68us) client_negotiation.cc:240] Negotiation successful
0927 15:12:59.021129 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":182,"thread_start_us":95,"threads_started":1}
I20260927 15:12:59.021390 28654 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:59.015548 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.1:43971 (local address 127.0.0.1:35918)
0927 15:12:59.016671 (+ 1123us) negotiation.cc:107] Waiting for socket to connect
0927 15:12:59.016684 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0927 15:12:59.016762 (+ 78us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0927 15:12:59.017373 (+ 611us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0927 15:12:59.017375 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0927 15:12:59.017392 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0927 15:12:59.017468 (+ 76us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:12:59.017473 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:12:59.018804 (+ 1331us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:12:59.018807 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:12:59.019837 (+ 1030us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:12:59.019847 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:12:59.021058 (+ 1211us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:12:59.021061 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:12:59.021136 (+ 75us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:59.021154 (+ 18us) client_negotiation.cc:769] Sending connection context
0927 15:12:59.021211 (+ 57us) client_negotiation.cc:240] Negotiation successful
0927 15:12:59.021263 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1066,"thread_start_us":88,"threads_started":1}
I20260927 15:12:59.021414 28653 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:59.015472 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41632 (local address 127.17.136.2:38597)
0927 15:12:59.016012 (+ 540us) server_negotiation.cc:206] Beginning negotiation
0927 15:12:59.016027 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0927 15:12:59.016049 (+ 22us) server_negotiation.cc:407] Connection header received
0927 15:12:59.016118 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:12:59.016123 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:12:59.016295 (+ 172us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:12:59.016442 (+ 147us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0927 15:12:59.016673 (+ 231us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:59.017735 (+ 1062us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:59.019117 (+ 1382us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:59.020763 (+ 1646us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:59.020865 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:59.020998 (+ 133us) server_negotiation.cc:1035] Waiting for connection context
0927 15:12:59.021089 (+ 91us) server_negotiation.cc:299] Negotiation successful
0927 15:12:59.021174 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":442,"thread_start_us":149,"threads_started":1}
I20260927 15:12:59.021795 28655 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:59.015910 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35918 (local address 127.17.136.1:43971)
0927 15:12:59.016264 (+ 354us) server_negotiation.cc:206] Beginning negotiation
0927 15:12:59.016278 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0927 15:12:59.016846 (+ 568us) server_negotiation.cc:407] Connection header received
0927 15:12:59.016935 (+ 89us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:12:59.016939 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:12:59.017105 (+ 166us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:12:59.017233 (+ 128us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0927 15:12:59.017572 (+ 339us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:59.018673 (+ 1101us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:59.020194 (+ 1521us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:59.020786 (+ 592us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:59.020876 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:59.021004 (+ 128us) server_negotiation.cc:1035] Waiting for connection context
0927 15:12:59.021572 (+ 568us) server_negotiation.cc:299] Negotiation successful
0927 15:12:59.021663 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":274,"thread_start_us":97,"threads_started":1}
I20260927 15:12:59.022691 28573 tablet_service.cc:1467] Processing CreateTablet for tablet f9f863a5dbec4eb88666a38442903b64 (DEFAULT_TABLE table=test-table [id=00782d2466ba4d94af1ee0b2f4950236]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:12:59.023713 28573 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f9f863a5dbec4eb88666a38442903b64. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:12:59.024158 28305 tablet_service.cc:1467] Processing CreateTablet for tablet f9f863a5dbec4eb88666a38442903b64 (DEFAULT_TABLE table=test-table [id=00782d2466ba4d94af1ee0b2f4950236]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:12:59.025043 28305 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f9f863a5dbec4eb88666a38442903b64. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:12:59.029819 28656 tablet_bootstrap.cc:492] T f9f863a5dbec4eb88666a38442903b64 P 17c763cce26b4209ad4ee6633b014ccf: Bootstrap starting.
I20260927 15:12:59.030866 28439 tablet_service.cc:1467] Processing CreateTablet for tablet f9f863a5dbec4eb88666a38442903b64 (DEFAULT_TABLE table=test-table [id=00782d2466ba4d94af1ee0b2f4950236]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:12:59.031605 28657 tablet_bootstrap.cc:492] T f9f863a5dbec4eb88666a38442903b64 P 48290a1312ff4155b464c68a706bbeff: Bootstrap starting.
I20260927 15:12:59.031795 28439 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f9f863a5dbec4eb88666a38442903b64. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:12:59.032284 28656 tablet_bootstrap.cc:654] T f9f863a5dbec4eb88666a38442903b64 P 17c763cce26b4209ad4ee6633b014ccf: Neither blocks nor log segments found. Creating new log.
I20260927 15:12:59.033510 28656 log.cc:824] T f9f863a5dbec4eb88666a38442903b64 P 17c763cce26b4209ad4ee6633b014ccf: Log is configured to *not* fsync() on all Append() calls
I20260927 15:12:59.033666 28657 tablet_bootstrap.cc:654] T f9f863a5dbec4eb88666a38442903b64 P 48290a1312ff4155b464c68a706bbeff: Neither blocks nor log segments found. Creating new log.
I20260927 15:12:59.034930 28657 log.cc:824] T f9f863a5dbec4eb88666a38442903b64 P 48290a1312ff4155b464c68a706bbeff: Log is configured to *not* fsync() on all Append() calls
I20260927 15:12:59.035619 28656 tablet_bootstrap.cc:492] T f9f863a5dbec4eb88666a38442903b64 P 17c763cce26b4209ad4ee6633b014ccf: No bootstrap required, opened a new log
I20260927 15:12:59.035804 28656 ts_tablet_manager.cc:1397] T f9f863a5dbec4eb88666a38442903b64 P 17c763cce26b4209ad4ee6633b014ccf: Time spent bootstrapping tablet: real 0.006s user 0.005s sys 0.000s
I20260927 15:12:59.036825 28657 tablet_bootstrap.cc:492] T f9f863a5dbec4eb88666a38442903b64 P 48290a1312ff4155b464c68a706bbeff: No bootstrap required, opened a new log
I20260927 15:12:59.036998 28657 ts_tablet_manager.cc:1397] T f9f863a5dbec4eb88666a38442903b64 P 48290a1312ff4155b464c68a706bbeff: Time spent bootstrapping tablet: real 0.006s user 0.003s sys 0.001s
I20260927 15:12:59.037669 28660 tablet_bootstrap.cc:492] T f9f863a5dbec4eb88666a38442903b64 P a43c2c57d3404887ac836da246bdff48: Bootstrap starting.
I20260927 15:12:59.039860 28656 raft_consensus.cc:348] T f9f863a5dbec4eb88666a38442903b64 P 17c763cce26b4209ad4ee6633b014ccf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17c763cce26b4209ad4ee6633b014ccf" member_type: VOTER last_known_addr { host: "127.17.136.3" port: 37807 } } peers { permanent_uuid: "48290a1312ff4155b464c68a706bbeff" member_type: VOTER last_known_addr { host: "127.17.136.1" port: 43971 } } peers { permanent_uuid: "a43c2c57d3404887ac836da246bdff48" member_type: VOTER last_known_addr { host: "127.17.136.2" port: 38597 } }
I20260927 15:12:59.040130 28656 raft_consensus.cc:374] T f9f863a5dbec4eb88666a38442903b64 P 17c763cce26b4209ad4ee6633b014ccf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:12:59.040158 28660 tablet_bootstrap.cc:654] T f9f863a5dbec4eb88666a38442903b64 P a43c2c57d3404887ac836da246bdff48: Neither blocks nor log segments found. Creating new log.
I20260927 15:12:59.040194 28656 raft_consensus.cc:729] T f9f863a5dbec4eb88666a38442903b64 P 17c763cce26b4209ad4ee6633b014ccf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 17c763cce26b4209ad4ee6633b014ccf, State: Initialized, Role: FOLLOWER
I20260927 15:12:59.040627 28656 consensus_queue.cc:260] T f9f863a5dbec4eb88666a38442903b64 P 17c763cce26b4209ad4ee6633b014ccf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17c763cce26b4209ad4ee6633b014ccf" member_type: VOTER last_known_addr { host: "127.17.136.3" port: 37807 } } peers { permanent_uuid: "48290a1312ff4155b464c68a706bbeff" member_type: VOTER last_known_addr { host: "127.17.136.1" port: 43971 } } peers { permanent_uuid: "a43c2c57d3404887ac836da246bdff48" member_type: VOTER last_known_addr { host: "127.17.136.2" port: 38597 } }
I20260927 15:12:59.040688 28657 raft_consensus.cc:348] T f9f863a5dbec4eb88666a38442903b64 P 48290a1312ff4155b464c68a706bbeff [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17c763cce26b4209ad4ee6633b014ccf" member_type: VOTER last_known_addr { host: "127.17.136.3" port: 37807 } } peers { permanent_uuid: "48290a1312ff4155b464c68a706bbeff" member_type: VOTER last_known_addr { host: "127.17.136.1" port: 43971 } } peers { permanent_uuid: "a43c2c57d3404887ac836da246bdff48" member_type: VOTER last_known_addr { host: "127.17.136.2" port: 38597 } }
I20260927 15:12:59.040923 28657 raft_consensus.cc:374] T f9f863a5dbec4eb88666a38442903b64 P 48290a1312ff4155b464c68a706bbeff [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:12:59.040985 28657 raft_consensus.cc:729] T f9f863a5dbec4eb88666a38442903b64 P 48290a1312ff4155b464c68a706bbeff [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48290a1312ff4155b464c68a706bbeff, State: Initialized, Role: FOLLOWER
I20260927 15:12:59.041265 28660 log.cc:824] T f9f863a5dbec4eb88666a38442903b64 P a43c2c57d3404887ac836da246bdff48: Log is configured to *not* fsync() on all Append() calls
I20260927 15:12:59.041376 28657 consensus_queue.cc:260] T f9f863a5dbec4eb88666a38442903b64 P 48290a1312ff4155b464c68a706bbeff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17c763cce26b4209ad4ee6633b014ccf" member_type: VOTER last_known_addr { host: "127.17.136.3" port: 37807 } } peers { permanent_uuid: "48290a1312ff4155b464c68a706bbeff" member_type: VOTER last_known_addr { host: "127.17.136.1" port: 43971 } } peers { permanent_uuid: "a43c2c57d3404887ac836da246bdff48" member_type: VOTER last_known_addr { host: "127.17.136.2" port: 38597 } }
I20260927 15:12:59.041862 28656 ts_tablet_manager.cc:1428] T f9f863a5dbec4eb88666a38442903b64 P 17c763cce26b4209ad4ee6633b014ccf: Time spent starting tablet: real 0.006s user 0.005s sys 0.000s
I20260927 15:12:59.042232 28639 heartbeater.cc:503] Master 127.17.136.62:35395 was elected leader, sending a full tablet report...
I20260927 15:12:59.042299 28657 ts_tablet_manager.cc:1428] T f9f863a5dbec4eb88666a38442903b64 P 48290a1312ff4155b464c68a706bbeff: Time spent starting tablet: real 0.005s user 0.002s sys 0.004s
I20260927 15:12:59.043085 28660 tablet_bootstrap.cc:492] T f9f863a5dbec4eb88666a38442903b64 P a43c2c57d3404887ac836da246bdff48: No bootstrap required, opened a new log
I20260927 15:12:59.043279 28660 ts_tablet_manager.cc:1397] T f9f863a5dbec4eb88666a38442903b64 P a43c2c57d3404887ac836da246bdff48: Time spent bootstrapping tablet: real 0.006s user 0.005s sys 0.000s
I20260927 15:12:59.043432 28371 heartbeater.cc:503] Master 127.17.136.62:35395 was elected leader, sending a full tablet report...
I20260927 15:12:59.046708 28660 raft_consensus.cc:348] T f9f863a5dbec4eb88666a38442903b64 P a43c2c57d3404887ac836da246bdff48 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17c763cce26b4209ad4ee6633b014ccf" member_type: VOTER last_known_addr { host: "127.17.136.3" port: 37807 } } peers { permanent_uuid: "48290a1312ff4155b464c68a706bbeff" member_type: VOTER last_known_addr { host: "127.17.136.1" port: 43971 } } peers { permanent_uuid: "a43c2c57d3404887ac836da246bdff48" member_type: VOTER last_known_addr { host: "127.17.136.2" port: 38597 } }
I20260927 15:12:59.046907 28660 raft_consensus.cc:374] T f9f863a5dbec4eb88666a38442903b64 P a43c2c57d3404887ac836da246bdff48 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:12:59.046938 28660 raft_consensus.cc:729] T f9f863a5dbec4eb88666a38442903b64 P a43c2c57d3404887ac836da246bdff48 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a43c2c57d3404887ac836da246bdff48, State: Initialized, Role: FOLLOWER
I20260927 15:12:59.047263 28660 consensus_queue.cc:260] T f9f863a5dbec4eb88666a38442903b64 P a43c2c57d3404887ac836da246bdff48 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17c763cce26b4209ad4ee6633b014ccf" member_type: VOTER last_known_addr { host: "127.17.136.3" port: 37807 } } peers { permanent_uuid: "48290a1312ff4155b464c68a706bbeff" member_type: VOTER last_known_addr { host: "127.17.136.1" port: 43971 } } peers { permanent_uuid: "a43c2c57d3404887ac836da246bdff48" member_type: VOTER last_known_addr { host: "127.17.136.2" port: 38597 } }
I20260927 15:12:59.047818 28505 heartbeater.cc:503] Master 127.17.136.62:35395 was elected leader, sending a full tablet report...
I20260927 15:12:59.048097 28660 ts_tablet_manager.cc:1428] T f9f863a5dbec4eb88666a38442903b64 P a43c2c57d3404887ac836da246bdff48: Time spent starting tablet: real 0.005s user 0.004s sys 0.000s
I20260927 15:12:59.067116 28664 raft_consensus.cc:482] T f9f863a5dbec4eb88666a38442903b64 P a43c2c57d3404887ac836da246bdff48 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:12:59.067325 28664 raft_consensus.cc:504] T f9f863a5dbec4eb88666a38442903b64 P a43c2c57d3404887ac836da246bdff48 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17c763cce26b4209ad4ee6633b014ccf" member_type: VOTER last_known_addr { host: "127.17.136.3" port: 37807 } } peers { permanent_uuid: "48290a1312ff4155b464c68a706bbeff" member_type: VOTER last_known_addr { host: "127.17.136.1" port: 43971 } } peers { permanent_uuid: "a43c2c57d3404887ac836da246bdff48" member_type: VOTER last_known_addr { host: "127.17.136.2" port: 38597 } }
I20260927 15:12:59.068406 28664 leader_election.cc:288] T f9f863a5dbec4eb88666a38442903b64 P a43c2c57d3404887ac836da246bdff48 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 17c763cce26b4209ad4ee6633b014ccf (127.17.136.3:37807), 48290a1312ff4155b464c68a706bbeff (127.17.136.1:43971)
I20260927 15:12:59.071856 28507 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:59.068614 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.3:37807 (local address 127.17.136.2:55083)
0927 15:12:59.068734 (+ 120us) negotiation.cc:107] Waiting for socket to connect
0927 15:12:59.068750 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0927 15:12:59.068840 (+ 90us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0927 15:12:59.069098 (+ 258us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0927 15:12:59.069101 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0927 15:12:59.069119 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0927 15:12:59.069233 (+ 114us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:12:59.069238 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:12:59.069962 (+ 724us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:12:59.069965 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:12:59.070798 (+ 833us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:12:59.070806 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:12:59.071451 (+ 645us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:12:59.071454 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:12:59.071570 (+ 116us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:59.071591 (+ 21us) client_negotiation.cc:769] Sending connection context
0927 15:12:59.071655 (+ 64us) client_negotiation.cc:240] Negotiation successful
0927 15:12:59.071727 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":42,"mutex_wait_us":19}
I20260927 15:12:59.071856 28651 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:59.068686 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.136.2:55083 (local address 127.17.136.3:37807)
0927 15:12:59.068796 (+ 110us) server_negotiation.cc:206] Beginning negotiation
0927 15:12:59.068799 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0927 15:12:59.068812 (+ 13us) server_negotiation.cc:407] Connection header received
0927 15:12:59.068946 (+ 134us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:12:59.068949 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:12:59.069002 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:12:59.069083 (+ 81us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0927 15:12:59.069340 (+ 257us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:59.069860 (+ 520us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:59.070924 (+ 1064us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:59.071351 (+ 427us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:59.071452 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:59.071516 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0927 15:12:59.071678 (+ 162us) server_negotiation.cc:299] Negotiation successful
0927 15:12:59.071741 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260927 15:12:59.072214 28655 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:59.068988 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.136.2:42863 (local address 127.17.136.1:43971)
0927 15:12:59.069126 (+ 138us) server_negotiation.cc:206] Beginning negotiation
0927 15:12:59.069131 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0927 15:12:59.069378 (+ 247us) server_negotiation.cc:407] Connection header received
0927 15:12:59.069462 (+ 84us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:12:59.069466 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:12:59.069504 (+ 38us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:12:59.069562 (+ 58us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0927 15:12:59.069799 (+ 237us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:59.070276 (+ 477us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:59.071298 (+ 1022us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:59.071694 (+ 396us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:59.071795 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:59.071842 (+ 47us) server_negotiation.cc:1035] Waiting for connection context
0927 15:12:59.072029 (+ 187us) server_negotiation.cc:299] Negotiation successful
0927 15:12:59.072100 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260927 15:12:59.072543 28665 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:59.068902 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.1:43971 (local address 127.17.136.2:42863)
0927 15:12:59.069289 (+ 387us) negotiation.cc:107] Waiting for socket to connect
0927 15:12:59.069299 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0927 15:12:59.069383 (+ 84us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0927 15:12:59.069582 (+ 199us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0927 15:12:59.069585 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0927 15:12:59.069598 (+ 13us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0927 15:12:59.069705 (+ 107us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:12:59.069710 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:12:59.070375 (+ 665us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:12:59.070378 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:12:59.071187 (+ 809us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:12:59.071196 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:12:59.071796 (+ 600us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:12:59.071799 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:12:59.071900 (+ 101us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:59.071920 (+ 20us) client_negotiation.cc:769] Sending connection context
0927 15:12:59.072344 (+ 424us) client_negotiation.cc:240] Negotiation successful
0927 15:12:59.072418 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":341,"mutex_wait_us":36,"thread_start_us":122,"threads_started":1}
I20260927 15:12:59.072661 28593 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f9f863a5dbec4eb88666a38442903b64" candidate_uuid: "a43c2c57d3404887ac836da246bdff48" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17c763cce26b4209ad4ee6633b014ccf" is_pre_election: true
I20260927 15:12:59.072979 28593 raft_consensus.cc:2454] T f9f863a5dbec4eb88666a38442903b64 P 17c763cce26b4209ad4ee6633b014ccf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a43c2c57d3404887ac836da246bdff48 in term 0.
I20260927 15:12:59.073251 28325 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f9f863a5dbec4eb88666a38442903b64" candidate_uuid: "a43c2c57d3404887ac836da246bdff48" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48290a1312ff4155b464c68a706bbeff" is_pre_election: true
I20260927 15:12:59.073426 28393 leader_election.cc:302] T f9f863a5dbec4eb88666a38442903b64 P a43c2c57d3404887ac836da246bdff48 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17c763cce26b4209ad4ee6633b014ccf, a43c2c57d3404887ac836da246bdff48; no voters:
I20260927 15:12:59.073527 28325 raft_consensus.cc:2454] T f9f863a5dbec4eb88666a38442903b64 P 48290a1312ff4155b464c68a706bbeff [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a43c2c57d3404887ac836da246bdff48 in term 0.
I20260927 15:12:59.073695 28664 raft_consensus.cc:2781] T f9f863a5dbec4eb88666a38442903b64 P a43c2c57d3404887ac836da246bdff48 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 15:12:59.073784 28664 raft_consensus.cc:482] T f9f863a5dbec4eb88666a38442903b64 P a43c2c57d3404887ac836da246bdff48 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 15:12:59.073833 28664 raft_consensus.cc:3037] T f9f863a5dbec4eb88666a38442903b64 P a43c2c57d3404887ac836da246bdff48 [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:12:59.074808 28664 raft_consensus.cc:504] T f9f863a5dbec4eb88666a38442903b64 P a43c2c57d3404887ac836da246bdff48 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17c763cce26b4209ad4ee6633b014ccf" member_type: VOTER last_known_addr { host: "127.17.136.3" port: 37807 } } peers { permanent_uuid: "48290a1312ff4155b464c68a706bbeff" member_type: VOTER last_known_addr { host: "127.17.136.1" port: 43971 } } peers { permanent_uuid: "a43c2c57d3404887ac836da246bdff48" member_type: VOTER last_known_addr { host: "127.17.136.2" port: 38597 } }
I20260927 15:12:59.075119 28664 leader_election.cc:288] T f9f863a5dbec4eb88666a38442903b64 P a43c2c57d3404887ac836da246bdff48 [CANDIDATE]: Term 1 election: Requested vote from peers 17c763cce26b4209ad4ee6633b014ccf (127.17.136.3:37807), 48290a1312ff4155b464c68a706bbeff (127.17.136.1:43971)
I20260927 15:12:59.075418 28593 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f9f863a5dbec4eb88666a38442903b64" candidate_uuid: "a43c2c57d3404887ac836da246bdff48" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17c763cce26b4209ad4ee6633b014ccf"
I20260927 15:12:59.075461 28325 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f9f863a5dbec4eb88666a38442903b64" candidate_uuid: "a43c2c57d3404887ac836da246bdff48" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48290a1312ff4155b464c68a706bbeff"
I20260927 15:12:59.075527 28593 raft_consensus.cc:3037] T f9f863a5dbec4eb88666a38442903b64 P 17c763cce26b4209ad4ee6633b014ccf [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:12:59.075584 28325 raft_consensus.cc:3037] T f9f863a5dbec4eb88666a38442903b64 P 48290a1312ff4155b464c68a706bbeff [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:12:59.076519 28593 raft_consensus.cc:2454] T f9f863a5dbec4eb88666a38442903b64 P 17c763cce26b4209ad4ee6633b014ccf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a43c2c57d3404887ac836da246bdff48 in term 1.
I20260927 15:12:59.076613 28325 raft_consensus.cc:2454] T f9f863a5dbec4eb88666a38442903b64 P 48290a1312ff4155b464c68a706bbeff [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a43c2c57d3404887ac836da246bdff48 in term 1.
I20260927 15:12:59.076864 28393 leader_election.cc:302] T f9f863a5dbec4eb88666a38442903b64 P a43c2c57d3404887ac836da246bdff48 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17c763cce26b4209ad4ee6633b014ccf, a43c2c57d3404887ac836da246bdff48; no voters:
I20260927 15:12:59.077020 28664 raft_consensus.cc:2781] T f9f863a5dbec4eb88666a38442903b64 P a43c2c57d3404887ac836da246bdff48 [term 1 FOLLOWER]: Leader election won for term 1
I20260927 15:12:59.077208 28664 raft_consensus.cc:686] T f9f863a5dbec4eb88666a38442903b64 P a43c2c57d3404887ac836da246bdff48 [term 1 LEADER]: Becoming Leader. State: Replica: a43c2c57d3404887ac836da246bdff48, State: Running, Role: LEADER
I20260927 15:12:59.077510 28664 consensus_queue.cc:237] T f9f863a5dbec4eb88666a38442903b64 P a43c2c57d3404887ac836da246bdff48 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17c763cce26b4209ad4ee6633b014ccf" member_type: VOTER last_known_addr { host: "127.17.136.3" port: 37807 } } peers { permanent_uuid: "48290a1312ff4155b464c68a706bbeff" member_type: VOTER last_known_addr { host: "127.17.136.1" port: 43971 } } peers { permanent_uuid: "a43c2c57d3404887ac836da246bdff48" member_type: VOTER last_known_addr { host: "127.17.136.2" port: 38597 } }
I20260927 15:12:59.080336 28177 catalog_manager.cc:5495] T f9f863a5dbec4eb88666a38442903b64 P a43c2c57d3404887ac836da246bdff48 reported cstate change: term changed from 0 to 1, leader changed from <none> to a43c2c57d3404887ac836da246bdff48 (127.17.136.2). New cstate: current_term: 1 leader_uuid: "a43c2c57d3404887ac836da246bdff48" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17c763cce26b4209ad4ee6633b014ccf" member_type: VOTER last_known_addr { host: "127.17.136.3" port: 37807 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "48290a1312ff4155b464c68a706bbeff" member_type: VOTER last_known_addr { host: "127.17.136.1" port: 43971 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a43c2c57d3404887ac836da246bdff48" member_type: VOTER last_known_addr { host: "127.17.136.2" port: 38597 } health_report { overall_health: HEALTHY } } }
I20260927 15:12:59.096133 28653 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:59.092545 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41636 (local address 127.17.136.2:38597)
0927 15:12:59.092682 (+ 137us) server_negotiation.cc:206] Beginning negotiation
0927 15:12:59.092686 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0927 15:12:59.092699 (+ 13us) server_negotiation.cc:407] Connection header received
0927 15:12:59.092776 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:12:59.092779 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:12:59.092833 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:12:59.092927 (+ 94us) server_negotiation.cc:226] Negotiated authn=TOKEN
0927 15:12:59.093188 (+ 261us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:59.093696 (+ 508us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:59.094524 (+ 828us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:12:59.094767 (+ 243us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:12:59.094849 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:12:59.095145 (+ 296us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0927 15:12:59.095715 (+ 570us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0927 15:12:59.095829 (+ 114us) server_negotiation.cc:1035] Waiting for connection context
0927 15:12:59.095908 (+ 79us) server_negotiation.cc:299] Negotiation successful
0927 15:12:59.095972 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260927 15:12:59.101843 28325 raft_consensus.cc:1261] T f9f863a5dbec4eb88666a38442903b64 P 48290a1312ff4155b464c68a706bbeff [term 1 FOLLOWER]: Refusing update from remote peer a43c2c57d3404887ac836da246bdff48: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260927 15:12:59.101843 28593 raft_consensus.cc:1261] T f9f863a5dbec4eb88666a38442903b64 P 17c763cce26b4209ad4ee6633b014ccf [term 1 FOLLOWER]: Refusing update from remote peer a43c2c57d3404887ac836da246bdff48: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260927 15:12:59.102504 28666 consensus_queue.cc:1035] T f9f863a5dbec4eb88666a38442903b64 P a43c2c57d3404887ac836da246bdff48 [LEADER]: Connected to new peer: Peer: permanent_uuid: "17c763cce26b4209ad4ee6633b014ccf" member_type: VOTER last_known_addr { host: "127.17.136.3" port: 37807 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260927 15:12:59.102669 28664 consensus_queue.cc:1035] T f9f863a5dbec4eb88666a38442903b64 P a43c2c57d3404887ac836da246bdff48 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48290a1312ff4155b464c68a706bbeff" member_type: VOTER last_known_addr { host: "127.17.136.1" port: 43971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260927 15:12:59.108220 28669 mvcc.cc:205] Tried to move back new op lower bound from 7333978026394165248 to 7333978026303840256. Current Snapshot: MvccSnapshot[applied={T|T < 7333978026394165248}]
I20260927 15:12:59.117147 28180 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:53468:
table { table_name: "test-table" } modify_external_catalogs: true
I20260927 15:12:59.117280 28180 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:53468:
table { table_name: "test-table" } modify_external_catalogs: true
I20260927 15:12:59.119324 28180 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 7d96ebf51d8f4cecbae3d882730b4f41: Sending DeleteTablet for 3 replicas of tablet f9f863a5dbec4eb88666a38442903b64
I20260927 15:12:59.120038 28439 tablet_service.cc:1514] Processing DeleteTablet for tablet f9f863a5dbec4eb88666a38442903b64 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:12:59 UTC) from {username='kudu', principal='kudu/127.17.136.62@KRBTEST.COM'} at 127.0.0.1:41632
I20260927 15:12:59.120220 28305 tablet_service.cc:1514] Processing DeleteTablet for tablet f9f863a5dbec4eb88666a38442903b64 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:12:59 UTC) from {username='kudu', principal='kudu/127.17.136.62@KRBTEST.COM'} at 127.0.0.1:35918
I20260927 15:12:59.120494 28679 tablet_replica.cc:330] T f9f863a5dbec4eb88666a38442903b64 P a43c2c57d3404887ac836da246bdff48: stopping tablet replica
I20260927 15:12:59.120479 28573 tablet_service.cc:1514] Processing DeleteTablet for tablet f9f863a5dbec4eb88666a38442903b64 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:12:59 UTC) from {username='kudu', principal='kudu/127.17.136.62@KRBTEST.COM'} at 127.0.0.1:35396
I20260927 15:12:59.120855 28681 tablet_replica.cc:330] T f9f863a5dbec4eb88666a38442903b64 P 17c763cce26b4209ad4ee6633b014ccf: stopping tablet replica
I20260927 15:12:59.120849 28679 raft_consensus.cc:2229] T f9f863a5dbec4eb88666a38442903b64 P a43c2c57d3404887ac836da246bdff48 [term 1 LEADER]: Raft consensus shutting down.
I20260927 15:12:59.120934 17952 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu with pid 28242
I20260927 15:12:59.121086 28681 raft_consensus.cc:2229] T f9f863a5dbec4eb88666a38442903b64 P 17c763cce26b4209ad4ee6633b014ccf [term 1 FOLLOWER]: Raft consensus shutting down.
I20260927 15:12:59.121554 28681 raft_consensus.cc:2258] T f9f863a5dbec4eb88666a38442903b64 P 17c763cce26b4209ad4ee6633b014ccf [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 15:12:59.121888 28679 raft_consensus.cc:2258] T f9f863a5dbec4eb88666a38442903b64 P a43c2c57d3404887ac836da246bdff48 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 15:12:59.123034 28681 ts_tablet_manager.cc:1905] T f9f863a5dbec4eb88666a38442903b64 P 17c763cce26b4209ad4ee6633b014ccf: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:12:59.123051 28679 ts_tablet_manager.cc:1905] T f9f863a5dbec4eb88666a38442903b64 P a43c2c57d3404887ac836da246bdff48: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:12:59.125519 28681 ts_tablet_manager.cc:1918] T f9f863a5dbec4eb88666a38442903b64 P 17c763cce26b4209ad4ee6633b014ccf: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260927 15:12:59.125519 28679 ts_tablet_manager.cc:1918] T f9f863a5dbec4eb88666a38442903b64 P a43c2c57d3404887ac836da246bdff48: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260927 15:12:59.125612 28681 log.cc:1196] T f9f863a5dbec4eb88666a38442903b64 P 17c763cce26b4209ad4ee6633b014ccf: Deleting WAL directory at /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790521920546562-17952-0/minicluster-data/ts-2/wal/wals/f9f863a5dbec4eb88666a38442903b64
I20260927 15:12:59.125713 28679 log.cc:1196] T f9f863a5dbec4eb88666a38442903b64 P a43c2c57d3404887ac836da246bdff48: Deleting WAL directory at /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790521920546562-17952-0/minicluster-data/ts-1/wal/wals/f9f863a5dbec4eb88666a38442903b64
I20260927 15:12:59.125910 28681 ts_tablet_manager.cc:1939] T f9f863a5dbec4eb88666a38442903b64 P 17c763cce26b4209ad4ee6633b014ccf: Deleting consensus metadata
I20260927 15:12:59.126109 28679 ts_tablet_manager.cc:1939] T f9f863a5dbec4eb88666a38442903b64 P a43c2c57d3404887ac836da246bdff48: Deleting consensus metadata
I20260927 15:12:59.127033 28165 catalog_manager.cc:4841] TS 17c763cce26b4209ad4ee6633b014ccf (127.17.136.3:37807): tablet f9f863a5dbec4eb88666a38442903b64 (table test-table [id=00782d2466ba4d94af1ee0b2f4950236]) successfully deleted
I20260927 15:12:59.127303 28166 catalog_manager.cc:4841] TS a43c2c57d3404887ac836da246bdff48 (127.17.136.2:38597): tablet f9f863a5dbec4eb88666a38442903b64 (table test-table [id=00782d2466ba4d94af1ee0b2f4950236]) successfully deleted
W20260927 15:12:59.129884 28165 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.17.136.1:43971 (error 108)
I20260927 15:12:59.130594 17952 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu with pid 28376
I20260927 15:12:59.130764 28654 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:12:59.130499 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.1:43971 (local address 127.0.0.1:35928)
0927 15:12:59.130625 (+ 126us) negotiation.cc:107] Waiting for socket to connect
0927 15:12:59.130688 (+ 63us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.136.1:43971: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":44}
W20260927 15:12:59.131629 28165 catalog_manager.cc:4584] TS 48290a1312ff4155b464c68a706bbeff (127.17.136.1:43971): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet f9f863a5dbec4eb88666a38442903b64: Network error: Client connection negotiation failed: client connection to 127.17.136.1:43971: connect: Connection refused (error 111)
I20260927 15:12:59.135869 17952 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu with pid 28510
I20260927 15:12:59.140280 17952 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu with pid 28148
2026-09-27T15:12:59Z chronyd exiting
[ OK ] SecurityITest.TestRequireAuthenticationSecureCluster (2119 ms)
[ RUN ] SecurityITest.TestEncryptionWithKMSIntegration
Loading random data
Initializing database '/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790521920546562-17952-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 27 15:12:59 dist-test-slave-5s2t krb5kdc[28685](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 27 15:12:59 dist-test-slave-5s2t krb5kdc[28685](info): set up 2 sockets
Sep 27 15:12:59 dist-test-slave-5s2t krb5kdc[28685](info): commencing operation
krb5kdc: starting...
W20260927 15:13:00.096129 17952 mini_kdc.cc:121] Time spent starting KDC: real 0.936s user 0.000s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790521920546562-17952-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790521920546562-17952-0/krb5kdc/test-user.keytab.
Sep 27 15:13:00 dist-test-slave-5s2t krb5kdc[28685](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790521980, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-27T15:13:00Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-27T15:13:00Z Disabled control of system clock
WARNING: no policy specified for rangeradmin/127.17.136.20@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangeradmin/127.17.136.20@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangeradmin/127.17.136.20@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790521920546562-17952-0/krb5kdc/rangeradmin_127.17.136.20@KRBTEST.COM.keytab.
Entry for principal rangeradmin/127.17.136.20@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790521920546562-17952-0/krb5kdc/rangeradmin_127.17.136.20@KRBTEST.COM.keytab.
WARNING: no policy specified for rangerlookup/127.17.136.20@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerlookup/127.17.136.20@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerlookup/127.17.136.20@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790521920546562-17952-0/krb5kdc/rangerlookup_127.17.136.20@KRBTEST.COM.keytab.
Entry for principal rangerlookup/127.17.136.20@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790521920546562-17952-0/krb5kdc/rangerlookup_127.17.136.20@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.17.136.20@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "HTTP/127.17.136.20@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.17.136.20@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790521920546562-17952-0/krb5kdc/HTTP_127.17.136.20@KRBTEST.COM.keytab.
Entry for principal HTTP/127.17.136.20@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790521920546562-17952-0/krb5kdc/HTTP_127.17.136.20@KRBTEST.COM.keytab.
I20260927 15:13:00.251575 17952 mini_postgres.cc:62] Running initdb...
The files belonging to this database system will be owned by user "slave".
This user must also own the server process.
The database cluster will be initialized with locale "C".
The default database encoding has accordingly been set to "SQL_ASCII".
The default text search configuration will be set to "english".
Data page checksums are disabled.
creating directory /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790521920546562-17952-0/minicluster-data/postgres ... ok
creating subdirectories ... ok
selecting dynamic shared memory implementation ... posix
selecting default max_connections ... 100
selecting default shared_buffers ... 128MB
selecting default time zone ... Etc/UTC
creating configuration files ... ok
running bootstrap script ... ok
performing post-bootstrap initialization ... ok
syncing data to disk ... ok
initdb: warning: enabling "trust" authentication for local connections
You can change this by editing pg_hba.conf or using the option -A, or
--auth-local and --auth-host, the next time you run initdb.
Success. You can now start the database server using:
/tmp/dist-test-taskiFOyeW/build/debug/bin/postgres/pg_ctl -D /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790521920546562-17952-0/minicluster-data/postgres -l logfile start
2026-09-27 15:13:02.572 UTC [28715] LOG: starting PostgreSQL 12.2 on x86_64-pc-linux-gnu, compiled by cc (GCC) 8.3.1 20190311 (Red Hat 8.3.1-3), 64-bit
2026-09-27 15:13:02.572 UTC [28715] LOG: listening on IPv4 address "127.17.136.20", port 59091
2026-09-27 15:13:02.575 UTC [28715] LOG: listening on Unix socket "/tmp/.s.PGSQL.59091"
2026-09-27 15:13:02.597 UTC [28718] LOG: database system was shut down at 2026-09-27 15:13:01 UTC
2026-09-27 15:13:02.600 UTC [28715] LOG: database system is ready to accept connections
I20260927 15:13:03.471720 17952 mini_postgres.cc:96] Postgres bound to 59091
2026-09-27 15:13:03.477 UTC [28726] FATAL: database "slave" does not exist
127.17.136.20:59091 - accepting connections
I20260927 15:13:03.477869 17952 mini_ranger.cc:161] Starting Ranger...
I20260927 15:13:03.491784 17952 mini_ranger.cc:84] Created miniranger Postgres user
I20260927 15:13:03.915911 17952 mini_ranger.cc:87] Created ranger Postgres database
I20260927 15:13:03.915999 17952 mini_ranger.cc:178] Starting Ranger out of /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790521920546562-17952-0/minicluster-data/ranger-admin
2026-09-27 15:13:04,197 [I] DB FLAVOR :POSTGRES
2026-09-27 15:13:04,197 [I] --------- Verifying Ranger DB connection ---------
2026-09-27 15:13:04,197 [I] Checking connection..
2026-09-27 15:13:04,197 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskiFOyeW/build/debug/bin/postgresql.jar:/tmp/dist-test-taskiFOyeW/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.17.136.20:59091/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select 1;"
2026-09-27 15:13:04,450 [I] Checking connection passed.
2026-09-27 15:13:04,450 [I] --------- Verifying version history table ---------
2026-09-27 15:13:04,451 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskiFOyeW/build/debug/bin/postgresql.jar:/tmp/dist-test-taskiFOyeW/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.17.136.20:59091/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-09-27 15:13:04,702 [I] Table x_db_version_h does not exist in database ranger
2026-09-27 15:13:04,702 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskiFOyeW/build/debug/bin/postgresql.jar:/tmp/dist-test-taskiFOyeW/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.17.136.20:59091/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-09-27 15:13:04,926 [I] Table x_db_version_h does not exist in database ranger
2026-09-27 15:13:04,926 [I] Importing x_db_version_h table schema to database ranger from file: create_dbversion_catalog.sql
2026-09-27 15:13:04,927 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskiFOyeW/build/debug/bin/postgresql.jar:/tmp/dist-test-taskiFOyeW/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.17.136.20:59091/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskiFOyeW/thirdparty/src/ranger-2.1.0-admin/db/postgres/create_dbversion_catalog.sql
2026-09-27 15:13:05.179 UTC [28790] WARNING: there is no transaction in progress
2026-09-27 15:13:05,185 [I] create_dbversion_catalog.sql file imported successfully
2026-09-27 15:13:05,185 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskiFOyeW/build/debug/bin/postgresql.jar:/tmp/dist-test-taskiFOyeW/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.17.136.20:59091/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-09-27 15:13:05,442 [I] Table x_db_version_h already exists in database 'ranger'
2026-09-27 15:13:05,443 [I] --------- Importing Ranger Core DB Schema ---------
2026-09-27 15:13:05,443 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskiFOyeW/build/debug/bin/postgresql.jar:/tmp/dist-test-taskiFOyeW/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.17.136.20:59091/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'Y';"
2026-09-27 15:13:05,687 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskiFOyeW/build/debug/bin/postgresql.jar:/tmp/dist-test-taskiFOyeW/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.17.136.20:59091/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'N';"
2026-09-27 15:13:05,926 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskiFOyeW/build/debug/bin/postgresql.jar:/tmp/dist-test-taskiFOyeW/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.17.136.20:59091/ranger -u miniranger -p '********' -noheader -trim -c \; -query "insert into x_db_version_h (version, inst_at, inst_by, updated_at, updated_by,active) values ('CORE_DB_SCHEMA', current_timestamp, 'Ranger 2.1.0', current_timestamp, 'dist-test-slave-5s2t.c.gcp-upstream.internal','N') ;"
2026-09-27 15:13:06,154 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskiFOyeW/build/debug/bin/postgresql.jar:/tmp/dist-test-taskiFOyeW/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.17.136.20:59091/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-09-27 15:13:06,406 [I] Table x_portal_user does not exist in database ranger
2026-09-27 15:13:06,407 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskiFOyeW/build/debug/bin/postgresql.jar:/tmp/dist-test-taskiFOyeW/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.17.136.20:59091/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-09-27 15:13:06,639 [I] Table x_policy_ref_group does not exist in database ranger
2026-09-27 15:13:06,639 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskiFOyeW/build/debug/bin/postgresql.jar:/tmp/dist-test-taskiFOyeW/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.17.136.20:59091/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-09-27 15:13:06,860 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskiFOyeW/build/debug/bin/postgresql.jar:/tmp/dist-test-taskiFOyeW/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.17.136.20:59091/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-09-27 15:13:07,105 [I] Importing DB schema to database ranger from file: ranger_core_db_postgres.sql
2026-09-27 15:13:07,105 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskiFOyeW/build/debug/bin/postgresql.jar:/tmp/dist-test-taskiFOyeW/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.17.136.20:59091/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskiFOyeW/thirdparty/src/ranger-2.1.0-admin/db/postgres/optimized/current/ranger_core_db_postgres.sql
2026-09-27 15:13:08.031 UTC [28898] WARNING: there is no transaction in progress
2026-09-27 15:13:08.048 UTC [28898] WARNING: there is no transaction in progress
2026-09-27 15:13:08.067 UTC [28898] WARNING: there is no transaction in progress
2026-09-27 15:13:08.083 UTC [28898] WARNING: there is no transaction in progress
2026-09-27 15:13:08.102 UTC [28898] WARNING: there is no transaction in progress
2026-09-27 15:13:08.118 UTC [28898] WARNING: there is no transaction in progress
2026-09-27 15:13:08.170 UTC [28898] WARNING: there is no transaction in progress
2026-09-27 15:13:08.176 UTC [28898] WARNING: there is no transaction in progress
2026-09-27 15:13:08.190 UTC [28898] WARNING: there is no transaction in progress
2026-09-27 15:13:08.200 UTC [28898] WARNING: there is no transaction in progress
2026-09-27 15:13:08.210 UTC [28898] WARNING: there is no transaction in progress
2026-09-27 15:13:08.223 UTC [28898] WARNING: there is no transaction in progress
2026-09-27 15:13:08.232 UTC [28898] WARNING: there is no transaction in progress
2026-09-27 15:13:08.238 UTC [28898] WARNING: there is no transaction in progress
2026-09-27 15:13:08.245 UTC [28898] WARNING: there is no transaction in progress
2026-09-27 15:13:08.251 UTC [28898] WARNING: there is no transaction in progress
2026-09-27 15:13:08,877 [I] ranger_core_db_postgres.sql file imported successfully
2026-09-27 15:13:08,877 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskiFOyeW/build/debug/bin/postgresql.jar:/tmp/dist-test-taskiFOyeW/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.17.136.20:59091/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set inst_by='Ranger 2.1.0' where active='Y' and updated_by='localhost';"
2026-09-27 15:13:09,124 [I] Patches status entries updated from base ranger version to current installed ranger version:Ranger 2.1.0
2026-09-27 15:13:09,125 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskiFOyeW/build/debug/bin/postgresql.jar:/tmp/dist-test-taskiFOyeW/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.17.136.20:59091/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-09-27 15:13:09,378 [I] Table x_portal_user already exists in database 'ranger'
2026-09-27 15:13:09,378 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskiFOyeW/build/debug/bin/postgresql.jar:/tmp/dist-test-taskiFOyeW/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.17.136.20:59091/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-09-27 15:13:09,616 [I] Table x_policy_ref_group already exists in database 'ranger'
2026-09-27 15:13:09,617 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskiFOyeW/build/debug/bin/postgresql.jar:/tmp/dist-test-taskiFOyeW/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.17.136.20:59091/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-09-27 15:13:09,865 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskiFOyeW/build/debug/bin/postgresql.jar:/tmp/dist-test-taskiFOyeW/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.17.136.20:59091/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-09-27 15:13:10,112 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskiFOyeW/build/debug/bin/postgresql.jar:/tmp/dist-test-taskiFOyeW/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.17.136.20:59091/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set active='Y' where version='CORE_DB_SCHEMA' and active='N' and updated_by='dist-test-slave-5s2t.c.gcp-upstream.internal';"
2026-09-27 15:13:10,354 [I] CORE_DB_SCHEMA import status has been updated
2026-09-27 15:13:10,355 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskiFOyeW/build/debug/bin/postgresql.jar:/tmp/dist-test-taskiFOyeW/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.17.136.20:59091/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and inst_by = 'Ranger 2.1.0' and active = 'Y';"
2026-09-27 15:13:10,606 [I] DB_PATCHES have already been applied
I20260927 15:13:10.611722 17952 mini_ranger.cc:191] Using Ranger class path: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790521920546562-17952-0/minicluster-data/ranger-admin:/tmp/dist-test-taskiFOyeW/thirdparty/src/ranger-2.1.0-admin/ews/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*:/tmp/dist-test-taskiFOyeW/thirdparty/src/hadoop-3.2.0/*:/tmp/dist-test-taskiFOyeW/build/debug/bin/postgresql.jar:/tmp/dist-test-taskiFOyeW/thirdparty/src/ranger-2.1.0-admin/ews/webapp
I20260927 15:13:10.611783 17952 mini_ranger.cc:193] Using host: 127.17.136.20
I20260927 15:13:10.614833 17952 mini_ranger.cc:227] Ranger admin URL: http://127.17.136.20:39577
Sep 27, 2026 3:13:10 PM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Sep 27, 2026 3:13:10 PM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Sep 27, 2026 3:13:11 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Deriving webapp folder from catalina.base property. folder=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790521920546562-17952-0/minicluster-data/ranger-admin/ews/webapp
Sep 27, 2026 3:13:11 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790521920546562-17952-0/minicluster-data/ranger-admin/ews/webapp, webAppName = /
Sep 27, 2026 3:13:11 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/] = path [/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790521920546562-17952-0/minicluster-data/ranger-admin/ews/webapp] .....
Sep 27, 2026 3:13:11 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/] = path [/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790521920546562-17952-0/minicluster-data/ranger-admin/ews/webapp].
Sep 27, 2026 3:13:11 PM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : miniranger
I20260927 15:13:11.594666 17952 mini_ranger.cc:160] Time spent starting Ranger: real 8.117s user 0.003s sys 0.006s
Sep 27, 2026 3:13:31 PM com.sun.jersey.api.core.PackagesResourceConfig init
INFO: Scanning for root resource and provider classes in the packages:
org.apache.ranger.rest
org.apache.ranger.common
xa.rest
Sep 27, 2026 3:13:31 PM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Root resource classes found:
class org.apache.ranger.rest.XAuditREST
class org.apache.ranger.rest.SecurityZoneREST
class org.apache.ranger.rest.PublicAPIsv2
class org.apache.ranger.rest.XKeyREST
class org.apache.ranger.rest.RoleREST
class org.apache.ranger.rest.ServiceREST
class org.apache.ranger.rest.AssetREST
class org.apache.ranger.rest.XUserREST
class org.apache.ranger.rest.TagREST
class org.apache.ranger.rest.MetricsREST
class org.apache.ranger.rest.PublicAPIs
class org.apache.ranger.rest.UserREST
Sep 27, 2026 3:13:31 PM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Provider classes found:
class org.apache.ranger.common.RangerJAXBContextResolver
Sep 27, 2026 3:13:31 PM com.sun.jersey.spi.spring.container.servlet.SpringServlet getContext
INFO: Using default applicationContext
Sep 27, 2026 3:13:31 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, assetREST, of type org.apache.ranger.rest.AssetREST as a root resource class
Sep 27, 2026 3:13:31 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, metricsREST, of type org.apache.ranger.rest.MetricsREST as a root resource class
Sep 27, 2026 3:13:31 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIs, of type org.apache.ranger.rest.PublicAPIs as a root resource class
Sep 27, 2026 3:13:31 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIsv2, of type org.apache.ranger.rest.PublicAPIsv2 as a root resource class
Sep 27, 2026 3:13:31 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, roleREST, of type org.apache.ranger.rest.RoleREST as a root resource class
Sep 27, 2026 3:13:31 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, securityZoneREST, of type org.apache.ranger.rest.SecurityZoneREST as a root resource class
Sep 27, 2026 3:13:31 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, serviceREST, of type org.apache.ranger.rest.ServiceREST as a root resource class
Sep 27, 2026 3:13:31 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, tagREST, of type org.apache.ranger.rest.TagREST as a root resource class
Sep 27, 2026 3:13:31 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, userREST, of type org.apache.ranger.rest.UserREST as a root resource class
Sep 27, 2026 3:13:31 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XAuditREST, of type org.apache.ranger.rest.XAuditREST as a root resource class
Sep 27, 2026 3:13:31 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XKeyREST, of type org.apache.ranger.rest.XKeyREST as a root resource class
Sep 27, 2026 3:13:31 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XUserREST, of type org.apache.ranger.rest.XUserREST as a root resource class
Sep 27, 2026 3:13:31 PM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.19.3 10/24/2016 03:58 PM'
Sep 27, 2026 3:13:31 PM com.sun.jersey.spi.inject.Errors processErrorMessages
WARNING: The following warnings have been detected with resource and/or provider classes:
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInExcel(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInJson(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse,java.lang.Boolean), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInCsv(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse) throws java.io.IOException, MUST return a non-void type.
I20260927 15:13:32.489615 17952 mini_ranger.cc:261] Created Kudu service
WARNING: no policy specified for rangerkms/127.17.136.20@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerkms/127.17.136.20@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerkms/127.17.136.20@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790521920546562-17952-0/krb5kdc/rangerkms_127.17.136.20@KRBTEST.COM.keytab.
Entry for principal rangerkms/127.17.136.20@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790521920546562-17952-0/krb5kdc/rangerkms_127.17.136.20@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.17.136.20@KRBTEST.COM; defaulting to no policy
add_principal: Principal or policy already exists while creating "HTTP/127.17.136.20@KRBTEST.COM".
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.17.136.20@KRBTEST.COM with kvno 3, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790521920546562-17952-0/krb5kdc/HTTP_127.17.136.20@KRBTEST.COM.keytab.
Entry for principal HTTP/127.17.136.20@KRBTEST.COM with kvno 3, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790521920546562-17952-0/krb5kdc/HTTP_127.17.136.20@KRBTEST.COM.keytab.
WARNING: no policy specified for keyadmin@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "keyadmin@KRBTEST.COM" created.
Sep 27 15:13:32 dist-test-slave-5s2t krb5kdc[28685](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790522012, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for keyadmin@KRBTEST.COM:
I20260927 15:13:32.571888 17952 mini_ranger_kms.cc:208] Starting Ranger KMS...
I20260927 15:13:32.580596 17952 mini_ranger_kms.cc:78] Created minirangerkms Postgres user
I20260927 15:13:33.380475 17952 mini_ranger_kms.cc:81] Created rangerkms Postgres database
I20260927 15:13:33.380564 17952 mini_ranger_kms.cc:226] Starting Ranger KMS out of /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790521920546562-17952-0/minicluster-data/ranger-kms
I20260927 15:13:33.380656 17952 mini_ranger_kms.cc:227] Using postgres at 127.17.136.20:59091
2026-09-27 15:13:33,537 [I] DB FLAVOR :POSTGRES
2026-09-27 15:13:33,538 [I] --------- Verifying Ranger DB connection ---------
2026-09-27 15:13:33,538 [I] Checking connection
2026-09-27 15:13:33,538 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskiFOyeW/build/debug/bin/postgresql.jar:/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790521920546562-17952-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.17.136.20:59091/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "SELECT 1;"
2026-09-27 15:13:33,754 [I] connection success
2026-09-27 15:13:33,754 [I] --------- Verifying Ranger DB tables ---------
2026-09-27 15:13:33,754 [I] Verifying table ranger_masterkey in database rangerkms
2026-09-27 15:13:33,755 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskiFOyeW/build/debug/bin/postgresql.jar:/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790521920546562-17952-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.17.136.20:59091/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='rangerkms' and table_name = 'ranger_masterkey') as temp;"
2026-09-27 15:13:33,977 [I] Table ranger_masterkey does not exist in database rangerkms
2026-09-27 15:13:33,977 [I] --------- Importing Ranger Core DB Schema ---------
2026-09-27 15:13:33,977 [I] Importing db schema to database rangerkms from file: kms_core_db_postgres.sql
2026-09-27 15:13:33,977 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskiFOyeW/build/debug/bin/postgresql.jar:/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790521920546562-17952-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.17.136.20:59091/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790521920546562-17952-0/minicluster-data/ranger-kms/db/postgres/kms_core_db_postgres.sql
2026-09-27 15:13:34,218 [I] kms_core_db_postgres.sql DB schema imported successfully
I20260927 15:13:34.647706 17952 mini_ranger_kms.cc:310] Created kms service
I20260927 15:13:34.811935 17952 mini_ranger_kms.cc:326] Created kudu user
I20260927 15:13:34.850507 17952 mini_ranger_kms.cc:343] Created rangerkms user
Sep 27 15:13:34 dist-test-slave-5s2t krb5kdc[28685](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790522012, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for HTTP/127.17.136.20@KRBTEST.COM
I20260927 15:13:35.198912 17952 mini_ranger_kms.cc:384] Added ranger policy
I20260927 15:13:35.199113 17952 mini_ranger_kms.cc:238] Using RangerKMS classpath: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790521920546562-17952-0/minicluster-data/ranger-kms:/tmp/dist-test-taskiFOyeW/build/debug/bin/postgresql.jar:/tmp/dist-test-taskiFOyeW/thirdparty/src/ranger-2.1.0-kms/ews/webapp/WEB-INF/classes/lib/*:/tmp/dist-test-taskiFOyeW/thirdparty/src/ranger-2.1.0-kms/ews/webapp/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*
I20260927 15:13:35.199144 17952 mini_ranger_kms.cc:240] Using host: 127.17.136.20
I20260927 15:13:35.202469 17952 mini_ranger_kms.cc:276] Ranger KMS PID: 29078
I20260927 15:13:35.202600 17952 mini_ranger_kms.cc:277] Ranger KMS URL: http://127.17.136.20:59159
Sep 27, 2026 3:13:36 PM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Sep 27, 2026 3:13:36 PM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Sep 27, 2026 3:13:36 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790521920546562-17952-0/minicluster-data/ranger-kms/ews/webapp, webAppName = /kms
Sep 27, 2026 3:13:36 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/kms] = path [/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790521920546562-17952-0/minicluster-data/ranger-kms/ews/webapp] .....
Sep 27, 2026 3:13:36 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/kms] = path [/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790521920546562-17952-0/minicluster-data/ranger-kms/ews/webapp].
Sep 27, 2026 3:13:36 PM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : minirangerkms
I20260927 15:13:37.182938 17952 mini_ranger_kms.cc:207] Time spent starting Ranger KMS: real 4.611s user 0.015s sys 0.127s
I20260927 15:13:37.183068 17952 mini_ranger_kms.cc:397] {"name":"kuduclusterkey","cipher":"AES/CTR/NoPadding","length":128,"description":"kuduclusterkey"}
I20260927 15:13:37.183176 17952 mini_ranger_kms.cc:401] 127.17.136.20:59159/kms/v1/keys
Sep 27 15:13:37 dist-test-slave-5s2t krb5kdc[28685](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1790522017, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.17.136.20@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Sep 27 15:13:37 dist-test-slave-5s2t krb5kdc[28685](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790522017, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.17.136.20@KRBTEST.COM for HTTP/127.17.136.20@KRBTEST.COM
Sep 27 15:13:38 dist-test-slave-5s2t krb5kdc[28685](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790522017, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.17.136.20@KRBTEST.COM for HTTP/127.17.136.20@KRBTEST.COM
Sep 27 15:13:40 dist-test-slave-5s2t krb5kdc[28685](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790522020, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
WARNING: no policy specified for kudu/127.17.136.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.136.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.136.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790521920546562-17952-0/krb5kdc/kudu_127.17.136.62.keytab.
Entry for principal kudu/127.17.136.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790521920546562-17952-0/krb5kdc/kudu_127.17.136.62.keytab.
I20260927 15:13:40.178648 17952 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu
/tmp/dist-test-taskiFOyeW/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790521920546562-17952-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790521920546562-17952-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790521920546562-17952-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790521920546562-17952-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.136.62:36691
--webserver_interface=127.17.136.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790521920546562-17952-0/krb5kdc/kudu_127.17.136.62.keytab
--principal=kudu/127.17.136.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.136.20:32879
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.136.62:36691
--ranger_config_path=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790521920546562-17952-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.17.136.20:59159/kms
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790521920546562-17952-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790521920546562-17952-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790521920546562-17952-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260927 15:13:40.331463 29129 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260927 15:13:40.331844 29129 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260927 15:13:40.331918 29129 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260927 15:13:40.337911 29129 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260927 15:13:40.337989 29129 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260927 15:13:40.338024 29129 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260927 15:13:40.338052 29129 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260927 15:13:40.338078 29129 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260927 15:13:40.346035 29129 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.136.20:32879
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790521920546562-17952-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790521920546562-17952-0/minicluster-data/master-0/wal
--ranger_kms_url=127.17.136.20:59159/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.17.136.62:36691
--ranger_config_path=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790521920546562-17952-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790521920546562-17952-0/krb5kdc/kudu_127.17.136.62.keytab
--principal=kudu/127.17.136.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.136.62:36691
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790521920546562-17952-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.17.136.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29129
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790521920546562-17952-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 27 Sep 2026 14:27:13 UTC on ccycloud.quasar-psqrth.root.comops.site
build id 4676138
I20260927 15:13:40.347352 29129 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260927 15:13:40.348609 29129 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260927 15:13:40.357864 29134 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260927 15:13:40.357910 29137 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260927 15:13:40.358024 29129 server_base.cc:1034] running on GCE node
W20260927 15:13:40.358225 29135 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260927 15:13:40.358771 29129 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260927 15:13:40.359892 29129 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260927 15:13:40.361037 29129 hybrid_clock.cc:648] HybridClock initialized: now 1790522020361018 us; error 34 us; skew 500 ppm
Sep 27 15:13:40 dist-test-slave-5s2t krb5kdc[28685](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790522020, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.136.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260927 15:13:40.363514 29129 init.cc:377] Logged in from keytab as kudu/127.17.136.62@KRBTEST.COM (short username kudu)
I20260927 15:13:40.364326 29129 webserver.cc:460] Webserver started at http://127.17.136.62:41827/ using document root <none> and password file <none>
I20260927 15:13:40.364826 29129 fs_manager.cc:359] Metadata directory not provided
I20260927 15:13:40.364879 29129 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260927 15:13:40.365057 29129 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Sep 27 15:13:40 dist-test-slave-5s2t krb5kdc[28685](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790522020, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.136.62@KRBTEST.COM for HTTP/127.17.136.20@KRBTEST.COM
I20260927 15:13:40.419935 29129 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790521920546562-17952-0/minicluster-data/master-0/data/instance:
uuid: "07f547c67a2c491b92fbe3c1efe526e9"
format_stamp: "Formatted at 2026-09-27 15:13:40 on dist-test-slave-5s2t"
server_key: "4b8d33b719d78b4926371e7e9f4463ce"
server_key_iv: "e9bff5d072e69f301c6a6f2ecebb887d"
server_key_version: "kuduclusterkey@0"
I20260927 15:13:40.420480 29129 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790521920546562-17952-0/minicluster-data/master-0/wal/instance:
uuid: "07f547c67a2c491b92fbe3c1efe526e9"
format_stamp: "Formatted at 2026-09-27 15:13:40 on dist-test-slave-5s2t"
server_key: "4b8d33b719d78b4926371e7e9f4463ce"
server_key_iv: "e9bff5d072e69f301c6a6f2ecebb887d"
server_key_version: "kuduclusterkey@0"
I20260927 15:13:40.424219 29129 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.001s
I20260927 15:13:40.441787 29144 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260927 15:13:40.443593 29129 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260927 15:13:40.443749 29129 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790521920546562-17952-0/minicluster-data/master-0/data,/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790521920546562-17952-0/minicluster-data/master-0/wal
uuid: "07f547c67a2c491b92fbe3c1efe526e9"
format_stamp: "Formatted at 2026-09-27 15:13:40 on dist-test-slave-5s2t"
server_key: "4b8d33b719d78b4926371e7e9f4463ce"
server_key_iv: "e9bff5d072e69f301c6a6f2ecebb887d"
server_key_version: "kuduclusterkey@0"
I20260927 15:13:40.443898 29129 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790521920546562-17952-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790521920546562-17952-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790521920546562-17952-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260927 15:13:40.464821 29129 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260927 15:13:40.467818 29129 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260927 15:13:40.468000 29129 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260927 15:13:40.476011 29129 rpc_server.cc:307] RPC server started. Bound to: 127.17.136.62:36691
I20260927 15:13:40.476038 29196 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.136.62:36691 every 8 connection(s)
I20260927 15:13:40.477164 29129 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790521920546562-17952-0/minicluster-data/master-0/data/info.pb
I20260927 15:13:40.479813 29197 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:13:40.485128 29197 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 07f547c67a2c491b92fbe3c1efe526e9: Bootstrap starting.
I20260927 15:13:40.486065 17952 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu as pid 29129
I20260927 15:13:40.486179 17952 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790521920546562-17952-0/minicluster-data/master-0/wal/instance
I20260927 15:13:40.486440 17952 external_mini_cluster.cc:1428] Setting key 61a7199d33fda1630c1d3454b56e49e4
I20260927 15:13:40.487665 29197 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 07f547c67a2c491b92fbe3c1efe526e9: Neither blocks nor log segments found. Creating new log.
I20260927 15:13:40.488374 29197 log.cc:824] T 00000000000000000000000000000000 P 07f547c67a2c491b92fbe3c1efe526e9: Log is configured to *not* fsync() on all Append() calls
I20260927 15:13:40.490303 29197 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 07f547c67a2c491b92fbe3c1efe526e9: No bootstrap required, opened a new log
I20260927 15:13:40.494374 29197 raft_consensus.cc:348] T 00000000000000000000000000000000 P 07f547c67a2c491b92fbe3c1efe526e9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "07f547c67a2c491b92fbe3c1efe526e9" member_type: VOTER last_known_addr { host: "127.17.136.62" port: 36691 } }
I20260927 15:13:40.494585 29197 raft_consensus.cc:374] T 00000000000000000000000000000000 P 07f547c67a2c491b92fbe3c1efe526e9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
Sep 27 15:13:40 dist-test-slave-5s2t krb5kdc[28685](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790522020, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.136.62@KRBTEST.COM
I20260927 15:13:40.494637 29197 raft_consensus.cc:729] T 00000000000000000000000000000000 P 07f547c67a2c491b92fbe3c1efe526e9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 07f547c67a2c491b92fbe3c1efe526e9, State: Initialized, Role: FOLLOWER
I20260927 15:13:40.495106 29197 consensus_queue.cc:260] T 00000000000000000000000000000000 P 07f547c67a2c491b92fbe3c1efe526e9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "07f547c67a2c491b92fbe3c1efe526e9" member_type: VOTER last_known_addr { host: "127.17.136.62" port: 36691 } }
I20260927 15:13:40.495278 29197 raft_consensus.cc:388] T 00000000000000000000000000000000 P 07f547c67a2c491b92fbe3c1efe526e9 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260927 15:13:40.495347 29197 raft_consensus.cc:482] T 00000000000000000000000000000000 P 07f547c67a2c491b92fbe3c1efe526e9 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260927 15:13:40.495437 29197 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 07f547c67a2c491b92fbe3c1efe526e9 [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:13:40.496204 29197 raft_consensus.cc:504] T 00000000000000000000000000000000 P 07f547c67a2c491b92fbe3c1efe526e9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "07f547c67a2c491b92fbe3c1efe526e9" member_type: VOTER last_known_addr { host: "127.17.136.62" port: 36691 } }
I20260927 15:13:40.496507 29197 leader_election.cc:302] T 00000000000000000000000000000000 P 07f547c67a2c491b92fbe3c1efe526e9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 07f547c67a2c491b92fbe3c1efe526e9; no voters:
I20260927 15:13:40.496788 29197 leader_election.cc:288] T 00000000000000000000000000000000 P 07f547c67a2c491b92fbe3c1efe526e9 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260927 15:13:40.496886 29202 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 07f547c67a2c491b92fbe3c1efe526e9 [term 1 FOLLOWER]: Leader election won for term 1
I20260927 15:13:40.497123 29202 raft_consensus.cc:686] T 00000000000000000000000000000000 P 07f547c67a2c491b92fbe3c1efe526e9 [term 1 LEADER]: Becoming Leader. State: Replica: 07f547c67a2c491b92fbe3c1efe526e9, State: Running, Role: LEADER
I20260927 15:13:40.497467 29202 consensus_queue.cc:237] T 00000000000000000000000000000000 P 07f547c67a2c491b92fbe3c1efe526e9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "07f547c67a2c491b92fbe3c1efe526e9" member_type: VOTER last_known_addr { host: "127.17.136.62" port: 36691 } }
I20260927 15:13:40.497970 29197 sys_catalog.cc:564] T 00000000000000000000000000000000 P 07f547c67a2c491b92fbe3c1efe526e9 [sys.catalog]: configured and running, proceeding with master startup.
I20260927 15:13:40.499125 29204 sys_catalog.cc:455] T 00000000000000000000000000000000 P 07f547c67a2c491b92fbe3c1efe526e9 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "07f547c67a2c491b92fbe3c1efe526e9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "07f547c67a2c491b92fbe3c1efe526e9" member_type: VOTER last_known_addr { host: "127.17.136.62" port: 36691 } } }
I20260927 15:13:40.499128 29203 sys_catalog.cc:455] T 00000000000000000000000000000000 P 07f547c67a2c491b92fbe3c1efe526e9 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 07f547c67a2c491b92fbe3c1efe526e9. Latest consensus state: current_term: 1 leader_uuid: "07f547c67a2c491b92fbe3c1efe526e9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "07f547c67a2c491b92fbe3c1efe526e9" member_type: VOTER last_known_addr { host: "127.17.136.62" port: 36691 } } }
I20260927 15:13:40.499276 29204 sys_catalog.cc:458] T 00000000000000000000000000000000 P 07f547c67a2c491b92fbe3c1efe526e9 [sys.catalog]: This master's current role is: LEADER
I20260927 15:13:40.499277 29203 sys_catalog.cc:458] T 00000000000000000000000000000000 P 07f547c67a2c491b92fbe3c1efe526e9 [sys.catalog]: This master's current role is: LEADER
I20260927 15:13:40.499691 29213 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260927 15:13:40.499993 29197 ranger_client.cc:318] Using new properties file: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790521920546562-17952-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260927 15:13:40.500137 29200 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:13:40.487468 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46874 (local address 127.17.136.62:36691)
0927 15:13:40.487875 (+ 407us) server_negotiation.cc:206] Beginning negotiation
0927 15:13:40.487891 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0927 15:13:40.487925 (+ 34us) server_negotiation.cc:407] Connection header received
0927 15:13:40.488538 (+ 613us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:13:40.488558 (+ 20us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:13:40.488881 (+ 323us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:13:40.489142 (+ 261us) server_negotiation.cc:226] Negotiated authn=SASL
0927 15:13:40.489932 (+ 790us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:13:40.490899 (+ 967us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:13:40.492080 (+ 1181us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:13:40.492530 (+ 450us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:13:40.492638 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:13:40.495234 (+ 2596us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0927 15:13:40.495239 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0927 15:13:40.495274 (+ 35us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0927 15:13:40.495303 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0927 15:13:40.496858 (+ 1555us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:13:40.497308 (+ 450us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:13:40.497313 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:13:40.497319 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:13:40.497439 (+ 120us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:13:40.497702 (+ 263us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:13:40.497705 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:13:40.497707 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:13:40.498169 (+ 462us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0927 15:13:40.498353 (+ 184us) server_negotiation.cc:1035] Waiting for connection context
0927 15:13:40.498930 (+ 577us) server_negotiation.cc:299] Negotiation successful
0927 15:13:40.499192 (+ 262us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":285,"thread_start_us":111,"threads_started":1}
I20260927 15:13:40.506397 29213 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260927 15:13:40.512594 29213 catalog_manager.cc:1347] Generated new cluster ID: d65d415cb4f64ec79d1267d3d3598c49
I20260927 15:13:40.512651 29213 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260927 15:13:40.525841 29213 catalog_manager.cc:1370] Generated new certificate authority record
I20260927 15:13:40.527312 29213 catalog_manager.cc:1504] Loading token signing keys...
I20260927 15:13:40.535590 29213 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 07f547c67a2c491b92fbe3c1efe526e9: Generated new TSK 0
I20260927 15:13:40.536415 29213 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.17.136.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.136.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.136.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790521920546562-17952-0/krb5kdc/kudu_127.17.136.1.keytab.
Entry for principal kudu/127.17.136.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790521920546562-17952-0/krb5kdc/kudu_127.17.136.1.keytab.
I20260927 15:13:41.174203 17952 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu
/tmp/dist-test-taskiFOyeW/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790521920546562-17952-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790521920546562-17952-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790521920546562-17952-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790521920546562-17952-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.17.136.20:59159/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.136.1:0
--local_ip_for_outbound_sockets=127.17.136.1
--webserver_interface=127.17.136.1
--webserver_port=0
--tserver_master_addrs=127.17.136.62:36691
--keytab_file=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790521920546562-17952-0/krb5kdc/kudu_127.17.136.1.keytab
--principal=kudu/127.17.136.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.136.20:32879
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790521920546562-17952-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790521920546562-17952-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790521920546562-17952-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260927 15:13:41.329478 29242 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260927 15:13:41.329854 29242 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260927 15:13:41.329921 29242 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260927 15:13:41.335546 29242 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260927 15:13:41.335668 29242 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260927 15:13:41.335788 29242 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.136.1
I20260927 15:13:41.343446 29242 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.136.20:32879
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790521920546562-17952-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790521920546562-17952-0/minicluster-data/ts-0/wal
--ranger_kms_url=127.17.136.20:59159/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790521920546562-17952-0/krb5kdc/kudu_127.17.136.1.keytab
--principal=kudu/127.17.136.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.136.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790521920546562-17952-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.17.136.1
--webserver_port=0
--tserver_master_addrs=127.17.136.62:36691
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29242
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.136.1
--log_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790521920546562-17952-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 27 Sep 2026 14:27:13 UTC on ccycloud.quasar-psqrth.root.comops.site
build id 4676138
I20260927 15:13:41.344820 29242 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260927 15:13:41.346141 29242 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260927 15:13:41.357057 29250 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260927 15:13:41.357335 29249 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260927 15:13:41.357053 29252 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260927 15:13:41.359421 29242 server_base.cc:1034] running on GCE node
I20260927 15:13:41.359898 29242 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260927 15:13:41.360713 29242 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260927 15:13:41.361908 29242 hybrid_clock.cc:648] HybridClock initialized: now 1790522021361875 us; error 41 us; skew 500 ppm
Sep 27 15:13:41 dist-test-slave-5s2t krb5kdc[28685](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790522021, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.136.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260927 15:13:41.365549 29242 init.cc:377] Logged in from keytab as kudu/127.17.136.1@KRBTEST.COM (short username kudu)
I20260927 15:13:41.366626 29242 webserver.cc:460] Webserver started at http://127.17.136.1:45815/ using document root <none> and password file <none>
I20260927 15:13:41.367345 29242 fs_manager.cc:359] Metadata directory not provided
I20260927 15:13:41.367431 29242 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260927 15:13:41.367707 29242 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Sep 27 15:13:41 dist-test-slave-5s2t krb5kdc[28685](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790522021, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.136.1@KRBTEST.COM for HTTP/127.17.136.20@KRBTEST.COM
I20260927 15:13:41.383525 29242 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790521920546562-17952-0/minicluster-data/ts-0/data/instance:
uuid: "a931734de6b448368b961a91d667fb82"
format_stamp: "Formatted at 2026-09-27 15:13:41 on dist-test-slave-5s2t"
server_key: "47ffc849e1030295763cfb40d6f67a4b"
server_key_iv: "eb2dd24dff3ebc0810c233ebc56480f5"
server_key_version: "kuduclusterkey@0"
I20260927 15:13:41.384335 29242 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790521920546562-17952-0/minicluster-data/ts-0/wal/instance:
uuid: "a931734de6b448368b961a91d667fb82"
format_stamp: "Formatted at 2026-09-27 15:13:41 on dist-test-slave-5s2t"
server_key: "47ffc849e1030295763cfb40d6f67a4b"
server_key_iv: "eb2dd24dff3ebc0810c233ebc56480f5"
server_key_version: "kuduclusterkey@0"
I20260927 15:13:41.389096 29242 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260927 15:13:41.421661 29259 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260927 15:13:41.423475 29242 fs_manager.cc:725] Time spent opening block manager: real 0.010s user 0.002s sys 0.001s
I20260927 15:13:41.423604 29242 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790521920546562-17952-0/minicluster-data/ts-0/data,/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790521920546562-17952-0/minicluster-data/ts-0/wal
uuid: "a931734de6b448368b961a91d667fb82"
format_stamp: "Formatted at 2026-09-27 15:13:41 on dist-test-slave-5s2t"
server_key: "47ffc849e1030295763cfb40d6f67a4b"
server_key_iv: "eb2dd24dff3ebc0810c233ebc56480f5"
server_key_version: "kuduclusterkey@0"
I20260927 15:13:41.423734 29242 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790521920546562-17952-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790521920546562-17952-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790521920546562-17952-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260927 15:13:41.443972 29242 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260927 15:13:41.447656 29242 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260927 15:13:41.447937 29242 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260927 15:13:41.448762 29242 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260927 15:13:41.450007 29242 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260927 15:13:41.450109 29242 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260927 15:13:41.450227 29242 ts_tablet_manager.cc:610] Registered 0 tablets
I20260927 15:13:41.450305 29242 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260927 15:13:41.460429 29242 rpc_server.cc:307] RPC server started. Bound to: 127.17.136.1:45559
I20260927 15:13:41.461602 29242 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790521920546562-17952-0/minicluster-data/ts-0/data/info.pb
I20260927 15:13:41.461954 17952 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu as pid 29242
I20260927 15:13:41.462076 17952 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790521920546562-17952-0/minicluster-data/ts-0/wal/instance
I20260927 15:13:41.462339 17952 external_mini_cluster.cc:1428] Setting key 6dd5e263cb2928bf5c16d16afcdc5061
I20260927 15:13:41.465596 29374 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.136.1:45559 every 8 connection(s)
Sep 27 15:13:41 dist-test-slave-5s2t krb5kdc[28685](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790522021, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.136.1@KRBTEST.COM for kudu/127.17.136.62@KRBTEST.COM
WARNING: no policy specified for kudu/127.17.136.2@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.136.2@KRBTEST.COM" created.
I20260927 15:13:41.488235 29379 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:13:41.467396 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.136.1:38497 (local address 127.17.136.62:36691)
0927 15:13:41.467715 (+ 319us) server_negotiation.cc:206] Beginning negotiation
0927 15:13:41.467723 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0927 15:13:41.468160 (+ 437us) server_negotiation.cc:407] Connection header received
0927 15:13:41.469298 (+ 1138us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:13:41.469301 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:13:41.469359 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:13:41.469450 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0927 15:13:41.470920 (+ 1470us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:13:41.471724 (+ 804us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:13:41.473458 (+ 1734us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:13:41.473811 (+ 353us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:13:41.473917 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:13:41.483781 (+ 9864us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0927 15:13:41.483785 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0927 15:13:41.483788 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0927 15:13:41.483819 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0927 15:13:41.485836 (+ 2017us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:13:41.486426 (+ 590us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:13:41.486429 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:13:41.486432 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:13:41.486516 (+ 84us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:13:41.486917 (+ 401us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:13:41.486921 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:13:41.486923 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:13:41.487155 (+ 232us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0927 15:13:41.487226 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0927 15:13:41.487924 (+ 698us) server_negotiation.cc:299] Negotiation successful
0927 15:13:41.488058 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":239,"thread_start_us":87,"threads_started":1}
I20260927 15:13:41.490065 29378 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:13:41.467121 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.62:36691 (local address 127.17.136.1:38497)
0927 15:13:41.467988 (+ 867us) negotiation.cc:107] Waiting for socket to connect
0927 15:13:41.468045 (+ 57us) client_negotiation.cc:174] Beginning negotiation
0927 15:13:41.469048 (+ 1003us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0927 15:13:41.469754 (+ 706us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0927 15:13:41.469763 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0927 15:13:41.470107 (+ 344us) client_negotiation.cc:189] Negotiated authn=SASL
0927 15:13:41.470744 (+ 637us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:13:41.470779 (+ 35us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:13:41.471861 (+ 1082us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:13:41.471864 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:13:41.473328 (+ 1464us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:13:41.473339 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:13:41.473970 (+ 631us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:13:41.473975 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:13:41.474162 (+ 187us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:13:41.474818 (+ 656us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0927 15:13:41.474838 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0927 15:13:41.481650 (+ 6812us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0927 15:13:41.485975 (+ 4325us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0927 15:13:41.485981 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0927 15:13:41.485998 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0927 15:13:41.486316 (+ 318us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0927 15:13:41.486618 (+ 302us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0927 15:13:41.486621 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0927 15:13:41.486623 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0927 15:13:41.486807 (+ 184us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0927 15:13:41.487324 (+ 517us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0927 15:13:41.487330 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0927 15:13:41.487634 (+ 304us) client_negotiation.cc:769] Sending connection context
0927 15:13:41.488683 (+ 1049us) client_negotiation.cc:240] Negotiation successful
0927 15:13:41.489034 (+ 351us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":637,"thread_start_us":142,"threads_started":1}
I20260927 15:13:41.491402 29375 heartbeater.cc:347] Connected to a master server at 127.17.136.62:36691
I20260927 15:13:41.491632 29375 heartbeater.cc:464] Registering TS with master...
I20260927 15:13:41.492154 29375 heartbeater.cc:511] Master 127.17.136.62:36691 requested a full tablet report, sending...
I20260927 15:13:41.493793 29161 ts_manager.cc:194] Registered new tserver with Master: a931734de6b448368b961a91d667fb82 (127.17.136.1:45559)
I20260927 15:13:41.495332 29161 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.136.1@KRBTEST.COM'} at 127.17.136.1:38497
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.136.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790521920546562-17952-0/krb5kdc/kudu_127.17.136.2.keytab.
Entry for principal kudu/127.17.136.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790521920546562-17952-0/krb5kdc/kudu_127.17.136.2.keytab.
I20260927 15:13:41.506817 17952 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu
/tmp/dist-test-taskiFOyeW/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790521920546562-17952-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790521920546562-17952-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790521920546562-17952-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790521920546562-17952-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.17.136.20:59159/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.136.2:0
--local_ip_for_outbound_sockets=127.17.136.2
--webserver_interface=127.17.136.2
--webserver_port=0
--tserver_master_addrs=127.17.136.62:36691
--keytab_file=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790521920546562-17952-0/krb5kdc/kudu_127.17.136.2.keytab
--principal=kudu/127.17.136.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.136.20:32879
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790521920546562-17952-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790521920546562-17952-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790521920546562-17952-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Sep 27 15:13:41 dist-test-slave-5s2t krb5kdc[28685](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1790522021, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.136.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
W20260927 15:13:41.653882 29381 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260927 15:13:41.654310 29381 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260927 15:13:41.654425 29381 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260927 15:13:41.660470 29381 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260927 15:13:41.660600 29381 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260927 15:13:41.660743 29381 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.136.2
I20260927 15:13:41.668442 29381 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.136.20:32879
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790521920546562-17952-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790521920546562-17952-0/minicluster-data/ts-1/wal
--ranger_kms_url=127.17.136.20:59159/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790521920546562-17952-0/krb5kdc/kudu_127.17.136.2.keytab
--principal=kudu/127.17.136.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.136.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790521920546562-17952-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.17.136.2
--webserver_port=0
--tserver_master_addrs=127.17.136.62:36691
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29381
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.136.2
--log_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790521920546562-17952-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 27 Sep 2026 14:27:13 UTC on ccycloud.quasar-psqrth.root.comops.site
build id 4676138
I20260927 15:13:41.669786 29381 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260927 15:13:41.671126 29381 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260927 15:13:41.683148 29390 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260927 15:13:41.683173 29387 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260927 15:13:41.683382 29388 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260927 15:13:41.684254 29381 server_base.cc:1034] running on GCE node
I20260927 15:13:41.684757 29381 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260927 15:13:41.685511 29381 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260927 15:13:41.686800 29381 hybrid_clock.cc:648] HybridClock initialized: now 1790522021686773 us; error 40 us; skew 500 ppm
Sep 27 15:13:41 dist-test-slave-5s2t krb5kdc[28685](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790522021, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.136.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260927 15:13:41.690308 29381 init.cc:377] Logged in from keytab as kudu/127.17.136.2@KRBTEST.COM (short username kudu)
I20260927 15:13:41.691428 29381 webserver.cc:460] Webserver started at http://127.17.136.2:45659/ using document root <none> and password file <none>
I20260927 15:13:41.692132 29381 fs_manager.cc:359] Metadata directory not provided
I20260927 15:13:41.692211 29381 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260927 15:13:41.692418 29381 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Sep 27 15:13:41 dist-test-slave-5s2t krb5kdc[28685](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790522021, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.136.2@KRBTEST.COM for HTTP/127.17.136.20@KRBTEST.COM
I20260927 15:13:41.723330 29381 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790521920546562-17952-0/minicluster-data/ts-1/data/instance:
uuid: "e3441e51427749d594fa636d0e8d850b"
format_stamp: "Formatted at 2026-09-27 15:13:41 on dist-test-slave-5s2t"
server_key: "fd83c8e3ab2a44f06a99c0ee1ca7305e"
server_key_iv: "626483acece38261ddbd5fb5aff52247"
server_key_version: "kuduclusterkey@0"
I20260927 15:13:41.724157 29381 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790521920546562-17952-0/minicluster-data/ts-1/wal/instance:
uuid: "e3441e51427749d594fa636d0e8d850b"
format_stamp: "Formatted at 2026-09-27 15:13:41 on dist-test-slave-5s2t"
server_key: "fd83c8e3ab2a44f06a99c0ee1ca7305e"
server_key_iv: "626483acece38261ddbd5fb5aff52247"
server_key_version: "kuduclusterkey@0"
I20260927 15:13:41.729369 29381 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260927 15:13:41.749580 29397 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260927 15:13:41.751096 29381 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260927 15:13:41.751221 29381 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790521920546562-17952-0/minicluster-data/ts-1/data,/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790521920546562-17952-0/minicluster-data/ts-1/wal
uuid: "e3441e51427749d594fa636d0e8d850b"
format_stamp: "Formatted at 2026-09-27 15:13:41 on dist-test-slave-5s2t"
server_key: "fd83c8e3ab2a44f06a99c0ee1ca7305e"
server_key_iv: "626483acece38261ddbd5fb5aff52247"
server_key_version: "kuduclusterkey@0"
I20260927 15:13:41.751389 29381 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790521920546562-17952-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790521920546562-17952-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790521920546562-17952-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260927 15:13:41.793246 29381 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260927 15:13:41.797178 29381 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260927 15:13:41.797463 29381 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260927 15:13:41.798368 29381 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260927 15:13:41.799649 29381 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260927 15:13:41.799773 29381 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260927 15:13:41.799885 29381 ts_tablet_manager.cc:610] Registered 0 tablets
I20260927 15:13:41.799955 29381 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260927 15:13:41.811441 29381 rpc_server.cc:307] RPC server started. Bound to: 127.17.136.2:37765
I20260927 15:13:41.812733 29381 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790521920546562-17952-0/minicluster-data/ts-1/data/info.pb
I20260927 15:13:41.818248 17952 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu as pid 29381
I20260927 15:13:41.818385 17952 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790521920546562-17952-0/minicluster-data/ts-1/wal/instance
I20260927 15:13:41.818753 17952 external_mini_cluster.cc:1428] Setting key d7a9e2c981006eda40b3eac4368d1a74
I20260927 15:13:41.826494 29510 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.136.2:37765 every 8 connection(s)
Sep 27 15:13:41 dist-test-slave-5s2t krb5kdc[28685](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790522021, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.136.2@KRBTEST.COM for kudu/127.17.136.62@KRBTEST.COM
WARNING: no policy specified for kudu/127.17.136.3@KRBTEST.COM; defaulting to no policy
I20260927 15:13:41.848121 29379 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:13:41.826275 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.136.2:35681 (local address 127.17.136.62:36691)
0927 15:13:41.826426 (+ 151us) server_negotiation.cc:206] Beginning negotiation
0927 15:13:41.826431 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0927 15:13:41.829231 (+ 2800us) server_negotiation.cc:407] Connection header received
0927 15:13:41.830711 (+ 1480us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:13:41.830716 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:13:41.830776 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:13:41.830838 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0927 15:13:41.832632 (+ 1794us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:13:41.833426 (+ 794us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:13:41.835175 (+ 1749us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:13:41.835572 (+ 397us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:13:41.835659 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:13:41.838908 (+ 3249us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0927 15:13:41.838913 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0927 15:13:41.838916 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0927 15:13:41.838947 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0927 15:13:41.840823 (+ 1876us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:13:41.841512 (+ 689us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:13:41.841516 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:13:41.841518 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:13:41.841630 (+ 112us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:13:41.846527 (+ 4897us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:13:41.846532 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:13:41.846534 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:13:41.846820 (+ 286us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0927 15:13:41.846909 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0927 15:13:41.847768 (+ 859us) server_negotiation.cc:299] Negotiation successful
0927 15:13:41.847928 (+ 160us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260927 15:13:41.850220 29514 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:13:41.825135 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.62:36691 (local address 127.17.136.2:35681)
0927 15:13:41.829054 (+ 3919us) negotiation.cc:107] Waiting for socket to connect
0927 15:13:41.829118 (+ 64us) client_negotiation.cc:174] Beginning negotiation
0927 15:13:41.830420 (+ 1302us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0927 15:13:41.831325 (+ 905us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0927 15:13:41.831336 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0927 15:13:41.831710 (+ 374us) client_negotiation.cc:189] Negotiated authn=SASL
0927 15:13:41.832428 (+ 718us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:13:41.832450 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:13:41.833616 (+ 1166us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:13:41.833619 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:13:41.835005 (+ 1386us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:13:41.835017 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:13:41.835878 (+ 861us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:13:41.835883 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:13:41.836113 (+ 230us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:13:41.836865 (+ 752us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0927 15:13:41.836890 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0927 15:13:41.838697 (+ 1807us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0927 15:13:41.840993 (+ 2296us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0927 15:13:41.840999 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0927 15:13:41.841018 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0927 15:13:41.841379 (+ 361us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0927 15:13:41.841758 (+ 379us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0927 15:13:41.841761 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0927 15:13:41.841764 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0927 15:13:41.841972 (+ 208us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0927 15:13:41.847012 (+ 5040us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0927 15:13:41.847019 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0927 15:13:41.847438 (+ 419us) client_negotiation.cc:769] Sending connection context
0927 15:13:41.848638 (+ 1200us) client_negotiation.cc:240] Negotiation successful
0927 15:13:41.849021 (+ 383us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":3616,"thread_start_us":169,"threads_started":1}
I20260927 15:13:41.851935 29511 heartbeater.cc:347] Connected to a master server at 127.17.136.62:36691
I20260927 15:13:41.852185 29511 heartbeater.cc:464] Registering TS with master...
I20260927 15:13:41.852805 29511 heartbeater.cc:511] Master 127.17.136.62:36691 requested a full tablet report, sending...
I20260927 15:13:41.854070 29161 ts_manager.cc:194] Registered new tserver with Master: e3441e51427749d594fa636d0e8d850b (127.17.136.2:37765)
I20260927 15:13:41.854911 29161 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.136.2@KRBTEST.COM'} at 127.17.136.2:35681
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.136.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.136.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790521920546562-17952-0/krb5kdc/kudu_127.17.136.3.keytab.
Entry for principal kudu/127.17.136.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790521920546562-17952-0/krb5kdc/kudu_127.17.136.3.keytab.
I20260927 15:13:41.882432 17952 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu
/tmp/dist-test-taskiFOyeW/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790521920546562-17952-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790521920546562-17952-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790521920546562-17952-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790521920546562-17952-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.17.136.20:59159/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.136.3:0
--local_ip_for_outbound_sockets=127.17.136.3
--webserver_interface=127.17.136.3
--webserver_port=0
--tserver_master_addrs=127.17.136.62:36691
--keytab_file=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790521920546562-17952-0/krb5kdc/kudu_127.17.136.3.keytab
--principal=kudu/127.17.136.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.136.20:32879
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790521920546562-17952-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790521920546562-17952-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790521920546562-17952-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Sep 27 15:13:41 dist-test-slave-5s2t krb5kdc[28685](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790522021, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.136.62@KRBTEST.COM for HTTP/127.17.136.20@KRBTEST.COM
W20260927 15:13:42.053267 29516 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260927 15:13:42.054100 29516 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260927 15:13:42.054242 29516 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260927 15:13:42.060285 29516 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260927 15:13:42.060454 29516 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260927 15:13:42.060582 29516 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.136.3
I20260927 15:13:42.068105 29516 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.136.20:32879
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790521920546562-17952-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790521920546562-17952-0/minicluster-data/ts-2/wal
--ranger_kms_url=127.17.136.20:59159/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790521920546562-17952-0/krb5kdc/kudu_127.17.136.3.keytab
--principal=kudu/127.17.136.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.136.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790521920546562-17952-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.17.136.3
--webserver_port=0
--tserver_master_addrs=127.17.136.62:36691
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29516
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.136.3
--log_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790521920546562-17952-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 27 Sep 2026 14:27:13 UTC on ccycloud.quasar-psqrth.root.comops.site
build id 4676138
I20260927 15:13:42.069644 29516 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260927 15:13:42.070993 29516 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260927 15:13:42.083813 29522 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260927 15:13:42.084141 29516 server_base.cc:1034] running on GCE node
W20260927 15:13:42.084508 29521 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260927 15:13:42.091429 29524 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260927 15:13:42.092137 29516 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260927 15:13:42.092963 29516 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260927 15:13:42.108424 29516 hybrid_clock.cc:648] HybridClock initialized: now 1790522022108336 us; error 93 us; skew 500 ppm
Sep 27 15:13:42 dist-test-slave-5s2t krb5kdc[28685](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790522022, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.136.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260927 15:13:42.112471 29516 init.cc:377] Logged in from keytab as kudu/127.17.136.3@KRBTEST.COM (short username kudu)
I20260927 15:13:42.113739 29516 webserver.cc:460] Webserver started at http://127.17.136.3:43175/ using document root <none> and password file <none>
I20260927 15:13:42.114500 29516 fs_manager.cc:359] Metadata directory not provided
I20260927 15:13:42.114639 29516 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260927 15:13:42.114889 29516 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Sep 27 15:13:42 dist-test-slave-5s2t krb5kdc[28685](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790522022, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.136.3@KRBTEST.COM for HTTP/127.17.136.20@KRBTEST.COM
I20260927 15:13:42.133319 29516 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790521920546562-17952-0/minicluster-data/ts-2/data/instance:
uuid: "647fd22538ae4aa4a41585c8425cdbb3"
format_stamp: "Formatted at 2026-09-27 15:13:42 on dist-test-slave-5s2t"
server_key: "9d0e1b0cdb8bf24104de6ba3145a1bc4"
server_key_iv: "aacdb9398835125133c25ee2daf7461c"
server_key_version: "kuduclusterkey@0"
I20260927 15:13:42.133869 29516 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790521920546562-17952-0/minicluster-data/ts-2/wal/instance:
uuid: "647fd22538ae4aa4a41585c8425cdbb3"
format_stamp: "Formatted at 2026-09-27 15:13:42 on dist-test-slave-5s2t"
server_key: "9d0e1b0cdb8bf24104de6ba3145a1bc4"
server_key_iv: "aacdb9398835125133c25ee2daf7461c"
server_key_version: "kuduclusterkey@0"
I20260927 15:13:42.139286 29516 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.001s sys 0.005s
I20260927 15:13:42.154763 29531 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260927 15:13:42.156692 29516 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.002s sys 0.001s
I20260927 15:13:42.156828 29516 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790521920546562-17952-0/minicluster-data/ts-2/data,/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790521920546562-17952-0/minicluster-data/ts-2/wal
uuid: "647fd22538ae4aa4a41585c8425cdbb3"
format_stamp: "Formatted at 2026-09-27 15:13:42 on dist-test-slave-5s2t"
server_key: "9d0e1b0cdb8bf24104de6ba3145a1bc4"
server_key_iv: "aacdb9398835125133c25ee2daf7461c"
server_key_version: "kuduclusterkey@0"
I20260927 15:13:42.156961 29516 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790521920546562-17952-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790521920546562-17952-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790521920546562-17952-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260927 15:13:42.181620 29516 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260927 15:13:42.185436 29516 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260927 15:13:42.185690 29516 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260927 15:13:42.186558 29516 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260927 15:13:42.187639 29516 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260927 15:13:42.187740 29516 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260927 15:13:42.187839 29516 ts_tablet_manager.cc:610] Registered 0 tablets
I20260927 15:13:42.187898 29516 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260927 15:13:42.197829 29516 rpc_server.cc:307] RPC server started. Bound to: 127.17.136.3:34131
I20260927 15:13:42.199021 29516 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790521920546562-17952-0/minicluster-data/ts-2/data/info.pb
I20260927 15:13:42.204107 17952 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu as pid 29516
I20260927 15:13:42.204238 17952 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790521920546562-17952-0/minicluster-data/ts-2/wal/instance
I20260927 15:13:42.204577 17952 external_mini_cluster.cc:1428] Setting key b7243126f1a1d86b2ef441893e7031ee
I20260927 15:13:42.208979 29644 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.136.3:34131 every 8 connection(s)
Sep 27 15:13:42 dist-test-slave-5s2t krb5kdc[28685](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790522022, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.136.3@KRBTEST.COM for kudu/127.17.136.62@KRBTEST.COM
I20260927 15:13:42.235042 29379 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:13:42.214667 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.136.3:59807 (local address 127.17.136.62:36691)
0927 15:13:42.214784 (+ 117us) server_negotiation.cc:206] Beginning negotiation
0927 15:13:42.214788 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0927 15:13:42.219771 (+ 4983us) server_negotiation.cc:407] Connection header received
0927 15:13:42.221002 (+ 1231us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:13:42.221005 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:13:42.221059 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:13:42.221128 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0927 15:13:42.223064 (+ 1936us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:13:42.223895 (+ 831us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:13:42.225583 (+ 1688us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:13:42.225925 (+ 342us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:13:42.226003 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:13:42.230806 (+ 4803us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0927 15:13:42.230810 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0927 15:13:42.230813 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0927 15:13:42.230840 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0927 15:13:42.232576 (+ 1736us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:13:42.233207 (+ 631us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:13:42.233211 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:13:42.233212 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:13:42.233302 (+ 90us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:13:42.233722 (+ 420us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:13:42.233726 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:13:42.233728 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:13:42.233949 (+ 221us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0927 15:13:42.234024 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0927 15:13:42.234754 (+ 730us) server_negotiation.cc:299] Negotiation successful
0927 15:13:42.234883 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260927 15:13:42.236868 29647 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:13:42.213522 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.62:36691 (local address 127.17.136.3:59807)
0927 15:13:42.219588 (+ 6066us) negotiation.cc:107] Waiting for socket to connect
0927 15:13:42.219650 (+ 62us) client_negotiation.cc:174] Beginning negotiation
0927 15:13:42.220759 (+ 1109us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0927 15:13:42.221599 (+ 840us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0927 15:13:42.221608 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0927 15:13:42.221958 (+ 350us) client_negotiation.cc:189] Negotiated authn=SASL
0927 15:13:42.222898 (+ 940us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:13:42.222919 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:13:42.224052 (+ 1133us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:13:42.224055 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:13:42.225447 (+ 1392us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:13:42.225458 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:13:42.226219 (+ 761us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:13:42.226223 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:13:42.226423 (+ 200us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:13:42.227099 (+ 676us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0927 15:13:42.227121 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0927 15:13:42.230622 (+ 3501us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0927 15:13:42.232704 (+ 2082us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0927 15:13:42.232710 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0927 15:13:42.232727 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0927 15:13:42.233088 (+ 361us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0927 15:13:42.233419 (+ 331us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0927 15:13:42.233422 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0927 15:13:42.233423 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0927 15:13:42.233608 (+ 185us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0927 15:13:42.234121 (+ 513us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0927 15:13:42.234127 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0927 15:13:42.234458 (+ 331us) client_negotiation.cc:769] Sending connection context
0927 15:13:42.235462 (+ 1004us) client_negotiation.cc:240] Negotiation successful
0927 15:13:42.235804 (+ 342us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":5832,"thread_start_us":169,"threads_started":1}
I20260927 15:13:42.238302 29645 heartbeater.cc:347] Connected to a master server at 127.17.136.62:36691
I20260927 15:13:42.238543 29645 heartbeater.cc:464] Registering TS with master...
I20260927 15:13:42.239111 29645 heartbeater.cc:511] Master 127.17.136.62:36691 requested a full tablet report, sending...
I20260927 15:13:42.240262 29161 ts_manager.cc:194] Registered new tserver with Master: 647fd22538ae4aa4a41585c8425cdbb3 (127.17.136.3:34131)
I20260927 15:13:42.240967 29161 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.136.3@KRBTEST.COM'} at 127.17.136.3:59807
I20260927 15:13:42.241964 17952 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260927 15:13:42.259781 29379 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:13:42.247738 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46882 (local address 127.17.136.62:36691)
0927 15:13:42.247860 (+ 122us) server_negotiation.cc:206] Beginning negotiation
0927 15:13:42.247865 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0927 15:13:42.250490 (+ 2625us) server_negotiation.cc:407] Connection header received
0927 15:13:42.250674 (+ 184us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:13:42.250678 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:13:42.250726 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:13:42.250774 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0927 15:13:42.251807 (+ 1033us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:13:42.252618 (+ 811us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:13:42.253810 (+ 1192us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:13:42.254118 (+ 308us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:13:42.254201 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:13:42.256044 (+ 1843us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0927 15:13:42.256048 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0927 15:13:42.256051 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0927 15:13:42.256089 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0927 15:13:42.257796 (+ 1707us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:13:42.258294 (+ 498us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:13:42.258298 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:13:42.258300 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:13:42.258387 (+ 87us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:13:42.258702 (+ 315us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:13:42.258706 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:13:42.258707 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:13:42.258909 (+ 202us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0927 15:13:42.259031 (+ 122us) server_negotiation.cc:1035] Waiting for connection context
0927 15:13:42.259429 (+ 398us) server_negotiation.cc:299] Negotiation successful
0927 15:13:42.259559 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260927 15:13:42.264849 29161 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:46882:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:13:42.269127 29161 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:13:42.287777 29658 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:13:42.279901 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.2:37765 (local address 127.0.0.1:60640)
0927 15:13:42.281540 (+ 1639us) negotiation.cc:107] Waiting for socket to connect
0927 15:13:42.281552 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0927 15:13:42.281650 (+ 98us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0927 15:13:42.282342 (+ 692us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0927 15:13:42.282345 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0927 15:13:42.282362 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0927 15:13:42.282464 (+ 102us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:13:42.282471 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:13:42.284080 (+ 1609us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:13:42.284084 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:13:42.285445 (+ 1361us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:13:42.285456 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:13:42.287152 (+ 1696us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:13:42.287156 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:13:42.287312 (+ 156us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:13:42.287358 (+ 46us) client_negotiation.cc:769] Sending connection context
0927 15:13:42.287466 (+ 108us) client_negotiation.cc:240] Negotiation successful
0927 15:13:42.287616 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1580,"thread_start_us":81,"threads_started":1}
I20260927 15:13:42.288389 29662 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:13:42.280414 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60640 (local address 127.17.136.2:37765)
0927 15:13:42.281382 (+ 968us) server_negotiation.cc:206] Beginning negotiation
0927 15:13:42.281401 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0927 15:13:42.281740 (+ 339us) server_negotiation.cc:407] Connection header received
0927 15:13:42.281818 (+ 78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:13:42.281824 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:13:42.282035 (+ 211us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:13:42.282185 (+ 150us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0927 15:13:42.282584 (+ 399us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:13:42.283942 (+ 1358us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:13:42.285607 (+ 1665us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:13:42.286792 (+ 1185us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:13:42.286925 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:13:42.287088 (+ 163us) server_negotiation.cc:1035] Waiting for connection context
0927 15:13:42.288126 (+ 1038us) server_negotiation.cc:299] Negotiation successful
0927 15:13:42.288246 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":865,"thread_start_us":114,"threads_started":1}
I20260927 15:13:42.291734 29660 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:13:42.278986 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.1:45559 (local address 127.0.0.1:51700)
0927 15:13:42.280652 (+ 1666us) negotiation.cc:107] Waiting for socket to connect
0927 15:13:42.280704 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0927 15:13:42.281485 (+ 781us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0927 15:13:42.282217 (+ 732us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0927 15:13:42.282223 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0927 15:13:42.282247 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0927 15:13:42.282399 (+ 152us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:13:42.282407 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:13:42.285703 (+ 3296us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:13:42.285707 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:13:42.287717 (+ 2010us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:13:42.287727 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:13:42.290512 (+ 2785us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:13:42.290515 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:13:42.290617 (+ 102us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:13:42.290645 (+ 28us) client_negotiation.cc:769] Sending connection context
0927 15:13:42.291491 (+ 846us) client_negotiation.cc:240] Negotiation successful
0927 15:13:42.291576 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1125,"thread_start_us":136,"threads_started":1}
I20260927 15:13:42.292042 29445 tablet_service.cc:1467] Processing CreateTablet for tablet a2da8de5b177455fa39dc0f0cc457daf (DEFAULT_TABLE table=test-table [id=440849fa79a84353bf08e4a433b3cc1c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:13:42.292725 29661 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:13:42.280267 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51700 (local address 127.17.136.1:45559)
0927 15:13:42.281719 (+ 1452us) server_negotiation.cc:206] Beginning negotiation
0927 15:13:42.281726 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0927 15:13:42.281749 (+ 23us) server_negotiation.cc:407] Connection header received
0927 15:13:42.281821 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:13:42.281827 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:13:42.282036 (+ 209us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:13:42.282548 (+ 512us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0927 15:13:42.282754 (+ 206us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:13:42.284871 (+ 2117us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:13:42.287869 (+ 2998us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:13:42.288687 (+ 818us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:13:42.292257 (+ 3570us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:13:42.292419 (+ 162us) server_negotiation.cc:1035] Waiting for connection context
0927 15:13:42.292473 (+ 54us) server_negotiation.cc:299] Negotiation successful
0927 15:13:42.292574 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1350,"thread_start_us":104,"threads_started":1}
I20260927 15:13:42.293232 29445 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a2da8de5b177455fa39dc0f0cc457daf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:13:42.295509 29309 tablet_service.cc:1467] Processing CreateTablet for tablet a2da8de5b177455fa39dc0f0cc457daf (DEFAULT_TABLE table=test-table [id=440849fa79a84353bf08e4a433b3cc1c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:13:42.296540 29309 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a2da8de5b177455fa39dc0f0cc457daf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:13:42.297060 29657 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:13:42.279549 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.3:34131 (local address 127.0.0.1:37696)
0927 15:13:42.280927 (+ 1378us) negotiation.cc:107] Waiting for socket to connect
0927 15:13:42.280941 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0927 15:13:42.281060 (+ 119us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0927 15:13:42.288836 (+ 7776us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0927 15:13:42.288839 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0927 15:13:42.288860 (+ 21us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0927 15:13:42.288968 (+ 108us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:13:42.288975 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:13:42.293604 (+ 4629us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:13:42.293608 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:13:42.294739 (+ 1131us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:13:42.294750 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:13:42.296675 (+ 1925us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:13:42.296679 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:13:42.296779 (+ 100us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:13:42.296805 (+ 26us) client_negotiation.cc:769] Sending connection context
0927 15:13:42.296858 (+ 53us) client_negotiation.cc:240] Negotiation successful
0927 15:13:42.296928 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1316,"thread_start_us":119,"threads_started":1}
I20260927 15:13:42.297765 29659 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:13:42.279753 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37696 (local address 127.17.136.3:34131)
0927 15:13:42.285169 (+ 5416us) server_negotiation.cc:206] Beginning negotiation
0927 15:13:42.285181 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0927 15:13:42.285206 (+ 25us) server_negotiation.cc:407] Connection header received
0927 15:13:42.285284 (+ 78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:13:42.285290 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:13:42.285503 (+ 213us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:13:42.289132 (+ 3629us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0927 15:13:42.289279 (+ 147us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:13:42.290361 (+ 1082us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:13:42.294916 (+ 4555us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:13:42.296528 (+ 1612us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:13:42.297315 (+ 787us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:13:42.297467 (+ 152us) server_negotiation.cc:1035] Waiting for connection context
0927 15:13:42.297522 (+ 55us) server_negotiation.cc:299] Negotiation successful
0927 15:13:42.297612 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":5297,"thread_start_us":137,"threads_started":1}
I20260927 15:13:42.300642 29579 tablet_service.cc:1467] Processing CreateTablet for tablet a2da8de5b177455fa39dc0f0cc457daf (DEFAULT_TABLE table=test-table [id=440849fa79a84353bf08e4a433b3cc1c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:13:42.301695 29579 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a2da8de5b177455fa39dc0f0cc457daf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:13:42.302074 29663 tablet_bootstrap.cc:492] T a2da8de5b177455fa39dc0f0cc457daf P e3441e51427749d594fa636d0e8d850b: Bootstrap starting.
I20260927 15:13:42.304802 29663 tablet_bootstrap.cc:654] T a2da8de5b177455fa39dc0f0cc457daf P e3441e51427749d594fa636d0e8d850b: Neither blocks nor log segments found. Creating new log.
I20260927 15:13:42.305672 29663 log.cc:824] T a2da8de5b177455fa39dc0f0cc457daf P e3441e51427749d594fa636d0e8d850b: Log is configured to *not* fsync() on all Append() calls
I20260927 15:13:42.307718 29663 tablet_bootstrap.cc:492] T a2da8de5b177455fa39dc0f0cc457daf P e3441e51427749d594fa636d0e8d850b: No bootstrap required, opened a new log
I20260927 15:13:42.307896 29663 ts_tablet_manager.cc:1397] T a2da8de5b177455fa39dc0f0cc457daf P e3441e51427749d594fa636d0e8d850b: Time spent bootstrapping tablet: real 0.006s user 0.005s sys 0.000s
I20260927 15:13:42.311632 29664 tablet_bootstrap.cc:492] T a2da8de5b177455fa39dc0f0cc457daf P a931734de6b448368b961a91d667fb82: Bootstrap starting.
I20260927 15:13:42.311712 29663 raft_consensus.cc:348] T a2da8de5b177455fa39dc0f0cc457daf P e3441e51427749d594fa636d0e8d850b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a931734de6b448368b961a91d667fb82" member_type: VOTER last_known_addr { host: "127.17.136.1" port: 45559 } } peers { permanent_uuid: "e3441e51427749d594fa636d0e8d850b" member_type: VOTER last_known_addr { host: "127.17.136.2" port: 37765 } } peers { permanent_uuid: "647fd22538ae4aa4a41585c8425cdbb3" member_type: VOTER last_known_addr { host: "127.17.136.3" port: 34131 } }
I20260927 15:13:42.311949 29663 raft_consensus.cc:374] T a2da8de5b177455fa39dc0f0cc457daf P e3441e51427749d594fa636d0e8d850b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:13:42.311995 29663 raft_consensus.cc:729] T a2da8de5b177455fa39dc0f0cc457daf P e3441e51427749d594fa636d0e8d850b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3441e51427749d594fa636d0e8d850b, State: Initialized, Role: FOLLOWER
I20260927 15:13:42.312510 29663 consensus_queue.cc:260] T a2da8de5b177455fa39dc0f0cc457daf P e3441e51427749d594fa636d0e8d850b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a931734de6b448368b961a91d667fb82" member_type: VOTER last_known_addr { host: "127.17.136.1" port: 45559 } } peers { permanent_uuid: "e3441e51427749d594fa636d0e8d850b" member_type: VOTER last_known_addr { host: "127.17.136.2" port: 37765 } } peers { permanent_uuid: "647fd22538ae4aa4a41585c8425cdbb3" member_type: VOTER last_known_addr { host: "127.17.136.3" port: 34131 } }
I20260927 15:13:42.313198 29511 heartbeater.cc:503] Master 127.17.136.62:36691 was elected leader, sending a full tablet report...
I20260927 15:13:42.313830 29664 tablet_bootstrap.cc:654] T a2da8de5b177455fa39dc0f0cc457daf P a931734de6b448368b961a91d667fb82: Neither blocks nor log segments found. Creating new log.
I20260927 15:13:42.314502 29663 ts_tablet_manager.cc:1428] T a2da8de5b177455fa39dc0f0cc457daf P e3441e51427749d594fa636d0e8d850b: Time spent starting tablet: real 0.007s user 0.005s sys 0.000s
I20260927 15:13:42.314649 29664 log.cc:824] T a2da8de5b177455fa39dc0f0cc457daf P a931734de6b448368b961a91d667fb82: Log is configured to *not* fsync() on all Append() calls
W20260927 15:13:42.323511 29512 tablet.cc:2369] T a2da8de5b177455fa39dc0f0cc457daf P e3441e51427749d594fa636d0e8d850b: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260927 15:13:42.323685 29666 tablet_bootstrap.cc:492] T a2da8de5b177455fa39dc0f0cc457daf P 647fd22538ae4aa4a41585c8425cdbb3: Bootstrap starting.
I20260927 15:13:42.326478 29666 tablet_bootstrap.cc:654] T a2da8de5b177455fa39dc0f0cc457daf P 647fd22538ae4aa4a41585c8425cdbb3: Neither blocks nor log segments found. Creating new log.
I20260927 15:13:42.327150 29666 log.cc:824] T a2da8de5b177455fa39dc0f0cc457daf P 647fd22538ae4aa4a41585c8425cdbb3: Log is configured to *not* fsync() on all Append() calls
I20260927 15:13:42.329348 29664 tablet_bootstrap.cc:492] T a2da8de5b177455fa39dc0f0cc457daf P a931734de6b448368b961a91d667fb82: No bootstrap required, opened a new log
I20260927 15:13:42.329574 29664 ts_tablet_manager.cc:1397] T a2da8de5b177455fa39dc0f0cc457daf P a931734de6b448368b961a91d667fb82: Time spent bootstrapping tablet: real 0.018s user 0.005s sys 0.000s
I20260927 15:13:42.330421 29666 tablet_bootstrap.cc:492] T a2da8de5b177455fa39dc0f0cc457daf P 647fd22538ae4aa4a41585c8425cdbb3: No bootstrap required, opened a new log
I20260927 15:13:42.330560 29666 ts_tablet_manager.cc:1397] T a2da8de5b177455fa39dc0f0cc457daf P 647fd22538ae4aa4a41585c8425cdbb3: Time spent bootstrapping tablet: real 0.007s user 0.000s sys 0.004s
I20260927 15:13:42.334015 29664 raft_consensus.cc:348] T a2da8de5b177455fa39dc0f0cc457daf P a931734de6b448368b961a91d667fb82 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a931734de6b448368b961a91d667fb82" member_type: VOTER last_known_addr { host: "127.17.136.1" port: 45559 } } peers { permanent_uuid: "e3441e51427749d594fa636d0e8d850b" member_type: VOTER last_known_addr { host: "127.17.136.2" port: 37765 } } peers { permanent_uuid: "647fd22538ae4aa4a41585c8425cdbb3" member_type: VOTER last_known_addr { host: "127.17.136.3" port: 34131 } }
I20260927 15:13:42.334304 29664 raft_consensus.cc:374] T a2da8de5b177455fa39dc0f0cc457daf P a931734de6b448368b961a91d667fb82 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:13:42.334354 29664 raft_consensus.cc:729] T a2da8de5b177455fa39dc0f0cc457daf P a931734de6b448368b961a91d667fb82 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a931734de6b448368b961a91d667fb82, State: Initialized, Role: FOLLOWER
I20260927 15:13:42.334990 29664 consensus_queue.cc:260] T a2da8de5b177455fa39dc0f0cc457daf P a931734de6b448368b961a91d667fb82 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a931734de6b448368b961a91d667fb82" member_type: VOTER last_known_addr { host: "127.17.136.1" port: 45559 } } peers { permanent_uuid: "e3441e51427749d594fa636d0e8d850b" member_type: VOTER last_known_addr { host: "127.17.136.2" port: 37765 } } peers { permanent_uuid: "647fd22538ae4aa4a41585c8425cdbb3" member_type: VOTER last_known_addr { host: "127.17.136.3" port: 34131 } }
I20260927 15:13:42.335753 29375 heartbeater.cc:503] Master 127.17.136.62:36691 was elected leader, sending a full tablet report...
I20260927 15:13:42.337169 29664 ts_tablet_manager.cc:1428] T a2da8de5b177455fa39dc0f0cc457daf P a931734de6b448368b961a91d667fb82: Time spent starting tablet: real 0.008s user 0.006s sys 0.000s
I20260927 15:13:42.338760 29666 raft_consensus.cc:348] T a2da8de5b177455fa39dc0f0cc457daf P 647fd22538ae4aa4a41585c8425cdbb3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a931734de6b448368b961a91d667fb82" member_type: VOTER last_known_addr { host: "127.17.136.1" port: 45559 } } peers { permanent_uuid: "e3441e51427749d594fa636d0e8d850b" member_type: VOTER last_known_addr { host: "127.17.136.2" port: 37765 } } peers { permanent_uuid: "647fd22538ae4aa4a41585c8425cdbb3" member_type: VOTER last_known_addr { host: "127.17.136.3" port: 34131 } }
I20260927 15:13:42.339042 29666 raft_consensus.cc:374] T a2da8de5b177455fa39dc0f0cc457daf P 647fd22538ae4aa4a41585c8425cdbb3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:13:42.339148 29666 raft_consensus.cc:729] T a2da8de5b177455fa39dc0f0cc457daf P 647fd22538ae4aa4a41585c8425cdbb3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 647fd22538ae4aa4a41585c8425cdbb3, State: Initialized, Role: FOLLOWER
I20260927 15:13:42.339605 29666 consensus_queue.cc:260] T a2da8de5b177455fa39dc0f0cc457daf P 647fd22538ae4aa4a41585c8425cdbb3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a931734de6b448368b961a91d667fb82" member_type: VOTER last_known_addr { host: "127.17.136.1" port: 45559 } } peers { permanent_uuid: "e3441e51427749d594fa636d0e8d850b" member_type: VOTER last_known_addr { host: "127.17.136.2" port: 37765 } } peers { permanent_uuid: "647fd22538ae4aa4a41585c8425cdbb3" member_type: VOTER last_known_addr { host: "127.17.136.3" port: 34131 } }
I20260927 15:13:42.340236 29645 heartbeater.cc:503] Master 127.17.136.62:36691 was elected leader, sending a full tablet report...
I20260927 15:13:42.340494 29666 ts_tablet_manager.cc:1428] T a2da8de5b177455fa39dc0f0cc457daf P 647fd22538ae4aa4a41585c8425cdbb3: Time spent starting tablet: real 0.010s user 0.006s sys 0.000s
Sep 27 15:13:42 dist-test-slave-5s2t krb5kdc[28685](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790522021, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.136.62@KRBTEST.COM for HTTP/127.17.136.20@KRBTEST.COM
W20260927 15:13:42.462034 29646 tablet.cc:2369] T a2da8de5b177455fa39dc0f0cc457daf P 647fd22538ae4aa4a41585c8425cdbb3: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260927 15:13:42.464977 29376 tablet.cc:2369] T a2da8de5b177455fa39dc0f0cc457daf P a931734de6b448368b961a91d667fb82: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260927 15:13:42.619266 29667 raft_consensus.cc:482] T a2da8de5b177455fa39dc0f0cc457daf P e3441e51427749d594fa636d0e8d850b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:13:42.619518 29667 raft_consensus.cc:504] T a2da8de5b177455fa39dc0f0cc457daf P e3441e51427749d594fa636d0e8d850b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a931734de6b448368b961a91d667fb82" member_type: VOTER last_known_addr { host: "127.17.136.1" port: 45559 } } peers { permanent_uuid: "e3441e51427749d594fa636d0e8d850b" member_type: VOTER last_known_addr { host: "127.17.136.2" port: 37765 } } peers { permanent_uuid: "647fd22538ae4aa4a41585c8425cdbb3" member_type: VOTER last_known_addr { host: "127.17.136.3" port: 34131 } }
I20260927 15:13:42.621023 29667 leader_election.cc:288] T a2da8de5b177455fa39dc0f0cc457daf P e3441e51427749d594fa636d0e8d850b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a931734de6b448368b961a91d667fb82 (127.17.136.1:45559), 647fd22538ae4aa4a41585c8425cdbb3 (127.17.136.3:34131)
I20260927 15:13:42.625890 29661 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:13:42.621635 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.136.2:50679 (local address 127.17.136.1:45559)
0927 15:13:42.621748 (+ 113us) server_negotiation.cc:206] Beginning negotiation
0927 15:13:42.621752 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0927 15:13:42.621768 (+ 16us) server_negotiation.cc:407] Connection header received
0927 15:13:42.621820 (+ 52us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:13:42.621823 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:13:42.621867 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:13:42.621945 (+ 78us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0927 15:13:42.622246 (+ 301us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:13:42.623038 (+ 792us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:13:42.624644 (+ 1606us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:13:42.625228 (+ 584us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:13:42.625317 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:13:42.625367 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0927 15:13:42.625683 (+ 316us) server_negotiation.cc:299] Negotiation successful
0927 15:13:42.625762 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260927 15:13:42.626468 29678 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:13:42.621263 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.1:45559 (local address 127.17.136.2:50679)
0927 15:13:42.621497 (+ 234us) negotiation.cc:107] Waiting for socket to connect
0927 15:13:42.621513 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0927 15:13:42.621638 (+ 125us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0927 15:13:42.621961 (+ 323us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0927 15:13:42.621964 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0927 15:13:42.621985 (+ 21us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0927 15:13:42.622104 (+ 119us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:13:42.622111 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:13:42.623187 (+ 1076us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:13:42.623191 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:13:42.624470 (+ 1279us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:13:42.624480 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:13:42.625453 (+ 973us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:13:42.625456 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:13:42.625542 (+ 86us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:13:42.625563 (+ 21us) client_negotiation.cc:769] Sending connection context
0927 15:13:42.626247 (+ 684us) client_negotiation.cc:240] Negotiation successful
0927 15:13:42.626322 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":158,"thread_start_us":84,"threads_started":1}
I20260927 15:13:42.627210 29329 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a2da8de5b177455fa39dc0f0cc457daf" candidate_uuid: "e3441e51427749d594fa636d0e8d850b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a931734de6b448368b961a91d667fb82" is_pre_election: true
I20260927 15:13:42.627473 29659 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:13:42.621754 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.136.2:34647 (local address 127.17.136.3:34131)
0927 15:13:42.621881 (+ 127us) server_negotiation.cc:206] Beginning negotiation
0927 15:13:42.621885 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0927 15:13:42.623215 (+ 1330us) server_negotiation.cc:407] Connection header received
0927 15:13:42.623415 (+ 200us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:13:42.623419 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:13:42.623464 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:13:42.623506 (+ 42us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0927 15:13:42.623859 (+ 353us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:13:42.624651 (+ 792us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:13:42.626182 (+ 1531us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:13:42.626776 (+ 594us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:13:42.626862 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:13:42.626907 (+ 45us) server_negotiation.cc:1035] Waiting for connection context
0927 15:13:42.627289 (+ 382us) server_negotiation.cc:299] Negotiation successful
0927 15:13:42.627359 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260927 15:13:42.627548 29329 raft_consensus.cc:2454] T a2da8de5b177455fa39dc0f0cc457daf P a931734de6b448368b961a91d667fb82 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3441e51427749d594fa636d0e8d850b in term 0.
I20260927 15:13:42.627786 29679 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:13:42.621381 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.3:34131 (local address 127.17.136.2:34647)
0927 15:13:42.623125 (+ 1744us) negotiation.cc:107] Waiting for socket to connect
0927 15:13:42.623139 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0927 15:13:42.623301 (+ 162us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0927 15:13:42.623625 (+ 324us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0927 15:13:42.623628 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0927 15:13:42.623643 (+ 15us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0927 15:13:42.623753 (+ 110us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:13:42.623758 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:13:42.624804 (+ 1046us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:13:42.624807 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:13:42.626038 (+ 1231us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:13:42.626048 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:13:42.627005 (+ 957us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:13:42.627008 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:13:42.627133 (+ 125us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:13:42.627153 (+ 20us) client_negotiation.cc:769] Sending connection context
0927 15:13:42.627601 (+ 448us) client_negotiation.cc:240] Negotiation successful
0927 15:13:42.627670 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1667,"thread_start_us":99,"threads_started":1}
I20260927 15:13:42.628311 29599 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a2da8de5b177455fa39dc0f0cc457daf" candidate_uuid: "e3441e51427749d594fa636d0e8d850b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "647fd22538ae4aa4a41585c8425cdbb3" is_pre_election: true
I20260927 15:13:42.628587 29599 raft_consensus.cc:2454] T a2da8de5b177455fa39dc0f0cc457daf P 647fd22538ae4aa4a41585c8425cdbb3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3441e51427749d594fa636d0e8d850b in term 0.
I20260927 15:13:42.628769 29399 leader_election.cc:302] T a2da8de5b177455fa39dc0f0cc457daf P e3441e51427749d594fa636d0e8d850b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a931734de6b448368b961a91d667fb82, e3441e51427749d594fa636d0e8d850b; no voters:
I20260927 15:13:42.629019 29667 raft_consensus.cc:2781] T a2da8de5b177455fa39dc0f0cc457daf P e3441e51427749d594fa636d0e8d850b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 15:13:42.629124 29667 raft_consensus.cc:482] T a2da8de5b177455fa39dc0f0cc457daf P e3441e51427749d594fa636d0e8d850b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 15:13:42.629171 29667 raft_consensus.cc:3037] T a2da8de5b177455fa39dc0f0cc457daf P e3441e51427749d594fa636d0e8d850b [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:13:42.630395 29667 raft_consensus.cc:504] T a2da8de5b177455fa39dc0f0cc457daf P e3441e51427749d594fa636d0e8d850b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a931734de6b448368b961a91d667fb82" member_type: VOTER last_known_addr { host: "127.17.136.1" port: 45559 } } peers { permanent_uuid: "e3441e51427749d594fa636d0e8d850b" member_type: VOTER last_known_addr { host: "127.17.136.2" port: 37765 } } peers { permanent_uuid: "647fd22538ae4aa4a41585c8425cdbb3" member_type: VOTER last_known_addr { host: "127.17.136.3" port: 34131 } }
I20260927 15:13:42.630720 29667 leader_election.cc:288] T a2da8de5b177455fa39dc0f0cc457daf P e3441e51427749d594fa636d0e8d850b [CANDIDATE]: Term 1 election: Requested vote from peers a931734de6b448368b961a91d667fb82 (127.17.136.1:45559), 647fd22538ae4aa4a41585c8425cdbb3 (127.17.136.3:34131)
I20260927 15:13:42.631178 29599 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a2da8de5b177455fa39dc0f0cc457daf" candidate_uuid: "e3441e51427749d594fa636d0e8d850b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "647fd22538ae4aa4a41585c8425cdbb3"
I20260927 15:13:42.631326 29599 raft_consensus.cc:3037] T a2da8de5b177455fa39dc0f0cc457daf P 647fd22538ae4aa4a41585c8425cdbb3 [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:13:42.631475 29329 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a2da8de5b177455fa39dc0f0cc457daf" candidate_uuid: "e3441e51427749d594fa636d0e8d850b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a931734de6b448368b961a91d667fb82"
I20260927 15:13:42.631598 29329 raft_consensus.cc:3037] T a2da8de5b177455fa39dc0f0cc457daf P a931734de6b448368b961a91d667fb82 [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:13:42.632544 29599 raft_consensus.cc:2454] T a2da8de5b177455fa39dc0f0cc457daf P 647fd22538ae4aa4a41585c8425cdbb3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3441e51427749d594fa636d0e8d850b in term 1.
I20260927 15:13:42.632674 29329 raft_consensus.cc:2454] T a2da8de5b177455fa39dc0f0cc457daf P a931734de6b448368b961a91d667fb82 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3441e51427749d594fa636d0e8d850b in term 1.
I20260927 15:13:42.632982 29399 leader_election.cc:302] T a2da8de5b177455fa39dc0f0cc457daf P e3441e51427749d594fa636d0e8d850b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a931734de6b448368b961a91d667fb82, e3441e51427749d594fa636d0e8d850b; no voters:
I20260927 15:13:42.633133 29667 raft_consensus.cc:2781] T a2da8de5b177455fa39dc0f0cc457daf P e3441e51427749d594fa636d0e8d850b [term 1 FOLLOWER]: Leader election won for term 1
I20260927 15:13:42.633316 29667 raft_consensus.cc:686] T a2da8de5b177455fa39dc0f0cc457daf P e3441e51427749d594fa636d0e8d850b [term 1 LEADER]: Becoming Leader. State: Replica: e3441e51427749d594fa636d0e8d850b, State: Running, Role: LEADER
I20260927 15:13:42.633658 29667 consensus_queue.cc:237] T a2da8de5b177455fa39dc0f0cc457daf P e3441e51427749d594fa636d0e8d850b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a931734de6b448368b961a91d667fb82" member_type: VOTER last_known_addr { host: "127.17.136.1" port: 45559 } } peers { permanent_uuid: "e3441e51427749d594fa636d0e8d850b" member_type: VOTER last_known_addr { host: "127.17.136.2" port: 37765 } } peers { permanent_uuid: "647fd22538ae4aa4a41585c8425cdbb3" member_type: VOTER last_known_addr { host: "127.17.136.3" port: 34131 } }
I20260927 15:13:42.636817 29161 catalog_manager.cc:5495] T a2da8de5b177455fa39dc0f0cc457daf P e3441e51427749d594fa636d0e8d850b reported cstate change: term changed from 0 to 1, leader changed from <none> to e3441e51427749d594fa636d0e8d850b (127.17.136.2). New cstate: current_term: 1 leader_uuid: "e3441e51427749d594fa636d0e8d850b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a931734de6b448368b961a91d667fb82" member_type: VOTER last_known_addr { host: "127.17.136.1" port: 45559 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3441e51427749d594fa636d0e8d850b" member_type: VOTER last_known_addr { host: "127.17.136.2" port: 37765 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "647fd22538ae4aa4a41585c8425cdbb3" member_type: VOTER last_known_addr { host: "127.17.136.3" port: 34131 } health_report { overall_health: UNKNOWN } } }
I20260927 15:13:42.648620 29662 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:13:42.645158 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60656 (local address 127.17.136.2:37765)
0927 15:13:42.645282 (+ 124us) server_negotiation.cc:206] Beginning negotiation
0927 15:13:42.645286 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0927 15:13:42.645333 (+ 47us) server_negotiation.cc:407] Connection header received
0927 15:13:42.645469 (+ 136us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:13:42.645472 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:13:42.645535 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:13:42.645657 (+ 122us) server_negotiation.cc:226] Negotiated authn=TOKEN
0927 15:13:42.645859 (+ 202us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:13:42.646348 (+ 489us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:13:42.647162 (+ 814us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:13:42.647436 (+ 274us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:13:42.647518 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:13:42.647808 (+ 290us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0927 15:13:42.648194 (+ 386us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0927 15:13:42.648320 (+ 126us) server_negotiation.cc:1035] Waiting for connection context
0927 15:13:42.648443 (+ 123us) server_negotiation.cc:299] Negotiation successful
0927 15:13:42.648496 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260927 15:13:42.655910 29599 raft_consensus.cc:1261] T a2da8de5b177455fa39dc0f0cc457daf P 647fd22538ae4aa4a41585c8425cdbb3 [term 1 FOLLOWER]: Refusing update from remote peer e3441e51427749d594fa636d0e8d850b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260927 15:13:42.656005 29329 raft_consensus.cc:1261] T a2da8de5b177455fa39dc0f0cc457daf P a931734de6b448368b961a91d667fb82 [term 1 FOLLOWER]: Refusing update from remote peer e3441e51427749d594fa636d0e8d850b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260927 15:13:42.656695 29667 consensus_queue.cc:1035] T a2da8de5b177455fa39dc0f0cc457daf P e3441e51427749d594fa636d0e8d850b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a931734de6b448368b961a91d667fb82" member_type: VOTER last_known_addr { host: "127.17.136.1" port: 45559 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260927 15:13:42.657140 29683 consensus_queue.cc:1035] T a2da8de5b177455fa39dc0f0cc457daf P e3441e51427749d594fa636d0e8d850b [LEADER]: Connected to new peer: Peer: permanent_uuid: "647fd22538ae4aa4a41585c8425cdbb3" member_type: VOTER last_known_addr { host: "127.17.136.3" port: 34131 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260927 15:13:42.669276 29686 mvcc.cc:205] Tried to move back new op lower bound from 7333978204789489664 to 7333978204709990400. Current Snapshot: MvccSnapshot[applied={T|T < 7333978204789489664}]
I20260927 15:13:42.669658 29688 mvcc.cc:205] Tried to move back new op lower bound from 7333978204789489664 to 7333978204709990400. Current Snapshot: MvccSnapshot[applied={T|T < 7333978204789489664}]
I20260927 15:13:42.672724 29687 mvcc.cc:205] Tried to move back new op lower bound from 7333978204789489664 to 7333978204709990400. Current Snapshot: MvccSnapshot[applied={T|T < 7333978204789489664}]
I20260927 15:13:42.680292 29161 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:46882:
table { table_name: "test-table" } modify_external_catalogs: true
I20260927 15:13:42.680445 29161 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:46882:
table { table_name: "test-table" } modify_external_catalogs: true
I20260927 15:13:42.682948 29161 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 07f547c67a2c491b92fbe3c1efe526e9: Sending DeleteTablet for 3 replicas of tablet a2da8de5b177455fa39dc0f0cc457daf
I20260927 15:13:42.683874 29445 tablet_service.cc:1514] Processing DeleteTablet for tablet a2da8de5b177455fa39dc0f0cc457daf with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:13:42 UTC) from {username='kudu', principal='kudu/127.17.136.62@KRBTEST.COM'} at 127.0.0.1:60640
I20260927 15:13:42.683907 29309 tablet_service.cc:1514] Processing DeleteTablet for tablet a2da8de5b177455fa39dc0f0cc457daf with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:13:42 UTC) from {username='kudu', principal='kudu/127.17.136.62@KRBTEST.COM'} at 127.0.0.1:51700
I20260927 15:13:42.684792 29579 tablet_service.cc:1514] Processing DeleteTablet for tablet a2da8de5b177455fa39dc0f0cc457daf with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:13:42 UTC) from {username='kudu', principal='kudu/127.17.136.62@KRBTEST.COM'} at 127.0.0.1:37696
I20260927 15:13:42.685913 17952 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu with pid 29242
I20260927 15:13:42.691506 29697 tablet_replica.cc:330] T a2da8de5b177455fa39dc0f0cc457daf P 647fd22538ae4aa4a41585c8425cdbb3: stopping tablet replica
I20260927 15:13:42.696543 29697 raft_consensus.cc:2229] T a2da8de5b177455fa39dc0f0cc457daf P 647fd22538ae4aa4a41585c8425cdbb3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260927 15:13:42.697005 29697 raft_consensus.cc:2258] T a2da8de5b177455fa39dc0f0cc457daf P 647fd22538ae4aa4a41585c8425cdbb3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 15:13:42.697449 29696 tablet_replica.cc:330] T a2da8de5b177455fa39dc0f0cc457daf P e3441e51427749d594fa636d0e8d850b: stopping tablet replica
I20260927 15:13:42.699075 29696 raft_consensus.cc:2229] T a2da8de5b177455fa39dc0f0cc457daf P e3441e51427749d594fa636d0e8d850b [term 1 LEADER]: Raft consensus shutting down.
I20260927 15:13:42.699494 29697 ts_tablet_manager.cc:1905] T a2da8de5b177455fa39dc0f0cc457daf P 647fd22538ae4aa4a41585c8425cdbb3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:13:42.699997 29696 raft_consensus.cc:2258] T a2da8de5b177455fa39dc0f0cc457daf P e3441e51427749d594fa636d0e8d850b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 15:13:42.702646 29697 ts_tablet_manager.cc:1918] T a2da8de5b177455fa39dc0f0cc457daf P 647fd22538ae4aa4a41585c8425cdbb3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260927 15:13:42.704124 29696 ts_tablet_manager.cc:1905] T a2da8de5b177455fa39dc0f0cc457daf P e3441e51427749d594fa636d0e8d850b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:13:42.706651 29696 ts_tablet_manager.cc:1918] T a2da8de5b177455fa39dc0f0cc457daf P e3441e51427749d594fa636d0e8d850b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
W20260927 15:13:42.706956 29146 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.17.136.1:45559 (error 108)
I20260927 15:13:42.707739 29697 log.cc:1196] T a2da8de5b177455fa39dc0f0cc457daf P 647fd22538ae4aa4a41585c8425cdbb3: Deleting WAL directory at /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790521920546562-17952-0/minicluster-data/ts-2/wal/wals/a2da8de5b177455fa39dc0f0cc457daf
I20260927 15:13:42.707989 17952 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu with pid 29381
I20260927 15:13:42.710032 29697 ts_tablet_manager.cc:1939] T a2da8de5b177455fa39dc0f0cc457daf P 647fd22538ae4aa4a41585c8425cdbb3: Deleting consensus metadata
I20260927 15:13:42.710722 29657 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:13:42.710386 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.1:45559 (local address 127.0.0.1:51716)
0927 15:13:42.710567 (+ 181us) negotiation.cc:107] Waiting for socket to connect
0927 15:13:42.710633 (+ 66us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.136.1:45559: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":107}
W20260927 15:13:42.711040 29146 catalog_manager.cc:4584] TS a931734de6b448368b961a91d667fb82 (127.17.136.1:45559): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet a2da8de5b177455fa39dc0f0cc457daf: Network error: Client connection negotiation failed: client connection to 127.17.136.1:45559: connect: Connection refused (error 111)
I20260927 15:13:42.711678 29145 catalog_manager.cc:4841] TS 647fd22538ae4aa4a41585c8425cdbb3 (127.17.136.3:34131): tablet a2da8de5b177455fa39dc0f0cc457daf (table test-table [id=440849fa79a84353bf08e4a433b3cc1c]) successfully deleted
I20260927 15:13:42.716619 17952 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu with pid 29516
I20260927 15:13:42.718153 29657 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:13:42.717872 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.2:37765 (local address 127.0.0.1:60670)
0927 15:13:42.718009 (+ 137us) negotiation.cc:107] Waiting for socket to connect
0927 15:13:42.718070 (+ 61us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.136.2:37765: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":47}
I20260927 15:13:42.722873 17952 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu with pid 29129
I20260927 15:13:42.733496 17952 mini_ranger_kms.cc:60] Stopping Ranger KMS...
I20260927 15:13:43.067683 17952 mini_ranger_kms.cc:62] Stopped Ranger KMS
I20260927 15:13:43.067822 17952 mini_ranger.cc:66] Stopping Ranger...
I20260927 15:13:43.401603 17952 mini_ranger.cc:68] Stopped Ranger
2026-09-27 15:13:43.401 UTC [28715] LOG: received smart shutdown request
2026-09-27 15:13:43.405 UTC [28715] LOG: background worker "logical replication launcher" (PID 28724) exited with exit code 1
2026-09-27 15:13:43.405 UTC [28719] LOG: shutting down
2026-09-27 15:13:43.562 UTC [28715] LOG: database system is shut down
2026-09-27T15:13:43Z chronyd exiting
[ OK ] SecurityITest.TestEncryptionWithKMSIntegration (44509 ms)
[ RUN ] SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers
Loading random data
Initializing database '/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790521920546562-17952-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 27 15:13:43 dist-test-slave-5s2t krb5kdc[29707](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 27 15:13:43 dist-test-slave-5s2t krb5kdc[29707](info): set up 2 sockets
Sep 27 15:13:43 dist-test-slave-5s2t krb5kdc[29707](info): commencing operation
krb5kdc: starting...
W20260927 15:13:44.607043 17952 mini_kdc.cc:121] Time spent starting KDC: real 0.938s user 0.003s sys 0.003s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790521920546562-17952-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790521920546562-17952-0/krb5kdc/test-user.keytab.
Sep 27 15:13:44 dist-test-slave-5s2t krb5kdc[29707](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790522024, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-27T15:13:44Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-27T15:13:44Z Disabled control of system clock
WARNING: no policy specified for rangeradmin/127.17.136.20@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangeradmin/127.17.136.20@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangeradmin/127.17.136.20@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790521920546562-17952-0/krb5kdc/rangeradmin_127.17.136.20@KRBTEST.COM.keytab.
Entry for principal rangeradmin/127.17.136.20@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790521920546562-17952-0/krb5kdc/rangeradmin_127.17.136.20@KRBTEST.COM.keytab.
WARNING: no policy specified for rangerlookup/127.17.136.20@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerlookup/127.17.136.20@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerlookup/127.17.136.20@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790521920546562-17952-0/krb5kdc/rangerlookup_127.17.136.20@KRBTEST.COM.keytab.
Entry for principal rangerlookup/127.17.136.20@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790521920546562-17952-0/krb5kdc/rangerlookup_127.17.136.20@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.17.136.20@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "HTTP/127.17.136.20@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.17.136.20@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790521920546562-17952-0/krb5kdc/HTTP_127.17.136.20@KRBTEST.COM.keytab.
Entry for principal HTTP/127.17.136.20@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790521920546562-17952-0/krb5kdc/HTTP_127.17.136.20@KRBTEST.COM.keytab.
I20260927 15:13:44.759969 17952 mini_postgres.cc:62] Running initdb...
The files belonging to this database system will be owned by user "slave".
This user must also own the server process.
The database cluster will be initialized with locale "C".
The default database encoding has accordingly been set to "SQL_ASCII".
The default text search configuration will be set to "english".
Data page checksums are disabled.
creating directory /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790521920546562-17952-0/minicluster-data/postgres ... ok
creating subdirectories ... ok
selecting dynamic shared memory implementation ... posix
selecting default max_connections ... 100
selecting default shared_buffers ... 128MB
selecting default time zone ... Etc/UTC
creating configuration files ... ok
running bootstrap script ... ok
performing post-bootstrap initialization ... ok
syncing data to disk ... ok
initdb: warning: enabling "trust" authentication for local connections
You can change this by editing pg_hba.conf or using the option -A, or
--auth-local and --auth-host, the next time you run initdb.
Success. You can now start the database server using:
/tmp/dist-test-taskiFOyeW/build/debug/bin/postgres/pg_ctl -D /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790521920546562-17952-0/minicluster-data/postgres -l logfile start
2026-09-27 15:13:47.078 UTC [29737] LOG: starting PostgreSQL 12.2 on x86_64-pc-linux-gnu, compiled by cc (GCC) 8.3.1 20190311 (Red Hat 8.3.1-3), 64-bit
2026-09-27 15:13:47.078 UTC [29737] LOG: listening on IPv4 address "127.17.136.20", port 47991
2026-09-27 15:13:47.081 UTC [29737] LOG: listening on Unix socket "/tmp/.s.PGSQL.47991"
2026-09-27 15:13:47.108 UTC [29740] LOG: database system was shut down at 2026-09-27 15:13:45 UTC
2026-09-27 15:13:47.111 UTC [29737] LOG: database system is ready to accept connections
I20260927 15:13:47.982805 17952 mini_postgres.cc:96] Postgres bound to 47991
2026-09-27 15:13:47.988 UTC [29748] FATAL: database "slave" does not exist
127.17.136.20:47991 - accepting connections
I20260927 15:13:47.988901 17952 mini_ranger.cc:161] Starting Ranger...
I20260927 15:13:48.002475 17952 mini_ranger.cc:84] Created miniranger Postgres user
I20260927 15:13:48.435345 17952 mini_ranger.cc:87] Created ranger Postgres database
I20260927 15:13:48.435422 17952 mini_ranger.cc:178] Starting Ranger out of /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790521920546562-17952-0/minicluster-data/ranger-admin
2026-09-27 15:13:48,685 [I] DB FLAVOR :POSTGRES
2026-09-27 15:13:48,685 [I] --------- Verifying Ranger DB connection ---------
2026-09-27 15:13:48,685 [I] Checking connection..
2026-09-27 15:13:48,685 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskiFOyeW/build/debug/bin/postgresql.jar:/tmp/dist-test-taskiFOyeW/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.17.136.20:47991/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select 1;"
2026-09-27 15:13:48,923 [I] Checking connection passed.
2026-09-27 15:13:48,924 [I] --------- Verifying version history table ---------
2026-09-27 15:13:48,924 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskiFOyeW/build/debug/bin/postgresql.jar:/tmp/dist-test-taskiFOyeW/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.17.136.20:47991/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-09-27 15:13:49,141 [I] Table x_db_version_h does not exist in database ranger
2026-09-27 15:13:49,142 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskiFOyeW/build/debug/bin/postgresql.jar:/tmp/dist-test-taskiFOyeW/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.17.136.20:47991/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-09-27 15:13:49,380 [I] Table x_db_version_h does not exist in database ranger
2026-09-27 15:13:49,381 [I] Importing x_db_version_h table schema to database ranger from file: create_dbversion_catalog.sql
2026-09-27 15:13:49,381 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskiFOyeW/build/debug/bin/postgresql.jar:/tmp/dist-test-taskiFOyeW/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.17.136.20:47991/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskiFOyeW/thirdparty/src/ranger-2.1.0-admin/db/postgres/create_dbversion_catalog.sql
2026-09-27 15:13:49.616 UTC [29812] WARNING: there is no transaction in progress
2026-09-27 15:13:49,621 [I] create_dbversion_catalog.sql file imported successfully
2026-09-27 15:13:49,621 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskiFOyeW/build/debug/bin/postgresql.jar:/tmp/dist-test-taskiFOyeW/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.17.136.20:47991/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-09-27 15:13:49,847 [I] Table x_db_version_h already exists in database 'ranger'
2026-09-27 15:13:49,847 [I] --------- Importing Ranger Core DB Schema ---------
2026-09-27 15:13:49,847 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskiFOyeW/build/debug/bin/postgresql.jar:/tmp/dist-test-taskiFOyeW/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.17.136.20:47991/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'Y';"
2026-09-27 15:13:50,091 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskiFOyeW/build/debug/bin/postgresql.jar:/tmp/dist-test-taskiFOyeW/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.17.136.20:47991/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'N';"
2026-09-27 15:13:50,339 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskiFOyeW/build/debug/bin/postgresql.jar:/tmp/dist-test-taskiFOyeW/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.17.136.20:47991/ranger -u miniranger -p '********' -noheader -trim -c \; -query "insert into x_db_version_h (version, inst_at, inst_by, updated_at, updated_by,active) values ('CORE_DB_SCHEMA', current_timestamp, 'Ranger 2.1.0', current_timestamp, 'dist-test-slave-5s2t.c.gcp-upstream.internal','N') ;"
2026-09-27 15:13:50,574 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskiFOyeW/build/debug/bin/postgresql.jar:/tmp/dist-test-taskiFOyeW/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.17.136.20:47991/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-09-27 15:13:50,803 [I] Table x_portal_user does not exist in database ranger
2026-09-27 15:13:50,803 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskiFOyeW/build/debug/bin/postgresql.jar:/tmp/dist-test-taskiFOyeW/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.17.136.20:47991/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-09-27 15:13:51,053 [I] Table x_policy_ref_group does not exist in database ranger
2026-09-27 15:13:51,053 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskiFOyeW/build/debug/bin/postgresql.jar:/tmp/dist-test-taskiFOyeW/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.17.136.20:47991/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-09-27 15:13:51,293 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskiFOyeW/build/debug/bin/postgresql.jar:/tmp/dist-test-taskiFOyeW/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.17.136.20:47991/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-09-27 15:13:51,539 [I] Importing DB schema to database ranger from file: ranger_core_db_postgres.sql
2026-09-27 15:13:51,539 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskiFOyeW/build/debug/bin/postgresql.jar:/tmp/dist-test-taskiFOyeW/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.17.136.20:47991/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskiFOyeW/thirdparty/src/ranger-2.1.0-admin/db/postgres/optimized/current/ranger_core_db_postgres.sql
2026-09-27 15:13:52.427 UTC [29920] WARNING: there is no transaction in progress
2026-09-27 15:13:52.442 UTC [29920] WARNING: there is no transaction in progress
2026-09-27 15:13:52.458 UTC [29920] WARNING: there is no transaction in progress
2026-09-27 15:13:52.472 UTC [29920] WARNING: there is no transaction in progress
2026-09-27 15:13:52.487 UTC [29920] WARNING: there is no transaction in progress
2026-09-27 15:13:52.504 UTC [29920] WARNING: there is no transaction in progress
2026-09-27 15:13:52.556 UTC [29920] WARNING: there is no transaction in progress
2026-09-27 15:13:52.562 UTC [29920] WARNING: there is no transaction in progress
2026-09-27 15:13:52.577 UTC [29920] WARNING: there is no transaction in progress
2026-09-27 15:13:52.586 UTC [29920] WARNING: there is no transaction in progress
2026-09-27 15:13:52.596 UTC [29920] WARNING: there is no transaction in progress
2026-09-27 15:13:52.610 UTC [29920] WARNING: there is no transaction in progress
2026-09-27 15:13:52.619 UTC [29920] WARNING: there is no transaction in progress
2026-09-27 15:13:52.624 UTC [29920] WARNING: there is no transaction in progress
2026-09-27 15:13:52.630 UTC [29920] WARNING: there is no transaction in progress
2026-09-27 15:13:52.636 UTC [29920] WARNING: there is no transaction in progress
2026-09-27 15:13:53,217 [I] ranger_core_db_postgres.sql file imported successfully
2026-09-27 15:13:53,217 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskiFOyeW/build/debug/bin/postgresql.jar:/tmp/dist-test-taskiFOyeW/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.17.136.20:47991/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set inst_by='Ranger 2.1.0' where active='Y' and updated_by='localhost';"
2026-09-27 15:13:53,463 [I] Patches status entries updated from base ranger version to current installed ranger version:Ranger 2.1.0
2026-09-27 15:13:53,464 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskiFOyeW/build/debug/bin/postgresql.jar:/tmp/dist-test-taskiFOyeW/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.17.136.20:47991/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-09-27 15:13:53,715 [I] Table x_portal_user already exists in database 'ranger'
2026-09-27 15:13:53,715 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskiFOyeW/build/debug/bin/postgresql.jar:/tmp/dist-test-taskiFOyeW/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.17.136.20:47991/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-09-27 15:13:53,966 [I] Table x_policy_ref_group already exists in database 'ranger'
2026-09-27 15:13:53,967 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskiFOyeW/build/debug/bin/postgresql.jar:/tmp/dist-test-taskiFOyeW/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.17.136.20:47991/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-09-27 15:13:54,207 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskiFOyeW/build/debug/bin/postgresql.jar:/tmp/dist-test-taskiFOyeW/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.17.136.20:47991/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-09-27 15:13:54,446 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskiFOyeW/build/debug/bin/postgresql.jar:/tmp/dist-test-taskiFOyeW/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.17.136.20:47991/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set active='Y' where version='CORE_DB_SCHEMA' and active='N' and updated_by='dist-test-slave-5s2t.c.gcp-upstream.internal';"
2026-09-27 15:13:54,667 [I] CORE_DB_SCHEMA import status has been updated
2026-09-27 15:13:54,667 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskiFOyeW/build/debug/bin/postgresql.jar:/tmp/dist-test-taskiFOyeW/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.17.136.20:47991/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and inst_by = 'Ranger 2.1.0' and active = 'Y';"
2026-09-27 15:13:54,910 [I] DB_PATCHES have already been applied
I20260927 15:13:54.916038 17952 mini_ranger.cc:191] Using Ranger class path: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790521920546562-17952-0/minicluster-data/ranger-admin:/tmp/dist-test-taskiFOyeW/thirdparty/src/ranger-2.1.0-admin/ews/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*:/tmp/dist-test-taskiFOyeW/thirdparty/src/hadoop-3.2.0/*:/tmp/dist-test-taskiFOyeW/build/debug/bin/postgresql.jar:/tmp/dist-test-taskiFOyeW/thirdparty/src/ranger-2.1.0-admin/ews/webapp
I20260927 15:13:54.916095 17952 mini_ranger.cc:193] Using host: 127.17.136.20
I20260927 15:13:54.919155 17952 mini_ranger.cc:227] Ranger admin URL: http://127.17.136.20:58763
Sep 27, 2026 3:13:55 PM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Sep 27, 2026 3:13:55 PM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Sep 27, 2026 3:13:55 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Deriving webapp folder from catalina.base property. folder=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790521920546562-17952-0/minicluster-data/ranger-admin/ews/webapp
Sep 27, 2026 3:13:55 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790521920546562-17952-0/minicluster-data/ranger-admin/ews/webapp, webAppName = /
Sep 27, 2026 3:13:55 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/] = path [/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790521920546562-17952-0/minicluster-data/ranger-admin/ews/webapp] .....
Sep 27, 2026 3:13:55 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/] = path [/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790521920546562-17952-0/minicluster-data/ranger-admin/ews/webapp].
Sep 27, 2026 3:13:55 PM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : miniranger
I20260927 15:13:55.895871 17952 mini_ranger.cc:160] Time spent starting Ranger: real 7.907s user 0.006s sys 0.002s
Sep 27, 2026 3:14:14 PM com.sun.jersey.api.core.PackagesResourceConfig init
INFO: Scanning for root resource and provider classes in the packages:
org.apache.ranger.rest
org.apache.ranger.common
xa.rest
Sep 27, 2026 3:14:14 PM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Root resource classes found:
class org.apache.ranger.rest.XAuditREST
class org.apache.ranger.rest.SecurityZoneREST
class org.apache.ranger.rest.PublicAPIsv2
class org.apache.ranger.rest.XKeyREST
class org.apache.ranger.rest.RoleREST
class org.apache.ranger.rest.ServiceREST
class org.apache.ranger.rest.AssetREST
class org.apache.ranger.rest.XUserREST
class org.apache.ranger.rest.TagREST
class org.apache.ranger.rest.MetricsREST
class org.apache.ranger.rest.PublicAPIs
class org.apache.ranger.rest.UserREST
Sep 27, 2026 3:14:14 PM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Provider classes found:
class org.apache.ranger.common.RangerJAXBContextResolver
Sep 27, 2026 3:14:14 PM com.sun.jersey.spi.spring.container.servlet.SpringServlet getContext
INFO: Using default applicationContext
Sep 27, 2026 3:14:14 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, assetREST, of type org.apache.ranger.rest.AssetREST as a root resource class
Sep 27, 2026 3:14:14 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, metricsREST, of type org.apache.ranger.rest.MetricsREST as a root resource class
Sep 27, 2026 3:14:14 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIs, of type org.apache.ranger.rest.PublicAPIs as a root resource class
Sep 27, 2026 3:14:14 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIsv2, of type org.apache.ranger.rest.PublicAPIsv2 as a root resource class
Sep 27, 2026 3:14:14 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, roleREST, of type org.apache.ranger.rest.RoleREST as a root resource class
Sep 27, 2026 3:14:14 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, securityZoneREST, of type org.apache.ranger.rest.SecurityZoneREST as a root resource class
Sep 27, 2026 3:14:14 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, serviceREST, of type org.apache.ranger.rest.ServiceREST as a root resource class
Sep 27, 2026 3:14:14 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, tagREST, of type org.apache.ranger.rest.TagREST as a root resource class
Sep 27, 2026 3:14:14 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, userREST, of type org.apache.ranger.rest.UserREST as a root resource class
Sep 27, 2026 3:14:14 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XAuditREST, of type org.apache.ranger.rest.XAuditREST as a root resource class
Sep 27, 2026 3:14:14 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XKeyREST, of type org.apache.ranger.rest.XKeyREST as a root resource class
Sep 27, 2026 3:14:14 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XUserREST, of type org.apache.ranger.rest.XUserREST as a root resource class
Sep 27, 2026 3:14:14 PM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.19.3 10/24/2016 03:58 PM'
Sep 27, 2026 3:14:15 PM com.sun.jersey.spi.inject.Errors processErrorMessages
WARNING: The following warnings have been detected with resource and/or provider classes:
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInExcel(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInJson(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse,java.lang.Boolean), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInCsv(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse) throws java.io.IOException, MUST return a non-void type.
I20260927 15:14:16.010967 17952 mini_ranger.cc:261] Created Kudu service
WARNING: no policy specified for rangerkms/127.17.136.20@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerkms/127.17.136.20@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerkms/127.17.136.20@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790521920546562-17952-0/krb5kdc/rangerkms_127.17.136.20@KRBTEST.COM.keytab.
Entry for principal rangerkms/127.17.136.20@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790521920546562-17952-0/krb5kdc/rangerkms_127.17.136.20@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.17.136.20@KRBTEST.COM; defaulting to no policy
add_principal: Principal or policy already exists while creating "HTTP/127.17.136.20@KRBTEST.COM".
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.17.136.20@KRBTEST.COM with kvno 3, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790521920546562-17952-0/krb5kdc/HTTP_127.17.136.20@KRBTEST.COM.keytab.
Entry for principal HTTP/127.17.136.20@KRBTEST.COM with kvno 3, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790521920546562-17952-0/krb5kdc/HTTP_127.17.136.20@KRBTEST.COM.keytab.
WARNING: no policy specified for keyadmin@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "keyadmin@KRBTEST.COM" created.
Sep 27 15:14:16 dist-test-slave-5s2t krb5kdc[29707](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790522056, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for keyadmin@KRBTEST.COM:
I20260927 15:14:16.094993 17952 mini_ranger_kms.cc:208] Starting Ranger KMS...
I20260927 15:14:16.103142 17952 mini_ranger_kms.cc:78] Created minirangerkms Postgres user
I20260927 15:14:16.901165 17952 mini_ranger_kms.cc:81] Created rangerkms Postgres database
I20260927 15:14:16.901255 17952 mini_ranger_kms.cc:226] Starting Ranger KMS out of /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790521920546562-17952-0/minicluster-data/ranger-kms
I20260927 15:14:16.901271 17952 mini_ranger_kms.cc:227] Using postgres at 127.17.136.20:47991
2026-09-27 15:14:17,047 [I] DB FLAVOR :POSTGRES
2026-09-27 15:14:17,047 [I] --------- Verifying Ranger DB connection ---------
2026-09-27 15:14:17,047 [I] Checking connection
2026-09-27 15:14:17,047 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskiFOyeW/build/debug/bin/postgresql.jar:/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790521920546562-17952-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.17.136.20:47991/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "SELECT 1;"
2026-09-27 15:14:17,283 [I] connection success
2026-09-27 15:14:17,283 [I] --------- Verifying Ranger DB tables ---------
2026-09-27 15:14:17,283 [I] Verifying table ranger_masterkey in database rangerkms
2026-09-27 15:14:17,283 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskiFOyeW/build/debug/bin/postgresql.jar:/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790521920546562-17952-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.17.136.20:47991/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='rangerkms' and table_name = 'ranger_masterkey') as temp;"
2026-09-27 15:14:17,534 [I] Table ranger_masterkey does not exist in database rangerkms
2026-09-27 15:14:17,535 [I] --------- Importing Ranger Core DB Schema ---------
2026-09-27 15:14:17,535 [I] Importing db schema to database rangerkms from file: kms_core_db_postgres.sql
2026-09-27 15:14:17,535 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskiFOyeW/build/debug/bin/postgresql.jar:/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790521920546562-17952-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.17.136.20:47991/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790521920546562-17952-0/minicluster-data/ranger-kms/db/postgres/kms_core_db_postgres.sql
2026-09-27 15:14:17,801 [I] kms_core_db_postgres.sql DB schema imported successfully
I20260927 15:14:18.254837 17952 mini_ranger_kms.cc:310] Created kms service
I20260927 15:14:18.429715 17952 mini_ranger_kms.cc:326] Created kudu user
I20260927 15:14:18.476704 17952 mini_ranger_kms.cc:343] Created rangerkms user
Sep 27 15:14:18 dist-test-slave-5s2t krb5kdc[29707](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790522056, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for HTTP/127.17.136.20@KRBTEST.COM
I20260927 15:14:18.848671 17952 mini_ranger_kms.cc:384] Added ranger policy
I20260927 15:14:18.848814 17952 mini_ranger_kms.cc:238] Using RangerKMS classpath: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790521920546562-17952-0/minicluster-data/ranger-kms:/tmp/dist-test-taskiFOyeW/build/debug/bin/postgresql.jar:/tmp/dist-test-taskiFOyeW/thirdparty/src/ranger-2.1.0-kms/ews/webapp/WEB-INF/classes/lib/*:/tmp/dist-test-taskiFOyeW/thirdparty/src/ranger-2.1.0-kms/ews/webapp/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*
I20260927 15:14:18.848834 17952 mini_ranger_kms.cc:240] Using host: 127.17.136.20
I20260927 15:14:18.852663 17952 mini_ranger_kms.cc:276] Ranger KMS PID: 30100
I20260927 15:14:18.852730 17952 mini_ranger_kms.cc:277] Ranger KMS URL: http://127.17.136.20:48985
Sep 27, 2026 3:14:19 PM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Sep 27, 2026 3:14:19 PM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Sep 27, 2026 3:14:19 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790521920546562-17952-0/minicluster-data/ranger-kms/ews/webapp, webAppName = /kms
Sep 27, 2026 3:14:19 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/kms] = path [/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790521920546562-17952-0/minicluster-data/ranger-kms/ews/webapp] .....
Sep 27, 2026 3:14:20 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/kms] = path [/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790521920546562-17952-0/minicluster-data/ranger-kms/ews/webapp].
Sep 27, 2026 3:14:20 PM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : minirangerkms
I20260927 15:14:20.833312 17952 mini_ranger_kms.cc:207] Time spent starting Ranger KMS: real 4.738s user 0.008s sys 0.122s
I20260927 15:14:20.833416 17952 mini_ranger_kms.cc:397] {"name":"kuduclusterkey","cipher":"AES/CTR/NoPadding","length":128,"description":"kuduclusterkey"}
I20260927 15:14:20.833485 17952 mini_ranger_kms.cc:401] 127.17.136.20:48985/kms/v1/keys
Sep 27 15:14:21 dist-test-slave-5s2t krb5kdc[29707](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1790522061, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.17.136.20@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Sep 27 15:14:21 dist-test-slave-5s2t krb5kdc[29707](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790522061, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.17.136.20@KRBTEST.COM for HTTP/127.17.136.20@KRBTEST.COM
Sep 27 15:14:21 dist-test-slave-5s2t krb5kdc[29707](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790522061, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.17.136.20@KRBTEST.COM for HTTP/127.17.136.20@KRBTEST.COM
Sep 27 15:14:23 dist-test-slave-5s2t krb5kdc[29707](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790522063, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
WARNING: no policy specified for kudu/127.17.136.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.136.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.136.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790521920546562-17952-0/krb5kdc/kudu_127.17.136.62.keytab.
Entry for principal kudu/127.17.136.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790521920546562-17952-0/krb5kdc/kudu_127.17.136.62.keytab.
I20260927 15:14:23.879580 17952 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu
/tmp/dist-test-taskiFOyeW/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790521920546562-17952-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790521920546562-17952-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790521920546562-17952-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790521920546562-17952-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.136.62:42917
--webserver_interface=127.17.136.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790521920546562-17952-0/krb5kdc/kudu_127.17.136.62.keytab
--principal=kudu/127.17.136.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.136.20:38045
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.136.62:42917
--ranger_config_path=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790521920546562-17952-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.17.136.20:48985/kms
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790521920546562-17952-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790521920546562-17952-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790521920546562-17952-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260927 15:14:23.984380 30151 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260927 15:14:23.984639 30151 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260927 15:14:23.984679 30151 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260927 15:14:23.988657 30151 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260927 15:14:23.988713 30151 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260927 15:14:23.988731 30151 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260927 15:14:23.988761 30151 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260927 15:14:23.988786 30151 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260927 15:14:23.994199 30151 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.136.20:38045
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790521920546562-17952-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790521920546562-17952-0/minicluster-data/master-0/wal
--ranger_kms_url=127.17.136.20:48985/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.17.136.62:42917
--ranger_config_path=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790521920546562-17952-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790521920546562-17952-0/krb5kdc/kudu_127.17.136.62.keytab
--principal=kudu/127.17.136.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.136.62:42917
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790521920546562-17952-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.17.136.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30151
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790521920546562-17952-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 27 Sep 2026 14:27:13 UTC on ccycloud.quasar-psqrth.root.comops.site
build id 4676138
I20260927 15:14:23.995275 30151 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260927 15:14:23.996270 30151 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260927 15:14:24.004166 30159 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260927 15:14:24.004175 30157 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260927 15:14:24.004179 30156 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260927 15:14:24.004495 30151 server_base.cc:1034] running on GCE node
I20260927 15:14:24.004992 30151 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260927 15:14:24.006012 30151 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260927 15:14:24.007153 30151 hybrid_clock.cc:648] HybridClock initialized: now 1790522064007133 us; error 36 us; skew 500 ppm
Sep 27 15:14:24 dist-test-slave-5s2t krb5kdc[29707](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790522064, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.136.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260927 15:14:24.016242 30151 init.cc:377] Logged in from keytab as kudu/127.17.136.62@KRBTEST.COM (short username kudu)
I20260927 15:14:24.017167 30151 webserver.cc:460] Webserver started at http://127.17.136.62:33389/ using document root <none> and password file <none>
I20260927 15:14:24.017678 30151 fs_manager.cc:359] Metadata directory not provided
I20260927 15:14:24.017729 30151 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260927 15:14:24.017903 30151 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Sep 27 15:14:24 dist-test-slave-5s2t krb5kdc[29707](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790522064, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.136.62@KRBTEST.COM for HTTP/127.17.136.20@KRBTEST.COM
I20260927 15:14:24.072444 30151 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790521920546562-17952-0/minicluster-data/master-0/data/instance:
uuid: "283a12e2b76b410684aa493c45f24682"
format_stamp: "Formatted at 2026-09-27 15:14:24 on dist-test-slave-5s2t"
server_key: "82199909742b95bd23e0ab6160778bb4"
server_key_iv: "f488c68343043b3ff496ceaaea1183f1"
server_key_version: "kuduclusterkey@0"
I20260927 15:14:24.073154 30151 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790521920546562-17952-0/minicluster-data/master-0/wal/instance:
uuid: "283a12e2b76b410684aa493c45f24682"
format_stamp: "Formatted at 2026-09-27 15:14:24 on dist-test-slave-5s2t"
server_key: "82199909742b95bd23e0ab6160778bb4"
server_key_iv: "f488c68343043b3ff496ceaaea1183f1"
server_key_version: "kuduclusterkey@0"
I20260927 15:14:24.077876 30151 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260927 15:14:24.094288 30166 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260927 15:14:24.095899 30151 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260927 15:14:24.096031 30151 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790521920546562-17952-0/minicluster-data/master-0/data,/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790521920546562-17952-0/minicluster-data/master-0/wal
uuid: "283a12e2b76b410684aa493c45f24682"
format_stamp: "Formatted at 2026-09-27 15:14:24 on dist-test-slave-5s2t"
server_key: "82199909742b95bd23e0ab6160778bb4"
server_key_iv: "f488c68343043b3ff496ceaaea1183f1"
server_key_version: "kuduclusterkey@0"
I20260927 15:14:24.096163 30151 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790521920546562-17952-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790521920546562-17952-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790521920546562-17952-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260927 15:14:24.114143 30151 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260927 15:14:24.117341 30151 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260927 15:14:24.117532 30151 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260927 15:14:24.124991 30151 rpc_server.cc:307] RPC server started. Bound to: 127.17.136.62:42917
I20260927 15:14:24.125011 30218 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.136.62:42917 every 8 connection(s)
I20260927 15:14:24.125883 30151 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790521920546562-17952-0/minicluster-data/master-0/data/info.pb
I20260927 15:14:24.126295 17952 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu as pid 30151
I20260927 15:14:24.126410 17952 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790521920546562-17952-0/minicluster-data/master-0/wal/instance
I20260927 15:14:24.126652 17952 external_mini_cluster.cc:1428] Setting key a833b3235e01bf9709ca814b4a5da19e
I20260927 15:14:24.128810 30219 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:14:24.133961 30219 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 283a12e2b76b410684aa493c45f24682: Bootstrap starting.
Sep 27 15:14:24 dist-test-slave-5s2t krb5kdc[29707](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790522063, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.136.62@KRBTEST.COM
I20260927 15:14:24.136246 30219 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 283a12e2b76b410684aa493c45f24682: Neither blocks nor log segments found. Creating new log.
I20260927 15:14:24.137256 30219 log.cc:824] T 00000000000000000000000000000000 P 283a12e2b76b410684aa493c45f24682: Log is configured to *not* fsync() on all Append() calls
I20260927 15:14:24.139006 30219 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 283a12e2b76b410684aa493c45f24682: No bootstrap required, opened a new log
I20260927 15:14:24.139292 30222 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:14:24.127967 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59780 (local address 127.17.136.62:42917)
0927 15:14:24.128364 (+ 397us) server_negotiation.cc:206] Beginning negotiation
0927 15:14:24.128377 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0927 15:14:24.128410 (+ 33us) server_negotiation.cc:407] Connection header received
0927 15:14:24.129071 (+ 661us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:14:24.129088 (+ 17us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:14:24.129401 (+ 313us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:14:24.129700 (+ 299us) server_negotiation.cc:226] Negotiated authn=SASL
0927 15:14:24.130449 (+ 749us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:14:24.131481 (+ 1032us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:14:24.132308 (+ 827us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:14:24.132753 (+ 445us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:14:24.132885 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:14:24.135364 (+ 2479us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0927 15:14:24.135368 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0927 15:14:24.135379 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0927 15:14:24.135404 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0927 15:14:24.136824 (+ 1420us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:14:24.137206 (+ 382us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:14:24.137210 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:14:24.137215 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:14:24.137328 (+ 113us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:14:24.137560 (+ 232us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:14:24.137564 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:14:24.137565 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:14:24.137904 (+ 339us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0927 15:14:24.138099 (+ 195us) server_negotiation.cc:1035] Waiting for connection context
0927 15:14:24.138348 (+ 249us) server_negotiation.cc:299] Negotiation successful
0927 15:14:24.138588 (+ 240us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":274,"thread_start_us":130,"threads_started":1}
I20260927 15:14:24.142191 30219 raft_consensus.cc:348] T 00000000000000000000000000000000 P 283a12e2b76b410684aa493c45f24682 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "283a12e2b76b410684aa493c45f24682" member_type: VOTER last_known_addr { host: "127.17.136.62" port: 42917 } }
I20260927 15:14:24.142385 30219 raft_consensus.cc:374] T 00000000000000000000000000000000 P 283a12e2b76b410684aa493c45f24682 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:14:24.142432 30219 raft_consensus.cc:729] T 00000000000000000000000000000000 P 283a12e2b76b410684aa493c45f24682 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 283a12e2b76b410684aa493c45f24682, State: Initialized, Role: FOLLOWER
I20260927 15:14:24.142802 30219 consensus_queue.cc:260] T 00000000000000000000000000000000 P 283a12e2b76b410684aa493c45f24682 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "283a12e2b76b410684aa493c45f24682" member_type: VOTER last_known_addr { host: "127.17.136.62" port: 42917 } }
I20260927 15:14:24.142925 30219 raft_consensus.cc:388] T 00000000000000000000000000000000 P 283a12e2b76b410684aa493c45f24682 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260927 15:14:24.142985 30219 raft_consensus.cc:482] T 00000000000000000000000000000000 P 283a12e2b76b410684aa493c45f24682 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260927 15:14:24.143085 30219 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 283a12e2b76b410684aa493c45f24682 [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:14:24.143886 30219 raft_consensus.cc:504] T 00000000000000000000000000000000 P 283a12e2b76b410684aa493c45f24682 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "283a12e2b76b410684aa493c45f24682" member_type: VOTER last_known_addr { host: "127.17.136.62" port: 42917 } }
I20260927 15:14:24.144189 30219 leader_election.cc:302] T 00000000000000000000000000000000 P 283a12e2b76b410684aa493c45f24682 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 283a12e2b76b410684aa493c45f24682; no voters:
I20260927 15:14:24.144446 30219 leader_election.cc:288] T 00000000000000000000000000000000 P 283a12e2b76b410684aa493c45f24682 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260927 15:14:24.144528 30224 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 283a12e2b76b410684aa493c45f24682 [term 1 FOLLOWER]: Leader election won for term 1
I20260927 15:14:24.144734 30224 raft_consensus.cc:686] T 00000000000000000000000000000000 P 283a12e2b76b410684aa493c45f24682 [term 1 LEADER]: Becoming Leader. State: Replica: 283a12e2b76b410684aa493c45f24682, State: Running, Role: LEADER
I20260927 15:14:24.145032 30224 consensus_queue.cc:237] T 00000000000000000000000000000000 P 283a12e2b76b410684aa493c45f24682 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "283a12e2b76b410684aa493c45f24682" member_type: VOTER last_known_addr { host: "127.17.136.62" port: 42917 } }
I20260927 15:14:24.145503 30219 sys_catalog.cc:564] T 00000000000000000000000000000000 P 283a12e2b76b410684aa493c45f24682 [sys.catalog]: configured and running, proceeding with master startup.
I20260927 15:14:24.146415 30225 sys_catalog.cc:455] T 00000000000000000000000000000000 P 283a12e2b76b410684aa493c45f24682 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "283a12e2b76b410684aa493c45f24682" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "283a12e2b76b410684aa493c45f24682" member_type: VOTER last_known_addr { host: "127.17.136.62" port: 42917 } } }
I20260927 15:14:24.146525 30225 sys_catalog.cc:458] T 00000000000000000000000000000000 P 283a12e2b76b410684aa493c45f24682 [sys.catalog]: This master's current role is: LEADER
I20260927 15:14:24.146807 30226 sys_catalog.cc:455] T 00000000000000000000000000000000 P 283a12e2b76b410684aa493c45f24682 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 283a12e2b76b410684aa493c45f24682. Latest consensus state: current_term: 1 leader_uuid: "283a12e2b76b410684aa493c45f24682" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "283a12e2b76b410684aa493c45f24682" member_type: VOTER last_known_addr { host: "127.17.136.62" port: 42917 } } }
I20260927 15:14:24.146910 30226 sys_catalog.cc:458] T 00000000000000000000000000000000 P 283a12e2b76b410684aa493c45f24682 [sys.catalog]: This master's current role is: LEADER
I20260927 15:14:24.146935 30233 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260927 15:14:24.149694 30233 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260927 15:14:24.150164 30219 ranger_client.cc:318] Using new properties file: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790521920546562-17952-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260927 15:14:24.157744 30233 catalog_manager.cc:1347] Generated new cluster ID: fc073b3ddb9d403c857d8f556e5a237b
I20260927 15:14:24.157810 30233 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260927 15:14:24.181335 30233 catalog_manager.cc:1370] Generated new certificate authority record
I20260927 15:14:24.182673 30233 catalog_manager.cc:1504] Loading token signing keys...
I20260927 15:14:24.193615 30233 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 283a12e2b76b410684aa493c45f24682: Generated new TSK 0
I20260927 15:14:24.194447 30233 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.17.136.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.136.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.136.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790521920546562-17952-0/krb5kdc/kudu_127.17.136.1.keytab.
Entry for principal kudu/127.17.136.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790521920546562-17952-0/krb5kdc/kudu_127.17.136.1.keytab.
I20260927 15:14:24.866816 17952 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu
/tmp/dist-test-taskiFOyeW/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790521920546562-17952-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790521920546562-17952-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790521920546562-17952-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790521920546562-17952-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.17.136.20:48985/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.136.1:0
--local_ip_for_outbound_sockets=127.17.136.1
--webserver_interface=127.17.136.1
--webserver_port=0
--tserver_master_addrs=127.17.136.62:42917
--keytab_file=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790521920546562-17952-0/krb5kdc/kudu_127.17.136.1.keytab
--principal=kudu/127.17.136.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.136.20:38045
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790521920546562-17952-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790521920546562-17952-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790521920546562-17952-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260927 15:14:25.001298 30264 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260927 15:14:25.001631 30264 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260927 15:14:25.001708 30264 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260927 15:14:25.006625 30264 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260927 15:14:25.006685 30264 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260927 15:14:25.006769 30264 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.136.1
I20260927 15:14:25.012756 30264 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.136.20:38045
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790521920546562-17952-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790521920546562-17952-0/minicluster-data/ts-0/wal
--ranger_kms_url=127.17.136.20:48985/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790521920546562-17952-0/krb5kdc/kudu_127.17.136.1.keytab
--principal=kudu/127.17.136.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.136.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790521920546562-17952-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.17.136.1
--webserver_port=0
--tserver_master_addrs=127.17.136.62:42917
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30264
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.136.1
--log_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790521920546562-17952-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 27 Sep 2026 14:27:13 UTC on ccycloud.quasar-psqrth.root.comops.site
build id 4676138
I20260927 15:14:25.014055 30264 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260927 15:14:25.015334 30264 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260927 15:14:25.025753 30271 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260927 15:14:25.025763 30274 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260927 15:14:25.026630 30272 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260927 15:14:25.026932 30264 server_base.cc:1034] running on GCE node
I20260927 15:14:25.027413 30264 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260927 15:14:25.028180 30264 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260927 15:14:25.029366 30264 hybrid_clock.cc:648] HybridClock initialized: now 1790522065029336 us; error 46 us; skew 500 ppm
Sep 27 15:14:25 dist-test-slave-5s2t krb5kdc[29707](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790522065, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.136.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260927 15:14:25.032966 30264 init.cc:377] Logged in from keytab as kudu/127.17.136.1@KRBTEST.COM (short username kudu)
I20260927 15:14:25.034121 30264 webserver.cc:460] Webserver started at http://127.17.136.1:46077/ using document root <none> and password file <none>
I20260927 15:14:25.034852 30264 fs_manager.cc:359] Metadata directory not provided
I20260927 15:14:25.034943 30264 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260927 15:14:25.035219 30264 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Sep 27 15:14:25 dist-test-slave-5s2t krb5kdc[29707](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790522065, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.136.1@KRBTEST.COM for HTTP/127.17.136.20@KRBTEST.COM
I20260927 15:14:25.052456 30264 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790521920546562-17952-0/minicluster-data/ts-0/data/instance:
uuid: "5b8e8298e79743c6a74319041a08c370"
format_stamp: "Formatted at 2026-09-27 15:14:25 on dist-test-slave-5s2t"
server_key: "cc462b97c08e2e72e912df456ea45276"
server_key_iv: "d6d1f6210797f468bed6c353ca127d5f"
server_key_version: "kuduclusterkey@0"
I20260927 15:14:25.053236 30264 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790521920546562-17952-0/minicluster-data/ts-0/wal/instance:
uuid: "5b8e8298e79743c6a74319041a08c370"
format_stamp: "Formatted at 2026-09-27 15:14:25 on dist-test-slave-5s2t"
server_key: "cc462b97c08e2e72e912df456ea45276"
server_key_iv: "d6d1f6210797f468bed6c353ca127d5f"
server_key_version: "kuduclusterkey@0"
I20260927 15:14:25.060719 30264 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.004s sys 0.000s
I20260927 15:14:25.082938 30281 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260927 15:14:25.084862 30264 fs_manager.cc:725] Time spent opening block manager: real 0.010s user 0.003s sys 0.000s
I20260927 15:14:25.084988 30264 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790521920546562-17952-0/minicluster-data/ts-0/data,/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790521920546562-17952-0/minicluster-data/ts-0/wal
uuid: "5b8e8298e79743c6a74319041a08c370"
format_stamp: "Formatted at 2026-09-27 15:14:25 on dist-test-slave-5s2t"
server_key: "cc462b97c08e2e72e912df456ea45276"
server_key_iv: "d6d1f6210797f468bed6c353ca127d5f"
server_key_version: "kuduclusterkey@0"
I20260927 15:14:25.085114 30264 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790521920546562-17952-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790521920546562-17952-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790521920546562-17952-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260927 15:14:25.097811 30264 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260927 15:14:25.101280 30264 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260927 15:14:25.101460 30264 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260927 15:14:25.102219 30264 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260927 15:14:25.103232 30264 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260927 15:14:25.103386 30264 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260927 15:14:25.103504 30264 ts_tablet_manager.cc:610] Registered 0 tablets
I20260927 15:14:25.103585 30264 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260927 15:14:25.116772 30264 rpc_server.cc:307] RPC server started. Bound to: 127.17.136.1:43101
I20260927 15:14:25.117930 30264 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790521920546562-17952-0/minicluster-data/ts-0/data/info.pb
I20260927 15:14:25.118813 30396 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.136.1:43101 every 8 connection(s)
I20260927 15:14:25.126498 17952 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu as pid 30264
I20260927 15:14:25.126616 17952 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790521920546562-17952-0/minicluster-data/ts-0/wal/instance
I20260927 15:14:25.126919 17952 external_mini_cluster.cc:1428] Setting key e66c01bdeaa40458c338f56f448e785c
Sep 27 15:14:25 dist-test-slave-5s2t krb5kdc[29707](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790522065, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.136.1@KRBTEST.COM for kudu/127.17.136.62@KRBTEST.COM
WARNING: no policy specified for kudu/127.17.136.2@KRBTEST.COM; defaulting to no policy
I20260927 15:14:25.145180 30400 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:14:25.122128 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.136.1:44017 (local address 127.17.136.62:42917)
0927 15:14:25.122394 (+ 266us) server_negotiation.cc:206] Beginning negotiation
0927 15:14:25.122402 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0927 15:14:25.122419 (+ 17us) server_negotiation.cc:407] Connection header received
0927 15:14:25.122851 (+ 432us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:14:25.122854 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:14:25.122909 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:14:25.122970 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0927 15:14:25.124561 (+ 1591us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:14:25.134546 (+ 9985us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:14:25.137276 (+ 2730us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:14:25.137612 (+ 336us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:14:25.137680 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:14:25.140812 (+ 3132us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0927 15:14:25.140816 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0927 15:14:25.140819 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0927 15:14:25.140847 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0927 15:14:25.142685 (+ 1838us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:14:25.143326 (+ 641us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:14:25.143329 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:14:25.143331 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:14:25.143423 (+ 92us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:14:25.143846 (+ 423us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:14:25.143850 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:14:25.143851 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:14:25.144082 (+ 231us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0927 15:14:25.144165 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0927 15:14:25.144865 (+ 700us) server_negotiation.cc:299] Negotiation successful
0927 15:14:25.144994 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":198,"thread_start_us":97,"threads_started":1}
I20260927 15:14:25.147038 30399 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:14:25.121121 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.62:42917 (local address 127.17.136.1:44017)
0927 15:14:25.121590 (+ 469us) negotiation.cc:107] Waiting for socket to connect
0927 15:14:25.121642 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0927 15:14:25.122614 (+ 972us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0927 15:14:25.123398 (+ 784us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0927 15:14:25.123408 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0927 15:14:25.123746 (+ 338us) client_negotiation.cc:189] Negotiated authn=SASL
0927 15:14:25.124387 (+ 641us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:14:25.124405 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:14:25.135716 (+ 11311us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:14:25.135720 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:14:25.137136 (+ 1416us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:14:25.137148 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:14:25.137877 (+ 729us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:14:25.137880 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:14:25.138071 (+ 191us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:14:25.138811 (+ 740us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0927 15:14:25.138832 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0927 15:14:25.140619 (+ 1787us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0927 15:14:25.142813 (+ 2194us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0927 15:14:25.142820 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0927 15:14:25.142835 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0927 15:14:25.143176 (+ 341us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0927 15:14:25.143530 (+ 354us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0927 15:14:25.143533 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0927 15:14:25.143535 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0927 15:14:25.143734 (+ 199us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0927 15:14:25.144230 (+ 496us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0927 15:14:25.144237 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0927 15:14:25.144572 (+ 335us) client_negotiation.cc:769] Sending connection context
0927 15:14:25.145467 (+ 895us) client_negotiation.cc:240] Negotiation successful
0927 15:14:25.145835 (+ 368us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":250,"thread_start_us":107,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.136.2@KRBTEST.COM" created.
I20260927 15:14:25.148543 30397 heartbeater.cc:347] Connected to a master server at 127.17.136.62:42917
I20260927 15:14:25.148828 30397 heartbeater.cc:464] Registering TS with master...
I20260927 15:14:25.149384 30397 heartbeater.cc:511] Master 127.17.136.62:42917 requested a full tablet report, sending...
I20260927 15:14:25.151221 30183 ts_manager.cc:194] Registered new tserver with Master: 5b8e8298e79743c6a74319041a08c370 (127.17.136.1:43101)
I20260927 15:14:25.152801 30183 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.136.1@KRBTEST.COM'} at 127.17.136.1:44017
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.136.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790521920546562-17952-0/krb5kdc/kudu_127.17.136.2.keytab.
Entry for principal kudu/127.17.136.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790521920546562-17952-0/krb5kdc/kudu_127.17.136.2.keytab.
I20260927 15:14:25.168483 17952 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu
/tmp/dist-test-taskiFOyeW/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790521920546562-17952-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790521920546562-17952-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790521920546562-17952-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790521920546562-17952-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.17.136.20:48985/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.136.2:0
--local_ip_for_outbound_sockets=127.17.136.2
--webserver_interface=127.17.136.2
--webserver_port=0
--tserver_master_addrs=127.17.136.62:42917
--keytab_file=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790521920546562-17952-0/krb5kdc/kudu_127.17.136.2.keytab
--principal=kudu/127.17.136.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.136.20:38045
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790521920546562-17952-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790521920546562-17952-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790521920546562-17952-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Sep 27 15:14:25 dist-test-slave-5s2t krb5kdc[29707](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1790522065, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.136.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
W20260927 15:14:25.325461 30403 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260927 15:14:25.325806 30403 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260927 15:14:25.325867 30403 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260927 15:14:25.331864 30403 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260927 15:14:25.331939 30403 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260927 15:14:25.332024 30403 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.136.2
I20260927 15:14:25.339787 30403 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.136.20:38045
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790521920546562-17952-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790521920546562-17952-0/minicluster-data/ts-1/wal
--ranger_kms_url=127.17.136.20:48985/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790521920546562-17952-0/krb5kdc/kudu_127.17.136.2.keytab
--principal=kudu/127.17.136.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.136.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790521920546562-17952-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.17.136.2
--webserver_port=0
--tserver_master_addrs=127.17.136.62:42917
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30403
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.136.2
--log_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790521920546562-17952-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 27 Sep 2026 14:27:13 UTC on ccycloud.quasar-psqrth.root.comops.site
build id 4676138
I20260927 15:14:25.341045 30403 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260927 15:14:25.342335 30403 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260927 15:14:25.355654 30409 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260927 15:14:25.356024 30410 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260927 15:14:25.356156 30412 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260927 15:14:25.356379 30403 server_base.cc:1034] running on GCE node
I20260927 15:14:25.356973 30403 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260927 15:14:25.357802 30403 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260927 15:14:25.358989 30403 hybrid_clock.cc:648] HybridClock initialized: now 1790522065358966 us; error 38 us; skew 500 ppm
Sep 27 15:14:25 dist-test-slave-5s2t krb5kdc[29707](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790522065, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.136.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260927 15:14:25.362598 30403 init.cc:377] Logged in from keytab as kudu/127.17.136.2@KRBTEST.COM (short username kudu)
I20260927 15:14:25.363729 30403 webserver.cc:460] Webserver started at http://127.17.136.2:46017/ using document root <none> and password file <none>
I20260927 15:14:25.364485 30403 fs_manager.cc:359] Metadata directory not provided
I20260927 15:14:25.364624 30403 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260927 15:14:25.364888 30403 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Sep 27 15:14:25 dist-test-slave-5s2t krb5kdc[29707](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790522065, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.136.2@KRBTEST.COM for HTTP/127.17.136.20@KRBTEST.COM
I20260927 15:14:25.391916 30403 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790521920546562-17952-0/minicluster-data/ts-1/data/instance:
uuid: "8f704da49bf344ee898a54d2c5dfd89b"
format_stamp: "Formatted at 2026-09-27 15:14:25 on dist-test-slave-5s2t"
server_key: "5323f7d7098b4ba335f595f46c3cb8f0"
server_key_iv: "eca96b5da691dfa5e16516e407cc97ef"
server_key_version: "kuduclusterkey@0"
I20260927 15:14:25.392724 30403 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790521920546562-17952-0/minicluster-data/ts-1/wal/instance:
uuid: "8f704da49bf344ee898a54d2c5dfd89b"
format_stamp: "Formatted at 2026-09-27 15:14:25 on dist-test-slave-5s2t"
server_key: "5323f7d7098b4ba335f595f46c3cb8f0"
server_key_iv: "eca96b5da691dfa5e16516e407cc97ef"
server_key_version: "kuduclusterkey@0"
I20260927 15:14:25.398792 30403 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.004s sys 0.000s
I20260927 15:14:25.415006 30419 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260927 15:14:25.416801 30403 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260927 15:14:25.416941 30403 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790521920546562-17952-0/minicluster-data/ts-1/data,/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790521920546562-17952-0/minicluster-data/ts-1/wal
uuid: "8f704da49bf344ee898a54d2c5dfd89b"
format_stamp: "Formatted at 2026-09-27 15:14:25 on dist-test-slave-5s2t"
server_key: "5323f7d7098b4ba335f595f46c3cb8f0"
server_key_iv: "eca96b5da691dfa5e16516e407cc97ef"
server_key_version: "kuduclusterkey@0"
I20260927 15:14:25.417096 30403 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790521920546562-17952-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790521920546562-17952-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790521920546562-17952-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260927 15:14:25.460820 30403 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260927 15:14:25.465855 30403 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260927 15:14:25.466089 30403 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260927 15:14:25.466852 30403 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260927 15:14:25.467932 30403 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260927 15:14:25.467995 30403 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260927 15:14:25.468050 30403 ts_tablet_manager.cc:610] Registered 0 tablets
I20260927 15:14:25.468089 30403 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260927 15:14:25.477991 30403 rpc_server.cc:307] RPC server started. Bound to: 127.17.136.2:39601
I20260927 15:14:25.479151 30403 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790521920546562-17952-0/minicluster-data/ts-1/data/info.pb
I20260927 15:14:25.488201 17952 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu as pid 30403
I20260927 15:14:25.488304 17952 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790521920546562-17952-0/minicluster-data/ts-1/wal/instance
I20260927 15:14:25.488588 17952 external_mini_cluster.cc:1428] Setting key 7909ddfd23a161891fdfbfde461692da
I20260927 15:14:25.487888 30532 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.136.2:39601 every 8 connection(s)
WARNING: no policy specified for kudu/127.17.136.3@KRBTEST.COM; defaulting to no policy
Sep 27 15:14:25 dist-test-slave-5s2t krb5kdc[29707](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790522065, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.136.2@KRBTEST.COM for kudu/127.17.136.62@KRBTEST.COM
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.136.3@KRBTEST.COM" created.
I20260927 15:14:25.518426 30400 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:14:25.490820 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.136.2:47983 (local address 127.17.136.62:42917)
0927 15:14:25.490976 (+ 156us) server_negotiation.cc:206] Beginning negotiation
0927 15:14:25.490980 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0927 15:14:25.495132 (+ 4152us) server_negotiation.cc:407] Connection header received
0927 15:14:25.496392 (+ 1260us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:14:25.496396 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:14:25.496450 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:14:25.496505 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0927 15:14:25.501367 (+ 4862us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:14:25.502213 (+ 846us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:14:25.504102 (+ 1889us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:14:25.504447 (+ 345us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:14:25.504546 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:14:25.511881 (+ 7335us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0927 15:14:25.511886 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0927 15:14:25.511889 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0927 15:14:25.511923 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0927 15:14:25.513674 (+ 1751us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:14:25.514368 (+ 694us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:14:25.514372 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:14:25.514374 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:14:25.514469 (+ 95us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:14:25.514928 (+ 459us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:14:25.514931 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:14:25.514933 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:14:25.515171 (+ 238us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0927 15:14:25.515290 (+ 119us) server_negotiation.cc:1035] Waiting for connection context
0927 15:14:25.518096 (+ 2806us) server_negotiation.cc:299] Negotiation successful
0927 15:14:25.518243 (+ 147us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260927 15:14:25.520215 30535 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:14:25.491441 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.62:42917 (local address 127.17.136.2:47983)
0927 15:14:25.494970 (+ 3529us) negotiation.cc:107] Waiting for socket to connect
0927 15:14:25.495032 (+ 62us) client_negotiation.cc:174] Beginning negotiation
0927 15:14:25.496138 (+ 1106us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0927 15:14:25.496954 (+ 816us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0927 15:14:25.496964 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0927 15:14:25.497321 (+ 357us) client_negotiation.cc:189] Negotiated authn=SASL
0927 15:14:25.498024 (+ 703us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:14:25.498044 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:14:25.502445 (+ 4401us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:14:25.502448 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:14:25.503915 (+ 1467us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:14:25.503927 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:14:25.504800 (+ 873us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:14:25.504803 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:14:25.504996 (+ 193us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:14:25.508075 (+ 3079us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0927 15:14:25.508098 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0927 15:14:25.511622 (+ 3524us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0927 15:14:25.513834 (+ 2212us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0927 15:14:25.513841 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0927 15:14:25.513862 (+ 21us) client_negotiation.cc:760] calling sasl_client_step()
0927 15:14:25.514244 (+ 382us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0927 15:14:25.514597 (+ 353us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0927 15:14:25.514600 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0927 15:14:25.514602 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0927 15:14:25.514812 (+ 210us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0927 15:14:25.515364 (+ 552us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0927 15:14:25.515371 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0927 15:14:25.515745 (+ 374us) client_negotiation.cc:769] Sending connection context
0927 15:14:25.518681 (+ 2936us) client_negotiation.cc:240] Negotiation successful
0927 15:14:25.519069 (+ 388us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":792,"thread_start_us":143,"threads_started":1}
I20260927 15:14:25.521584 30533 heartbeater.cc:347] Connected to a master server at 127.17.136.62:42917
I20260927 15:14:25.521836 30533 heartbeater.cc:464] Registering TS with master...
I20260927 15:14:25.522449 30533 heartbeater.cc:511] Master 127.17.136.62:42917 requested a full tablet report, sending...
I20260927 15:14:25.523518 30183 ts_manager.cc:194] Registered new tserver with Master: 8f704da49bf344ee898a54d2c5dfd89b (127.17.136.2:39601)
I20260927 15:14:25.524296 30183 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.136.2@KRBTEST.COM'} at 127.17.136.2:47983
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.136.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790521920546562-17952-0/krb5kdc/kudu_127.17.136.3.keytab.
Entry for principal kudu/127.17.136.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790521920546562-17952-0/krb5kdc/kudu_127.17.136.3.keytab.
I20260927 15:14:25.542727 17952 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu
/tmp/dist-test-taskiFOyeW/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790521920546562-17952-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790521920546562-17952-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790521920546562-17952-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790521920546562-17952-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.17.136.20:48985/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.136.3:0
--local_ip_for_outbound_sockets=127.17.136.3
--webserver_interface=127.17.136.3
--webserver_port=0
--tserver_master_addrs=127.17.136.62:42917
--keytab_file=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790521920546562-17952-0/krb5kdc/kudu_127.17.136.3.keytab
--principal=kudu/127.17.136.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.136.20:38045
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790521920546562-17952-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790521920546562-17952-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790521920546562-17952-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Sep 27 15:14:25 dist-test-slave-5s2t krb5kdc[29707](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790522065, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.136.62@KRBTEST.COM for HTTP/127.17.136.20@KRBTEST.COM
W20260927 15:14:25.700438 30538 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260927 15:14:25.700889 30538 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260927 15:14:25.701010 30538 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260927 15:14:25.707041 30538 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260927 15:14:25.707118 30538 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260927 15:14:25.707199 30538 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.136.3
I20260927 15:14:25.715234 30538 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.136.20:38045
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790521920546562-17952-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790521920546562-17952-0/minicluster-data/ts-2/wal
--ranger_kms_url=127.17.136.20:48985/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790521920546562-17952-0/krb5kdc/kudu_127.17.136.3.keytab
--principal=kudu/127.17.136.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.136.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790521920546562-17952-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.17.136.3
--webserver_port=0
--tserver_master_addrs=127.17.136.62:42917
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30538
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.136.3
--log_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790521920546562-17952-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 27 Sep 2026 14:27:13 UTC on ccycloud.quasar-psqrth.root.comops.site
build id 4676138
I20260927 15:14:25.716629 30538 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260927 15:14:25.717929 30538 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260927 15:14:25.730475 30544 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260927 15:14:25.730607 30543 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260927 15:14:25.730888 30538 server_base.cc:1034] running on GCE node
W20260927 15:14:25.733052 30546 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260927 15:14:25.733525 30538 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260927 15:14:25.734241 30538 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260927 15:14:25.737484 30538 hybrid_clock.cc:648] HybridClock initialized: now 1790522065737419 us; error 79 us; skew 500 ppm
Sep 27 15:14:25 dist-test-slave-5s2t krb5kdc[29707](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790522065, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.136.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260927 15:14:25.741005 30538 init.cc:377] Logged in from keytab as kudu/127.17.136.3@KRBTEST.COM (short username kudu)
I20260927 15:14:25.741997 30538 webserver.cc:460] Webserver started at http://127.17.136.3:43251/ using document root <none> and password file <none>
I20260927 15:14:25.742657 30538 fs_manager.cc:359] Metadata directory not provided
I20260927 15:14:25.742730 30538 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260927 15:14:25.742941 30538 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Sep 27 15:14:25 dist-test-slave-5s2t krb5kdc[29707](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790522065, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.136.3@KRBTEST.COM for HTTP/127.17.136.20@KRBTEST.COM
I20260927 15:14:25.774854 30538 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790521920546562-17952-0/minicluster-data/ts-2/data/instance:
uuid: "a363e237b7834e2ab8980eff01e257e6"
format_stamp: "Formatted at 2026-09-27 15:14:25 on dist-test-slave-5s2t"
server_key: "56fb01399d10417a86a112dadafe5270"
server_key_iv: "c2a280b4d45e4b0b88c5c80f8aa5919c"
server_key_version: "kuduclusterkey@0"
I20260927 15:14:25.775695 30538 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790521920546562-17952-0/minicluster-data/ts-2/wal/instance:
uuid: "a363e237b7834e2ab8980eff01e257e6"
format_stamp: "Formatted at 2026-09-27 15:14:25 on dist-test-slave-5s2t"
server_key: "56fb01399d10417a86a112dadafe5270"
server_key_iv: "c2a280b4d45e4b0b88c5c80f8aa5919c"
server_key_version: "kuduclusterkey@0"
I20260927 15:14:25.785053 30538 fs_manager.cc:691] Time spent creating directory manager: real 0.009s user 0.001s sys 0.003s
I20260927 15:14:25.810649 30553 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260927 15:14:25.812525 30538 fs_manager.cc:725] Time spent opening block manager: real 0.013s user 0.001s sys 0.000s
I20260927 15:14:25.812673 30538 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790521920546562-17952-0/minicluster-data/ts-2/data,/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790521920546562-17952-0/minicluster-data/ts-2/wal
uuid: "a363e237b7834e2ab8980eff01e257e6"
format_stamp: "Formatted at 2026-09-27 15:14:25 on dist-test-slave-5s2t"
server_key: "56fb01399d10417a86a112dadafe5270"
server_key_iv: "c2a280b4d45e4b0b88c5c80f8aa5919c"
server_key_version: "kuduclusterkey@0"
I20260927 15:14:25.812814 30538 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790521920546562-17952-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790521920546562-17952-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790521920546562-17952-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260927 15:14:25.834254 30538 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260927 15:14:25.837536 30538 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260927 15:14:25.837728 30538 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260927 15:14:25.838410 30538 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260927 15:14:25.839370 30538 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260927 15:14:25.839426 30538 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260927 15:14:25.839479 30538 ts_tablet_manager.cc:610] Registered 0 tablets
I20260927 15:14:25.839506 30538 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260927 15:14:25.848647 30538 rpc_server.cc:307] RPC server started. Bound to: 127.17.136.3:33363
I20260927 15:14:25.849684 30538 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790521920546562-17952-0/minicluster-data/ts-2/data/info.pb
I20260927 15:14:25.850947 17952 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu as pid 30538
I20260927 15:14:25.851055 17952 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790521920546562-17952-0/minicluster-data/ts-2/wal/instance
I20260927 15:14:25.851382 17952 external_mini_cluster.cc:1428] Setting key 7cd12b13b73a6b50ac8b38f0f0d4785a
I20260927 15:14:25.862751 30666 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.136.3:33363 every 8 connection(s)
Sep 27 15:14:25 dist-test-slave-5s2t krb5kdc[29707](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790522065, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.136.3@KRBTEST.COM for kudu/127.17.136.62@KRBTEST.COM
I20260927 15:14:25.880106 30400 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:14:25.861232 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.136.3:43063 (local address 127.17.136.62:42917)
0927 15:14:25.861356 (+ 124us) server_negotiation.cc:206] Beginning negotiation
0927 15:14:25.861360 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0927 15:14:25.865636 (+ 4276us) server_negotiation.cc:407] Connection header received
0927 15:14:25.866794 (+ 1158us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:14:25.866797 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:14:25.866847 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:14:25.866892 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0927 15:14:25.868565 (+ 1673us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:14:25.869426 (+ 861us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:14:25.871127 (+ 1701us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:14:25.871473 (+ 346us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:14:25.871561 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:14:25.874458 (+ 2897us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0927 15:14:25.874462 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0927 15:14:25.874464 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0927 15:14:25.874492 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0927 15:14:25.877728 (+ 3236us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:14:25.878328 (+ 600us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:14:25.878332 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:14:25.878334 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:14:25.878418 (+ 84us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:14:25.878804 (+ 386us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:14:25.878807 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:14:25.878809 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:14:25.879038 (+ 229us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0927 15:14:25.879106 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0927 15:14:25.879816 (+ 710us) server_negotiation.cc:299] Negotiation successful
0927 15:14:25.879947 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260927 15:14:25.882010 30669 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:14:25.861741 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.62:42917 (local address 127.17.136.3:43063)
0927 15:14:25.865493 (+ 3752us) negotiation.cc:107] Waiting for socket to connect
0927 15:14:25.865551 (+ 58us) client_negotiation.cc:174] Beginning negotiation
0927 15:14:25.866552 (+ 1001us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0927 15:14:25.867334 (+ 782us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0927 15:14:25.867343 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0927 15:14:25.867679 (+ 336us) client_negotiation.cc:189] Negotiated authn=SASL
0927 15:14:25.868411 (+ 732us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:14:25.868432 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:14:25.869594 (+ 1162us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:14:25.869597 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:14:25.870952 (+ 1355us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:14:25.870962 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:14:25.871775 (+ 813us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:14:25.871779 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:14:25.871989 (+ 210us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:14:25.872662 (+ 673us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0927 15:14:25.872683 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0927 15:14:25.874275 (+ 1592us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0927 15:14:25.877866 (+ 3591us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0927 15:14:25.877872 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0927 15:14:25.877890 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0927 15:14:25.878223 (+ 333us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0927 15:14:25.878517 (+ 294us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0927 15:14:25.878520 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0927 15:14:25.878522 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0927 15:14:25.878698 (+ 176us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0927 15:14:25.879184 (+ 486us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0927 15:14:25.879191 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0927 15:14:25.879542 (+ 351us) client_negotiation.cc:769] Sending connection context
0927 15:14:25.880536 (+ 994us) client_negotiation.cc:240] Negotiation successful
0927 15:14:25.880965 (+ 429us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":3524,"thread_start_us":161,"threads_started":1}
I20260927 15:14:25.883430 30667 heartbeater.cc:347] Connected to a master server at 127.17.136.62:42917
I20260927 15:14:25.883651 30667 heartbeater.cc:464] Registering TS with master...
I20260927 15:14:25.884163 30667 heartbeater.cc:511] Master 127.17.136.62:42917 requested a full tablet report, sending...
I20260927 15:14:25.885247 30183 ts_manager.cc:194] Registered new tserver with Master: a363e237b7834e2ab8980eff01e257e6 (127.17.136.3:33363)
I20260927 15:14:25.885957 30183 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.136.3@KRBTEST.COM'} at 127.17.136.3:43063
I20260927 15:14:25.889343 17952 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260927 15:14:25.890010 17952 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu with pid 30264
I20260927 15:14:25.896317 17952 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu with pid 30403
I20260927 15:14:25.904006 17952 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu with pid 30538
I20260927 15:14:25.911428 17952 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu with pid 30151
I20260927 15:14:25.918610 17952 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu
/tmp/dist-test-taskiFOyeW/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790521920546562-17952-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790521920546562-17952-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790521920546562-17952-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790521920546562-17952-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.136.62:42917
--webserver_interface=127.17.136.62
--webserver_port=33389
--keytab_file=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790521920546562-17952-0/krb5kdc/kudu_127.17.136.62.keytab
--principal=kudu/127.17.136.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.136.20:38045
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.136.62:42917
--ranger_config_path=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790521920546562-17952-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.17.136.20:48985/kms
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.17.136.20:48985/kms with env {KRB5CCNAME=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790521920546562-17952-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790521920546562-17952-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790521920546562-17952-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260927 15:14:26.026165 30670 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260927 15:14:26.026443 30670 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260927 15:14:26.026484 30670 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260927 15:14:26.030390 30670 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260927 15:14:26.030455 30670 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260927 15:14:26.030476 30670 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260927 15:14:26.030495 30670 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260927 15:14:26.030519 30670 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260927 15:14:26.036013 30670 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.136.20:38045
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790521920546562-17952-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790521920546562-17952-0/minicluster-data/master-0/wal
--ranger_kms_url=invalid.host:1234/kms,127.17.136.20:48985/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.17.136.62:42917
--ranger_config_path=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790521920546562-17952-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790521920546562-17952-0/krb5kdc/kudu_127.17.136.62.keytab
--principal=kudu/127.17.136.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.136.62:42917
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790521920546562-17952-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.17.136.62
--webserver_port=33389
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30670
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790521920546562-17952-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 27 Sep 2026 14:27:13 UTC on ccycloud.quasar-psqrth.root.comops.site
build id 4676138
I20260927 15:14:26.037003 30670 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260927 15:14:26.037988 30670 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260927 15:14:26.046078 30678 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260927 15:14:26.046118 30675 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260927 15:14:26.046257 30670 server_base.cc:1034] running on GCE node
W20260927 15:14:26.046190 30676 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260927 15:14:26.046798 30670 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260927 15:14:26.047866 30670 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260927 15:14:26.049012 30670 hybrid_clock.cc:648] HybridClock initialized: now 1790522066048990 us; error 41 us; skew 500 ppm
Sep 27 15:14:26 dist-test-slave-5s2t krb5kdc[29707](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790522066, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.136.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260927 15:14:26.051563 30670 init.cc:377] Logged in from keytab as kudu/127.17.136.62@KRBTEST.COM (short username kudu)
I20260927 15:14:26.052341 30670 webserver.cc:460] Webserver started at http://127.17.136.62:33389/ using document root <none> and password file <none>
I20260927 15:14:26.052829 30670 fs_manager.cc:359] Metadata directory not provided
I20260927 15:14:26.052896 30670 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Sep 27 15:14:26 dist-test-slave-5s2t krb5kdc[29707](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790522066, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.136.62@KRBTEST.COM for HTTP/127.17.136.20@KRBTEST.COM
I20260927 15:14:26.117331 30670 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.003s sys 0.000s
I20260927 15:14:26.119477 30686 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260927 15:14:26.120685 30670 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260927 15:14:26.120788 30670 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790521920546562-17952-0/minicluster-data/master-0/data,/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790521920546562-17952-0/minicluster-data/master-0/wal
uuid: "283a12e2b76b410684aa493c45f24682"
format_stamp: "Formatted at 2026-09-27 15:14:24 on dist-test-slave-5s2t"
server_key: "82199909742b95bd23e0ab6160778bb4"
server_key_iv: "f488c68343043b3ff496ceaaea1183f1"
server_key_version: "kuduclusterkey@0"
I20260927 15:14:26.121304 30670 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790521920546562-17952-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790521920546562-17952-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790521920546562-17952-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260927 15:14:26.135660 30670 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260927 15:14:26.137964 30670 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260927 15:14:26.138130 30670 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260927 15:14:26.144641 30670 rpc_server.cc:307] RPC server started. Bound to: 127.17.136.62:42917
I20260927 15:14:26.144709 30738 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.136.62:42917 every 8 connection(s)
I20260927 15:14:26.145643 30670 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790521920546562-17952-0/minicluster-data/master-0/data/info.pb
I20260927 15:14:26.149607 30739 sys_catalog.cc:263] Verifying existing consensus state
I20260927 15:14:26.151160 30739 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 283a12e2b76b410684aa493c45f24682: Bootstrap starting.
I20260927 15:14:26.155189 17952 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu as pid 30670
I20260927 15:14:26.155591 17952 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu
/tmp/dist-test-taskiFOyeW/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790521920546562-17952-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790521920546562-17952-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790521920546562-17952-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790521920546562-17952-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.17.136.20:48985/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.136.1:43101
--local_ip_for_outbound_sockets=127.17.136.1
--tserver_master_addrs=127.17.136.62:42917
--webserver_port=46077
--webserver_interface=127.17.136.1
--keytab_file=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790521920546562-17952-0/krb5kdc/kudu_127.17.136.1.keytab
--principal=kudu/127.17.136.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.136.20:38045
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.17.136.20:48985/kms with env {KRB5CCNAME=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790521920546562-17952-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790521920546562-17952-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790521920546562-17952-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260927 15:14:26.166709 30739 log.cc:824] T 00000000000000000000000000000000 P 283a12e2b76b410684aa493c45f24682: Log is configured to *not* fsync() on all Append() calls
I20260927 15:14:26.173102 30739 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 283a12e2b76b410684aa493c45f24682: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260927 15:14:26.173432 30739 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 283a12e2b76b410684aa493c45f24682: Bootstrap complete.
I20260927 15:14:26.177256 30739 raft_consensus.cc:348] T 00000000000000000000000000000000 P 283a12e2b76b410684aa493c45f24682 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "283a12e2b76b410684aa493c45f24682" member_type: VOTER last_known_addr { host: "127.17.136.62" port: 42917 } }
I20260927 15:14:26.177621 30739 raft_consensus.cc:729] T 00000000000000000000000000000000 P 283a12e2b76b410684aa493c45f24682 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 283a12e2b76b410684aa493c45f24682, State: Initialized, Role: FOLLOWER
I20260927 15:14:26.178058 30739 consensus_queue.cc:260] T 00000000000000000000000000000000 P 283a12e2b76b410684aa493c45f24682 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "283a12e2b76b410684aa493c45f24682" member_type: VOTER last_known_addr { host: "127.17.136.62" port: 42917 } }
I20260927 15:14:26.178164 30739 raft_consensus.cc:388] T 00000000000000000000000000000000 P 283a12e2b76b410684aa493c45f24682 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260927 15:14:26.178223 30739 raft_consensus.cc:482] T 00000000000000000000000000000000 P 283a12e2b76b410684aa493c45f24682 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260927 15:14:26.178305 30739 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 283a12e2b76b410684aa493c45f24682 [term 1 FOLLOWER]: Advancing to term 2
I20260927 15:14:26.180056 30739 raft_consensus.cc:504] T 00000000000000000000000000000000 P 283a12e2b76b410684aa493c45f24682 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "283a12e2b76b410684aa493c45f24682" member_type: VOTER last_known_addr { host: "127.17.136.62" port: 42917 } }
I20260927 15:14:26.180338 30739 leader_election.cc:302] T 00000000000000000000000000000000 P 283a12e2b76b410684aa493c45f24682 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 283a12e2b76b410684aa493c45f24682; no voters:
I20260927 15:14:26.180603 30739 leader_election.cc:288] T 00000000000000000000000000000000 P 283a12e2b76b410684aa493c45f24682 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260927 15:14:26.180693 30743 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 283a12e2b76b410684aa493c45f24682 [term 2 FOLLOWER]: Leader election won for term 2
I20260927 15:14:26.180881 30743 raft_consensus.cc:686] T 00000000000000000000000000000000 P 283a12e2b76b410684aa493c45f24682 [term 2 LEADER]: Becoming Leader. State: Replica: 283a12e2b76b410684aa493c45f24682, State: Running, Role: LEADER
I20260927 15:14:26.181227 30743 consensus_queue.cc:237] T 00000000000000000000000000000000 P 283a12e2b76b410684aa493c45f24682 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "283a12e2b76b410684aa493c45f24682" member_type: VOTER last_known_addr { host: "127.17.136.62" port: 42917 } }
I20260927 15:14:26.181738 30739 sys_catalog.cc:564] T 00000000000000000000000000000000 P 283a12e2b76b410684aa493c45f24682 [sys.catalog]: configured and running, proceeding with master startup.
I20260927 15:14:26.182085 30743 sys_catalog.cc:455] T 00000000000000000000000000000000 P 283a12e2b76b410684aa493c45f24682 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 283a12e2b76b410684aa493c45f24682. Latest consensus state: current_term: 2 leader_uuid: "283a12e2b76b410684aa493c45f24682" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "283a12e2b76b410684aa493c45f24682" member_type: VOTER last_known_addr { host: "127.17.136.62" port: 42917 } } }
I20260927 15:14:26.182253 30743 sys_catalog.cc:458] T 00000000000000000000000000000000 P 283a12e2b76b410684aa493c45f24682 [sys.catalog]: This master's current role is: LEADER
I20260927 15:14:26.182417 30744 sys_catalog.cc:455] T 00000000000000000000000000000000 P 283a12e2b76b410684aa493c45f24682 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "283a12e2b76b410684aa493c45f24682" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "283a12e2b76b410684aa493c45f24682" member_type: VOTER last_known_addr { host: "127.17.136.62" port: 42917 } } }
I20260927 15:14:26.182590 30744 sys_catalog.cc:458] T 00000000000000000000000000000000 P 283a12e2b76b410684aa493c45f24682 [sys.catalog]: This master's current role is: LEADER
I20260927 15:14:26.182646 30747 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260927 15:14:26.185688 30747 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260927 15:14:26.186120 30739 ranger_client.cc:318] Using overwritten properties file: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790521920546562-17952-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260927 15:14:26.186318 30747 catalog_manager.cc:1259] Loaded cluster ID: fc073b3ddb9d403c857d8f556e5a237b
I20260927 15:14:26.186363 30747 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260927 15:14:26.188638 30747 catalog_manager.cc:1504] Loading token signing keys...
I20260927 15:14:26.189257 30747 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 283a12e2b76b410684aa493c45f24682: Loaded TSK: 0
I20260927 15:14:26.190387 30747 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260927 15:14:26.289708 30741 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260927 15:14:26.290130 30741 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260927 15:14:26.290251 30741 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260927 15:14:26.296191 30741 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260927 15:14:26.296316 30741 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260927 15:14:26.296449 30741 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.136.1
I20260927 15:14:26.303973 30741 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.136.20:38045
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790521920546562-17952-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790521920546562-17952-0/minicluster-data/ts-0/wal
--ranger_kms_url=invalid.host:1234/kms,127.17.136.20:48985/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790521920546562-17952-0/krb5kdc/kudu_127.17.136.1.keytab
--principal=kudu/127.17.136.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.136.1:43101
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790521920546562-17952-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.17.136.1
--webserver_port=46077
--tserver_master_addrs=127.17.136.62:42917
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30741
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.136.1
--log_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790521920546562-17952-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 27 Sep 2026 14:27:13 UTC on ccycloud.quasar-psqrth.root.comops.site
build id 4676138
I20260927 15:14:26.305253 30741 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260927 15:14:26.306553 30741 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260927 15:14:26.318874 30776 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260927 15:14:26.319463 30779 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260927 15:14:26.320163 30777 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260927 15:14:26.321911 30741 server_base.cc:1034] running on GCE node
I20260927 15:14:26.322453 30741 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260927 15:14:26.323321 30741 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260927 15:14:26.330744 30741 hybrid_clock.cc:648] HybridClock initialized: now 1790522066330694 us; error 63 us; skew 500 ppm
Sep 27 15:14:26 dist-test-slave-5s2t krb5kdc[29707](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790522066, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.136.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260927 15:14:26.334534 30741 init.cc:377] Logged in from keytab as kudu/127.17.136.1@KRBTEST.COM (short username kudu)
I20260927 15:14:26.335728 30741 webserver.cc:460] Webserver started at http://127.17.136.1:46077/ using document root <none> and password file <none>
I20260927 15:14:26.336432 30741 fs_manager.cc:359] Metadata directory not provided
I20260927 15:14:26.336541 30741 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Sep 27 15:14:26 dist-test-slave-5s2t krb5kdc[29707](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790522066, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.136.1@KRBTEST.COM for HTTP/127.17.136.20@KRBTEST.COM
I20260927 15:14:26.363234 30741 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.002s sys 0.000s
I20260927 15:14:26.369740 30787 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260927 15:14:26.373180 30741 fs_manager.cc:725] Time spent opening block manager: real 0.009s user 0.003s sys 0.000s
I20260927 15:14:26.373464 30741 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790521920546562-17952-0/minicluster-data/ts-0/data,/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790521920546562-17952-0/minicluster-data/ts-0/wal
uuid: "5b8e8298e79743c6a74319041a08c370"
format_stamp: "Formatted at 2026-09-27 15:14:25 on dist-test-slave-5s2t"
server_key: "cc462b97c08e2e72e912df456ea45276"
server_key_iv: "d6d1f6210797f468bed6c353ca127d5f"
server_key_version: "kuduclusterkey@0"
I20260927 15:14:26.374392 30741 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790521920546562-17952-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790521920546562-17952-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790521920546562-17952-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260927 15:14:26.388999 30741 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260927 15:14:26.392153 30741 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260927 15:14:26.392335 30741 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260927 15:14:26.392939 30741 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260927 15:14:26.393872 30741 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260927 15:14:26.393934 30741 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260927 15:14:26.393987 30741 ts_tablet_manager.cc:610] Registered 0 tablets
I20260927 15:14:26.394014 30741 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260927 15:14:26.403824 30741 rpc_server.cc:307] RPC server started. Bound to: 127.17.136.1:43101
I20260927 15:14:26.405167 30741 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790521920546562-17952-0/minicluster-data/ts-0/data/info.pb
I20260927 15:14:26.405159 30900 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.136.1:43101 every 8 connection(s)
I20260927 15:14:26.414103 17952 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu as pid 30741
I20260927 15:14:26.414564 17952 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu
/tmp/dist-test-taskiFOyeW/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790521920546562-17952-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790521920546562-17952-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790521920546562-17952-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790521920546562-17952-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.17.136.20:48985/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.136.2:39601
--local_ip_for_outbound_sockets=127.17.136.2
--tserver_master_addrs=127.17.136.62:42917
--webserver_port=46017
--webserver_interface=127.17.136.2
--keytab_file=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790521920546562-17952-0/krb5kdc/kudu_127.17.136.2.keytab
--principal=kudu/127.17.136.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.136.20:38045
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.17.136.20:48985/kms with env {KRB5CCNAME=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790521920546562-17952-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790521920546562-17952-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790521920546562-17952-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Sep 27 15:14:26 dist-test-slave-5s2t krb5kdc[29707](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790522066, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.136.1@KRBTEST.COM for kudu/127.17.136.62@KRBTEST.COM
I20260927 15:14:26.423746 30904 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:14:26.407681 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.62:42917 (local address 127.17.136.1:50455)
0927 15:14:26.408357 (+ 676us) negotiation.cc:107] Waiting for socket to connect
0927 15:14:26.408417 (+ 60us) client_negotiation.cc:174] Beginning negotiation
0927 15:14:26.409269 (+ 852us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0927 15:14:26.410420 (+ 1151us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0927 15:14:26.410429 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0927 15:14:26.410741 (+ 312us) client_negotiation.cc:189] Negotiated authn=SASL
0927 15:14:26.411196 (+ 455us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:14:26.411210 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:14:26.412508 (+ 1298us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:14:26.412511 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:14:26.413740 (+ 1229us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:14:26.413751 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:14:26.414973 (+ 1222us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:14:26.414977 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:14:26.415165 (+ 188us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:14:26.415887 (+ 722us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0927 15:14:26.415908 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0927 15:14:26.417316 (+ 1408us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0927 15:14:26.419706 (+ 2390us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0927 15:14:26.419712 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0927 15:14:26.419727 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0927 15:14:26.420065 (+ 338us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0927 15:14:26.420468 (+ 403us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0927 15:14:26.420471 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0927 15:14:26.420473 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0927 15:14:26.421056 (+ 583us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0927 15:14:26.421946 (+ 890us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0927 15:14:26.421952 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0927 15:14:26.422217 (+ 265us) client_negotiation.cc:769] Sending connection context
0927 15:14:26.422375 (+ 158us) client_negotiation.cc:240] Negotiation successful
0927 15:14:26.422701 (+ 326us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":485,"thread_start_us":133,"threads_started":1}
I20260927 15:14:26.423732 30903 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:14:26.407450 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.136.1:50455 (local address 127.17.136.62:42917)
0927 15:14:26.408089 (+ 639us) server_negotiation.cc:206] Beginning negotiation
0927 15:14:26.408111 (+ 22us) server_negotiation.cc:399] Waiting for connection header
0927 15:14:26.408542 (+ 431us) server_negotiation.cc:407] Connection header received
0927 15:14:26.409693 (+ 1151us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:14:26.409704 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:14:26.410015 (+ 311us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:14:26.410307 (+ 292us) server_negotiation.cc:226] Negotiated authn=SASL
0927 15:14:26.411384 (+ 1077us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:14:26.412374 (+ 990us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:14:26.413882 (+ 1508us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:14:26.414581 (+ 699us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:14:26.414726 (+ 145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:14:26.417505 (+ 2779us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0927 15:14:26.417511 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0927 15:14:26.417523 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0927 15:14:26.417551 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0927 15:14:26.419572 (+ 2021us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:14:26.420203 (+ 631us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:14:26.420209 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:14:26.420215 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:14:26.420351 (+ 136us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:14:26.421170 (+ 819us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:14:26.421174 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:14:26.421175 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:14:26.421733 (+ 558us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0927 15:14:26.421855 (+ 122us) server_negotiation.cc:1035] Waiting for connection context
0927 15:14:26.422589 (+ 734us) server_negotiation.cc:299] Negotiation successful
0927 15:14:26.422852 (+ 263us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":480,"thread_start_us":121,"threads_started":1}
I20260927 15:14:26.426296 30901 heartbeater.cc:347] Connected to a master server at 127.17.136.62:42917
I20260927 15:14:26.426532 30901 heartbeater.cc:464] Registering TS with master...
I20260927 15:14:26.427000 30901 heartbeater.cc:511] Master 127.17.136.62:42917 requested a full tablet report, sending...
W20260927 15:14:26.428977 30901 heartbeater.cc:644] Failed to heartbeat to 127.17.136.62:42917 (0 consecutive failures): Service unavailable: Catalog manager is not initialized. State: Starting
I20260927 15:14:26.429087 30901 heartbeater.cc:464] Registering TS with master...
I20260927 15:14:26.429244 30901 heartbeater.cc:511] Master 127.17.136.62:42917 requested a full tablet report, sending...
I20260927 15:14:26.429983 30901 heartbeater.cc:464] Registering TS with master...
I20260927 15:14:26.430146 30901 heartbeater.cc:511] Master 127.17.136.62:42917 requested a full tablet report, sending...
W20260927 15:14:26.430809 30901 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260927 15:14:26.554183 30905 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260927 15:14:26.554427 30905 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260927 15:14:26.554476 30905 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260927 15:14:26.558862 30905 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260927 15:14:26.558924 30905 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260927 15:14:26.559003 30905 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.136.2
I20260927 15:14:26.565639 30905 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.136.20:38045
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790521920546562-17952-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790521920546562-17952-0/minicluster-data/ts-1/wal
--ranger_kms_url=invalid.host:1234/kms,127.17.136.20:48985/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790521920546562-17952-0/krb5kdc/kudu_127.17.136.2.keytab
--principal=kudu/127.17.136.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.136.2:39601
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790521920546562-17952-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.17.136.2
--webserver_port=46017
--tserver_master_addrs=127.17.136.62:42917
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30905
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.136.2
--log_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790521920546562-17952-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 27 Sep 2026 14:27:13 UTC on ccycloud.quasar-psqrth.root.comops.site
build id 4676138
I20260927 15:14:26.566897 30905 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260927 15:14:26.568068 30905 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260927 15:14:26.578825 30913 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260927 15:14:26.578832 30911 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260927 15:14:26.579325 30910 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260927 15:14:26.580268 30905 server_base.cc:1034] running on GCE node
I20260927 15:14:26.580778 30905 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260927 15:14:26.581544 30905 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260927 15:14:26.582726 30905 hybrid_clock.cc:648] HybridClock initialized: now 1790522066582698 us; error 42 us; skew 500 ppm
Sep 27 15:14:26 dist-test-slave-5s2t krb5kdc[29707](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790522066, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.136.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260927 15:14:26.586292 30905 init.cc:377] Logged in from keytab as kudu/127.17.136.2@KRBTEST.COM (short username kudu)
I20260927 15:14:26.587368 30905 webserver.cc:460] Webserver started at http://127.17.136.2:46017/ using document root <none> and password file <none>
I20260927 15:14:26.588083 30905 fs_manager.cc:359] Metadata directory not provided
I20260927 15:14:26.588182 30905 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Sep 27 15:14:26 dist-test-slave-5s2t krb5kdc[29707](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790522066, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.136.2@KRBTEST.COM for HTTP/127.17.136.20@KRBTEST.COM
I20260927 15:14:26.611420 30905 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.003s sys 0.001s
I20260927 15:14:26.613989 30921 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260927 15:14:26.615640 30905 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260927 15:14:26.615809 30905 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790521920546562-17952-0/minicluster-data/ts-1/data,/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790521920546562-17952-0/minicluster-data/ts-1/wal
uuid: "8f704da49bf344ee898a54d2c5dfd89b"
format_stamp: "Formatted at 2026-09-27 15:14:25 on dist-test-slave-5s2t"
server_key: "5323f7d7098b4ba335f595f46c3cb8f0"
server_key_iv: "eca96b5da691dfa5e16516e407cc97ef"
server_key_version: "kuduclusterkey@0"
I20260927 15:14:26.616529 30905 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790521920546562-17952-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790521920546562-17952-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790521920546562-17952-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260927 15:14:26.644166 30905 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260927 15:14:26.648036 30905 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260927 15:14:26.648311 30905 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260927 15:14:26.649312 30905 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260927 15:14:26.650398 30905 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260927 15:14:26.650508 30905 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260927 15:14:26.650601 30905 ts_tablet_manager.cc:610] Registered 0 tablets
I20260927 15:14:26.650665 30905 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260927 15:14:26.661712 30905 rpc_server.cc:307] RPC server started. Bound to: 127.17.136.2:39601
I20260927 15:14:26.662525 31035 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.136.2:39601 every 8 connection(s)
I20260927 15:14:26.663136 30905 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790521920546562-17952-0/minicluster-data/ts-1/data/info.pb
I20260927 15:14:26.671512 17952 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu as pid 30905
I20260927 15:14:26.671968 17952 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu
/tmp/dist-test-taskiFOyeW/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790521920546562-17952-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790521920546562-17952-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790521920546562-17952-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790521920546562-17952-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.17.136.20:48985/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.136.3:33363
--local_ip_for_outbound_sockets=127.17.136.3
--tserver_master_addrs=127.17.136.62:42917
--webserver_port=43251
--webserver_interface=127.17.136.3
--keytab_file=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790521920546562-17952-0/krb5kdc/kudu_127.17.136.3.keytab
--principal=kudu/127.17.136.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.136.20:38045
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.17.136.20:48985/kms with env {KRB5CCNAME=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790521920546562-17952-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790521920546562-17952-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790521920546562-17952-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Sep 27 15:14:26 dist-test-slave-5s2t krb5kdc[29707](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790522066, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.136.2@KRBTEST.COM for kudu/127.17.136.62@KRBTEST.COM
I20260927 15:14:26.684175 30903 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:14:26.669012 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.136.2:45567 (local address 127.17.136.62:42917)
0927 15:14:26.669156 (+ 144us) server_negotiation.cc:206] Beginning negotiation
0927 15:14:26.669160 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0927 15:14:26.670275 (+ 1115us) server_negotiation.cc:407] Connection header received
0927 15:14:26.673754 (+ 3479us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:14:26.673759 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:14:26.673817 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:14:26.673906 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0927 15:14:26.675368 (+ 1462us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:14:26.675907 (+ 539us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:14:26.677502 (+ 1595us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:14:26.677742 (+ 240us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:14:26.677830 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:14:26.680644 (+ 2814us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0927 15:14:26.680648 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0927 15:14:26.680651 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0927 15:14:26.680677 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0927 15:14:26.682050 (+ 1373us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:14:26.682608 (+ 558us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:14:26.682611 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:14:26.682613 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:14:26.682717 (+ 104us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:14:26.683078 (+ 361us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:14:26.683082 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:14:26.683084 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:14:26.683303 (+ 219us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0927 15:14:26.683389 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0927 15:14:26.683947 (+ 558us) server_negotiation.cc:299] Negotiation successful
0927 15:14:26.684057 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260927 15:14:26.685386 31038 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:14:26.669579 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.62:42917 (local address 127.17.136.2:45567)
0927 15:14:26.670112 (+ 533us) negotiation.cc:107] Waiting for socket to connect
0927 15:14:26.670175 (+ 63us) client_negotiation.cc:174] Beginning negotiation
0927 15:14:26.673502 (+ 3327us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0927 15:14:26.674126 (+ 624us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0927 15:14:26.674136 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0927 15:14:26.674489 (+ 353us) client_negotiation.cc:189] Negotiated authn=SASL
0927 15:14:26.675180 (+ 691us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:14:26.675201 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:14:26.676037 (+ 836us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:14:26.676040 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:14:26.677371 (+ 1331us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:14:26.677380 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:14:26.677877 (+ 497us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:14:26.677881 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:14:26.678073 (+ 192us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:14:26.678708 (+ 635us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0927 15:14:26.678724 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0927 15:14:26.680487 (+ 1763us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0927 15:14:26.682154 (+ 1667us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0927 15:14:26.682159 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0927 15:14:26.682174 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0927 15:14:26.682502 (+ 328us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0927 15:14:26.682840 (+ 338us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0927 15:14:26.682842 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0927 15:14:26.682845 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0927 15:14:26.682979 (+ 134us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0927 15:14:26.683394 (+ 415us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0927 15:14:26.683401 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0927 15:14:26.683673 (+ 272us) client_negotiation.cc:769] Sending connection context
0927 15:14:26.684385 (+ 712us) client_negotiation.cc:240] Negotiation successful
0927 15:14:26.684666 (+ 281us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":304,"thread_start_us":139,"threads_started":1}
I20260927 15:14:26.686563 31036 heartbeater.cc:347] Connected to a master server at 127.17.136.62:42917
I20260927 15:14:26.686795 31036 heartbeater.cc:464] Registering TS with master...
I20260927 15:14:26.687342 31036 heartbeater.cc:511] Master 127.17.136.62:42917 requested a full tablet report, sending...
W20260927 15:14:26.688942 31036 heartbeater.cc:644] Failed to heartbeat to 127.17.136.62:42917 (0 consecutive failures): Service unavailable: Catalog manager is not initialized. State: Starting
I20260927 15:14:26.689050 31036 heartbeater.cc:464] Registering TS with master...
I20260927 15:14:26.689201 31036 heartbeater.cc:511] Master 127.17.136.62:42917 requested a full tablet report, sending...
I20260927 15:14:26.689893 31036 heartbeater.cc:464] Registering TS with master...
I20260927 15:14:26.690047 31036 heartbeater.cc:511] Master 127.17.136.62:42917 requested a full tablet report, sending...
W20260927 15:14:26.690673 31036 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260927 15:14:26.811403 31039 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260927 15:14:26.811650 31039 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260927 15:14:26.811708 31039 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260927 15:14:26.815747 31039 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260927 15:14:26.815800 31039 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260927 15:14:26.815878 31039 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.136.3
I20260927 15:14:26.821267 31039 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.136.20:38045
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790521920546562-17952-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790521920546562-17952-0/minicluster-data/ts-2/wal
--ranger_kms_url=invalid.host:1234/kms,127.17.136.20:48985/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790521920546562-17952-0/krb5kdc/kudu_127.17.136.3.keytab
--principal=kudu/127.17.136.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.136.3:33363
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790521920546562-17952-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.17.136.3
--webserver_port=43251
--tserver_master_addrs=127.17.136.62:42917
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31039
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.136.3
--log_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790521920546562-17952-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 27 Sep 2026 14:27:13 UTC on ccycloud.quasar-psqrth.root.comops.site
build id 4676138
I20260927 15:14:26.822561 31039 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260927 15:14:26.823623 31039 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260927 15:14:26.834625 31047 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260927 15:14:26.834540 31045 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260927 15:14:26.834923 31039 server_base.cc:1034] running on GCE node
W20260927 15:14:26.835111 31044 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260927 15:14:26.835508 31039 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260927 15:14:26.836122 31039 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260927 15:14:26.839356 31039 hybrid_clock.cc:648] HybridClock initialized: now 1790522066839321 us; error 45 us; skew 500 ppm
Sep 27 15:14:26 dist-test-slave-5s2t krb5kdc[29707](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790522066, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.136.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260927 15:14:26.842708 31039 init.cc:377] Logged in from keytab as kudu/127.17.136.3@KRBTEST.COM (short username kudu)
I20260927 15:14:26.843829 31039 webserver.cc:460] Webserver started at http://127.17.136.3:43251/ using document root <none> and password file <none>
I20260927 15:14:26.844529 31039 fs_manager.cc:359] Metadata directory not provided
I20260927 15:14:26.844636 31039 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Sep 27 15:14:26 dist-test-slave-5s2t krb5kdc[29707](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790522066, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.136.3@KRBTEST.COM for HTTP/127.17.136.20@KRBTEST.COM
I20260927 15:14:26.866056 31039 fs_manager.cc:709] Time spent opening directory manager: real 0.008s user 0.003s sys 0.000s
I20260927 15:14:26.869366 31055 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260927 15:14:26.871229 31039 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.001s sys 0.000s
I20260927 15:14:26.871389 31039 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790521920546562-17952-0/minicluster-data/ts-2/data,/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790521920546562-17952-0/minicluster-data/ts-2/wal
uuid: "a363e237b7834e2ab8980eff01e257e6"
format_stamp: "Formatted at 2026-09-27 15:14:25 on dist-test-slave-5s2t"
server_key: "56fb01399d10417a86a112dadafe5270"
server_key_iv: "c2a280b4d45e4b0b88c5c80f8aa5919c"
server_key_version: "kuduclusterkey@0"
I20260927 15:14:26.872153 31039 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790521920546562-17952-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790521920546562-17952-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790521920546562-17952-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260927 15:14:26.897017 31039 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260927 15:14:26.900518 31039 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260927 15:14:26.900730 31039 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260927 15:14:26.901481 31039 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260927 15:14:26.902415 31039 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260927 15:14:26.902464 31039 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260927 15:14:26.902516 31039 ts_tablet_manager.cc:610] Registered 0 tablets
I20260927 15:14:26.902545 31039 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260927 15:14:26.913467 31039 rpc_server.cc:307] RPC server started. Bound to: 127.17.136.3:33363
I20260927 15:14:26.913614 31168 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.136.3:33363 every 8 connection(s)
I20260927 15:14:26.914885 31039 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790521920546562-17952-0/minicluster-data/ts-2/data/info.pb
I20260927 15:14:26.920574 17952 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu as pid 31039
Sep 27 15:14:26 dist-test-slave-5s2t krb5kdc[29707](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790522066, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.136.3@KRBTEST.COM for kudu/127.17.136.62@KRBTEST.COM
I20260927 15:14:26.929776 30903 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:14:26.916780 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.136.3:54377 (local address 127.17.136.62:42917)
0927 15:14:26.916905 (+ 125us) server_negotiation.cc:206] Beginning negotiation
0927 15:14:26.916909 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0927 15:14:26.917756 (+ 847us) server_negotiation.cc:407] Connection header received
0927 15:14:26.918750 (+ 994us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:14:26.918754 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:14:26.918810 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:14:26.918915 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0927 15:14:26.920079 (+ 1164us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:14:26.920839 (+ 760us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:14:26.922491 (+ 1652us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:14:26.922781 (+ 290us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:14:26.922869 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:14:26.925891 (+ 3022us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0927 15:14:26.925895 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0927 15:14:26.925897 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0927 15:14:26.925919 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0927 15:14:26.927642 (+ 1723us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:14:26.928231 (+ 589us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:14:26.928234 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:14:26.928236 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:14:26.928323 (+ 87us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:14:26.928731 (+ 408us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:14:26.928735 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:14:26.928737 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:14:26.928940 (+ 203us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0927 15:14:26.929021 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0927 15:14:26.929505 (+ 484us) server_negotiation.cc:299] Negotiation successful
0927 15:14:26.929613 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":1,"server-negotiator.queue_time_us":37}
I20260927 15:14:26.930655 31178 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:14:26.917124 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.62:42917 (local address 127.17.136.3:54377)
0927 15:14:26.917586 (+ 462us) negotiation.cc:107] Waiting for socket to connect
0927 15:14:26.917637 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0927 15:14:26.918519 (+ 882us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0927 15:14:26.919080 (+ 561us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0927 15:14:26.919087 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0927 15:14:26.919390 (+ 303us) client_negotiation.cc:189] Negotiated authn=SASL
0927 15:14:26.919934 (+ 544us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:14:26.919947 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:14:26.920999 (+ 1052us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:14:26.921002 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:14:26.922373 (+ 1371us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:14:26.922384 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:14:26.923028 (+ 644us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:14:26.923032 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:14:26.923234 (+ 202us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:14:26.923874 (+ 640us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0927 15:14:26.923915 (+ 41us) client_negotiation.cc:656] calling sasl_client_start()
0927 15:14:26.925711 (+ 1796us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0927 15:14:26.927765 (+ 2054us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0927 15:14:26.927771 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0927 15:14:26.927787 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0927 15:14:26.928113 (+ 326us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0927 15:14:26.928437 (+ 324us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0927 15:14:26.928440 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0927 15:14:26.928441 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0927 15:14:26.928636 (+ 195us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0927 15:14:26.929036 (+ 400us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0927 15:14:26.929043 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0927 15:14:26.929285 (+ 242us) client_negotiation.cc:769] Sending connection context
0927 15:14:26.929451 (+ 166us) client_negotiation.cc:240] Negotiation successful
0927 15:14:26.929769 (+ 318us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":262,"thread_start_us":114,"threads_started":1}
I20260927 15:14:26.931864 31176 heartbeater.cc:347] Connected to a master server at 127.17.136.62:42917
I20260927 15:14:26.932096 31180 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:14:26.921148 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59796 (local address 127.17.136.62:42917)
0927 15:14:26.921686 (+ 538us) server_negotiation.cc:206] Beginning negotiation
0927 15:14:26.921692 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0927 15:14:26.921702 (+ 10us) server_negotiation.cc:407] Connection header received
0927 15:14:26.921730 (+ 28us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:14:26.921732 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:14:26.921765 (+ 33us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:14:26.921837 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0927 15:14:26.922597 (+ 760us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:14:26.923402 (+ 805us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:14:26.924498 (+ 1096us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:14:26.925644 (+ 1146us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:14:26.925742 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:14:26.927121 (+ 1379us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0927 15:14:26.927125 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0927 15:14:26.927127 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0927 15:14:26.927167 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0927 15:14:26.928452 (+ 1285us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:14:26.928860 (+ 408us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:14:26.928864 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:14:26.928866 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:14:26.928949 (+ 83us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:14:26.931241 (+ 2292us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:14:26.931264 (+ 23us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:14:26.931266 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:14:26.931484 (+ 218us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0927 15:14:26.931666 (+ 182us) server_negotiation.cc:1035] Waiting for connection context
0927 15:14:26.931808 (+ 142us) server_negotiation.cc:299] Negotiation successful
0927 15:14:26.931927 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":473,"thread_start_us":92,"threads_started":1}
I20260927 15:14:26.932126 31176 heartbeater.cc:464] Registering TS with master...
I20260927 15:14:26.932643 31176 heartbeater.cc:511] Master 127.17.136.62:42917 requested a full tablet report, sending...
I20260927 15:14:26.933997 30703 ts_manager.cc:194] Registered new tserver with Master: a363e237b7834e2ab8980eff01e257e6 (127.17.136.3:33363)
I20260927 15:14:26.935086 30703 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.136.3@KRBTEST.COM'} at 127.17.136.3:54377
Sep 27 15:14:27 dist-test-slave-5s2t krb5kdc[29707](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1790522067, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.136.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260927 15:14:27.431039 30901 heartbeater.cc:464] Registering TS with master...
I20260927 15:14:27.431357 30901 heartbeater.cc:511] Master 127.17.136.62:42917 requested a full tablet report, sending...
I20260927 15:14:27.432025 30703 ts_manager.cc:194] Registered new tserver with Master: 5b8e8298e79743c6a74319041a08c370 (127.17.136.1:43101)
I20260927 15:14:27.432732 30703 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.136.1@KRBTEST.COM'} at 127.17.136.1:50455
Sep 27 15:14:27 dist-test-slave-5s2t krb5kdc[29707](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790522067, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.136.62@KRBTEST.COM for HTTP/127.17.136.20@KRBTEST.COM
I20260927 15:14:27.690878 31036 heartbeater.cc:464] Registering TS with master...
I20260927 15:14:27.691180 31036 heartbeater.cc:511] Master 127.17.136.62:42917 requested a full tablet report, sending...
I20260927 15:14:27.691895 30703 ts_manager.cc:194] Registered new tserver with Master: 8f704da49bf344ee898a54d2c5dfd89b (127.17.136.2:39601)
I20260927 15:14:27.692636 30703 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.136.2@KRBTEST.COM'} at 127.17.136.2:45567
I20260927 15:14:27.701042 17952 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260927 15:14:27.710983 31190 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:14:27.702735 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59812 (local address 127.17.136.62:42917)
0927 15:14:27.703336 (+ 601us) server_negotiation.cc:206] Beginning negotiation
0927 15:14:27.703341 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0927 15:14:27.703569 (+ 228us) server_negotiation.cc:407] Connection header received
0927 15:14:27.703760 (+ 191us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:14:27.703763 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:14:27.703827 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:14:27.703887 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0927 15:14:27.704818 (+ 931us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:14:27.705332 (+ 514us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:14:27.706127 (+ 795us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:14:27.706344 (+ 217us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:14:27.706434 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:14:27.708096 (+ 1662us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0927 15:14:27.708099 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0927 15:14:27.708101 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0927 15:14:27.708122 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0927 15:14:27.709474 (+ 1352us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:14:27.709853 (+ 379us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:14:27.709856 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:14:27.709858 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:14:27.709930 (+ 72us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:14:27.710161 (+ 231us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:14:27.710164 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:14:27.710166 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:14:27.710351 (+ 185us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0927 15:14:27.710464 (+ 113us) server_negotiation.cc:1035] Waiting for connection context
0927 15:14:27.710688 (+ 224us) server_negotiation.cc:299] Negotiation successful
0927 15:14:27.710811 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":496,"thread_start_us":91,"threads_started":1}
I20260927 15:14:27.714323 30703 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:59812:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:14:27.717729 30703 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:14:27.734434 31197 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:14:27.727389 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.1:43101 (local address 127.0.0.1:37860)
0927 15:14:27.728754 (+ 1365us) negotiation.cc:107] Waiting for socket to connect
0927 15:14:27.728800 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0927 15:14:27.728940 (+ 140us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0927 15:14:27.729648 (+ 708us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0927 15:14:27.729654 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0927 15:14:27.729678 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0927 15:14:27.729808 (+ 130us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:14:27.729816 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:14:27.731187 (+ 1371us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:14:27.731190 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:14:27.732673 (+ 1483us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:14:27.732684 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:14:27.733869 (+ 1185us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:14:27.733872 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:14:27.734031 (+ 159us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:14:27.734074 (+ 43us) client_negotiation.cc:769] Sending connection context
0927 15:14:27.734170 (+ 96us) client_negotiation.cc:240] Negotiation successful
0927 15:14:27.734287 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1204,"mutex_wait_us":57,"thread_start_us":104,"threads_started":1}
I20260927 15:14:27.734843 31200 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:14:27.728171 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37860 (local address 127.17.136.1:43101)
0927 15:14:27.728519 (+ 348us) server_negotiation.cc:206] Beginning negotiation
0927 15:14:27.728526 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0927 15:14:27.728902 (+ 376us) server_negotiation.cc:407] Connection header received
0927 15:14:27.729097 (+ 195us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:14:27.729103 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:14:27.729320 (+ 217us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:14:27.729463 (+ 143us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0927 15:14:27.729943 (+ 480us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:14:27.731056 (+ 1113us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:14:27.732801 (+ 1745us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:14:27.733580 (+ 779us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:14:27.733679 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:14:27.733811 (+ 132us) server_negotiation.cc:1035] Waiting for connection context
0927 15:14:27.734616 (+ 805us) server_negotiation.cc:299] Negotiation successful
0927 15:14:27.734712 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":255,"thread_start_us":96,"threads_started":1}
I20260927 15:14:27.737803 30835 tablet_service.cc:1467] Processing CreateTablet for tablet d7e7cf40b569470eb48767e23f6bb47e (DEFAULT_TABLE table=test-table [id=dc91de05fbb74c04a955e86affecd4a8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:14:27.738868 30835 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d7e7cf40b569470eb48767e23f6bb47e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:14:27.739530 31196 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:14:27.728099 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.3:33363 (local address 127.0.0.1:42242)
0927 15:14:27.729348 (+ 1249us) negotiation.cc:107] Waiting for socket to connect
0927 15:14:27.729358 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0927 15:14:27.729413 (+ 55us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0927 15:14:27.735572 (+ 6159us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0927 15:14:27.735576 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0927 15:14:27.735593 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0927 15:14:27.735670 (+ 77us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:14:27.735676 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:14:27.737024 (+ 1348us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:14:27.737028 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:14:27.738046 (+ 1018us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:14:27.738055 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:14:27.739104 (+ 1049us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:14:27.739108 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:14:27.739267 (+ 159us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:14:27.739292 (+ 25us) client_negotiation.cc:769] Sending connection context
0927 15:14:27.739341 (+ 49us) client_negotiation.cc:240] Negotiation successful
0927 15:14:27.739404 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1203,"thread_start_us":77,"threads_started":1}
I20260927 15:14:27.740187 31201 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:14:27.728452 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42242 (local address 127.17.136.3:33363)
0927 15:14:27.734117 (+ 5665us) server_negotiation.cc:206] Beginning negotiation
0927 15:14:27.734123 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0927 15:14:27.734143 (+ 20us) server_negotiation.cc:407] Connection header received
0927 15:14:27.734208 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:14:27.734212 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:14:27.734373 (+ 161us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:14:27.735416 (+ 1043us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0927 15:14:27.735802 (+ 386us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:14:27.736896 (+ 1094us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:14:27.738180 (+ 1284us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:14:27.738975 (+ 795us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:14:27.739787 (+ 812us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:14:27.739926 (+ 139us) server_negotiation.cc:1035] Waiting for connection context
0927 15:14:27.739976 (+ 50us) server_negotiation.cc:299] Negotiation successful
0927 15:14:27.740058 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":5568,"thread_start_us":79,"threads_started":1}
I20260927 15:14:27.742381 31103 tablet_service.cc:1467] Processing CreateTablet for tablet d7e7cf40b569470eb48767e23f6bb47e (DEFAULT_TABLE table=test-table [id=dc91de05fbb74c04a955e86affecd4a8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:14:27.743142 31103 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d7e7cf40b569470eb48767e23f6bb47e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:14:27.744067 31199 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:14:27.727457 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.2:39601 (local address 127.0.0.1:38900)
0927 15:14:27.729144 (+ 1687us) negotiation.cc:107] Waiting for socket to connect
0927 15:14:27.729154 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0927 15:14:27.729217 (+ 63us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0927 15:14:27.730145 (+ 928us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0927 15:14:27.730148 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0927 15:14:27.730164 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0927 15:14:27.730246 (+ 82us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:14:27.730252 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:14:27.731565 (+ 1313us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:14:27.731568 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:14:27.732707 (+ 1139us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:14:27.732718 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:14:27.733868 (+ 1150us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:14:27.733872 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:14:27.743764 (+ 9892us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:14:27.743791 (+ 27us) client_negotiation.cc:769] Sending connection context
0927 15:14:27.743861 (+ 70us) client_negotiation.cc:240] Negotiation successful
0927 15:14:27.743941 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1631,"mutex_wait_us":528,"thread_start_us":96,"threads_started":1}
I20260927 15:14:27.747606 31198 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:14:27.727593 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38900 (local address 127.17.136.2:39601)
0927 15:14:27.729617 (+ 2024us) server_negotiation.cc:206] Beginning negotiation
0927 15:14:27.729623 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0927 15:14:27.729643 (+ 20us) server_negotiation.cc:407] Connection header received
0927 15:14:27.729710 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:14:27.729715 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:14:27.729879 (+ 164us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:14:27.730018 (+ 139us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0927 15:14:27.730357 (+ 339us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:14:27.731448 (+ 1091us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:14:27.732839 (+ 1391us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:14:27.733596 (+ 757us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:14:27.733688 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:14:27.733812 (+ 124us) server_negotiation.cc:1035] Waiting for connection context
0927 15:14:27.747357 (+ 13545us) server_negotiation.cc:299] Negotiation successful
0927 15:14:27.747471 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1922,"thread_start_us":57,"threads_started":1}
I20260927 15:14:27.750295 31202 tablet_bootstrap.cc:492] T d7e7cf40b569470eb48767e23f6bb47e P 5b8e8298e79743c6a74319041a08c370: Bootstrap starting.
I20260927 15:14:27.750385 30970 tablet_service.cc:1467] Processing CreateTablet for tablet d7e7cf40b569470eb48767e23f6bb47e (DEFAULT_TABLE table=test-table [id=dc91de05fbb74c04a955e86affecd4a8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:14:27.751415 30970 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d7e7cf40b569470eb48767e23f6bb47e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:14:27.752754 31202 tablet_bootstrap.cc:654] T d7e7cf40b569470eb48767e23f6bb47e P 5b8e8298e79743c6a74319041a08c370: Neither blocks nor log segments found. Creating new log.
I20260927 15:14:27.753638 31202 log.cc:824] T d7e7cf40b569470eb48767e23f6bb47e P 5b8e8298e79743c6a74319041a08c370: Log is configured to *not* fsync() on all Append() calls
I20260927 15:14:27.755740 31202 tablet_bootstrap.cc:492] T d7e7cf40b569470eb48767e23f6bb47e P 5b8e8298e79743c6a74319041a08c370: No bootstrap required, opened a new log
I20260927 15:14:27.755916 31202 ts_tablet_manager.cc:1397] T d7e7cf40b569470eb48767e23f6bb47e P 5b8e8298e79743c6a74319041a08c370: Time spent bootstrapping tablet: real 0.006s user 0.001s sys 0.004s
I20260927 15:14:27.759955 31202 raft_consensus.cc:348] T d7e7cf40b569470eb48767e23f6bb47e P 5b8e8298e79743c6a74319041a08c370 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b8e8298e79743c6a74319041a08c370" member_type: VOTER last_known_addr { host: "127.17.136.1" port: 43101 } } peers { permanent_uuid: "8f704da49bf344ee898a54d2c5dfd89b" member_type: VOTER last_known_addr { host: "127.17.136.2" port: 39601 } } peers { permanent_uuid: "a363e237b7834e2ab8980eff01e257e6" member_type: VOTER last_known_addr { host: "127.17.136.3" port: 33363 } }
I20260927 15:14:27.760214 31202 raft_consensus.cc:374] T d7e7cf40b569470eb48767e23f6bb47e P 5b8e8298e79743c6a74319041a08c370 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:14:27.760257 31202 raft_consensus.cc:729] T d7e7cf40b569470eb48767e23f6bb47e P 5b8e8298e79743c6a74319041a08c370 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5b8e8298e79743c6a74319041a08c370, State: Initialized, Role: FOLLOWER
I20260927 15:14:27.760900 31202 consensus_queue.cc:260] T d7e7cf40b569470eb48767e23f6bb47e P 5b8e8298e79743c6a74319041a08c370 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b8e8298e79743c6a74319041a08c370" member_type: VOTER last_known_addr { host: "127.17.136.1" port: 43101 } } peers { permanent_uuid: "8f704da49bf344ee898a54d2c5dfd89b" member_type: VOTER last_known_addr { host: "127.17.136.2" port: 39601 } } peers { permanent_uuid: "a363e237b7834e2ab8980eff01e257e6" member_type: VOTER last_known_addr { host: "127.17.136.3" port: 33363 } }
I20260927 15:14:27.762001 31202 ts_tablet_manager.cc:1428] T d7e7cf40b569470eb48767e23f6bb47e P 5b8e8298e79743c6a74319041a08c370: Time spent starting tablet: real 0.006s user 0.005s sys 0.000s
I20260927 15:14:27.762380 30901 heartbeater.cc:503] Master 127.17.136.62:42917 was elected leader, sending a full tablet report...
I20260927 15:14:27.764099 31204 tablet_bootstrap.cc:492] T d7e7cf40b569470eb48767e23f6bb47e P 8f704da49bf344ee898a54d2c5dfd89b: Bootstrap starting.
I20260927 15:14:27.766413 31204 tablet_bootstrap.cc:654] T d7e7cf40b569470eb48767e23f6bb47e P 8f704da49bf344ee898a54d2c5dfd89b: Neither blocks nor log segments found. Creating new log.
I20260927 15:14:27.767414 31204 log.cc:824] T d7e7cf40b569470eb48767e23f6bb47e P 8f704da49bf344ee898a54d2c5dfd89b: Log is configured to *not* fsync() on all Append() calls
I20260927 15:14:27.768270 31206 tablet_bootstrap.cc:492] T d7e7cf40b569470eb48767e23f6bb47e P a363e237b7834e2ab8980eff01e257e6: Bootstrap starting.
I20260927 15:14:27.770581 31206 tablet_bootstrap.cc:654] T d7e7cf40b569470eb48767e23f6bb47e P a363e237b7834e2ab8980eff01e257e6: Neither blocks nor log segments found. Creating new log.
I20260927 15:14:27.771876 31206 log.cc:824] T d7e7cf40b569470eb48767e23f6bb47e P a363e237b7834e2ab8980eff01e257e6: Log is configured to *not* fsync() on all Append() calls
I20260927 15:14:27.773368 31204 tablet_bootstrap.cc:492] T d7e7cf40b569470eb48767e23f6bb47e P 8f704da49bf344ee898a54d2c5dfd89b: No bootstrap required, opened a new log
I20260927 15:14:27.773566 31204 ts_tablet_manager.cc:1397] T d7e7cf40b569470eb48767e23f6bb47e P 8f704da49bf344ee898a54d2c5dfd89b: Time spent bootstrapping tablet: real 0.010s user 0.000s sys 0.005s
I20260927 15:14:27.773761 31206 tablet_bootstrap.cc:492] T d7e7cf40b569470eb48767e23f6bb47e P a363e237b7834e2ab8980eff01e257e6: No bootstrap required, opened a new log
I20260927 15:14:27.773916 31206 ts_tablet_manager.cc:1397] T d7e7cf40b569470eb48767e23f6bb47e P a363e237b7834e2ab8980eff01e257e6: Time spent bootstrapping tablet: real 0.006s user 0.001s sys 0.003s
I20260927 15:14:27.778448 31206 raft_consensus.cc:348] T d7e7cf40b569470eb48767e23f6bb47e P a363e237b7834e2ab8980eff01e257e6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b8e8298e79743c6a74319041a08c370" member_type: VOTER last_known_addr { host: "127.17.136.1" port: 43101 } } peers { permanent_uuid: "8f704da49bf344ee898a54d2c5dfd89b" member_type: VOTER last_known_addr { host: "127.17.136.2" port: 39601 } } peers { permanent_uuid: "a363e237b7834e2ab8980eff01e257e6" member_type: VOTER last_known_addr { host: "127.17.136.3" port: 33363 } }
I20260927 15:14:27.778750 31206 raft_consensus.cc:374] T d7e7cf40b569470eb48767e23f6bb47e P a363e237b7834e2ab8980eff01e257e6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:14:27.778802 31206 raft_consensus.cc:729] T d7e7cf40b569470eb48767e23f6bb47e P a363e237b7834e2ab8980eff01e257e6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a363e237b7834e2ab8980eff01e257e6, State: Initialized, Role: FOLLOWER
I20260927 15:14:27.779018 31204 raft_consensus.cc:348] T d7e7cf40b569470eb48767e23f6bb47e P 8f704da49bf344ee898a54d2c5dfd89b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b8e8298e79743c6a74319041a08c370" member_type: VOTER last_known_addr { host: "127.17.136.1" port: 43101 } } peers { permanent_uuid: "8f704da49bf344ee898a54d2c5dfd89b" member_type: VOTER last_known_addr { host: "127.17.136.2" port: 39601 } } peers { permanent_uuid: "a363e237b7834e2ab8980eff01e257e6" member_type: VOTER last_known_addr { host: "127.17.136.3" port: 33363 } }
I20260927 15:14:27.779348 31204 raft_consensus.cc:374] T d7e7cf40b569470eb48767e23f6bb47e P 8f704da49bf344ee898a54d2c5dfd89b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:14:27.779333 31206 consensus_queue.cc:260] T d7e7cf40b569470eb48767e23f6bb47e P a363e237b7834e2ab8980eff01e257e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b8e8298e79743c6a74319041a08c370" member_type: VOTER last_known_addr { host: "127.17.136.1" port: 43101 } } peers { permanent_uuid: "8f704da49bf344ee898a54d2c5dfd89b" member_type: VOTER last_known_addr { host: "127.17.136.2" port: 39601 } } peers { permanent_uuid: "a363e237b7834e2ab8980eff01e257e6" member_type: VOTER last_known_addr { host: "127.17.136.3" port: 33363 } }
I20260927 15:14:27.779500 31204 raft_consensus.cc:729] T d7e7cf40b569470eb48767e23f6bb47e P 8f704da49bf344ee898a54d2c5dfd89b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8f704da49bf344ee898a54d2c5dfd89b, State: Initialized, Role: FOLLOWER
I20260927 15:14:27.780010 31204 consensus_queue.cc:260] T d7e7cf40b569470eb48767e23f6bb47e P 8f704da49bf344ee898a54d2c5dfd89b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b8e8298e79743c6a74319041a08c370" member_type: VOTER last_known_addr { host: "127.17.136.1" port: 43101 } } peers { permanent_uuid: "8f704da49bf344ee898a54d2c5dfd89b" member_type: VOTER last_known_addr { host: "127.17.136.2" port: 39601 } } peers { permanent_uuid: "a363e237b7834e2ab8980eff01e257e6" member_type: VOTER last_known_addr { host: "127.17.136.3" port: 33363 } }
I20260927 15:14:27.780414 31206 ts_tablet_manager.cc:1428] T d7e7cf40b569470eb48767e23f6bb47e P a363e237b7834e2ab8980eff01e257e6: Time spent starting tablet: real 0.006s user 0.003s sys 0.005s
I20260927 15:14:27.780824 31176 heartbeater.cc:503] Master 127.17.136.62:42917 was elected leader, sending a full tablet report...
I20260927 15:14:27.781225 31036 heartbeater.cc:503] Master 127.17.136.62:42917 was elected leader, sending a full tablet report...
I20260927 15:14:27.783012 31204 ts_tablet_manager.cc:1428] T d7e7cf40b569470eb48767e23f6bb47e P 8f704da49bf344ee898a54d2c5dfd89b: Time spent starting tablet: real 0.009s user 0.003s sys 0.002s
I20260927 15:14:27.859650 31205 raft_consensus.cc:482] T d7e7cf40b569470eb48767e23f6bb47e P 5b8e8298e79743c6a74319041a08c370 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:14:27.859896 31205 raft_consensus.cc:504] T d7e7cf40b569470eb48767e23f6bb47e P 5b8e8298e79743c6a74319041a08c370 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b8e8298e79743c6a74319041a08c370" member_type: VOTER last_known_addr { host: "127.17.136.1" port: 43101 } } peers { permanent_uuid: "8f704da49bf344ee898a54d2c5dfd89b" member_type: VOTER last_known_addr { host: "127.17.136.2" port: 39601 } } peers { permanent_uuid: "a363e237b7834e2ab8980eff01e257e6" member_type: VOTER last_known_addr { host: "127.17.136.3" port: 33363 } }
I20260927 15:14:27.861532 31205 leader_election.cc:288] T d7e7cf40b569470eb48767e23f6bb47e P 5b8e8298e79743c6a74319041a08c370 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8f704da49bf344ee898a54d2c5dfd89b (127.17.136.2:39601), a363e237b7834e2ab8980eff01e257e6 (127.17.136.3:33363)
Sep 27 15:14:27 dist-test-slave-5s2t krb5kdc[29707](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790522067, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.136.62@KRBTEST.COM for HTTP/127.17.136.20@KRBTEST.COM
I20260927 15:14:27.874255 31198 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:14:27.862349 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.136.1:50021 (local address 127.17.136.2:39601)
0927 15:14:27.862514 (+ 165us) server_negotiation.cc:206] Beginning negotiation
0927 15:14:27.862519 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0927 15:14:27.863719 (+ 1200us) server_negotiation.cc:407] Connection header received
0927 15:14:27.864167 (+ 448us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:14:27.864170 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:14:27.864214 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:14:27.864256 (+ 42us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0927 15:14:27.864676 (+ 420us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:14:27.865482 (+ 806us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:14:27.870366 (+ 4884us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:14:27.871008 (+ 642us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:14:27.871152 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:14:27.871213 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0927 15:14:27.874007 (+ 2794us) server_negotiation.cc:299] Negotiation successful
0927 15:14:27.874114 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260927 15:14:27.874907 31212 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:14:27.861870 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.2:39601 (local address 127.17.136.1:50021)
0927 15:14:27.863636 (+ 1766us) negotiation.cc:107] Waiting for socket to connect
0927 15:14:27.863650 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0927 15:14:27.864063 (+ 413us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0927 15:14:27.864376 (+ 313us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0927 15:14:27.864379 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0927 15:14:27.864396 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0927 15:14:27.864548 (+ 152us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:14:27.864555 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:14:27.866984 (+ 2429us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:14:27.866987 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:14:27.870243 (+ 3256us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:14:27.870255 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:14:27.873739 (+ 3484us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:14:27.873742 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:14:27.873835 (+ 93us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:14:27.873862 (+ 27us) client_negotiation.cc:769] Sending connection context
0927 15:14:27.874650 (+ 788us) client_negotiation.cc:240] Negotiation successful
0927 15:14:27.874736 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1001,"mutex_wait_us":4,"thread_start_us":130,"threads_started":1}
I20260927 15:14:27.877072 30972 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d7e7cf40b569470eb48767e23f6bb47e" candidate_uuid: "5b8e8298e79743c6a74319041a08c370" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f704da49bf344ee898a54d2c5dfd89b" is_pre_election: true
I20260927 15:14:27.877434 30972 raft_consensus.cc:2454] T d7e7cf40b569470eb48767e23f6bb47e P 8f704da49bf344ee898a54d2c5dfd89b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b8e8298e79743c6a74319041a08c370 in term 0.
I20260927 15:14:27.878113 30790 leader_election.cc:302] T d7e7cf40b569470eb48767e23f6bb47e P 5b8e8298e79743c6a74319041a08c370 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b8e8298e79743c6a74319041a08c370, 8f704da49bf344ee898a54d2c5dfd89b; no voters:
I20260927 15:14:27.878459 31205 raft_consensus.cc:2781] T d7e7cf40b569470eb48767e23f6bb47e P 5b8e8298e79743c6a74319041a08c370 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 15:14:27.878561 31205 raft_consensus.cc:482] T d7e7cf40b569470eb48767e23f6bb47e P 5b8e8298e79743c6a74319041a08c370 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 15:14:27.878607 31205 raft_consensus.cc:3037] T d7e7cf40b569470eb48767e23f6bb47e P 5b8e8298e79743c6a74319041a08c370 [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:14:27.879940 31205 raft_consensus.cc:504] T d7e7cf40b569470eb48767e23f6bb47e P 5b8e8298e79743c6a74319041a08c370 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b8e8298e79743c6a74319041a08c370" member_type: VOTER last_known_addr { host: "127.17.136.1" port: 43101 } } peers { permanent_uuid: "8f704da49bf344ee898a54d2c5dfd89b" member_type: VOTER last_known_addr { host: "127.17.136.2" port: 39601 } } peers { permanent_uuid: "a363e237b7834e2ab8980eff01e257e6" member_type: VOTER last_known_addr { host: "127.17.136.3" port: 33363 } }
I20260927 15:14:27.880332 31205 leader_election.cc:288] T d7e7cf40b569470eb48767e23f6bb47e P 5b8e8298e79743c6a74319041a08c370 [CANDIDATE]: Term 1 election: Requested vote from peers 8f704da49bf344ee898a54d2c5dfd89b (127.17.136.2:39601), a363e237b7834e2ab8980eff01e257e6 (127.17.136.3:33363)
I20260927 15:14:27.881234 30972 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d7e7cf40b569470eb48767e23f6bb47e" candidate_uuid: "5b8e8298e79743c6a74319041a08c370" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f704da49bf344ee898a54d2c5dfd89b"
I20260927 15:14:27.881366 30972 raft_consensus.cc:3037] T d7e7cf40b569470eb48767e23f6bb47e P 8f704da49bf344ee898a54d2c5dfd89b [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:14:27.882601 30972 raft_consensus.cc:2454] T d7e7cf40b569470eb48767e23f6bb47e P 8f704da49bf344ee898a54d2c5dfd89b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b8e8298e79743c6a74319041a08c370 in term 1.
I20260927 15:14:27.882933 30790 leader_election.cc:302] T d7e7cf40b569470eb48767e23f6bb47e P 5b8e8298e79743c6a74319041a08c370 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b8e8298e79743c6a74319041a08c370, 8f704da49bf344ee898a54d2c5dfd89b; no voters:
I20260927 15:14:27.883157 31205 raft_consensus.cc:2781] T d7e7cf40b569470eb48767e23f6bb47e P 5b8e8298e79743c6a74319041a08c370 [term 1 FOLLOWER]: Leader election won for term 1
I20260927 15:14:27.883406 31205 raft_consensus.cc:686] T d7e7cf40b569470eb48767e23f6bb47e P 5b8e8298e79743c6a74319041a08c370 [term 1 LEADER]: Becoming Leader. State: Replica: 5b8e8298e79743c6a74319041a08c370, State: Running, Role: LEADER
I20260927 15:14:27.883776 31205 consensus_queue.cc:237] T d7e7cf40b569470eb48767e23f6bb47e P 5b8e8298e79743c6a74319041a08c370 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b8e8298e79743c6a74319041a08c370" member_type: VOTER last_known_addr { host: "127.17.136.1" port: 43101 } } peers { permanent_uuid: "8f704da49bf344ee898a54d2c5dfd89b" member_type: VOTER last_known_addr { host: "127.17.136.2" port: 39601 } } peers { permanent_uuid: "a363e237b7834e2ab8980eff01e257e6" member_type: VOTER last_known_addr { host: "127.17.136.3" port: 33363 } }
I20260927 15:14:27.884486 31213 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:14:27.862726 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.3:33363 (local address 127.17.136.1:54877)
0927 15:14:27.863839 (+ 1113us) negotiation.cc:107] Waiting for socket to connect
0927 15:14:27.863850 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0927 15:14:27.863960 (+ 110us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0927 15:14:27.867177 (+ 3217us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0927 15:14:27.867180 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0927 15:14:27.867204 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0927 15:14:27.867391 (+ 187us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:14:27.867398 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:14:27.872454 (+ 5056us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:14:27.872457 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:14:27.873588 (+ 1131us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:14:27.873601 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:14:27.884029 (+ 10428us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:14:27.884032 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:14:27.884147 (+ 115us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:14:27.884171 (+ 24us) client_negotiation.cc:769] Sending connection context
0927 15:14:27.884233 (+ 62us) client_negotiation.cc:240] Negotiation successful
0927 15:14:27.884312 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1059,"mutex_wait_us":36,"thread_start_us":232,"threads_started":1}
I20260927 15:14:27.884943 31201 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:14:27.863283 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.136.1:54877 (local address 127.17.136.3:33363)
0927 15:14:27.863391 (+ 108us) server_negotiation.cc:206] Beginning negotiation
0927 15:14:27.863395 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0927 15:14:27.863916 (+ 521us) server_negotiation.cc:407] Connection header received
0927 15:14:27.864052 (+ 136us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:14:27.864055 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:14:27.864105 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:14:27.864167 (+ 62us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0927 15:14:27.867579 (+ 3412us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:14:27.868363 (+ 784us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:14:27.883031 (+ 14668us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:14:27.883776 (+ 745us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:14:27.883904 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:14:27.883958 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0927 15:14:27.884742 (+ 784us) server_negotiation.cc:299] Negotiation successful
0927 15:14:27.884832 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30}
I20260927 15:14:27.885618 31123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d7e7cf40b569470eb48767e23f6bb47e" candidate_uuid: "5b8e8298e79743c6a74319041a08c370" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a363e237b7834e2ab8980eff01e257e6" is_pre_election: true
I20260927 15:14:27.885882 31123 raft_consensus.cc:2454] T d7e7cf40b569470eb48767e23f6bb47e P a363e237b7834e2ab8980eff01e257e6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b8e8298e79743c6a74319041a08c370 in term 0.
I20260927 15:14:27.886178 31122 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d7e7cf40b569470eb48767e23f6bb47e" candidate_uuid: "5b8e8298e79743c6a74319041a08c370" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a363e237b7834e2ab8980eff01e257e6"
I20260927 15:14:27.886271 31122 raft_consensus.cc:3037] T d7e7cf40b569470eb48767e23f6bb47e P a363e237b7834e2ab8980eff01e257e6 [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:14:27.887483 31122 raft_consensus.cc:2454] T d7e7cf40b569470eb48767e23f6bb47e P a363e237b7834e2ab8980eff01e257e6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b8e8298e79743c6a74319041a08c370 in term 1.
I20260927 15:14:27.887284 30702 catalog_manager.cc:5495] T d7e7cf40b569470eb48767e23f6bb47e P 5b8e8298e79743c6a74319041a08c370 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5b8e8298e79743c6a74319041a08c370 (127.17.136.1). New cstate: current_term: 1 leader_uuid: "5b8e8298e79743c6a74319041a08c370" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b8e8298e79743c6a74319041a08c370" member_type: VOTER last_known_addr { host: "127.17.136.1" port: 43101 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8f704da49bf344ee898a54d2c5dfd89b" member_type: VOTER last_known_addr { host: "127.17.136.2" port: 39601 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a363e237b7834e2ab8980eff01e257e6" member_type: VOTER last_known_addr { host: "127.17.136.3" port: 33363 } health_report { overall_health: UNKNOWN } } }
W20260927 15:14:27.907967 30902 tablet.cc:2369] T d7e7cf40b569470eb48767e23f6bb47e P 5b8e8298e79743c6a74319041a08c370: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260927 15:14:27.916425 31177 tablet.cc:2369] T d7e7cf40b569470eb48767e23f6bb47e P a363e237b7834e2ab8980eff01e257e6: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260927 15:14:27.919270 31037 tablet.cc:2369] T d7e7cf40b569470eb48767e23f6bb47e P 8f704da49bf344ee898a54d2c5dfd89b: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260927 15:14:27.936455 31200 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:14:27.931479 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37862 (local address 127.17.136.1:43101)
0927 15:14:27.931607 (+ 128us) server_negotiation.cc:206] Beginning negotiation
0927 15:14:27.931612 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0927 15:14:27.931625 (+ 13us) server_negotiation.cc:407] Connection header received
0927 15:14:27.931710 (+ 85us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:14:27.931713 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:14:27.931777 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:14:27.931874 (+ 97us) server_negotiation.cc:226] Negotiated authn=TOKEN
0927 15:14:27.932257 (+ 383us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:14:27.933084 (+ 827us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:14:27.934336 (+ 1252us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:14:27.934677 (+ 341us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:14:27.934765 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:14:27.935168 (+ 403us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0927 15:14:27.935732 (+ 564us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0927 15:14:27.935838 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0927 15:14:27.936240 (+ 402us) server_negotiation.cc:299] Negotiation successful
0927 15:14:27.936297 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260927 15:14:27.948916 31122 raft_consensus.cc:1261] T d7e7cf40b569470eb48767e23f6bb47e P a363e237b7834e2ab8980eff01e257e6 [term 1 FOLLOWER]: Refusing update from remote peer 5b8e8298e79743c6a74319041a08c370: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260927 15:14:27.949846 30972 raft_consensus.cc:1261] T d7e7cf40b569470eb48767e23f6bb47e P 8f704da49bf344ee898a54d2c5dfd89b [term 1 FOLLOWER]: Refusing update from remote peer 5b8e8298e79743c6a74319041a08c370: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260927 15:14:27.950698 31214 consensus_queue.cc:1035] T d7e7cf40b569470eb48767e23f6bb47e P 5b8e8298e79743c6a74319041a08c370 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8f704da49bf344ee898a54d2c5dfd89b" member_type: VOTER last_known_addr { host: "127.17.136.2" port: 39601 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260927 15:14:27.951267 31205 consensus_queue.cc:1035] T d7e7cf40b569470eb48767e23f6bb47e P 5b8e8298e79743c6a74319041a08c370 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a363e237b7834e2ab8980eff01e257e6" member_type: VOTER last_known_addr { host: "127.17.136.3" port: 33363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260927 15:14:27.966455 31217 mvcc.cc:205] Tried to move back new op lower bound from 7333978390307848192 to 7333978390055673856. Current Snapshot: MvccSnapshot[applied={T|T < 7333978390307848192}]
I20260927 15:14:27.966758 31218 mvcc.cc:205] Tried to move back new op lower bound from 7333978390307848192 to 7333978390055673856. Current Snapshot: MvccSnapshot[applied={T|T < 7333978390307848192}]
I20260927 15:14:27.975204 31221 mvcc.cc:205] Tried to move back new op lower bound from 7333978390307848192 to 7333978390055673856. Current Snapshot: MvccSnapshot[applied={T|T < 7333978390307848192}]
I20260927 15:14:27.983006 30702 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:59812:
table { table_name: "test-table" } modify_external_catalogs: true
I20260927 15:14:27.983186 30702 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:59812:
table { table_name: "test-table" } modify_external_catalogs: true
I20260927 15:14:27.985906 30702 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 283a12e2b76b410684aa493c45f24682: Sending DeleteTablet for 3 replicas of tablet d7e7cf40b569470eb48767e23f6bb47e
I20260927 15:14:27.986639 30835 tablet_service.cc:1514] Processing DeleteTablet for tablet d7e7cf40b569470eb48767e23f6bb47e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:14:27 UTC) from {username='kudu', principal='kudu/127.17.136.62@KRBTEST.COM'} at 127.0.0.1:37860
I20260927 15:14:27.988759 30970 tablet_service.cc:1514] Processing DeleteTablet for tablet d7e7cf40b569470eb48767e23f6bb47e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:14:27 UTC) from {username='kudu', principal='kudu/127.17.136.62@KRBTEST.COM'} at 127.0.0.1:38900
I20260927 15:14:27.989723 31103 tablet_service.cc:1514] Processing DeleteTablet for tablet d7e7cf40b569470eb48767e23f6bb47e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:14:27 UTC) from {username='kudu', principal='kudu/127.17.136.62@KRBTEST.COM'} at 127.0.0.1:42242
I20260927 15:14:27.991211 17952 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu with pid 30741
I20260927 15:14:27.995527 31230 tablet_replica.cc:330] T d7e7cf40b569470eb48767e23f6bb47e P a363e237b7834e2ab8980eff01e257e6: stopping tablet replica
I20260927 15:14:27.995971 31230 raft_consensus.cc:2229] T d7e7cf40b569470eb48767e23f6bb47e P a363e237b7834e2ab8980eff01e257e6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260927 15:14:27.997920 31229 tablet_replica.cc:330] T d7e7cf40b569470eb48767e23f6bb47e P 8f704da49bf344ee898a54d2c5dfd89b: stopping tablet replica
I20260927 15:14:27.998667 31230 raft_consensus.cc:2258] T d7e7cf40b569470eb48767e23f6bb47e P a363e237b7834e2ab8980eff01e257e6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 15:14:27.999531 31229 raft_consensus.cc:2229] T d7e7cf40b569470eb48767e23f6bb47e P 8f704da49bf344ee898a54d2c5dfd89b [term 1 FOLLOWER]: Raft consensus shutting down.
W20260927 15:14:28.002125 30687 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.17.136.1:43101 (error 108)
I20260927 15:14:28.002245 31230 ts_tablet_manager.cc:1905] T d7e7cf40b569470eb48767e23f6bb47e P a363e237b7834e2ab8980eff01e257e6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:14:28.003312 31229 raft_consensus.cc:2258] T d7e7cf40b569470eb48767e23f6bb47e P 8f704da49bf344ee898a54d2c5dfd89b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 15:14:28.003728 17952 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu with pid 30905
I20260927 15:14:28.004295 31199 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:14:28.003411 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.1:43101 (local address 127.0.0.1:37874)
0927 15:14:28.004132 (+ 721us) negotiation.cc:107] Waiting for socket to connect
0927 15:14:28.004205 (+ 73us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.136.1:43101: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":632}
W20260927 15:14:28.007155 30687 catalog_manager.cc:4584] TS 5b8e8298e79743c6a74319041a08c370 (127.17.136.1:43101): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet d7e7cf40b569470eb48767e23f6bb47e: Network error: Client connection negotiation failed: client connection to 127.17.136.1:43101: connect: Connection refused (error 111)
I20260927 15:14:28.013120 31199 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:14:28.012784 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.2:39601 (local address 127.0.0.1:38902)
0927 15:14:28.012973 (+ 189us) negotiation.cc:107] Waiting for socket to connect
0927 15:14:28.013028 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.136.2:39601: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":100}
I20260927 15:14:28.016817 17952 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu with pid 31039
I20260927 15:14:28.028239 17952 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu with pid 30670
I20260927 15:14:28.036085 17952 mini_ranger_kms.cc:60] Stopping Ranger KMS...
I20260927 15:14:28.370682 17952 mini_ranger_kms.cc:62] Stopped Ranger KMS
I20260927 15:14:28.370790 17952 mini_ranger.cc:66] Stopping Ranger...
I20260927 15:14:28.704860 17952 mini_ranger.cc:68] Stopped Ranger
2026-09-27 15:14:28.705 UTC [29737] LOG: received smart shutdown request
2026-09-27 15:14:28.708 UTC [29737] LOG: background worker "logical replication launcher" (PID 29746) exited with exit code 1
2026-09-27 15:14:28.708 UTC [29741] LOG: shutting down
2026-09-27 15:14:28.855 UTC [29737] LOG: database system is shut down
2026-09-27T15:14:28Z chronyd exiting
[ OK ] SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers (45296 ms)
[ RUN ] SecurityITest.IPKICACert
Loading random data
Initializing database '/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790521920546562-17952-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 27 15:14:28 dist-test-slave-5s2t krb5kdc[31240](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 27 15:14:28 dist-test-slave-5s2t krb5kdc[31240](info): set up 2 sockets
Sep 27 15:14:28 dist-test-slave-5s2t krb5kdc[31240](info): commencing operation
krb5kdc: starting...
W20260927 15:14:29.895012 17952 mini_kdc.cc:121] Time spent starting KDC: real 0.930s user 0.004s sys 0.000s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790521920546562-17952-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790521920546562-17952-0/krb5kdc/test-user.keytab.
Sep 27 15:14:29 dist-test-slave-5s2t krb5kdc[31240](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790522069, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-27T15:14:29Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-27T15:14:29Z Disabled control of system clock
WARNING: no policy specified for kudu/127.17.136.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.136.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.136.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790521920546562-17952-0/krb5kdc/kudu_127.17.136.62.keytab.
Entry for principal kudu/127.17.136.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790521920546562-17952-0/krb5kdc/kudu_127.17.136.62.keytab.
I20260927 15:14:30.006801 17952 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu
/tmp/dist-test-taskiFOyeW/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790521920546562-17952-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790521920546562-17952-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790521920546562-17952-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790521920546562-17952-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.136.62:44461
--webserver_interface=127.17.136.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790521920546562-17952-0/krb5kdc/kudu_127.17.136.62.keytab
--principal=kudu/127.17.136.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.136.20:37345
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.136.62:44461,127.17.136.61:35071,127.17.136.60:36851
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790521920546562-17952-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790521920546562-17952-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790521920546562-17952-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260927 15:14:30.112321 31253 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260927 15:14:30.112583 31253 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260927 15:14:30.112640 31253 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260927 15:14:30.116593 31253 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260927 15:14:30.116647 31253 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260927 15:14:30.116672 31253 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260927 15:14:30.116694 31253 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260927 15:14:30.116722 31253 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260927 15:14:30.121855 31253 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.136.20:37345
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790521920546562-17952-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790521920546562-17952-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.17.136.62:44461,127.17.136.61:35071,127.17.136.60:36851
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790521920546562-17952-0/krb5kdc/kudu_127.17.136.62.keytab
--principal=kudu/127.17.136.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.136.62:44461
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790521920546562-17952-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.17.136.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31253
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790521920546562-17952-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 27 Sep 2026 14:27:13 UTC on ccycloud.quasar-psqrth.root.comops.site
build id 4676138
I20260927 15:14:30.122851 31253 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260927 15:14:30.123842 31253 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260927 15:14:30.131539 31259 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260927 15:14:30.131559 31261 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260927 15:14:30.131608 31258 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260927 15:14:30.131610 31253 server_base.cc:1034] running on GCE node
I20260927 15:14:30.132238 31253 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260927 15:14:30.133284 31253 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260927 15:14:30.134441 31253 hybrid_clock.cc:648] HybridClock initialized: now 1790522070134426 us; error 34 us; skew 500 ppm
Sep 27 15:14:30 dist-test-slave-5s2t krb5kdc[31240](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790522070, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.136.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260927 15:14:30.139448 31253 init.cc:377] Logged in from keytab as kudu/127.17.136.62@KRBTEST.COM (short username kudu)
I20260927 15:14:30.140326 31253 webserver.cc:460] Webserver started at http://127.17.136.62:45771/ using document root <none> and password file <none>
I20260927 15:14:30.140843 31253 fs_manager.cc:359] Metadata directory not provided
I20260927 15:14:30.140906 31253 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260927 15:14:30.141088 31253 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260927 15:14:30.143023 31253 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790521920546562-17952-0/minicluster-data/master-0/data/instance:
uuid: "6c627098975540dd8e914e67d30598b4"
format_stamp: "Formatted at 2026-09-27 15:14:30 on dist-test-slave-5s2t"
server_key: "46559088f06dd036de67c819efaa14af"
server_key_iv: "1960d3ccb2ed5b5e2f3ec9aa981358d7"
server_key_version: "encryptionkey@0"
I20260927 15:14:30.143558 31253 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790521920546562-17952-0/minicluster-data/master-0/wal/instance:
uuid: "6c627098975540dd8e914e67d30598b4"
format_stamp: "Formatted at 2026-09-27 15:14:30 on dist-test-slave-5s2t"
server_key: "46559088f06dd036de67c819efaa14af"
server_key_iv: "1960d3ccb2ed5b5e2f3ec9aa981358d7"
server_key_version: "encryptionkey@0"
I20260927 15:14:30.146931 31253 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.000s
I20260927 15:14:30.149194 31268 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260927 15:14:30.150321 31253 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260927 15:14:30.150440 31253 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790521920546562-17952-0/minicluster-data/master-0/data,/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790521920546562-17952-0/minicluster-data/master-0/wal
uuid: "6c627098975540dd8e914e67d30598b4"
format_stamp: "Formatted at 2026-09-27 15:14:30 on dist-test-slave-5s2t"
server_key: "46559088f06dd036de67c819efaa14af"
server_key_iv: "1960d3ccb2ed5b5e2f3ec9aa981358d7"
server_key_version: "encryptionkey@0"
I20260927 15:14:30.150556 31253 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790521920546562-17952-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790521920546562-17952-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790521920546562-17952-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260927 15:14:30.164585 31253 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260927 15:14:30.167364 31253 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260927 15:14:30.167549 31253 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260927 15:14:30.174322 31253 rpc_server.cc:307] RPC server started. Bound to: 127.17.136.62:44461
I20260927 15:14:30.174340 31320 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.136.62:44461 every 8 connection(s)
I20260927 15:14:30.175287 31253 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790521920546562-17952-0/minicluster-data/master-0/data/info.pb
I20260927 15:14:30.177937 31321 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:14:30.181560 31321 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.17.136.62" port: 44461 } has no permanent_uuid. Determining permanent_uuid...
I20260927 15:14:30.182601 17952 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu as pid 31253
I20260927 15:14:30.182713 17952 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790521920546562-17952-0/minicluster-data/master-0/wal/instance
I20260927 15:14:30.182967 17952 external_mini_cluster.cc:1428] Setting key 6c7fbaa2da47fa1cf44de233c5803e85
WARNING: no policy specified for kudu/127.17.136.61@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.136.61@KRBTEST.COM" created.
Sep 27 15:14:30 dist-test-slave-5s2t krb5kdc[31240](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790522070, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.136.62@KRBTEST.COM for kudu/127.17.136.62@KRBTEST.COM
I20260927 15:14:30.198563 31325 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:14:30.183955 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.62:44461 (local address 127.0.0.1:36186)
0927 15:14:30.184631 (+ 676us) negotiation.cc:107] Waiting for socket to connect
0927 15:14:30.184683 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0927 15:14:30.185644 (+ 961us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0927 15:14:30.186319 (+ 675us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0927 15:14:30.186324 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0927 15:14:30.186786 (+ 462us) client_negotiation.cc:189] Negotiated authn=SASL
0927 15:14:30.187130 (+ 344us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:14:30.187149 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:14:30.188312 (+ 1163us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:14:30.188316 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:14:30.189463 (+ 1147us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:14:30.189474 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:14:30.190109 (+ 635us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:14:30.190114 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:14:30.190242 (+ 128us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:14:30.190815 (+ 573us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0927 15:14:30.190833 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0927 15:14:30.193892 (+ 3059us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0927 15:14:30.195826 (+ 1934us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0927 15:14:30.195834 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0927 15:14:30.195842 (+ 8us) client_negotiation.cc:760] calling sasl_client_step()
0927 15:14:30.196075 (+ 233us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0927 15:14:30.196378 (+ 303us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0927 15:14:30.196380 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0927 15:14:30.196381 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0927 15:14:30.196478 (+ 97us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0927 15:14:30.197196 (+ 718us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0927 15:14:30.197202 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0927 15:14:30.197327 (+ 125us) client_negotiation.cc:769] Sending connection context
0927 15:14:30.197465 (+ 138us) client_negotiation.cc:240] Negotiation successful
0927 15:14:30.197729 (+ 264us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":464,"spinlock_wait_cycles":50560,"thread_start_us":148,"threads_started":1}
I20260927 15:14:30.198566 31324 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:14:30.183955 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36186 (local address 127.17.136.62:44461)
0927 15:14:30.184488 (+ 533us) server_negotiation.cc:206] Beginning negotiation
0927 15:14:30.184506 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0927 15:14:30.184796 (+ 290us) server_negotiation.cc:407] Connection header received
0927 15:14:30.185959 (+ 1163us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:14:30.185963 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:14:30.186136 (+ 173us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:14:30.186279 (+ 143us) server_negotiation.cc:226] Negotiated authn=SASL
0927 15:14:30.187307 (+ 1028us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:14:30.188195 (+ 888us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:14:30.189587 (+ 1392us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:14:30.189952 (+ 365us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:14:30.190064 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:14:30.194070 (+ 4006us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0927 15:14:30.194076 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0927 15:14:30.194087 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0927 15:14:30.194109 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0927 15:14:30.195732 (+ 1623us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:14:30.196171 (+ 439us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:14:30.196177 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:14:30.196179 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:14:30.196303 (+ 124us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:14:30.196554 (+ 251us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:14:30.196558 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:14:30.196560 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:14:30.197096 (+ 536us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0927 15:14:30.197227 (+ 131us) server_negotiation.cc:1035] Waiting for connection context
0927 15:14:30.197565 (+ 338us) server_negotiation.cc:299] Negotiation successful
0927 15:14:30.197828 (+ 263us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":69,"server-negotiator.queue_time_us":396,"thread_start_us":124,"threads_started":1}
I20260927 15:14:30.201205 31321 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.17.136.61" port: 35071 } has no permanent_uuid. Determining permanent_uuid...
I20260927 15:14:30.201907 31325 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:14:30.201679 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.61:35071 (local address 127.0.0.1:35474)
0927 15:14:30.201782 (+ 103us) negotiation.cc:107] Waiting for socket to connect
0927 15:14:30.201849 (+ 67us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.136.61:35071: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":36}
W20260927 15:14:30.202059 31269 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.17.136.61:35071: connect: Connection refused (error 111)
I20260927 15:14:30.202888 31325 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:14:30.202688 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.61:35071 (local address 127.0.0.1:35488)
0927 15:14:30.202782 (+ 94us) negotiation.cc:107] Waiting for socket to connect
0927 15:14:30.202825 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.136.61:35071: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":33}
W20260927 15:14:30.203015 31321 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.17.136.61:35071: Network error: Client connection negotiation failed: client connection to 127.17.136.61:35071: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.136.61 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790521920546562-17952-0/krb5kdc/kudu_127.17.136.61.keytab.
Entry for principal kudu/127.17.136.61 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790521920546562-17952-0/krb5kdc/kudu_127.17.136.61.keytab.
I20260927 15:14:30.209823 17952 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu
/tmp/dist-test-taskiFOyeW/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790521920546562-17952-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790521920546562-17952-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790521920546562-17952-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790521920546562-17952-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.136.61:35071
--webserver_interface=127.17.136.61
--webserver_port=0
--keytab_file=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790521920546562-17952-0/krb5kdc/kudu_127.17.136.61.keytab
--principal=kudu/127.17.136.61
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.136.20:37345
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.136.62:44461,127.17.136.61:35071,127.17.136.60:36851
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790521920546562-17952-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790521920546562-17952-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790521920546562-17952-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260927 15:14:30.252259 31321 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.17.136.61" port: 35071 } attempt: 1
I20260927 15:14:30.253126 31325 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:14:30.252827 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.61:35071 (local address 127.0.0.1:35504)
0927 15:14:30.252971 (+ 144us) negotiation.cc:107] Waiting for socket to connect
0927 15:14:30.253048 (+ 77us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.136.61:35071: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":54}
I20260927 15:14:30.253849 31325 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:14:30.253657 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.61:35071 (local address 127.0.0.1:35508)
0927 15:14:30.253747 (+ 90us) negotiation.cc:107] Waiting for socket to connect
0927 15:14:30.253792 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.136.61:35071: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":34}
W20260927 15:14:30.254011 31321 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.17.136.61:35071: Network error: Client connection negotiation failed: client connection to 127.17.136.61:35071: connect: Connection refused (error 111)
W20260927 15:14:30.317287 31328 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260927 15:14:30.317569 31328 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260927 15:14:30.317633 31328 flags.cc:425] Enabled unsafe flag: --never_fsync=true
I20260927 15:14:30.322161 31321 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.17.136.61" port: 35071 } attempt: 2
W20260927 15:14:30.322986 31328 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
I20260927 15:14:30.323103 31325 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:14:30.322728 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.61:35071 (local address 127.0.0.1:35516)
0927 15:14:30.322940 (+ 212us) negotiation.cc:107] Waiting for socket to connect
0927 15:14:30.323002 (+ 62us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.136.61:35071: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":128}
W20260927 15:14:30.323118 31328 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260927 15:14:30.323164 31328 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260927 15:14:30.323192 31328 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260927 15:14:30.323241 31328 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260927 15:14:30.323910 31325 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:14:30.323633 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.61:35071 (local address 127.0.0.1:35518)
0927 15:14:30.323769 (+ 136us) negotiation.cc:107] Waiting for socket to connect
0927 15:14:30.323842 (+ 73us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.136.61:35071: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":41}
W20260927 15:14:30.324055 31321 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.17.136.61:35071: Network error: Client connection negotiation failed: client connection to 127.17.136.61:35071: connect: Connection refused (error 111)
I20260927 15:14:30.328886 31328 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.136.20:37345
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790521920546562-17952-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790521920546562-17952-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.17.136.62:44461,127.17.136.61:35071,127.17.136.60:36851
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790521920546562-17952-0/krb5kdc/kudu_127.17.136.61.keytab
--principal=kudu/127.17.136.61
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.136.61:35071
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790521920546562-17952-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.17.136.61
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31328
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790521920546562-17952-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 27 Sep 2026 14:27:13 UTC on ccycloud.quasar-psqrth.root.comops.site
build id 4676138
I20260927 15:14:30.329830 31328 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260927 15:14:30.330739 31328 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260927 15:14:30.338590 31333 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260927 15:14:30.338613 31336 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260927 15:14:30.338670 31328 server_base.cc:1034] running on GCE node
W20260927 15:14:30.338621 31334 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260927 15:14:30.339321 31328 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260927 15:14:30.340329 31328 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260927 15:14:30.341473 31328 hybrid_clock.cc:648] HybridClock initialized: now 1790522070341449 us; error 36 us; skew 500 ppm
Sep 27 15:14:30 dist-test-slave-5s2t krb5kdc[31240](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790522070, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.136.61@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260927 15:14:30.343976 31328 init.cc:377] Logged in from keytab as kudu/127.17.136.61@KRBTEST.COM (short username kudu)
I20260927 15:14:30.344784 31328 webserver.cc:460] Webserver started at http://127.17.136.61:36685/ using document root <none> and password file <none>
I20260927 15:14:30.345273 31328 fs_manager.cc:359] Metadata directory not provided
I20260927 15:14:30.345325 31328 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260927 15:14:30.345482 31328 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260927 15:14:30.347433 31328 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790521920546562-17952-0/minicluster-data/master-1/data/instance:
uuid: "92b215828a594c3eaae84881f55d237d"
format_stamp: "Formatted at 2026-09-27 15:14:30 on dist-test-slave-5s2t"
server_key: "6e60d001e360588d78a51e4ec50ad624"
server_key_iv: "910da699aaa3a95c2a0905ccdc8a23c3"
server_key_version: "encryptionkey@0"
I20260927 15:14:30.347914 31328 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790521920546562-17952-0/minicluster-data/master-1/wal/instance:
uuid: "92b215828a594c3eaae84881f55d237d"
format_stamp: "Formatted at 2026-09-27 15:14:30 on dist-test-slave-5s2t"
server_key: "6e60d001e360588d78a51e4ec50ad624"
server_key_iv: "910da699aaa3a95c2a0905ccdc8a23c3"
server_key_version: "encryptionkey@0"
I20260927 15:14:30.351231 31328 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.001s
I20260927 15:14:30.353577 31343 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260927 15:14:30.354831 31328 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.000s sys 0.002s
I20260927 15:14:30.354925 31328 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790521920546562-17952-0/minicluster-data/master-1/data,/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790521920546562-17952-0/minicluster-data/master-1/wal
uuid: "92b215828a594c3eaae84881f55d237d"
format_stamp: "Formatted at 2026-09-27 15:14:30 on dist-test-slave-5s2t"
server_key: "6e60d001e360588d78a51e4ec50ad624"
server_key_iv: "910da699aaa3a95c2a0905ccdc8a23c3"
server_key_version: "encryptionkey@0"
I20260927 15:14:30.355003 31328 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790521920546562-17952-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790521920546562-17952-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790521920546562-17952-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260927 15:14:30.378959 31328 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260927 15:14:30.381999 31328 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260927 15:14:30.382190 31328 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260927 15:14:30.389293 31328 rpc_server.cc:307] RPC server started. Bound to: 127.17.136.61:35071
I20260927 15:14:30.389300 31395 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.136.61:35071 every 8 connection(s)
I20260927 15:14:30.390252 31328 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790521920546562-17952-0/minicluster-data/master-1/data/info.pb
I20260927 15:14:30.393013 31396 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:14:30.395442 17952 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu as pid 31328
I20260927 15:14:30.395552 17952 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790521920546562-17952-0/minicluster-data/master-1/wal/instance
I20260927 15:14:30.395825 17952 external_mini_cluster.cc:1428] Setting key 444afa2bc94a72a7528f3464ef20fc0e
I20260927 15:14:30.396790 31396 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.17.136.62" port: 44461 } has no permanent_uuid. Determining permanent_uuid...
WARNING: no policy specified for kudu/127.17.136.60@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.136.60@KRBTEST.COM" created.
Sep 27 15:14:30 dist-test-slave-5s2t krb5kdc[31240](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790522070, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.136.61@KRBTEST.COM for kudu/127.17.136.62@KRBTEST.COM
I20260927 15:14:30.410275 31324 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:14:30.398954 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36192 (local address 127.17.136.62:44461)
0927 15:14:30.399112 (+ 158us) server_negotiation.cc:206] Beginning negotiation
0927 15:14:30.399117 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0927 15:14:30.400002 (+ 885us) server_negotiation.cc:407] Connection header received
0927 15:14:30.400967 (+ 965us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:14:30.400971 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:14:30.401040 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:14:30.401131 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0927 15:14:30.402308 (+ 1177us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:14:30.403105 (+ 797us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:14:30.404335 (+ 1230us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:14:30.404561 (+ 226us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:14:30.404639 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:14:30.407020 (+ 2381us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0927 15:14:30.407023 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0927 15:14:30.407025 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0927 15:14:30.407058 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0927 15:14:30.408342 (+ 1284us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:14:30.408819 (+ 477us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:14:30.408823 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:14:30.408824 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:14:30.408897 (+ 73us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:14:30.409198 (+ 301us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:14:30.409201 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:14:30.409203 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:14:30.409377 (+ 174us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0927 15:14:30.409458 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0927 15:14:30.409967 (+ 509us) server_negotiation.cc:299] Negotiation successful
0927 15:14:30.410100 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260927 15:14:30.411058 31399 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:14:30.399333 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.62:44461 (local address 127.0.0.1:36192)
0927 15:14:30.399828 (+ 495us) negotiation.cc:107] Waiting for socket to connect
0927 15:14:30.399881 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0927 15:14:30.400759 (+ 878us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0927 15:14:30.401294 (+ 535us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0927 15:14:30.401302 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0927 15:14:30.401672 (+ 370us) client_negotiation.cc:189] Negotiated authn=SASL
0927 15:14:30.402155 (+ 483us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:14:30.402169 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:14:30.403267 (+ 1098us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:14:30.403272 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:14:30.404239 (+ 967us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:14:30.404249 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:14:30.404694 (+ 445us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:14:30.404699 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:14:30.404838 (+ 139us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:14:30.405388 (+ 550us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0927 15:14:30.405404 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0927 15:14:30.406867 (+ 1463us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0927 15:14:30.408447 (+ 1580us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0927 15:14:30.408452 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0927 15:14:30.408467 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0927 15:14:30.408725 (+ 258us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0927 15:14:30.408975 (+ 250us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0927 15:14:30.408978 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0927 15:14:30.408980 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0927 15:14:30.409115 (+ 135us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0927 15:14:30.409470 (+ 355us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0927 15:14:30.409477 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0927 15:14:30.409735 (+ 258us) client_negotiation.cc:769] Sending connection context
0927 15:14:30.409897 (+ 162us) client_negotiation.cc:240] Negotiation successful
0927 15:14:30.410215 (+ 318us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":280,"thread_start_us":134,"threads_started":1}
I20260927 15:14:30.412411 31396 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.17.136.61" port: 35071 } has no permanent_uuid. Determining permanent_uuid...
I20260927 15:14:30.415195 31321 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.17.136.61" port: 35071 } attempt: 3
Sep 27 15:14:30 dist-test-slave-5s2t krb5kdc[31240](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790522070, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.136.61@KRBTEST.COM for kudu/127.17.136.61@KRBTEST.COM
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.136.60 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790521920546562-17952-0/krb5kdc/kudu_127.17.136.60.keytab.
Entry for principal kudu/127.17.136.60 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790521920546562-17952-0/krb5kdc/kudu_127.17.136.60.keytab.
I20260927 15:14:30.420346 17952 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu
/tmp/dist-test-taskiFOyeW/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790521920546562-17952-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790521920546562-17952-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790521920546562-17952-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790521920546562-17952-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.136.60:36851
--webserver_interface=127.17.136.60
--webserver_port=0
--keytab_file=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790521920546562-17952-0/krb5kdc/kudu_127.17.136.60.keytab
--principal=kudu/127.17.136.60
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.136.20:37345
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.136.62:44461,127.17.136.61:35071,127.17.136.60:36851
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790521920546562-17952-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790521920546562-17952-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790521920546562-17952-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Sep 27 15:14:30 dist-test-slave-5s2t krb5kdc[31240](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790522070, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.136.62@KRBTEST.COM for kudu/127.17.136.61@KRBTEST.COM
I20260927 15:14:30.422909 31399 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:14:30.412846 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.61:35071 (local address 127.0.0.1:35522)
0927 15:14:30.412956 (+ 110us) negotiation.cc:107] Waiting for socket to connect
0927 15:14:30.412968 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0927 15:14:30.413040 (+ 72us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0927 15:14:30.413546 (+ 506us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0927 15:14:30.413549 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0927 15:14:30.413669 (+ 120us) client_negotiation.cc:189] Negotiated authn=SASL
0927 15:14:30.413787 (+ 118us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:14:30.413804 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:14:30.414834 (+ 1030us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:14:30.414837 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:14:30.415565 (+ 728us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:14:30.415590 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:14:30.416469 (+ 879us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:14:30.416472 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:14:30.416609 (+ 137us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:14:30.417026 (+ 417us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0927 15:14:30.417041 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0927 15:14:30.418356 (+ 1315us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0927 15:14:30.421334 (+ 2978us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0927 15:14:30.421337 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0927 15:14:30.421339 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0927 15:14:30.421651 (+ 312us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0927 15:14:30.421914 (+ 263us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0927 15:14:30.421918 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0927 15:14:30.421920 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0927 15:14:30.422006 (+ 86us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0927 15:14:30.422422 (+ 416us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0927 15:14:30.422425 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0927 15:14:30.422508 (+ 83us) client_negotiation.cc:769] Sending connection context
0927 15:14:30.422596 (+ 88us) client_negotiation.cc:240] Negotiation successful
0927 15:14:30.422714 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":42,"mutex_wait_us":2}
I20260927 15:14:30.422953 31401 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:14:30.412944 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35522 (local address 127.17.136.61:35071)
0927 15:14:30.413237 (+ 293us) server_negotiation.cc:206] Beginning negotiation
0927 15:14:30.413248 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0927 15:14:30.413266 (+ 18us) server_negotiation.cc:407] Connection header received
0927 15:14:30.413297 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:14:30.413301 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:14:30.413447 (+ 146us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:14:30.413555 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0927 15:14:30.413894 (+ 339us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:14:30.414746 (+ 852us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:14:30.415902 (+ 1156us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:14:30.416366 (+ 464us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:14:30.416473 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:14:30.418470 (+ 1997us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0927 15:14:30.418479 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0927 15:14:30.418489 (+ 10us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0927 15:14:30.418544 (+ 55us) server_negotiation.cc:922] calling sasl_server_start()
0927 15:14:30.421231 (+ 2687us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:14:30.421757 (+ 526us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:14:30.421763 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:14:30.421765 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:14:30.421841 (+ 76us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:14:30.422098 (+ 257us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:14:30.422102 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:14:30.422104 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:14:30.422330 (+ 226us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0927 15:14:30.422462 (+ 132us) server_negotiation.cc:1035] Waiting for connection context
0927 15:14:30.422684 (+ 222us) server_negotiation.cc:299] Negotiation successful
0927 15:14:30.422805 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":30,"server-negotiator.queue_time_us":205,"thread_start_us":120,"threads_started":1}
I20260927 15:14:30.424774 31396 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.17.136.60" port: 36851 } has no permanent_uuid. Determining permanent_uuid...
I20260927 15:14:30.425436 31399 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:14:30.425166 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.60:36851 (local address 127.0.0.1:58450)
0927 15:14:30.425280 (+ 114us) negotiation.cc:107] Waiting for socket to connect
0927 15:14:30.425361 (+ 81us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.136.60:36851: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":42}
W20260927 15:14:30.425632 31345 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.17.136.60:36851: connect: Connection refused (error 111)
I20260927 15:14:30.426391 31399 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:14:30.426176 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.60:36851 (local address 127.0.0.1:58452)
0927 15:14:30.426278 (+ 102us) negotiation.cc:107] Waiting for socket to connect
0927 15:14:30.426329 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.136.60:36851: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":37}
W20260927 15:14:30.426532 31396 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.17.136.60:36851: Network error: Client connection negotiation failed: client connection to 127.17.136.60:36851: connect: Connection refused (error 111)
I20260927 15:14:30.428332 31402 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:14:30.415690 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35536 (local address 127.17.136.61:35071)
0927 15:14:30.415950 (+ 260us) server_negotiation.cc:206] Beginning negotiation
0927 15:14:30.415958 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0927 15:14:30.415970 (+ 12us) server_negotiation.cc:407] Connection header received
0927 15:14:30.415996 (+ 26us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:14:30.415999 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:14:30.416035 (+ 36us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:14:30.416113 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0927 15:14:30.416445 (+ 332us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:14:30.416997 (+ 552us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:14:30.418601 (+ 1604us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:14:30.418881 (+ 280us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:14:30.419011 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:14:30.420864 (+ 1853us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0927 15:14:30.420867 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0927 15:14:30.420870 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0927 15:14:30.420893 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0927 15:14:30.422532 (+ 1639us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:14:30.422960 (+ 428us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:14:30.422963 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:14:30.422964 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:14:30.423059 (+ 95us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:14:30.427591 (+ 4532us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:14:30.427594 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:14:30.427596 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:14:30.427785 (+ 189us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0927 15:14:30.427860 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0927 15:14:30.428130 (+ 270us) server_negotiation.cc:299] Negotiation successful
0927 15:14:30.428213 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":202,"thread_start_us":84,"threads_started":1}
I20260927 15:14:30.428400 31325 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:14:30.415602 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.61:35071 (local address 127.0.0.1:35536)
0927 15:14:30.415712 (+ 110us) negotiation.cc:107] Waiting for socket to connect
0927 15:14:30.415726 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0927 15:14:30.415784 (+ 58us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0927 15:14:30.416133 (+ 349us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0927 15:14:30.416136 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0927 15:14:30.416260 (+ 124us) client_negotiation.cc:189] Negotiated authn=SASL
0927 15:14:30.416351 (+ 91us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:14:30.416357 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:14:30.417205 (+ 848us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:14:30.417207 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:14:30.418510 (+ 1303us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:14:30.418519 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:14:30.419012 (+ 493us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:14:30.419016 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:14:30.419132 (+ 116us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:14:30.419566 (+ 434us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0927 15:14:30.419576 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0927 15:14:30.420721 (+ 1145us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0927 15:14:30.422648 (+ 1927us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0927 15:14:30.422651 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0927 15:14:30.422653 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0927 15:14:30.422865 (+ 212us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0927 15:14:30.427355 (+ 4490us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0927 15:14:30.427359 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0927 15:14:30.427361 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0927 15:14:30.427463 (+ 102us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0927 15:14:30.427872 (+ 409us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0927 15:14:30.427876 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0927 15:14:30.427984 (+ 108us) client_negotiation.cc:769] Sending connection context
0927 15:14:30.428101 (+ 117us) client_negotiation.cc:240] Negotiation successful
0927 15:14:30.428240 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":43}
I20260927 15:14:30.429107 31321 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.17.136.60" port: 36851 } has no permanent_uuid. Determining permanent_uuid...
I20260927 15:14:30.429734 31325 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:14:30.429533 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.60:36851 (local address 127.0.0.1:58464)
0927 15:14:30.429637 (+ 104us) negotiation.cc:107] Waiting for socket to connect
0927 15:14:30.429681 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.136.60:36851: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":42}
I20260927 15:14:30.430339 31325 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:14:30.430131 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.60:36851 (local address 127.0.0.1:58478)
0927 15:14:30.430255 (+ 124us) negotiation.cc:107] Waiting for socket to connect
0927 15:14:30.430293 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.136.60:36851: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":65}
W20260927 15:14:30.430452 31321 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.17.136.60:36851: Network error: Client connection negotiation failed: client connection to 127.17.136.60:36851: connect: Connection refused (error 111)
I20260927 15:14:30.461588 31321 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.17.136.60" port: 36851 } attempt: 1
I20260927 15:14:30.462406 31325 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:14:30.462121 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.60:36851 (local address 127.0.0.1:58482)
0927 15:14:30.462266 (+ 145us) negotiation.cc:107] Waiting for socket to connect
0927 15:14:30.462327 (+ 61us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.136.60:36851: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":56}
I20260927 15:14:30.463039 31325 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:14:30.462842 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.60:36851 (local address 127.0.0.1:58492)
0927 15:14:30.462938 (+ 96us) negotiation.cc:107] Waiting for socket to connect
0927 15:14:30.462982 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.136.60:36851: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":34}
W20260927 15:14:30.463140 31321 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.17.136.60:36851: Network error: Client connection negotiation failed: client connection to 127.17.136.60:36851: connect: Connection refused (error 111)
I20260927 15:14:30.475761 31396 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.17.136.60" port: 36851 } attempt: 1
I20260927 15:14:30.476554 31399 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:14:30.476262 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.60:36851 (local address 127.0.0.1:58500)
0927 15:14:30.476400 (+ 138us) negotiation.cc:107] Waiting for socket to connect
0927 15:14:30.476461 (+ 61us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.136.60:36851: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":51}
I20260927 15:14:30.477181 31399 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:14:30.476983 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.60:36851 (local address 127.0.0.1:58504)
0927 15:14:30.477083 (+ 100us) negotiation.cc:107] Waiting for socket to connect
0927 15:14:30.477128 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.136.60:36851: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":35}
W20260927 15:14:30.477288 31396 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.17.136.60:36851: Network error: Client connection negotiation failed: client connection to 127.17.136.60:36851: connect: Connection refused (error 111)
W20260927 15:14:30.528586 31403 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260927 15:14:30.528853 31403 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260927 15:14:30.528910 31403 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260927 15:14:30.532873 31403 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260927 15:14:30.532934 31403 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260927 15:14:30.532961 31403 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260927 15:14:30.532985 31403 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260927 15:14:30.533013 31403 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260927 15:14:30.538303 31321 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.17.136.60" port: 36851 } attempt: 2
I20260927 15:14:30.538681 31403 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.136.20:37345
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790521920546562-17952-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790521920546562-17952-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.17.136.62:44461,127.17.136.61:35071,127.17.136.60:36851
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790521920546562-17952-0/krb5kdc/kudu_127.17.136.60.keytab
--principal=kudu/127.17.136.60
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.136.60:36851
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790521920546562-17952-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.17.136.60
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31403
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790521920546562-17952-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 27 Sep 2026 14:27:13 UTC on ccycloud.quasar-psqrth.root.comops.site
build id 4676138
I20260927 15:14:30.539187 31325 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:14:30.538865 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.60:36851 (local address 127.0.0.1:58512)
0927 15:14:30.539045 (+ 180us) negotiation.cc:107] Waiting for socket to connect
0927 15:14:30.539104 (+ 59us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.136.60:36851: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":88}
I20260927 15:14:30.539801 31403 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260927 15:14:30.539876 31325 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:14:30.539678 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.60:36851 (local address 127.0.0.1:58514)
0927 15:14:30.539777 (+ 99us) negotiation.cc:107] Waiting for socket to connect
0927 15:14:30.539820 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.136.60:36851: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":36}
W20260927 15:14:30.540023 31321 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.17.136.60:36851: Network error: Client connection negotiation failed: client connection to 127.17.136.60:36851: connect: Connection refused (error 111)
I20260927 15:14:30.540834 31403 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260927 15:14:30.545465 31396 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.17.136.60" port: 36851 } attempt: 2
I20260927 15:14:30.546141 31399 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:14:30.545896 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.60:36851 (local address 127.0.0.1:58526)
0927 15:14:30.546018 (+ 122us) negotiation.cc:107] Waiting for socket to connect
0927 15:14:30.546074 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.136.60:36851: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":48}
I20260927 15:14:30.546789 31399 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:14:30.546585 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.60:36851 (local address 127.0.0.1:58536)
0927 15:14:30.546685 (+ 100us) negotiation.cc:107] Waiting for socket to connect
0927 15:14:30.546733 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.136.60:36851: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":37}
W20260927 15:14:30.546916 31396 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.17.136.60:36851: Network error: Client connection negotiation failed: client connection to 127.17.136.60:36851: connect: Connection refused (error 111)
W20260927 15:14:30.549013 31410 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260927 15:14:30.549027 31412 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260927 15:14:30.549023 31409 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260927 15:14:30.549342 31403 server_base.cc:1034] running on GCE node
I20260927 15:14:30.549875 31403 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260927 15:14:30.550895 31403 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260927 15:14:30.552059 31403 hybrid_clock.cc:648] HybridClock initialized: now 1790522070552039 us; error 30 us; skew 500 ppm
Sep 27 15:14:30 dist-test-slave-5s2t krb5kdc[31240](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790522070, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.136.60@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260927 15:14:30.554730 31403 init.cc:377] Logged in from keytab as kudu/127.17.136.60@KRBTEST.COM (short username kudu)
I20260927 15:14:30.555593 31403 webserver.cc:460] Webserver started at http://127.17.136.60:36675/ using document root <none> and password file <none>
I20260927 15:14:30.556177 31403 fs_manager.cc:359] Metadata directory not provided
I20260927 15:14:30.556265 31403 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260927 15:14:30.556519 31403 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260927 15:14:30.558668 31403 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790521920546562-17952-0/minicluster-data/master-2/data/instance:
uuid: "47dfb21b63914430bae332dc3c1f8d0a"
format_stamp: "Formatted at 2026-09-27 15:14:30 on dist-test-slave-5s2t"
server_key: "6890fa98fc7b99d82c7138ba69a1fe84"
server_key_iv: "dd231e7eaa798a7be7be02d62710a347"
server_key_version: "encryptionkey@0"
I20260927 15:14:30.559167 31403 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790521920546562-17952-0/minicluster-data/master-2/wal/instance:
uuid: "47dfb21b63914430bae332dc3c1f8d0a"
format_stamp: "Formatted at 2026-09-27 15:14:30 on dist-test-slave-5s2t"
server_key: "6890fa98fc7b99d82c7138ba69a1fe84"
server_key_iv: "dd231e7eaa798a7be7be02d62710a347"
server_key_version: "encryptionkey@0"
I20260927 15:14:30.562613 31403 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.000s
I20260927 15:14:30.564846 31419 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260927 15:14:30.565996 31403 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260927 15:14:30.566105 31403 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790521920546562-17952-0/minicluster-data/master-2/data,/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790521920546562-17952-0/minicluster-data/master-2/wal
uuid: "47dfb21b63914430bae332dc3c1f8d0a"
format_stamp: "Formatted at 2026-09-27 15:14:30 on dist-test-slave-5s2t"
server_key: "6890fa98fc7b99d82c7138ba69a1fe84"
server_key_iv: "dd231e7eaa798a7be7be02d62710a347"
server_key_version: "encryptionkey@0"
I20260927 15:14:30.566188 31403 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790521920546562-17952-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790521920546562-17952-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790521920546562-17952-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260927 15:14:30.577252 31403 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260927 15:14:30.579818 31403 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260927 15:14:30.579968 31403 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260927 15:14:30.586109 31403 rpc_server.cc:307] RPC server started. Bound to: 127.17.136.60:36851
I20260927 15:14:30.586128 31471 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.136.60:36851 every 8 connection(s)
I20260927 15:14:30.586946 31403 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790521920546562-17952-0/minicluster-data/master-2/data/info.pb
I20260927 15:14:30.589481 31472 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:14:30.593029 31472 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.17.136.62" port: 44461 } has no permanent_uuid. Determining permanent_uuid...
I20260927 15:14:30.596832 17952 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu as pid 31403
I20260927 15:14:30.596931 17952 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790521920546562-17952-0/minicluster-data/master-2/wal/instance
I20260927 15:14:30.597198 17952 external_mini_cluster.cc:1428] Setting key 42bad0b2d651b3f2065b1290438bd4ae
Sep 27 15:14:30 dist-test-slave-5s2t krb5kdc[31240](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790522070, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.136.60@KRBTEST.COM for kudu/127.17.136.62@KRBTEST.COM
Sep 27 15:14:30 dist-test-slave-5s2t krb5kdc[31240](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790522069, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.136.60@KRBTEST.COM
I20260927 15:14:30.605504 31324 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:14:30.594761 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36194 (local address 127.17.136.62:44461)
0927 15:14:30.594885 (+ 124us) server_negotiation.cc:206] Beginning negotiation
0927 15:14:30.594890 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0927 15:14:30.595711 (+ 821us) server_negotiation.cc:407] Connection header received
0927 15:14:30.596601 (+ 890us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:14:30.596605 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:14:30.596659 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:14:30.596726 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0927 15:14:30.597947 (+ 1221us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:14:30.598588 (+ 641us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:14:30.599665 (+ 1077us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:14:30.599881 (+ 216us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:14:30.599969 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:14:30.602244 (+ 2275us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0927 15:14:30.602247 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0927 15:14:30.602249 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0927 15:14:30.602273 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0927 15:14:30.603526 (+ 1253us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:14:30.603968 (+ 442us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:14:30.603973 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:14:30.603974 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:14:30.604048 (+ 74us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:14:30.604381 (+ 333us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:14:30.604385 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:14:30.604387 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:14:30.604631 (+ 244us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0927 15:14:30.604732 (+ 101us) server_negotiation.cc:1035] Waiting for connection context
0927 15:14:30.605227 (+ 495us) server_negotiation.cc:299] Negotiation successful
0927 15:14:30.605337 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260927 15:14:30.606256 31474 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:14:30.595104 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.62:44461 (local address 127.0.0.1:36194)
0927 15:14:30.595574 (+ 470us) negotiation.cc:107] Waiting for socket to connect
0927 15:14:30.595614 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0927 15:14:30.596391 (+ 777us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0927 15:14:30.596897 (+ 506us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0927 15:14:30.596905 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0927 15:14:30.597271 (+ 366us) client_negotiation.cc:189] Negotiated authn=SASL
0927 15:14:30.597783 (+ 512us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:14:30.597797 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:14:30.598685 (+ 888us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:14:30.598687 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:14:30.599559 (+ 872us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:14:30.599568 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:14:30.600007 (+ 439us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:14:30.600011 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:14:30.600171 (+ 160us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:14:30.600725 (+ 554us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0927 15:14:30.600739 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0927 15:14:30.602112 (+ 1373us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0927 15:14:30.603635 (+ 1523us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0927 15:14:30.603640 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0927 15:14:30.603650 (+ 10us) client_negotiation.cc:760] calling sasl_client_step()
0927 15:14:30.603877 (+ 227us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0927 15:14:30.604127 (+ 250us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0927 15:14:30.604130 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0927 15:14:30.604132 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0927 15:14:30.604279 (+ 147us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0927 15:14:30.604730 (+ 451us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0927 15:14:30.604737 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0927 15:14:30.604996 (+ 259us) client_negotiation.cc:769] Sending connection context
0927 15:14:30.605153 (+ 157us) client_negotiation.cc:240] Negotiation successful
0927 15:14:30.605443 (+ 290us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":293,"thread_start_us":166,"threads_started":1}
I20260927 15:14:30.607182 31476 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:14:30.597748 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58544 (local address 127.17.136.60:36851)
0927 15:14:30.598083 (+ 335us) server_negotiation.cc:206] Beginning negotiation
0927 15:14:30.598092 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0927 15:14:30.598112 (+ 20us) server_negotiation.cc:407] Connection header received
0927 15:14:30.598198 (+ 86us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:14:30.598201 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:14:30.598342 (+ 141us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:14:30.598461 (+ 119us) server_negotiation.cc:226] Negotiated authn=SASL
0927 15:14:30.599170 (+ 709us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:14:30.599915 (+ 745us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:14:30.600804 (+ 889us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:14:30.601135 (+ 331us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:14:30.601220 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:14:30.603988 (+ 2768us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0927 15:14:30.603997 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0927 15:14:30.604008 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0927 15:14:30.604038 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0927 15:14:30.605619 (+ 1581us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:14:30.605968 (+ 349us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:14:30.605974 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:14:30.605975 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:14:30.606053 (+ 78us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:14:30.606291 (+ 238us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:14:30.606295 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:14:30.606296 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:14:30.606547 (+ 251us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0927 15:14:30.606719 (+ 172us) server_negotiation.cc:1035] Waiting for connection context
0927 15:14:30.606903 (+ 184us) server_negotiation.cc:299] Negotiation successful
0927 15:14:30.607021 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":257,"thread_start_us":141,"threads_started":1}
I20260927 15:14:30.607479 31472 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.17.136.61" port: 35071 } has no permanent_uuid. Determining permanent_uuid...
Sep 27 15:14:30 dist-test-slave-5s2t krb5kdc[31240](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790522070, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.136.60@KRBTEST.COM for kudu/127.17.136.61@KRBTEST.COM
Sep 27 15:14:30 dist-test-slave-5s2t krb5kdc[31240](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790522069, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.136.62@KRBTEST.COM
I20260927 15:14:30.614899 31474 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:14:30.607876 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.61:35071 (local address 127.0.0.1:35552)
0927 15:14:30.608080 (+ 204us) negotiation.cc:107] Waiting for socket to connect
0927 15:14:30.608092 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0927 15:14:30.608147 (+ 55us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0927 15:14:30.608335 (+ 188us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0927 15:14:30.608337 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0927 15:14:30.608443 (+ 106us) client_negotiation.cc:189] Negotiated authn=SASL
0927 15:14:30.608520 (+ 77us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:14:30.608524 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:14:30.609441 (+ 917us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:14:30.609444 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:14:30.609998 (+ 554us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:14:30.610006 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:14:30.610436 (+ 430us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:14:30.610439 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:14:30.610535 (+ 96us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:14:30.610903 (+ 368us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0927 15:14:30.610916 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0927 15:14:30.612174 (+ 1258us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0927 15:14:30.613670 (+ 1496us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0927 15:14:30.613672 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0927 15:14:30.613673 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0927 15:14:30.613867 (+ 194us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0927 15:14:30.614115 (+ 248us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0927 15:14:30.614117 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0927 15:14:30.614118 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0927 15:14:30.614188 (+ 70us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0927 15:14:30.614562 (+ 374us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0927 15:14:30.614565 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0927 15:14:30.614636 (+ 71us) client_negotiation.cc:769] Sending connection context
0927 15:14:30.614710 (+ 74us) client_negotiation.cc:240] Negotiation successful
0927 15:14:30.614795 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":151}
I20260927 15:14:30.615038 31402 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:14:30.607977 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35552 (local address 127.17.136.61:35071)
0927 15:14:30.608099 (+ 122us) server_negotiation.cc:206] Beginning negotiation
0927 15:14:30.608103 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0927 15:14:30.608120 (+ 17us) server_negotiation.cc:407] Connection header received
0927 15:14:30.608211 (+ 91us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:14:30.608214 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:14:30.608259 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:14:30.608333 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0927 15:14:30.608638 (+ 305us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:14:30.609341 (+ 703us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:14:30.610115 (+ 774us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:14:30.610351 (+ 236us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:14:30.610425 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:14:30.612298 (+ 1873us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0927 15:14:30.612301 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0927 15:14:30.612303 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0927 15:14:30.612327 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0927 15:14:30.613577 (+ 1250us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:14:30.613954 (+ 377us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:14:30.613958 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:14:30.613960 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:14:30.614031 (+ 71us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:14:30.614265 (+ 234us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:14:30.614268 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:14:30.614269 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:14:30.614469 (+ 200us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0927 15:14:30.614575 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0927 15:14:30.614778 (+ 203us) server_negotiation.cc:299] Negotiation successful
0927 15:14:30.614885 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260927 15:14:30.615759 31472 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.17.136.60" port: 36851 } has no permanent_uuid. Determining permanent_uuid...
I20260927 15:14:30.616668 31324 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:14:30.609107 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36198 (local address 127.17.136.62:44461)
0927 15:14:30.609209 (+ 102us) server_negotiation.cc:206] Beginning negotiation
0927 15:14:30.609211 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0927 15:14:30.609222 (+ 11us) server_negotiation.cc:407] Connection header received
0927 15:14:30.609296 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:14:30.609298 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:14:30.609328 (+ 30us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:14:30.609383 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0927 15:14:30.609890 (+ 507us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:14:30.610422 (+ 532us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:14:30.611143 (+ 721us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:14:30.611466 (+ 323us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:14:30.611546 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:14:30.613577 (+ 2031us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0927 15:14:30.613581 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0927 15:14:30.613583 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0927 15:14:30.613605 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0927 15:14:30.615083 (+ 1478us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:14:30.615540 (+ 457us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:14:30.615542 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:14:30.615544 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:14:30.615625 (+ 81us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:14:30.615898 (+ 273us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:14:30.615901 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:14:30.615903 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:14:30.616099 (+ 196us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0927 15:14:30.616306 (+ 207us) server_negotiation.cc:1035] Waiting for connection context
0927 15:14:30.616430 (+ 124us) server_negotiation.cc:299] Negotiation successful
0927 15:14:30.616517 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
Sep 27 15:14:30 dist-test-slave-5s2t krb5kdc[31240](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790522070, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.136.60@KRBTEST.COM for kudu/127.17.136.60@KRBTEST.COM
Sep 27 15:14:30 dist-test-slave-5s2t krb5kdc[31240](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790522069, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.136.61@KRBTEST.COM
I20260927 15:14:30.623168 31476 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:14:30.616305 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58550 (local address 127.17.136.60:36851)
0927 15:14:30.616395 (+ 90us) server_negotiation.cc:206] Beginning negotiation
0927 15:14:30.616399 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0927 15:14:30.616409 (+ 10us) server_negotiation.cc:407] Connection header received
0927 15:14:30.616437 (+ 28us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:14:30.616440 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:14:30.616478 (+ 38us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:14:30.616557 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0927 15:14:30.616890 (+ 333us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:14:30.617405 (+ 515us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:14:30.618346 (+ 941us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:14:30.618605 (+ 259us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:14:30.618692 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:14:30.620475 (+ 1783us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0927 15:14:30.620477 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0927 15:14:30.620479 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0927 15:14:30.620496 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0927 15:14:30.621781 (+ 1285us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:14:30.622140 (+ 359us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:14:30.622143 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:14:30.622145 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:14:30.622220 (+ 75us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:14:30.622472 (+ 252us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:14:30.622473 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:14:30.622475 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:14:30.622628 (+ 153us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0927 15:14:30.622703 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0927 15:14:30.622930 (+ 227us) server_negotiation.cc:299] Negotiation successful
0927 15:14:30.623037 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":42,"server-negotiator.queue_time_us":33}
I20260927 15:14:30.623168 31474 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:14:30.616164 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.60:36851 (local address 127.0.0.1:58550)
0927 15:14:30.616252 (+ 88us) negotiation.cc:107] Waiting for socket to connect
0927 15:14:30.616264 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0927 15:14:30.616326 (+ 62us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0927 15:14:30.616576 (+ 250us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0927 15:14:30.616579 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0927 15:14:30.616716 (+ 137us) client_negotiation.cc:189] Negotiated authn=SASL
0927 15:14:30.616799 (+ 83us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:14:30.616805 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:14:30.617502 (+ 697us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:14:30.617506 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:14:30.618232 (+ 726us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:14:30.618242 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:14:30.618699 (+ 457us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:14:30.618702 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:14:30.618789 (+ 87us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:14:30.619145 (+ 356us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0927 15:14:30.619160 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0927 15:14:30.620376 (+ 1216us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0927 15:14:30.621887 (+ 1511us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0927 15:14:30.621889 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0927 15:14:30.621890 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0927 15:14:30.622060 (+ 170us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0927 15:14:30.622302 (+ 242us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0927 15:14:30.622305 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0927 15:14:30.622307 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0927 15:14:30.622395 (+ 88us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0927 15:14:30.622710 (+ 315us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0927 15:14:30.622713 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0927 15:14:30.622787 (+ 74us) client_negotiation.cc:769] Sending connection context
0927 15:14:30.622865 (+ 78us) client_negotiation.cc:240] Negotiation successful
0927 15:14:30.622988 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":28,"mutex_wait_us":16}
I20260927 15:14:30.625501 31402 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:14:30.617688 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35562 (local address 127.17.136.61:35071)
0927 15:14:30.617779 (+ 91us) server_negotiation.cc:206] Beginning negotiation
0927 15:14:30.617782 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0927 15:14:30.617795 (+ 13us) server_negotiation.cc:407] Connection header received
0927 15:14:30.617866 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:14:30.617868 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:14:30.617900 (+ 32us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:14:30.617954 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0927 15:14:30.618539 (+ 585us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:14:30.619105 (+ 566us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:14:30.619992 (+ 887us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:14:30.620275 (+ 283us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:14:30.620351 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:14:30.622594 (+ 2243us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0927 15:14:30.622598 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0927 15:14:30.622600 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0927 15:14:30.622623 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0927 15:14:30.624085 (+ 1462us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:14:30.624420 (+ 335us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:14:30.624423 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:14:30.624425 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:14:30.624496 (+ 71us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:14:30.624715 (+ 219us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:14:30.624718 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:14:30.624720 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:14:30.624875 (+ 155us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0927 15:14:30.625067 (+ 192us) server_negotiation.cc:1035] Waiting for connection context
0927 15:14:30.625179 (+ 112us) server_negotiation.cc:299] Negotiation successful
0927 15:14:30.625277 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260927 15:14:30.626490 31472 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 47dfb21b63914430bae332dc3c1f8d0a: Bootstrap starting.
I20260927 15:14:30.628813 17952 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260927 15:14:30.629051 31472 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 47dfb21b63914430bae332dc3c1f8d0a: Neither blocks nor log segments found. Creating new log.
I20260927 15:14:30.629726 31472 log.cc:824] T 00000000000000000000000000000000 P 47dfb21b63914430bae332dc3c1f8d0a: Log is configured to *not* fsync() on all Append() calls
I20260927 15:14:30.631799 31472 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 47dfb21b63914430bae332dc3c1f8d0a: No bootstrap required, opened a new log
I20260927 15:14:30.636643 31472 raft_consensus.cc:348] T 00000000000000000000000000000000 P 47dfb21b63914430bae332dc3c1f8d0a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c627098975540dd8e914e67d30598b4" member_type: VOTER last_known_addr { host: "127.17.136.62" port: 44461 } } peers { permanent_uuid: "92b215828a594c3eaae84881f55d237d" member_type: VOTER last_known_addr { host: "127.17.136.61" port: 35071 } } peers { permanent_uuid: "47dfb21b63914430bae332dc3c1f8d0a" member_type: VOTER last_known_addr { host: "127.17.136.60" port: 36851 } }
I20260927 15:14:30.636909 31472 raft_consensus.cc:374] T 00000000000000000000000000000000 P 47dfb21b63914430bae332dc3c1f8d0a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:14:30.636960 31472 raft_consensus.cc:729] T 00000000000000000000000000000000 P 47dfb21b63914430bae332dc3c1f8d0a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 47dfb21b63914430bae332dc3c1f8d0a, State: Initialized, Role: FOLLOWER
I20260927 15:14:30.637470 31472 consensus_queue.cc:260] T 00000000000000000000000000000000 P 47dfb21b63914430bae332dc3c1f8d0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c627098975540dd8e914e67d30598b4" member_type: VOTER last_known_addr { host: "127.17.136.62" port: 44461 } } peers { permanent_uuid: "92b215828a594c3eaae84881f55d237d" member_type: VOTER last_known_addr { host: "127.17.136.61" port: 35071 } } peers { permanent_uuid: "47dfb21b63914430bae332dc3c1f8d0a" member_type: VOTER last_known_addr { host: "127.17.136.60" port: 36851 } }
I20260927 15:14:30.638068 31396 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.17.136.60" port: 36851 } attempt: 3
I20260927 15:14:30.639145 31321 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.17.136.60" port: 36851 } attempt: 3
I20260927 15:14:30.639710 31476 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:14:30.630945 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58566 (local address 127.17.136.60:36851)
0927 15:14:30.631054 (+ 109us) server_negotiation.cc:206] Beginning negotiation
0927 15:14:30.631058 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0927 15:14:30.631221 (+ 163us) server_negotiation.cc:407] Connection header received
0927 15:14:30.631334 (+ 113us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:14:30.631337 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:14:30.631379 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:14:30.631444 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0927 15:14:30.632185 (+ 741us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:14:30.632652 (+ 467us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:14:30.633682 (+ 1030us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:14:30.633883 (+ 201us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:14:30.633952 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:14:30.635480 (+ 1528us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0927 15:14:30.635484 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0927 15:14:30.635486 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0927 15:14:30.635508 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0927 15:14:30.636959 (+ 1451us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:14:30.638302 (+ 1343us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:14:30.638305 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:14:30.638307 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:14:30.638388 (+ 81us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:14:30.638671 (+ 283us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:14:30.638674 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:14:30.638676 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:14:30.638918 (+ 242us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0927 15:14:30.639049 (+ 131us) server_negotiation.cc:1035] Waiting for connection context
0927 15:14:30.639447 (+ 398us) server_negotiation.cc:299] Negotiation successful
0927 15:14:30.639553 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260927 15:14:30.640446 31472 sys_catalog.cc:564] T 00000000000000000000000000000000 P 47dfb21b63914430bae332dc3c1f8d0a [sys.catalog]: configured and running, proceeding with master startup.
I20260927 15:14:30.643519 31486 sys_catalog.cc:455] T 00000000000000000000000000000000 P 47dfb21b63914430bae332dc3c1f8d0a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c627098975540dd8e914e67d30598b4" member_type: VOTER last_known_addr { host: "127.17.136.62" port: 44461 } } peers { permanent_uuid: "92b215828a594c3eaae84881f55d237d" member_type: VOTER last_known_addr { host: "127.17.136.61" port: 35071 } } peers { permanent_uuid: "47dfb21b63914430bae332dc3c1f8d0a" member_type: VOTER last_known_addr { host: "127.17.136.60" port: 36851 } } }
I20260927 15:14:30.643657 31486 sys_catalog.cc:458] T 00000000000000000000000000000000 P 47dfb21b63914430bae332dc3c1f8d0a [sys.catalog]: This master's current role is: FOLLOWER
I20260927 15:14:30.644244 31324 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:14:30.630624 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36210 (local address 127.17.136.62:44461)
0927 15:14:30.635368 (+ 4744us) server_negotiation.cc:206] Beginning negotiation
0927 15:14:30.635373 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0927 15:14:30.635386 (+ 13us) server_negotiation.cc:407] Connection header received
0927 15:14:30.635425 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:14:30.635428 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:14:30.635474 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:14:30.635555 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0927 15:14:30.636244 (+ 689us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:14:30.637637 (+ 1393us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:14:30.638563 (+ 926us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:14:30.638833 (+ 270us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:14:30.638914 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:14:30.640756 (+ 1842us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0927 15:14:30.640760 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0927 15:14:30.640763 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0927 15:14:30.640789 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0927 15:14:30.642381 (+ 1592us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:14:30.642822 (+ 441us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:14:30.642826 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:14:30.642827 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:14:30.642907 (+ 80us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:14:30.643186 (+ 279us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:14:30.643189 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:14:30.643191 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:14:30.643417 (+ 226us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0927 15:14:30.643547 (+ 130us) server_negotiation.cc:1035] Waiting for connection context
0927 15:14:30.644043 (+ 496us) server_negotiation.cc:299] Negotiation successful
0927 15:14:30.644138 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":4661}
Sep 27 15:14:30 dist-test-slave-5s2t krb5kdc[31240](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790522070, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.136.61@KRBTEST.COM for kudu/127.17.136.60@KRBTEST.COM
I20260927 15:14:30.646639 31402 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:14:30.631209 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35564 (local address 127.17.136.61:35071)
0927 15:14:30.631338 (+ 129us) server_negotiation.cc:206] Beginning negotiation
0927 15:14:30.631341 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0927 15:14:30.635504 (+ 4163us) server_negotiation.cc:407] Connection header received
0927 15:14:30.635588 (+ 84us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:14:30.635591 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:14:30.635631 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:14:30.635690 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0927 15:14:30.636458 (+ 768us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:14:30.636955 (+ 497us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:14:30.637726 (+ 771us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:14:30.637927 (+ 201us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:14:30.637980 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:14:30.640096 (+ 2116us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0927 15:14:30.640100 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0927 15:14:30.640102 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0927 15:14:30.640124 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0927 15:14:30.642287 (+ 2163us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:14:30.645151 (+ 2864us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:14:30.645155 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:14:30.645156 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:14:30.645229 (+ 73us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:14:30.645520 (+ 291us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:14:30.645523 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:14:30.645525 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:14:30.645730 (+ 205us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0927 15:14:30.645834 (+ 104us) server_negotiation.cc:1035] Waiting for connection context
0927 15:14:30.646218 (+ 384us) server_negotiation.cc:299] Negotiation successful
0927 15:14:30.646500 (+ 282us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260927 15:14:30.643971 31403 master_runner.cc:186] Error getting master registration for 127.17.136.62:44461: OK, instance_id { permanent_uuid: "6c627098975540dd8e914e67d30598b4" instance_seqno: 1790522070172340 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260927 15:14:30.647722 31403 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260927 15:14:30.649628 31399 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:14:30.638428 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.60:36851 (local address 127.0.0.1:58568)
0927 15:14:30.638622 (+ 194us) negotiation.cc:107] Waiting for socket to connect
0927 15:14:30.638635 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0927 15:14:30.638699 (+ 64us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0927 15:14:30.640157 (+ 1458us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0927 15:14:30.640159 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0927 15:14:30.640605 (+ 446us) client_negotiation.cc:189] Negotiated authn=SASL
0927 15:14:30.640699 (+ 94us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:14:30.640706 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:14:30.643166 (+ 2460us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:14:30.643169 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:14:30.643894 (+ 725us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:14:30.643904 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:14:30.644488 (+ 584us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:14:30.644491 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:14:30.644578 (+ 87us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:14:30.645013 (+ 435us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0927 15:14:30.645036 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0927 15:14:30.646376 (+ 1340us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0927 15:14:30.648054 (+ 1678us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0927 15:14:30.648057 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0927 15:14:30.648058 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0927 15:14:30.648272 (+ 214us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0927 15:14:30.648553 (+ 281us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0927 15:14:30.648557 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0927 15:14:30.648559 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0927 15:14:30.648660 (+ 101us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0927 15:14:30.649190 (+ 530us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0927 15:14:30.649193 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0927 15:14:30.649275 (+ 82us) client_negotiation.cc:769] Sending connection context
0927 15:14:30.649365 (+ 90us) client_negotiation.cc:240] Negotiation successful
0927 15:14:30.649485 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":126}
W20260927 15:14:30.649914 31497 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 47dfb21b63914430bae332dc3c1f8d0a: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260927 15:14:30.649978 31497 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260927 15:14:30.650147 31476 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:14:30.638820 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58568 (local address 127.17.136.60:36851)
0927 15:14:30.639844 (+ 1024us) server_negotiation.cc:206] Beginning negotiation
0927 15:14:30.639847 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0927 15:14:30.639859 (+ 12us) server_negotiation.cc:407] Connection header received
0927 15:14:30.639889 (+ 30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:14:30.639892 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:14:30.639929 (+ 37us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:14:30.639998 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0927 15:14:30.642372 (+ 2374us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:14:30.643045 (+ 673us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:14:30.644008 (+ 963us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:14:30.644307 (+ 299us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:14:30.644390 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:14:30.646478 (+ 2088us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0927 15:14:30.646481 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0927 15:14:30.646484 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0927 15:14:30.646504 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0927 15:14:30.647960 (+ 1456us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:14:30.648379 (+ 419us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:14:30.648383 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:14:30.648385 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:14:30.648460 (+ 75us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:14:30.648874 (+ 414us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:14:30.648877 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:14:30.648879 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:14:30.649078 (+ 199us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0927 15:14:30.649150 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0927 15:14:30.649865 (+ 715us) server_negotiation.cc:299] Negotiation successful
0927 15:14:30.649991 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":973,"thread_start_us":93,"threads_started":1}
Sep 27 15:14:30 dist-test-slave-5s2t krb5kdc[31240](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790522070, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.136.62@KRBTEST.COM for kudu/127.17.136.60@KRBTEST.COM
I20260927 15:14:30.653553 31396 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 92b215828a594c3eaae84881f55d237d: Bootstrap starting.
I20260927 15:14:30.655488 31325 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:14:30.639493 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.60:36851 (local address 127.0.0.1:58584)
0927 15:14:30.639693 (+ 200us) negotiation.cc:107] Waiting for socket to connect
0927 15:14:30.639705 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0927 15:14:30.639770 (+ 65us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0927 15:14:30.645511 (+ 5741us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0927 15:14:30.645514 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0927 15:14:30.645682 (+ 168us) client_negotiation.cc:189] Negotiated authn=SASL
0927 15:14:30.645767 (+ 85us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:14:30.645773 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:14:30.648161 (+ 2388us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:14:30.648164 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:14:30.648912 (+ 748us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:14:30.648922 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:14:30.649519 (+ 597us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:14:30.649522 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:14:30.649612 (+ 90us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:14:30.650403 (+ 791us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0927 15:14:30.650418 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0927 15:14:30.652167 (+ 1749us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0927 15:14:30.653956 (+ 1789us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0927 15:14:30.653959 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0927 15:14:30.653961 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0927 15:14:30.654215 (+ 254us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0927 15:14:30.654496 (+ 281us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0927 15:14:30.654499 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0927 15:14:30.654502 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0927 15:14:30.654591 (+ 89us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0927 15:14:30.654971 (+ 380us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0927 15:14:30.654974 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0927 15:14:30.655079 (+ 105us) client_negotiation.cc:769] Sending connection context
0927 15:14:30.655187 (+ 108us) client_negotiation.cc:240] Negotiation successful
0927 15:14:30.655333 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":139}
I20260927 15:14:30.655522 31485 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:14:30.639879 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58584 (local address 127.17.136.60:36851)
0927 15:14:30.645299 (+ 5420us) server_negotiation.cc:206] Beginning negotiation
0927 15:14:30.645306 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0927 15:14:30.645317 (+ 11us) server_negotiation.cc:407] Connection header received
0927 15:14:30.645347 (+ 30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:14:30.645349 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:14:30.645386 (+ 37us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:14:30.645865 (+ 479us) server_negotiation.cc:226] Negotiated authn=SASL
0927 15:14:30.645971 (+ 106us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:14:30.648076 (+ 2105us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:14:30.649025 (+ 949us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:14:30.649342 (+ 317us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:14:30.649420 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:14:30.652294 (+ 2874us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0927 15:14:30.652298 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0927 15:14:30.652300 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0927 15:14:30.652323 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0927 15:14:30.653859 (+ 1536us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:14:30.654304 (+ 445us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:14:30.654307 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:14:30.654309 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:14:30.654407 (+ 98us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:14:30.654679 (+ 272us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:14:30.654682 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:14:30.654684 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:14:30.654879 (+ 195us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0927 15:14:30.654971 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0927 15:14:30.655274 (+ 303us) server_negotiation.cc:299] Negotiation successful
0927 15:14:30.655378 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":5348}
I20260927 15:14:30.656530 31396 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 92b215828a594c3eaae84881f55d237d: Neither blocks nor log segments found. Creating new log.
I20260927 15:14:30.657356 31396 log.cc:824] T 00000000000000000000000000000000 P 92b215828a594c3eaae84881f55d237d: Log is configured to *not* fsync() on all Append() calls
I20260927 15:14:30.658316 31321 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6c627098975540dd8e914e67d30598b4: Bootstrap starting.
I20260927 15:14:30.659583 31396 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 92b215828a594c3eaae84881f55d237d: No bootstrap required, opened a new log
I20260927 15:14:30.661002 31321 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 6c627098975540dd8e914e67d30598b4: Neither blocks nor log segments found. Creating new log.
I20260927 15:14:30.661788 31321 log.cc:824] T 00000000000000000000000000000000 P 6c627098975540dd8e914e67d30598b4: Log is configured to *not* fsync() on all Append() calls
I20260927 15:14:30.663790 31321 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6c627098975540dd8e914e67d30598b4: No bootstrap required, opened a new log
I20260927 15:14:30.663861 31396 raft_consensus.cc:348] T 00000000000000000000000000000000 P 92b215828a594c3eaae84881f55d237d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c627098975540dd8e914e67d30598b4" member_type: VOTER last_known_addr { host: "127.17.136.62" port: 44461 } } peers { permanent_uuid: "92b215828a594c3eaae84881f55d237d" member_type: VOTER last_known_addr { host: "127.17.136.61" port: 35071 } } peers { permanent_uuid: "47dfb21b63914430bae332dc3c1f8d0a" member_type: VOTER last_known_addr { host: "127.17.136.60" port: 36851 } }
I20260927 15:14:30.664079 31396 raft_consensus.cc:374] T 00000000000000000000000000000000 P 92b215828a594c3eaae84881f55d237d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:14:30.664136 31396 raft_consensus.cc:729] T 00000000000000000000000000000000 P 92b215828a594c3eaae84881f55d237d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92b215828a594c3eaae84881f55d237d, State: Initialized, Role: FOLLOWER
I20260927 15:14:30.664583 31396 consensus_queue.cc:260] T 00000000000000000000000000000000 P 92b215828a594c3eaae84881f55d237d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c627098975540dd8e914e67d30598b4" member_type: VOTER last_known_addr { host: "127.17.136.62" port: 44461 } } peers { permanent_uuid: "92b215828a594c3eaae84881f55d237d" member_type: VOTER last_known_addr { host: "127.17.136.61" port: 35071 } } peers { permanent_uuid: "47dfb21b63914430bae332dc3c1f8d0a" member_type: VOTER last_known_addr { host: "127.17.136.60" port: 36851 } }
I20260927 15:14:30.665042 31501 sys_catalog.cc:455] T 00000000000000000000000000000000 P 92b215828a594c3eaae84881f55d237d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c627098975540dd8e914e67d30598b4" member_type: VOTER last_known_addr { host: "127.17.136.62" port: 44461 } } peers { permanent_uuid: "92b215828a594c3eaae84881f55d237d" member_type: VOTER last_known_addr { host: "127.17.136.61" port: 35071 } } peers { permanent_uuid: "47dfb21b63914430bae332dc3c1f8d0a" member_type: VOTER last_known_addr { host: "127.17.136.60" port: 36851 } } }
I20260927 15:14:30.666386 31501 sys_catalog.cc:458] T 00000000000000000000000000000000 P 92b215828a594c3eaae84881f55d237d [sys.catalog]: This master's current role is: FOLLOWER
I20260927 15:14:30.666448 31396 sys_catalog.cc:564] T 00000000000000000000000000000000 P 92b215828a594c3eaae84881f55d237d [sys.catalog]: configured and running, proceeding with master startup.
I20260927 15:14:30.667753 31321 raft_consensus.cc:348] T 00000000000000000000000000000000 P 6c627098975540dd8e914e67d30598b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c627098975540dd8e914e67d30598b4" member_type: VOTER last_known_addr { host: "127.17.136.62" port: 44461 } } peers { permanent_uuid: "92b215828a594c3eaae84881f55d237d" member_type: VOTER last_known_addr { host: "127.17.136.61" port: 35071 } } peers { permanent_uuid: "47dfb21b63914430bae332dc3c1f8d0a" member_type: VOTER last_known_addr { host: "127.17.136.60" port: 36851 } }
I20260927 15:14:30.667970 31321 raft_consensus.cc:374] T 00000000000000000000000000000000 P 6c627098975540dd8e914e67d30598b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:14:30.668027 31321 raft_consensus.cc:729] T 00000000000000000000000000000000 P 6c627098975540dd8e914e67d30598b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6c627098975540dd8e914e67d30598b4, State: Initialized, Role: FOLLOWER
I20260927 15:14:30.668610 31321 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6c627098975540dd8e914e67d30598b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c627098975540dd8e914e67d30598b4" member_type: VOTER last_known_addr { host: "127.17.136.62" port: 44461 } } peers { permanent_uuid: "92b215828a594c3eaae84881f55d237d" member_type: VOTER last_known_addr { host: "127.17.136.61" port: 35071 } } peers { permanent_uuid: "47dfb21b63914430bae332dc3c1f8d0a" member_type: VOTER last_known_addr { host: "127.17.136.60" port: 36851 } }
I20260927 15:14:30.669997 31321 sys_catalog.cc:564] T 00000000000000000000000000000000 P 6c627098975540dd8e914e67d30598b4 [sys.catalog]: configured and running, proceeding with master startup.
W20260927 15:14:30.672037 31513 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 92b215828a594c3eaae84881f55d237d: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260927 15:14:30.672149 31513 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260927 15:14:30.672165 31512 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6c627098975540dd8e914e67d30598b4 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c627098975540dd8e914e67d30598b4" member_type: VOTER last_known_addr { host: "127.17.136.62" port: 44461 } } peers { permanent_uuid: "92b215828a594c3eaae84881f55d237d" member_type: VOTER last_known_addr { host: "127.17.136.61" port: 35071 } } peers { permanent_uuid: "47dfb21b63914430bae332dc3c1f8d0a" member_type: VOTER last_known_addr { host: "127.17.136.60" port: 36851 } } }
I20260927 15:14:30.672525 31512 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6c627098975540dd8e914e67d30598b4 [sys.catalog]: This master's current role is: FOLLOWER
I20260927 15:14:30.670490 31328 master_runner.cc:186] Error getting master registration for 127.17.136.62:44461: OK, instance_id { permanent_uuid: "6c627098975540dd8e914e67d30598b4" instance_seqno: 1790522070172340 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260927 15:14:30.673748 31328 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260927 15:14:30.676167 31525 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 6c627098975540dd8e914e67d30598b4: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260927 15:14:30.676229 31525 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260927 15:14:30.679272 31253 master_runner.cc:263] No leader master found from master 6c627098975540dd8e914e67d30598b4
I20260927 15:14:30.679334 31253 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260927 15:14:30.831152 31425 tablet.cc:2369] T 00000000000000000000000000000000 P 47dfb21b63914430bae332dc3c1f8d0a: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260927 15:14:30.883739 31349 tablet.cc:2369] T 00000000000000000000000000000000 P 92b215828a594c3eaae84881f55d237d: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260927 15:14:30.883787 31501 raft_consensus.cc:482] T 00000000000000000000000000000000 P 92b215828a594c3eaae84881f55d237d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:14:30.883949 31501 raft_consensus.cc:504] T 00000000000000000000000000000000 P 92b215828a594c3eaae84881f55d237d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c627098975540dd8e914e67d30598b4" member_type: VOTER last_known_addr { host: "127.17.136.62" port: 44461 } } peers { permanent_uuid: "92b215828a594c3eaae84881f55d237d" member_type: VOTER last_known_addr { host: "127.17.136.61" port: 35071 } } peers { permanent_uuid: "47dfb21b63914430bae332dc3c1f8d0a" member_type: VOTER last_known_addr { host: "127.17.136.60" port: 36851 } }
I20260927 15:14:30.884816 31501 leader_election.cc:288] T 00000000000000000000000000000000 P 92b215828a594c3eaae84881f55d237d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6c627098975540dd8e914e67d30598b4 (127.17.136.62:44461), 47dfb21b63914430bae332dc3c1f8d0a (127.17.136.60:36851)
I20260927 15:14:30.885332 31446 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "92b215828a594c3eaae84881f55d237d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "47dfb21b63914430bae332dc3c1f8d0a" is_pre_election: true
I20260927 15:14:30.885334 31295 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "92b215828a594c3eaae84881f55d237d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c627098975540dd8e914e67d30598b4" is_pre_election: true
I20260927 15:14:30.885654 31446 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 47dfb21b63914430bae332dc3c1f8d0a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92b215828a594c3eaae84881f55d237d in term 0.
I20260927 15:14:30.885655 31295 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 6c627098975540dd8e914e67d30598b4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92b215828a594c3eaae84881f55d237d in term 0.
I20260927 15:14:30.886063 31345 leader_election.cc:302] T 00000000000000000000000000000000 P 92b215828a594c3eaae84881f55d237d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47dfb21b63914430bae332dc3c1f8d0a, 92b215828a594c3eaae84881f55d237d; no voters:
I20260927 15:14:30.886310 31501 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 92b215828a594c3eaae84881f55d237d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 15:14:30.886381 31501 raft_consensus.cc:482] T 00000000000000000000000000000000 P 92b215828a594c3eaae84881f55d237d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 15:14:30.886428 31501 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 92b215828a594c3eaae84881f55d237d [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:14:30.887418 31501 raft_consensus.cc:504] T 00000000000000000000000000000000 P 92b215828a594c3eaae84881f55d237d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c627098975540dd8e914e67d30598b4" member_type: VOTER last_known_addr { host: "127.17.136.62" port: 44461 } } peers { permanent_uuid: "92b215828a594c3eaae84881f55d237d" member_type: VOTER last_known_addr { host: "127.17.136.61" port: 35071 } } peers { permanent_uuid: "47dfb21b63914430bae332dc3c1f8d0a" member_type: VOTER last_known_addr { host: "127.17.136.60" port: 36851 } }
I20260927 15:14:30.887702 31501 leader_election.cc:288] T 00000000000000000000000000000000 P 92b215828a594c3eaae84881f55d237d [CANDIDATE]: Term 1 election: Requested vote from peers 6c627098975540dd8e914e67d30598b4 (127.17.136.62:44461), 47dfb21b63914430bae332dc3c1f8d0a (127.17.136.60:36851)
I20260927 15:14:30.887995 31446 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "92b215828a594c3eaae84881f55d237d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "47dfb21b63914430bae332dc3c1f8d0a"
I20260927 15:14:30.887995 31295 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "92b215828a594c3eaae84881f55d237d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c627098975540dd8e914e67d30598b4"
I20260927 15:14:30.888118 31446 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 47dfb21b63914430bae332dc3c1f8d0a [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:14:30.888119 31295 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 6c627098975540dd8e914e67d30598b4 [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:14:30.889287 31446 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 47dfb21b63914430bae332dc3c1f8d0a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92b215828a594c3eaae84881f55d237d in term 1.
I20260927 15:14:30.889287 31295 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 6c627098975540dd8e914e67d30598b4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92b215828a594c3eaae84881f55d237d in term 1.
I20260927 15:14:30.889549 31345 leader_election.cc:302] T 00000000000000000000000000000000 P 92b215828a594c3eaae84881f55d237d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47dfb21b63914430bae332dc3c1f8d0a, 92b215828a594c3eaae84881f55d237d; no voters:
I20260927 15:14:30.889695 31501 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 92b215828a594c3eaae84881f55d237d [term 1 FOLLOWER]: Leader election won for term 1
I20260927 15:14:30.889894 31501 raft_consensus.cc:686] T 00000000000000000000000000000000 P 92b215828a594c3eaae84881f55d237d [term 1 LEADER]: Becoming Leader. State: Replica: 92b215828a594c3eaae84881f55d237d, State: Running, Role: LEADER
I20260927 15:14:30.890190 31501 consensus_queue.cc:237] T 00000000000000000000000000000000 P 92b215828a594c3eaae84881f55d237d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c627098975540dd8e914e67d30598b4" member_type: VOTER last_known_addr { host: "127.17.136.62" port: 44461 } } peers { permanent_uuid: "92b215828a594c3eaae84881f55d237d" member_type: VOTER last_known_addr { host: "127.17.136.61" port: 35071 } } peers { permanent_uuid: "47dfb21b63914430bae332dc3c1f8d0a" member_type: VOTER last_known_addr { host: "127.17.136.60" port: 36851 } }
I20260927 15:14:30.891997 31527 sys_catalog.cc:455] T 00000000000000000000000000000000 P 92b215828a594c3eaae84881f55d237d [sys.catalog]: SysCatalogTable state changed. Reason: New leader 92b215828a594c3eaae84881f55d237d. Latest consensus state: current_term: 1 leader_uuid: "92b215828a594c3eaae84881f55d237d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c627098975540dd8e914e67d30598b4" member_type: VOTER last_known_addr { host: "127.17.136.62" port: 44461 } } peers { permanent_uuid: "92b215828a594c3eaae84881f55d237d" member_type: VOTER last_known_addr { host: "127.17.136.61" port: 35071 } } peers { permanent_uuid: "47dfb21b63914430bae332dc3c1f8d0a" member_type: VOTER last_known_addr { host: "127.17.136.60" port: 36851 } } }
I20260927 15:14:30.892117 31527 sys_catalog.cc:458] T 00000000000000000000000000000000 P 92b215828a594c3eaae84881f55d237d [sys.catalog]: This master's current role is: LEADER
I20260927 15:14:30.892441 31529 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260927 15:14:30.893232 31529 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260927 15:14:30.897277 31446 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 47dfb21b63914430bae332dc3c1f8d0a [term 1 FOLLOWER]: Refusing update from remote peer 92b215828a594c3eaae84881f55d237d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260927 15:14:30.897279 31295 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 6c627098975540dd8e914e67d30598b4 [term 1 FOLLOWER]: Refusing update from remote peer 92b215828a594c3eaae84881f55d237d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260927 15:14:30.897781 31501 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 92b215828a594c3eaae84881f55d237d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c627098975540dd8e914e67d30598b4" member_type: VOTER last_known_addr { host: "127.17.136.62" port: 44461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260927 15:14:30.897935 31527 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 92b215828a594c3eaae84881f55d237d [LEADER]: Connected to new peer: Peer: permanent_uuid: "47dfb21b63914430bae332dc3c1f8d0a" member_type: VOTER last_known_addr { host: "127.17.136.60" port: 36851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260927 15:14:30.901350 31512 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6c627098975540dd8e914e67d30598b4 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 92b215828a594c3eaae84881f55d237d. Latest consensus state: current_term: 1 leader_uuid: "92b215828a594c3eaae84881f55d237d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c627098975540dd8e914e67d30598b4" member_type: VOTER last_known_addr { host: "127.17.136.62" port: 44461 } } peers { permanent_uuid: "92b215828a594c3eaae84881f55d237d" member_type: VOTER last_known_addr { host: "127.17.136.61" port: 35071 } } peers { permanent_uuid: "47dfb21b63914430bae332dc3c1f8d0a" member_type: VOTER last_known_addr { host: "127.17.136.60" port: 36851 } } }
I20260927 15:14:30.901353 31486 sys_catalog.cc:455] T 00000000000000000000000000000000 P 47dfb21b63914430bae332dc3c1f8d0a [sys.catalog]: SysCatalogTable state changed. Reason: New leader 92b215828a594c3eaae84881f55d237d. Latest consensus state: current_term: 1 leader_uuid: "92b215828a594c3eaae84881f55d237d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c627098975540dd8e914e67d30598b4" member_type: VOTER last_known_addr { host: "127.17.136.62" port: 44461 } } peers { permanent_uuid: "92b215828a594c3eaae84881f55d237d" member_type: VOTER last_known_addr { host: "127.17.136.61" port: 35071 } } peers { permanent_uuid: "47dfb21b63914430bae332dc3c1f8d0a" member_type: VOTER last_known_addr { host: "127.17.136.60" port: 36851 } } }
I20260927 15:14:30.901467 31486 sys_catalog.cc:458] T 00000000000000000000000000000000 P 47dfb21b63914430bae332dc3c1f8d0a [sys.catalog]: This master's current role is: FOLLOWER
I20260927 15:14:30.901469 31512 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6c627098975540dd8e914e67d30598b4 [sys.catalog]: This master's current role is: FOLLOWER
I20260927 15:14:30.904165 31527 sys_catalog.cc:455] T 00000000000000000000000000000000 P 92b215828a594c3eaae84881f55d237d [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "92b215828a594c3eaae84881f55d237d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c627098975540dd8e914e67d30598b4" member_type: VOTER last_known_addr { host: "127.17.136.62" port: 44461 } } peers { permanent_uuid: "92b215828a594c3eaae84881f55d237d" member_type: VOTER last_known_addr { host: "127.17.136.61" port: 35071 } } peers { permanent_uuid: "47dfb21b63914430bae332dc3c1f8d0a" member_type: VOTER last_known_addr { host: "127.17.136.60" port: 36851 } } }
I20260927 15:14:30.904273 31527 sys_catalog.cc:458] T 00000000000000000000000000000000 P 92b215828a594c3eaae84881f55d237d [sys.catalog]: This master's current role is: LEADER
I20260927 15:14:30.904369 31532 mvcc.cc:205] Tried to move back new op lower bound from 7333978402389745664 to 7333978402368634880. Current Snapshot: MvccSnapshot[applied={T|T < 7333978402389745664}]
I20260927 15:14:30.904410 31527 sys_catalog.cc:455] T 00000000000000000000000000000000 P 92b215828a594c3eaae84881f55d237d [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "92b215828a594c3eaae84881f55d237d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c627098975540dd8e914e67d30598b4" member_type: VOTER last_known_addr { host: "127.17.136.62" port: 44461 } } peers { permanent_uuid: "92b215828a594c3eaae84881f55d237d" member_type: VOTER last_known_addr { host: "127.17.136.61" port: 35071 } } peers { permanent_uuid: "47dfb21b63914430bae332dc3c1f8d0a" member_type: VOTER last_known_addr { host: "127.17.136.60" port: 36851 } } }
I20260927 15:14:30.904484 31527 sys_catalog.cc:458] T 00000000000000000000000000000000 P 92b215828a594c3eaae84881f55d237d [sys.catalog]: This master's current role is: LEADER
I20260927 15:14:30.904484 31512 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6c627098975540dd8e914e67d30598b4 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "92b215828a594c3eaae84881f55d237d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c627098975540dd8e914e67d30598b4" member_type: VOTER last_known_addr { host: "127.17.136.62" port: 44461 } } peers { permanent_uuid: "92b215828a594c3eaae84881f55d237d" member_type: VOTER last_known_addr { host: "127.17.136.61" port: 35071 } } peers { permanent_uuid: "47dfb21b63914430bae332dc3c1f8d0a" member_type: VOTER last_known_addr { host: "127.17.136.60" port: 36851 } } }
I20260927 15:14:30.904553 31512 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6c627098975540dd8e914e67d30598b4 [sys.catalog]: This master's current role is: FOLLOWER
I20260927 15:14:30.904657 31486 sys_catalog.cc:455] T 00000000000000000000000000000000 P 47dfb21b63914430bae332dc3c1f8d0a [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "92b215828a594c3eaae84881f55d237d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c627098975540dd8e914e67d30598b4" member_type: VOTER last_known_addr { host: "127.17.136.62" port: 44461 } } peers { permanent_uuid: "92b215828a594c3eaae84881f55d237d" member_type: VOTER last_known_addr { host: "127.17.136.61" port: 35071 } } peers { permanent_uuid: "47dfb21b63914430bae332dc3c1f8d0a" member_type: VOTER last_known_addr { host: "127.17.136.60" port: 36851 } } }
I20260927 15:14:30.904747 31486 sys_catalog.cc:458] T 00000000000000000000000000000000 P 47dfb21b63914430bae332dc3c1f8d0a [sys.catalog]: This master's current role is: FOLLOWER
I20260927 15:14:30.905736 31529 catalog_manager.cc:1347] Generated new cluster ID: 6929ab9f18484ba499adabedbb50c92e
I20260927 15:14:30.905787 31529 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260927 15:14:30.926910 31529 catalog_manager.cc:1370] Generated new certificate authority record
I20260927 15:14:30.928020 31529 catalog_manager.cc:1504] Loading token signing keys...
I20260927 15:14:30.938222 31529 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 92b215828a594c3eaae84881f55d237d: Generated new TSK 0
I20260927 15:14:30.939062 31529 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260927 15:14:31.651284 31497 catalog_manager.cc:1259] Loaded cluster ID: 6929ab9f18484ba499adabedbb50c92e
I20260927 15:14:31.651365 31497 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 47dfb21b63914430bae332dc3c1f8d0a: loading cluster ID for follower catalog manager: success
I20260927 15:14:31.652961 31497 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 47dfb21b63914430bae332dc3c1f8d0a: acquiring CA information for follower catalog manager: success
I20260927 15:14:31.654085 31497 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 47dfb21b63914430bae332dc3c1f8d0a: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260927 15:14:31.677453 31525 catalog_manager.cc:1259] Loaded cluster ID: 6929ab9f18484ba499adabedbb50c92e
I20260927 15:14:31.677541 31525 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 6c627098975540dd8e914e67d30598b4: loading cluster ID for follower catalog manager: success
I20260927 15:14:31.679189 31525 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 6c627098975540dd8e914e67d30598b4: acquiring CA information for follower catalog manager: success
I20260927 15:14:31.680539 31525 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 6c627098975540dd8e914e67d30598b4: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260927 15:14:31.996243 17952 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu with pid 31253
I20260927 15:14:32.001474 17952 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu with pid 31328
I20260927 15:14:32.006103 17952 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu with pid 31403
2026-09-27T15:14:32Z chronyd exiting
[ OK ] SecurityITest.IPKICACert (3060 ms)
[ RUN ] SecurityITest.IPKICACertWebServerEndPoints
Loading random data
Initializing database '/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1790521920546562-17952-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 27 15:14:32 dist-test-slave-5s2t krb5kdc[31545](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 27 15:14:32 dist-test-slave-5s2t krb5kdc[31545](info): set up 2 sockets
Sep 27 15:14:32 dist-test-slave-5s2t krb5kdc[31545](info): commencing operation
krb5kdc: starting...
W20260927 15:14:32.955132 17952 mini_kdc.cc:121] Time spent starting KDC: real 0.929s user 0.002s sys 0.003s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1790521920546562-17952-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1790521920546562-17952-0/krb5kdc/test-user.keytab.
Sep 27 15:14:33 dist-test-slave-5s2t krb5kdc[31545](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790522073, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-27T15:14:33Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-27T15:14:33Z Disabled control of system clock
WARNING: no policy specified for kudu/127.17.136.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.136.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.136.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1790521920546562-17952-0/krb5kdc/kudu_127.17.136.62.keytab.
Entry for principal kudu/127.17.136.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1790521920546562-17952-0/krb5kdc/kudu_127.17.136.62.keytab.
I20260927 15:14:33.065722 17952 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu
/tmp/dist-test-taskiFOyeW/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1790521920546562-17952-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1790521920546562-17952-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1790521920546562-17952-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1790521920546562-17952-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.136.62:45735
--webserver_interface=127.17.136.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1790521920546562-17952-0/krb5kdc/kudu_127.17.136.62.keytab
--principal=kudu/127.17.136.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.136.20:35287
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.136.62:45735
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1790521920546562-17952-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1790521920546562-17952-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1790521920546562-17952-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260927 15:14:33.170384 31558 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260927 15:14:33.170670 31558 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260927 15:14:33.170727 31558 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260927 15:14:33.174805 31558 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260927 15:14:33.174886 31558 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260927 15:14:33.174913 31558 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260927 15:14:33.174933 31558 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260927 15:14:33.174953 31558 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260927 15:14:33.180295 31558 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.136.20:35287
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1790521920546562-17952-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1790521920546562-17952-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.17.136.62:45735
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1790521920546562-17952-0/krb5kdc/kudu_127.17.136.62.keytab
--principal=kudu/127.17.136.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.136.62:45735
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1790521920546562-17952-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.17.136.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31558
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1790521920546562-17952-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 27 Sep 2026 14:27:13 UTC on ccycloud.quasar-psqrth.root.comops.site
build id 4676138
I20260927 15:14:33.181354 31558 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260927 15:14:33.182339 31558 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260927 15:14:33.190497 31564 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260927 15:14:33.190543 31566 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260927 15:14:33.190497 31563 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260927 15:14:33.190721 31558 server_base.cc:1034] running on GCE node
I20260927 15:14:33.191352 31558 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260927 15:14:33.192392 31558 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260927 15:14:33.193567 31558 hybrid_clock.cc:648] HybridClock initialized: now 1790522073193551 us; error 36 us; skew 500 ppm
Sep 27 15:14:33 dist-test-slave-5s2t krb5kdc[31545](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790522073, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.136.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260927 15:14:33.196278 31558 init.cc:377] Logged in from keytab as kudu/127.17.136.62@KRBTEST.COM (short username kudu)
I20260927 15:14:33.197199 31558 webserver.cc:460] Webserver started at http://127.17.136.62:34987/ using document root <none> and password file <none>
I20260927 15:14:33.197731 31558 fs_manager.cc:359] Metadata directory not provided
I20260927 15:14:33.197796 31558 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260927 15:14:33.198024 31558 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260927 15:14:33.200099 31558 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1790521920546562-17952-0/minicluster-data/master-0/data/instance:
uuid: "6cceba93e5be4e7694fdcdc4abb3e8d8"
format_stamp: "Formatted at 2026-09-27 15:14:33 on dist-test-slave-5s2t"
server_key: "51d4df96414f00ef1c3ddc507130be26"
server_key_iv: "c4f59d9fb85244583620a0de6148886d"
server_key_version: "encryptionkey@0"
I20260927 15:14:33.200627 31558 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1790521920546562-17952-0/minicluster-data/master-0/wal/instance:
uuid: "6cceba93e5be4e7694fdcdc4abb3e8d8"
format_stamp: "Formatted at 2026-09-27 15:14:33 on dist-test-slave-5s2t"
server_key: "51d4df96414f00ef1c3ddc507130be26"
server_key_iv: "c4f59d9fb85244583620a0de6148886d"
server_key_version: "encryptionkey@0"
I20260927 15:14:33.204241 31558 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260927 15:14:33.206550 31573 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260927 15:14:33.207832 31558 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260927 15:14:33.207947 31558 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1790521920546562-17952-0/minicluster-data/master-0/data,/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1790521920546562-17952-0/minicluster-data/master-0/wal
uuid: "6cceba93e5be4e7694fdcdc4abb3e8d8"
format_stamp: "Formatted at 2026-09-27 15:14:33 on dist-test-slave-5s2t"
server_key: "51d4df96414f00ef1c3ddc507130be26"
server_key_iv: "c4f59d9fb85244583620a0de6148886d"
server_key_version: "encryptionkey@0"
I20260927 15:14:33.208067 31558 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1790521920546562-17952-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1790521920546562-17952-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1790521920546562-17952-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260927 15:14:33.222402 31558 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260927 15:14:33.225428 31558 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260927 15:14:33.225610 31558 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260927 15:14:33.232292 31558 rpc_server.cc:307] RPC server started. Bound to: 127.17.136.62:45735
I20260927 15:14:33.232304 31625 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.136.62:45735 every 8 connection(s)
I20260927 15:14:33.233196 31558 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1790521920546562-17952-0/minicluster-data/master-0/data/info.pb
I20260927 15:14:33.235898 31626 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:14:33.240854 17952 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu as pid 31558
I20260927 15:14:33.240967 17952 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1790521920546562-17952-0/minicluster-data/master-0/wal/instance
I20260927 15:14:33.241222 17952 external_mini_cluster.cc:1428] Setting key 7bfef5bc6b652ac53617f67a5b1a940c
I20260927 15:14:33.241287 31626 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6cceba93e5be4e7694fdcdc4abb3e8d8: Bootstrap starting.
I20260927 15:14:33.243981 31626 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 6cceba93e5be4e7694fdcdc4abb3e8d8: Neither blocks nor log segments found. Creating new log.
I20260927 15:14:33.244701 31626 log.cc:824] T 00000000000000000000000000000000 P 6cceba93e5be4e7694fdcdc4abb3e8d8: Log is configured to *not* fsync() on all Append() calls
I20260927 15:14:33.246543 31626 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6cceba93e5be4e7694fdcdc4abb3e8d8: No bootstrap required, opened a new log
Sep 27 15:14:33 dist-test-slave-5s2t krb5kdc[31545](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790522073, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.136.62@KRBTEST.COM
I20260927 15:14:33.250516 31626 raft_consensus.cc:348] T 00000000000000000000000000000000 P 6cceba93e5be4e7694fdcdc4abb3e8d8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6cceba93e5be4e7694fdcdc4abb3e8d8" member_type: VOTER last_known_addr { host: "127.17.136.62" port: 45735 } }
I20260927 15:14:33.250773 31626 raft_consensus.cc:374] T 00000000000000000000000000000000 P 6cceba93e5be4e7694fdcdc4abb3e8d8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:14:33.250845 31626 raft_consensus.cc:729] T 00000000000000000000000000000000 P 6cceba93e5be4e7694fdcdc4abb3e8d8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6cceba93e5be4e7694fdcdc4abb3e8d8, State: Initialized, Role: FOLLOWER
I20260927 15:14:33.251384 31626 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6cceba93e5be4e7694fdcdc4abb3e8d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6cceba93e5be4e7694fdcdc4abb3e8d8" member_type: VOTER last_known_addr { host: "127.17.136.62" port: 45735 } }
I20260927 15:14:33.251550 31626 raft_consensus.cc:388] T 00000000000000000000000000000000 P 6cceba93e5be4e7694fdcdc4abb3e8d8 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260927 15:14:33.251624 31626 raft_consensus.cc:482] T 00000000000000000000000000000000 P 6cceba93e5be4e7694fdcdc4abb3e8d8 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260927 15:14:33.251724 31626 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 6cceba93e5be4e7694fdcdc4abb3e8d8 [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:14:33.252779 31626 raft_consensus.cc:504] T 00000000000000000000000000000000 P 6cceba93e5be4e7694fdcdc4abb3e8d8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6cceba93e5be4e7694fdcdc4abb3e8d8" member_type: VOTER last_known_addr { host: "127.17.136.62" port: 45735 } }
I20260927 15:14:33.253118 31626 leader_election.cc:302] T 00000000000000000000000000000000 P 6cceba93e5be4e7694fdcdc4abb3e8d8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 6cceba93e5be4e7694fdcdc4abb3e8d8; no voters:
I20260927 15:14:33.253465 31626 leader_election.cc:288] T 00000000000000000000000000000000 P 6cceba93e5be4e7694fdcdc4abb3e8d8 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260927 15:14:33.253556 31631 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 6cceba93e5be4e7694fdcdc4abb3e8d8 [term 1 FOLLOWER]: Leader election won for term 1
I20260927 15:14:33.253758 31631 raft_consensus.cc:686] T 00000000000000000000000000000000 P 6cceba93e5be4e7694fdcdc4abb3e8d8 [term 1 LEADER]: Becoming Leader. State: Replica: 6cceba93e5be4e7694fdcdc4abb3e8d8, State: Running, Role: LEADER
I20260927 15:14:33.254120 31631 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6cceba93e5be4e7694fdcdc4abb3e8d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6cceba93e5be4e7694fdcdc4abb3e8d8" member_type: VOTER last_known_addr { host: "127.17.136.62" port: 45735 } }
I20260927 15:14:33.254760 31626 sys_catalog.cc:564] T 00000000000000000000000000000000 P 6cceba93e5be4e7694fdcdc4abb3e8d8 [sys.catalog]: configured and running, proceeding with master startup.
I20260927 15:14:33.255226 31631 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6cceba93e5be4e7694fdcdc4abb3e8d8 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6cceba93e5be4e7694fdcdc4abb3e8d8. Latest consensus state: current_term: 1 leader_uuid: "6cceba93e5be4e7694fdcdc4abb3e8d8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6cceba93e5be4e7694fdcdc4abb3e8d8" member_type: VOTER last_known_addr { host: "127.17.136.62" port: 45735 } } }
I20260927 15:14:33.255226 31633 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6cceba93e5be4e7694fdcdc4abb3e8d8 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "6cceba93e5be4e7694fdcdc4abb3e8d8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6cceba93e5be4e7694fdcdc4abb3e8d8" member_type: VOTER last_known_addr { host: "127.17.136.62" port: 45735 } } }
I20260927 15:14:33.255435 31629 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:14:33.242494 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53378 (local address 127.17.136.62:45735)
0927 15:14:33.242928 (+ 434us) server_negotiation.cc:206] Beginning negotiation
0927 15:14:33.242943 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0927 15:14:33.242977 (+ 34us) server_negotiation.cc:407] Connection header received
0927 15:14:33.243617 (+ 640us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:14:33.243633 (+ 16us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:14:33.243954 (+ 321us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:14:33.244280 (+ 326us) server_negotiation.cc:226] Negotiated authn=SASL
0927 15:14:33.245040 (+ 760us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:14:33.245981 (+ 941us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:14:33.246863 (+ 882us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:14:33.247380 (+ 517us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:14:33.247529 (+ 149us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:14:33.250143 (+ 2614us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0927 15:14:33.250150 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0927 15:14:33.250166 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0927 15:14:33.250199 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0927 15:14:33.252248 (+ 2049us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:14:33.252655 (+ 407us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:14:33.252661 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:14:33.252667 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:14:33.252819 (+ 152us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:14:33.253128 (+ 309us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:14:33.253131 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:14:33.253133 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:14:33.253645 (+ 512us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0927 15:14:33.253827 (+ 182us) server_negotiation.cc:1035] Waiting for connection context
0927 15:14:33.254123 (+ 296us) server_negotiation.cc:299] Negotiation successful
0927 15:14:33.254412 (+ 289us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":295,"thread_start_us":140,"threads_started":1}
I20260927 15:14:33.255439 31633 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6cceba93e5be4e7694fdcdc4abb3e8d8 [sys.catalog]: This master's current role is: LEADER
I20260927 15:14:33.255522 31631 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6cceba93e5be4e7694fdcdc4abb3e8d8 [sys.catalog]: This master's current role is: LEADER
I20260927 15:14:33.257090 31640 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260927 15:14:33.259951 17952 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260927 15:14:33.260100 31640 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260927 15:14:33.265409 31640 catalog_manager.cc:1347] Generated new cluster ID: 751dd886f27844788689e6b94aa8c21d
I20260927 15:14:33.265458 31640 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260927 15:14:33.276283 31640 catalog_manager.cc:1370] Generated new certificate authority record
I20260927 15:14:33.277180 31640 catalog_manager.cc:1504] Loading token signing keys...
I20260927 15:14:33.281675 31640 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 6cceba93e5be4e7694fdcdc4abb3e8d8: Generated new TSK 0
I20260927 15:14:33.282292 31640 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260927 15:14:33.315709 17952 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu with pid 31558
2026-09-27T15:14:33Z chronyd exiting
[ OK ] SecurityITest.IPKICACertWebServerEndPoints (1308 ms)
[ RUN ] SecurityITest.TestEnableAndDisableEncryptedIPKICert
Loading random data
Initializing database '/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790521920546562-17952-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 27 15:14:33 dist-test-slave-5s2t krb5kdc[31654](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 27 15:14:33 dist-test-slave-5s2t krb5kdc[31654](info): set up 2 sockets
Sep 27 15:14:33 dist-test-slave-5s2t krb5kdc[31654](info): commencing operation
krb5kdc: starting...
W20260927 15:14:34.251116 17952 mini_kdc.cc:121] Time spent starting KDC: real 0.917s user 0.000s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790521920546562-17952-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790521920546562-17952-0/krb5kdc/test-user.keytab.
Sep 27 15:14:34 dist-test-slave-5s2t krb5kdc[31654](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790522074, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-27T15:14:34Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-27T15:14:34Z Disabled control of system clock
WARNING: no policy specified for kudu/127.17.136.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.136.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.136.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790521920546562-17952-0/krb5kdc/kudu_127.17.136.62.keytab.
Entry for principal kudu/127.17.136.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790521920546562-17952-0/krb5kdc/kudu_127.17.136.62.keytab.
I20260927 15:14:34.365644 17952 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu
/tmp/dist-test-taskiFOyeW/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790521920546562-17952-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790521920546562-17952-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790521920546562-17952-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790521920546562-17952-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.136.62:42541
--webserver_interface=127.17.136.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790521920546562-17952-0/krb5kdc/kudu_127.17.136.62.keytab
--principal=kudu/127.17.136.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.136.20:39235
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.136.62:42541
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790521920546562-17952-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790521920546562-17952-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790521920546562-17952-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260927 15:14:34.472859 31667 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260927 15:14:34.473107 31667 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260927 15:14:34.473146 31667 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260927 15:14:34.477101 31667 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260927 15:14:34.477165 31667 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260927 15:14:34.477185 31667 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260927 15:14:34.477200 31667 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260927 15:14:34.477214 31667 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260927 15:14:34.482360 31667 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.136.20:39235
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790521920546562-17952-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790521920546562-17952-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.17.136.62:42541
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790521920546562-17952-0/krb5kdc/kudu_127.17.136.62.keytab
--principal=kudu/127.17.136.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.136.62:42541
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790521920546562-17952-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.17.136.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31667
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790521920546562-17952-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 27 Sep 2026 14:27:13 UTC on ccycloud.quasar-psqrth.root.comops.site
build id 4676138
I20260927 15:14:34.483357 31667 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260927 15:14:34.484308 31667 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260927 15:14:34.492249 31667 server_base.cc:1034] running on GCE node
W20260927 15:14:34.492198 31672 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260927 15:14:34.492204 31675 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260927 15:14:34.492231 31673 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260927 15:14:34.492933 31667 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260927 15:14:34.493993 31667 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260927 15:14:34.495144 31667 hybrid_clock.cc:648] HybridClock initialized: now 1790522074495122 us; error 37 us; skew 500 ppm
Sep 27 15:14:34 dist-test-slave-5s2t krb5kdc[31654](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790522074, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.136.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260927 15:14:34.497650 31667 init.cc:377] Logged in from keytab as kudu/127.17.136.62@KRBTEST.COM (short username kudu)
I20260927 15:14:34.498421 31667 webserver.cc:460] Webserver started at http://127.17.136.62:37927/ using document root <none> and password file <none>
I20260927 15:14:34.498920 31667 fs_manager.cc:359] Metadata directory not provided
I20260927 15:14:34.498980 31667 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260927 15:14:34.499161 31667 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260927 15:14:34.501181 31667 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790521920546562-17952-0/minicluster-data/master-0/data/instance:
uuid: "619c4b9f4fe842a89844dd0897d3bbc0"
format_stamp: "Formatted at 2026-09-27 15:14:34 on dist-test-slave-5s2t"
server_key: "6b93fe1a90c20b46f9f06e018dac52af"
server_key_iv: "caaa606c3983b45683431eb6d13c4dd4"
server_key_version: "encryptionkey@0"
I20260927 15:14:34.501690 31667 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790521920546562-17952-0/minicluster-data/master-0/wal/instance:
uuid: "619c4b9f4fe842a89844dd0897d3bbc0"
format_stamp: "Formatted at 2026-09-27 15:14:34 on dist-test-slave-5s2t"
server_key: "6b93fe1a90c20b46f9f06e018dac52af"
server_key_iv: "caaa606c3983b45683431eb6d13c4dd4"
server_key_version: "encryptionkey@0"
I20260927 15:14:34.505095 31667 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260927 15:14:34.507359 31682 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260927 15:14:34.508504 31667 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260927 15:14:34.508617 31667 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790521920546562-17952-0/minicluster-data/master-0/data,/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790521920546562-17952-0/minicluster-data/master-0/wal
uuid: "619c4b9f4fe842a89844dd0897d3bbc0"
format_stamp: "Formatted at 2026-09-27 15:14:34 on dist-test-slave-5s2t"
server_key: "6b93fe1a90c20b46f9f06e018dac52af"
server_key_iv: "caaa606c3983b45683431eb6d13c4dd4"
server_key_version: "encryptionkey@0"
I20260927 15:14:34.508702 31667 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790521920546562-17952-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790521920546562-17952-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790521920546562-17952-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260927 15:14:34.529644 31667 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260927 15:14:34.533082 31667 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260927 15:14:34.533281 31667 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260927 15:14:34.540529 31667 rpc_server.cc:307] RPC server started. Bound to: 127.17.136.62:42541
I20260927 15:14:34.540773 31734 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.136.62:42541 every 8 connection(s)
I20260927 15:14:34.541589 31667 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790521920546562-17952-0/minicluster-data/master-0/data/info.pb
I20260927 15:14:34.544317 31735 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:14:34.549822 31735 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 619c4b9f4fe842a89844dd0897d3bbc0: Bootstrap starting.
I20260927 15:14:34.551056 17952 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu as pid 31667
I20260927 15:14:34.551172 17952 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790521920546562-17952-0/minicluster-data/master-0/wal/instance
I20260927 15:14:34.551452 17952 external_mini_cluster.cc:1428] Setting key 41b9d430bae8216cd3da442ba7867885
I20260927 15:14:34.552702 31735 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 619c4b9f4fe842a89844dd0897d3bbc0: Neither blocks nor log segments found. Creating new log.
I20260927 15:14:34.553436 31735 log.cc:824] T 00000000000000000000000000000000 P 619c4b9f4fe842a89844dd0897d3bbc0: Log is configured to *not* fsync() on all Append() calls
I20260927 15:14:34.555727 31735 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 619c4b9f4fe842a89844dd0897d3bbc0: No bootstrap required, opened a new log
I20260927 15:14:34.560092 31735 raft_consensus.cc:348] T 00000000000000000000000000000000 P 619c4b9f4fe842a89844dd0897d3bbc0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "619c4b9f4fe842a89844dd0897d3bbc0" member_type: VOTER last_known_addr { host: "127.17.136.62" port: 42541 } }
I20260927 15:14:34.560348 31735 raft_consensus.cc:374] T 00000000000000000000000000000000 P 619c4b9f4fe842a89844dd0897d3bbc0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:14:34.560417 31735 raft_consensus.cc:729] T 00000000000000000000000000000000 P 619c4b9f4fe842a89844dd0897d3bbc0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 619c4b9f4fe842a89844dd0897d3bbc0, State: Initialized, Role: FOLLOWER
Sep 27 15:14:34 dist-test-slave-5s2t krb5kdc[31654](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790522074, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.136.62@KRBTEST.COM
I20260927 15:14:34.560873 31735 consensus_queue.cc:260] T 00000000000000000000000000000000 P 619c4b9f4fe842a89844dd0897d3bbc0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "619c4b9f4fe842a89844dd0897d3bbc0" member_type: VOTER last_known_addr { host: "127.17.136.62" port: 42541 } }
I20260927 15:14:34.561009 31735 raft_consensus.cc:388] T 00000000000000000000000000000000 P 619c4b9f4fe842a89844dd0897d3bbc0 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260927 15:14:34.561077 31735 raft_consensus.cc:482] T 00000000000000000000000000000000 P 619c4b9f4fe842a89844dd0897d3bbc0 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260927 15:14:34.561179 31735 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 619c4b9f4fe842a89844dd0897d3bbc0 [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:14:34.562290 31735 raft_consensus.cc:504] T 00000000000000000000000000000000 P 619c4b9f4fe842a89844dd0897d3bbc0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "619c4b9f4fe842a89844dd0897d3bbc0" member_type: VOTER last_known_addr { host: "127.17.136.62" port: 42541 } }
I20260927 15:14:34.562623 31735 leader_election.cc:302] T 00000000000000000000000000000000 P 619c4b9f4fe842a89844dd0897d3bbc0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 619c4b9f4fe842a89844dd0897d3bbc0; no voters:
I20260927 15:14:34.562938 31735 leader_election.cc:288] T 00000000000000000000000000000000 P 619c4b9f4fe842a89844dd0897d3bbc0 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260927 15:14:34.563024 31740 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 619c4b9f4fe842a89844dd0897d3bbc0 [term 1 FOLLOWER]: Leader election won for term 1
I20260927 15:14:34.563222 31740 raft_consensus.cc:686] T 00000000000000000000000000000000 P 619c4b9f4fe842a89844dd0897d3bbc0 [term 1 LEADER]: Becoming Leader. State: Replica: 619c4b9f4fe842a89844dd0897d3bbc0, State: Running, Role: LEADER
I20260927 15:14:34.563601 31740 consensus_queue.cc:237] T 00000000000000000000000000000000 P 619c4b9f4fe842a89844dd0897d3bbc0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "619c4b9f4fe842a89844dd0897d3bbc0" member_type: VOTER last_known_addr { host: "127.17.136.62" port: 42541 } }
I20260927 15:14:34.564272 31735 sys_catalog.cc:564] T 00000000000000000000000000000000 P 619c4b9f4fe842a89844dd0897d3bbc0 [sys.catalog]: configured and running, proceeding with master startup.
I20260927 15:14:34.565340 31741 sys_catalog.cc:455] T 00000000000000000000000000000000 P 619c4b9f4fe842a89844dd0897d3bbc0 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "619c4b9f4fe842a89844dd0897d3bbc0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "619c4b9f4fe842a89844dd0897d3bbc0" member_type: VOTER last_known_addr { host: "127.17.136.62" port: 42541 } } }
I20260927 15:14:34.565454 31741 sys_catalog.cc:458] T 00000000000000000000000000000000 P 619c4b9f4fe842a89844dd0897d3bbc0 [sys.catalog]: This master's current role is: LEADER
I20260927 15:14:34.565732 31742 sys_catalog.cc:455] T 00000000000000000000000000000000 P 619c4b9f4fe842a89844dd0897d3bbc0 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 619c4b9f4fe842a89844dd0897d3bbc0. Latest consensus state: current_term: 1 leader_uuid: "619c4b9f4fe842a89844dd0897d3bbc0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "619c4b9f4fe842a89844dd0897d3bbc0" member_type: VOTER last_known_addr { host: "127.17.136.62" port: 42541 } } }
I20260927 15:14:34.565860 31742 sys_catalog.cc:458] T 00000000000000000000000000000000 P 619c4b9f4fe842a89844dd0897d3bbc0 [sys.catalog]: This master's current role is: LEADER
I20260927 15:14:34.565919 31738 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:14:34.552524 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45340 (local address 127.17.136.62:42541)
0927 15:14:34.552966 (+ 442us) server_negotiation.cc:206] Beginning negotiation
0927 15:14:34.552982 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0927 15:14:34.553019 (+ 37us) server_negotiation.cc:407] Connection header received
0927 15:14:34.553678 (+ 659us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:14:34.553697 (+ 19us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:14:34.554100 (+ 403us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:14:34.554405 (+ 305us) server_negotiation.cc:226] Negotiated authn=SASL
0927 15:14:34.555362 (+ 957us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:14:34.556382 (+ 1020us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:14:34.557586 (+ 1204us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:14:34.558095 (+ 509us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:14:34.558217 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:14:34.561103 (+ 2886us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0927 15:14:34.561110 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0927 15:14:34.561127 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0927 15:14:34.561158 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0927 15:14:34.562819 (+ 1661us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:14:34.563313 (+ 494us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:14:34.563319 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:14:34.563325 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:14:34.563455 (+ 130us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:14:34.563758 (+ 303us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:14:34.563761 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:14:34.563763 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:14:34.564143 (+ 380us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0927 15:14:34.564331 (+ 188us) server_negotiation.cc:1035] Waiting for connection context
0927 15:14:34.564615 (+ 284us) server_negotiation.cc:299] Negotiation successful
0927 15:14:34.564923 (+ 308us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":296,"thread_start_us":143,"threads_started":1}
I20260927 15:14:34.566851 31749 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260927 15:14:34.570235 31749 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260927 15:14:34.575312 31749 catalog_manager.cc:1347] Generated new cluster ID: eec749150f1140fe9b94481d699a02a6
I20260927 15:14:34.575379 31749 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260927 15:14:34.582280 31749 catalog_manager.cc:1370] Generated new certificate authority record
I20260927 15:14:34.583089 31749 catalog_manager.cc:1504] Loading token signing keys...
I20260927 15:14:34.593243 31749 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 619c4b9f4fe842a89844dd0897d3bbc0: Generated new TSK 0
I20260927 15:14:34.593914 31749 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.17.136.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.136.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.136.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790521920546562-17952-0/krb5kdc/kudu_127.17.136.1.keytab.
Entry for principal kudu/127.17.136.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790521920546562-17952-0/krb5kdc/kudu_127.17.136.1.keytab.
I20260927 15:14:34.626438 17952 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu
/tmp/dist-test-taskiFOyeW/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790521920546562-17952-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790521920546562-17952-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790521920546562-17952-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790521920546562-17952-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.136.1:0
--local_ip_for_outbound_sockets=127.17.136.1
--webserver_interface=127.17.136.1
--webserver_port=0
--tserver_master_addrs=127.17.136.62:42541
--keytab_file=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790521920546562-17952-0/krb5kdc/kudu_127.17.136.1.keytab
--principal=kudu/127.17.136.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.136.20:39235
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790521920546562-17952-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790521920546562-17952-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790521920546562-17952-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260927 15:14:34.731899 31761 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260927 15:14:34.732143 31761 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260927 15:14:34.732185 31761 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260927 15:14:34.736119 31761 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260927 15:14:34.736169 31761 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260927 15:14:34.736225 31761 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.136.1
I20260927 15:14:34.741255 31761 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.136.20:39235
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790521920546562-17952-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790521920546562-17952-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790521920546562-17952-0/krb5kdc/kudu_127.17.136.1.keytab
--principal=kudu/127.17.136.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.136.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790521920546562-17952-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.17.136.1
--webserver_port=0
--tserver_master_addrs=127.17.136.62:42541
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31761
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.136.1
--log_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790521920546562-17952-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 27 Sep 2026 14:27:13 UTC on ccycloud.quasar-psqrth.root.comops.site
build id 4676138
I20260927 15:14:34.742175 31761 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260927 15:14:34.743085 31761 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260927 15:14:34.752169 31761 server_base.cc:1034] running on GCE node
W20260927 15:14:34.752094 31767 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260927 15:14:34.752104 31766 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260927 15:14:34.752095 31769 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260927 15:14:34.752702 31761 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260927 15:14:34.753330 31761 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260927 15:14:34.754487 31761 hybrid_clock.cc:648] HybridClock initialized: now 1790522074754475 us; error 34 us; skew 500 ppm
Sep 27 15:14:34 dist-test-slave-5s2t krb5kdc[31654](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790522074, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.136.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260927 15:14:34.757063 31761 init.cc:377] Logged in from keytab as kudu/127.17.136.1@KRBTEST.COM (short username kudu)
I20260927 15:14:34.757867 31761 webserver.cc:460] Webserver started at http://127.17.136.1:40831/ using document root <none> and password file <none>
I20260927 15:14:34.758419 31761 fs_manager.cc:359] Metadata directory not provided
I20260927 15:14:34.758481 31761 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260927 15:14:34.758682 31761 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260927 15:14:34.760923 31761 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790521920546562-17952-0/minicluster-data/ts-0/data/instance:
uuid: "2c12418b9eda4943b132c69370a1d644"
format_stamp: "Formatted at 2026-09-27 15:14:34 on dist-test-slave-5s2t"
server_key: "d2909d8ee09ad198ab012edeaff5ecbf"
server_key_iv: "568890b8d7bc40518cc25c3a14a60f9e"
server_key_version: "encryptionkey@0"
I20260927 15:14:34.761531 31761 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790521920546562-17952-0/minicluster-data/ts-0/wal/instance:
uuid: "2c12418b9eda4943b132c69370a1d644"
format_stamp: "Formatted at 2026-09-27 15:14:34 on dist-test-slave-5s2t"
server_key: "d2909d8ee09ad198ab012edeaff5ecbf"
server_key_iv: "568890b8d7bc40518cc25c3a14a60f9e"
server_key_version: "encryptionkey@0"
I20260927 15:14:34.765437 31761 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260927 15:14:34.767805 31776 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260927 15:14:34.768985 31761 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260927 15:14:34.769088 31761 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790521920546562-17952-0/minicluster-data/ts-0/data,/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790521920546562-17952-0/minicluster-data/ts-0/wal
uuid: "2c12418b9eda4943b132c69370a1d644"
format_stamp: "Formatted at 2026-09-27 15:14:34 on dist-test-slave-5s2t"
server_key: "d2909d8ee09ad198ab012edeaff5ecbf"
server_key_iv: "568890b8d7bc40518cc25c3a14a60f9e"
server_key_version: "encryptionkey@0"
I20260927 15:14:34.769181 31761 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790521920546562-17952-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790521920546562-17952-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790521920546562-17952-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260927 15:14:34.786911 31761 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260927 15:14:34.789577 31761 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260927 15:14:34.789744 31761 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260927 15:14:34.790292 31761 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260927 15:14:34.791074 31761 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260927 15:14:34.791132 31761 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260927 15:14:34.791184 31761 ts_tablet_manager.cc:610] Registered 0 tablets
I20260927 15:14:34.791213 31761 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260927 15:14:34.799181 31761 rpc_server.cc:307] RPC server started. Bound to: 127.17.136.1:36919
I20260927 15:14:34.799214 31889 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.136.1:36919 every 8 connection(s)
I20260927 15:14:34.800043 31761 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790521920546562-17952-0/minicluster-data/ts-0/data/info.pb
I20260927 15:14:34.801721 17952 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu as pid 31761
I20260927 15:14:34.801842 17952 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790521920546562-17952-0/minicluster-data/ts-0/wal/instance
I20260927 15:14:34.802147 17952 external_mini_cluster.cc:1428] Setting key f8bab7a4cab0fbb2812b04f485dfc695
Sep 27 15:14:34 dist-test-slave-5s2t krb5kdc[31654](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790522074, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.136.1@KRBTEST.COM for kudu/127.17.136.62@KRBTEST.COM
WARNING: no policy specified for kudu/127.17.136.2@KRBTEST.COM; defaulting to no policy
I20260927 15:14:34.814110 31738 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:14:34.801841 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.136.1:42129 (local address 127.17.136.62:42541)
0927 15:14:34.801978 (+ 137us) server_negotiation.cc:206] Beginning negotiation
0927 15:14:34.801983 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0927 15:14:34.802876 (+ 893us) server_negotiation.cc:407] Connection header received
0927 15:14:34.804461 (+ 1585us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:14:34.804463 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:14:34.804506 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:14:34.804573 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0927 15:14:34.805936 (+ 1363us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:14:34.806687 (+ 751us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:14:34.807818 (+ 1131us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:14:34.808177 (+ 359us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:14:34.808284 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:14:34.810843 (+ 2559us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0927 15:14:34.810846 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0927 15:14:34.810848 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0927 15:14:34.810871 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0927 15:14:34.812337 (+ 1466us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:14:34.812814 (+ 477us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:14:34.812817 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:14:34.812818 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:14:34.812898 (+ 80us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:14:34.813202 (+ 304us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:14:34.813205 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:14:34.813206 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:14:34.813377 (+ 171us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0927 15:14:34.813448 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0927 15:14:34.813877 (+ 429us) server_negotiation.cc:299] Negotiation successful
0927 15:14:34.813986 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.136.2@KRBTEST.COM" created.
I20260927 15:14:34.815073 31892 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:14:34.802260 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.62:42541 (local address 127.17.136.1:42129)
0927 15:14:34.802734 (+ 474us) negotiation.cc:107] Waiting for socket to connect
0927 15:14:34.802776 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0927 15:14:34.804242 (+ 1466us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0927 15:14:34.804770 (+ 528us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0927 15:14:34.804779 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0927 15:14:34.805234 (+ 455us) client_negotiation.cc:189] Negotiated authn=SASL
0927 15:14:34.805810 (+ 576us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:14:34.805824 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:14:34.806775 (+ 951us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:14:34.806777 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:14:34.807703 (+ 926us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:14:34.807712 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:14:34.808310 (+ 598us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:14:34.808313 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:14:34.808449 (+ 136us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:14:34.808959 (+ 510us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0927 15:14:34.808980 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0927 15:14:34.810665 (+ 1685us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0927 15:14:34.812439 (+ 1774us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0927 15:14:34.812443 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0927 15:14:34.812455 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0927 15:14:34.812736 (+ 281us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0927 15:14:34.812967 (+ 231us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0927 15:14:34.812969 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0927 15:14:34.812970 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0927 15:14:34.813136 (+ 166us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0927 15:14:34.813447 (+ 311us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0927 15:14:34.813452 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0927 15:14:34.813694 (+ 242us) client_negotiation.cc:769] Sending connection context
0927 15:14:34.813844 (+ 150us) client_negotiation.cc:240] Negotiation successful
0927 15:14:34.814143 (+ 299us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":289,"thread_start_us":130,"threads_started":1}
I20260927 15:14:34.816352 31890 heartbeater.cc:347] Connected to a master server at 127.17.136.62:42541
I20260927 15:14:34.816581 31890 heartbeater.cc:464] Registering TS with master...
I20260927 15:14:34.817030 31890 heartbeater.cc:511] Master 127.17.136.62:42541 requested a full tablet report, sending...
I20260927 15:14:34.818424 31699 ts_manager.cc:194] Registered new tserver with Master: 2c12418b9eda4943b132c69370a1d644 (127.17.136.1:36919)
I20260927 15:14:34.819540 31699 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.136.1@KRBTEST.COM'} at 127.17.136.1:42129
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.136.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790521920546562-17952-0/krb5kdc/kudu_127.17.136.2.keytab.
Entry for principal kudu/127.17.136.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790521920546562-17952-0/krb5kdc/kudu_127.17.136.2.keytab.
I20260927 15:14:34.830075 17952 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu
/tmp/dist-test-taskiFOyeW/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790521920546562-17952-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790521920546562-17952-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790521920546562-17952-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790521920546562-17952-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.136.2:0
--local_ip_for_outbound_sockets=127.17.136.2
--webserver_interface=127.17.136.2
--webserver_port=0
--tserver_master_addrs=127.17.136.62:42541
--keytab_file=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790521920546562-17952-0/krb5kdc/kudu_127.17.136.2.keytab
--principal=kudu/127.17.136.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.136.20:39235
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790521920546562-17952-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790521920546562-17952-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790521920546562-17952-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260927 15:14:34.933904 31895 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260927 15:14:34.934144 31895 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260927 15:14:34.934201 31895 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260927 15:14:34.938120 31895 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260927 15:14:34.938171 31895 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260927 15:14:34.938247 31895 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.136.2
I20260927 15:14:34.943182 31895 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.136.20:39235
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790521920546562-17952-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790521920546562-17952-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790521920546562-17952-0/krb5kdc/kudu_127.17.136.2.keytab
--principal=kudu/127.17.136.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.136.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790521920546562-17952-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.17.136.2
--webserver_port=0
--tserver_master_addrs=127.17.136.62:42541
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31895
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.136.2
--log_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790521920546562-17952-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 27 Sep 2026 14:27:13 UTC on ccycloud.quasar-psqrth.root.comops.site
build id 4676138
I20260927 15:14:34.944150 31895 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260927 15:14:34.945094 31895 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260927 15:14:34.954038 31901 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260927 15:14:34.954066 31903 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260927 15:14:34.954097 31900 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260927 15:14:34.954977 31895 server_base.cc:1034] running on GCE node
I20260927 15:14:34.955379 31895 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260927 15:14:34.955979 31895 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260927 15:14:34.957129 31895 hybrid_clock.cc:648] HybridClock initialized: now 1790522074957109 us; error 37 us; skew 500 ppm
Sep 27 15:14:34 dist-test-slave-5s2t krb5kdc[31654](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790522074, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.136.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260927 15:14:34.959692 31895 init.cc:377] Logged in from keytab as kudu/127.17.136.2@KRBTEST.COM (short username kudu)
I20260927 15:14:34.960448 31895 webserver.cc:460] Webserver started at http://127.17.136.2:36037/ using document root <none> and password file <none>
I20260927 15:14:34.960927 31895 fs_manager.cc:359] Metadata directory not provided
I20260927 15:14:34.960979 31895 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260927 15:14:34.961133 31895 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260927 15:14:34.962980 31895 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790521920546562-17952-0/minicluster-data/ts-1/data/instance:
uuid: "cfe00bf42aff43b5be70835cd6f08b3c"
format_stamp: "Formatted at 2026-09-27 15:14:34 on dist-test-slave-5s2t"
server_key: "41bfc98fb0319e4faf6c7cb286a1c4f4"
server_key_iv: "8fe0f887629898ad580486e7d93f5bd3"
server_key_version: "encryptionkey@0"
I20260927 15:14:34.963502 31895 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790521920546562-17952-0/minicluster-data/ts-1/wal/instance:
uuid: "cfe00bf42aff43b5be70835cd6f08b3c"
format_stamp: "Formatted at 2026-09-27 15:14:34 on dist-test-slave-5s2t"
server_key: "41bfc98fb0319e4faf6c7cb286a1c4f4"
server_key_iv: "8fe0f887629898ad580486e7d93f5bd3"
server_key_version: "encryptionkey@0"
I20260927 15:14:34.966946 31895 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.000s
I20260927 15:14:34.969101 31910 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260927 15:14:34.970203 31895 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260927 15:14:34.970290 31895 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790521920546562-17952-0/minicluster-data/ts-1/data,/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790521920546562-17952-0/minicluster-data/ts-1/wal
uuid: "cfe00bf42aff43b5be70835cd6f08b3c"
format_stamp: "Formatted at 2026-09-27 15:14:34 on dist-test-slave-5s2t"
server_key: "41bfc98fb0319e4faf6c7cb286a1c4f4"
server_key_iv: "8fe0f887629898ad580486e7d93f5bd3"
server_key_version: "encryptionkey@0"
I20260927 15:14:34.970364 31895 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790521920546562-17952-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790521920546562-17952-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790521920546562-17952-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260927 15:14:34.984934 31895 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260927 15:14:34.987788 31895 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260927 15:14:34.987923 31895 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260927 15:14:34.988397 31895 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260927 15:14:34.989118 31895 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260927 15:14:34.989161 31895 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260927 15:14:34.989202 31895 ts_tablet_manager.cc:610] Registered 0 tablets
I20260927 15:14:34.989221 31895 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260927 15:14:34.997021 31895 rpc_server.cc:307] RPC server started. Bound to: 127.17.136.2:44529
I20260927 15:14:34.997064 32023 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.136.2:44529 every 8 connection(s)
I20260927 15:14:34.997841 31895 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790521920546562-17952-0/minicluster-data/ts-1/data/info.pb
I20260927 15:14:35.005342 17952 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu as pid 31895
I20260927 15:14:35.005456 17952 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790521920546562-17952-0/minicluster-data/ts-1/wal/instance
I20260927 15:14:35.005751 17952 external_mini_cluster.cc:1428] Setting key 6b95e3a59a1bb46585465698ac8beede
Sep 27 15:14:35 dist-test-slave-5s2t krb5kdc[31654](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790522074, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.136.2@KRBTEST.COM for kudu/127.17.136.62@KRBTEST.COM
I20260927 15:14:35.010461 31738 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:14:34.999489 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.136.2:59961 (local address 127.17.136.62:42541)
0927 15:14:34.999625 (+ 136us) server_negotiation.cc:206] Beginning negotiation
0927 15:14:34.999628 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0927 15:14:35.000423 (+ 795us) server_negotiation.cc:407] Connection header received
0927 15:14:35.001708 (+ 1285us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:14:35.001712 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:14:35.001767 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:14:35.001838 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0927 15:14:35.002957 (+ 1119us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:14:35.003525 (+ 568us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:14:35.004613 (+ 1088us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:14:35.004826 (+ 213us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:14:35.004911 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:14:35.007367 (+ 2456us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0927 15:14:35.007372 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0927 15:14:35.007375 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0927 15:14:35.007403 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0927 15:14:35.008687 (+ 1284us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:14:35.009125 (+ 438us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:14:35.009128 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:14:35.009130 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:14:35.009212 (+ 82us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:14:35.009475 (+ 263us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:14:35.009478 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:14:35.009479 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:14:35.009681 (+ 202us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0927 15:14:35.009756 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0927 15:14:35.010188 (+ 432us) server_negotiation.cc:299] Negotiation successful
0927 15:14:35.010309 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260927 15:14:35.011204 32026 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:14:34.999869 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.62:42541 (local address 127.17.136.2:59961)
0927 15:14:35.000291 (+ 422us) negotiation.cc:107] Waiting for socket to connect
0927 15:14:35.000329 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0927 15:14:35.001505 (+ 1176us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0927 15:14:35.002027 (+ 522us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0927 15:14:35.002033 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0927 15:14:35.002366 (+ 333us) client_negotiation.cc:189] Negotiated authn=SASL
0927 15:14:35.002819 (+ 453us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:14:35.002832 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:14:35.003642 (+ 810us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:14:35.003645 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:14:35.004502 (+ 857us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:14:35.004510 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:14:35.004960 (+ 450us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:14:35.004964 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:14:35.005125 (+ 161us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:14:35.005706 (+ 581us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0927 15:14:35.005721 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0927 15:14:35.007191 (+ 1470us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0927 15:14:35.008790 (+ 1599us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0927 15:14:35.008794 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0927 15:14:35.008805 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0927 15:14:35.009045 (+ 240us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0927 15:14:35.009285 (+ 240us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0927 15:14:35.009287 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0927 15:14:35.009289 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0927 15:14:35.009402 (+ 113us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0927 15:14:35.009754 (+ 352us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0927 15:14:35.009758 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0927 15:14:35.009968 (+ 210us) client_negotiation.cc:769] Sending connection context
0927 15:14:35.010115 (+ 147us) client_negotiation.cc:240] Negotiation successful
0927 15:14:35.010350 (+ 235us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":251,"thread_start_us":104,"threads_started":1}
I20260927 15:14:35.012271 32024 heartbeater.cc:347] Connected to a master server at 127.17.136.62:42541
I20260927 15:14:35.012485 32024 heartbeater.cc:464] Registering TS with master...
I20260927 15:14:35.012919 32024 heartbeater.cc:511] Master 127.17.136.62:42541 requested a full tablet report, sending...
I20260927 15:14:35.013933 31699 ts_manager.cc:194] Registered new tserver with Master: cfe00bf42aff43b5be70835cd6f08b3c (127.17.136.2:44529)
I20260927 15:14:35.014462 31699 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.136.2@KRBTEST.COM'} at 127.17.136.2:59961
WARNING: no policy specified for kudu/127.17.136.3@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.136.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.136.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790521920546562-17952-0/krb5kdc/kudu_127.17.136.3.keytab.
Entry for principal kudu/127.17.136.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790521920546562-17952-0/krb5kdc/kudu_127.17.136.3.keytab.
I20260927 15:14:35.030336 17952 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu
/tmp/dist-test-taskiFOyeW/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790521920546562-17952-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790521920546562-17952-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790521920546562-17952-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790521920546562-17952-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.136.3:0
--local_ip_for_outbound_sockets=127.17.136.3
--webserver_interface=127.17.136.3
--webserver_port=0
--tserver_master_addrs=127.17.136.62:42541
--keytab_file=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790521920546562-17952-0/krb5kdc/kudu_127.17.136.3.keytab
--principal=kudu/127.17.136.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.136.20:39235
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790521920546562-17952-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790521920546562-17952-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790521920546562-17952-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260927 15:14:35.135880 32029 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260927 15:14:35.136121 32029 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260927 15:14:35.136163 32029 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260927 15:14:35.140064 32029 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260927 15:14:35.140113 32029 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260927 15:14:35.140172 32029 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.136.3
I20260927 15:14:35.145192 32029 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.136.20:39235
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790521920546562-17952-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790521920546562-17952-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790521920546562-17952-0/krb5kdc/kudu_127.17.136.3.keytab
--principal=kudu/127.17.136.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.136.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790521920546562-17952-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.17.136.3
--webserver_port=0
--tserver_master_addrs=127.17.136.62:42541
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32029
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.136.3
--log_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790521920546562-17952-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 27 Sep 2026 14:27:13 UTC on ccycloud.quasar-psqrth.root.comops.site
build id 4676138
I20260927 15:14:35.146152 32029 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260927 15:14:35.147102 32029 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260927 15:14:35.156205 32034 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260927 15:14:35.156270 32035 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260927 15:14:35.156454 32029 server_base.cc:1034] running on GCE node
W20260927 15:14:35.156538 32037 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260927 15:14:35.156909 32029 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260927 15:14:35.157581 32029 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260927 15:14:35.158741 32029 hybrid_clock.cc:648] HybridClock initialized: now 1790522075158713 us; error 38 us; skew 500 ppm
Sep 27 15:14:35 dist-test-slave-5s2t krb5kdc[31654](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790522075, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.136.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260927 15:14:35.166709 32029 init.cc:377] Logged in from keytab as kudu/127.17.136.3@KRBTEST.COM (short username kudu)
I20260927 15:14:35.167729 32029 webserver.cc:460] Webserver started at http://127.17.136.3:45393/ using document root <none> and password file <none>
I20260927 15:14:35.168282 32029 fs_manager.cc:359] Metadata directory not provided
I20260927 15:14:35.168354 32029 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260927 15:14:35.168555 32029 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260927 15:14:35.170564 32029 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790521920546562-17952-0/minicluster-data/ts-2/data/instance:
uuid: "a4632fdbe3fd4678a5a57275c077138a"
format_stamp: "Formatted at 2026-09-27 15:14:35 on dist-test-slave-5s2t"
server_key: "5dae5570bf038468319d4de5bb6e5611"
server_key_iv: "e61e7e89875face082bce425b10b7c36"
server_key_version: "encryptionkey@0"
I20260927 15:14:35.171113 32029 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790521920546562-17952-0/minicluster-data/ts-2/wal/instance:
uuid: "a4632fdbe3fd4678a5a57275c077138a"
format_stamp: "Formatted at 2026-09-27 15:14:35 on dist-test-slave-5s2t"
server_key: "5dae5570bf038468319d4de5bb6e5611"
server_key_iv: "e61e7e89875face082bce425b10b7c36"
server_key_version: "encryptionkey@0"
I20260927 15:14:35.174886 32029 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.000s
I20260927 15:14:35.177219 32044 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260927 15:14:35.178470 32029 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.000s sys 0.002s
I20260927 15:14:35.178581 32029 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790521920546562-17952-0/minicluster-data/ts-2/data,/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790521920546562-17952-0/minicluster-data/ts-2/wal
uuid: "a4632fdbe3fd4678a5a57275c077138a"
format_stamp: "Formatted at 2026-09-27 15:14:35 on dist-test-slave-5s2t"
server_key: "5dae5570bf038468319d4de5bb6e5611"
server_key_iv: "e61e7e89875face082bce425b10b7c36"
server_key_version: "encryptionkey@0"
I20260927 15:14:35.178675 32029 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790521920546562-17952-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790521920546562-17952-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790521920546562-17952-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260927 15:14:35.188714 32029 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260927 15:14:35.191365 32029 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260927 15:14:35.191533 32029 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260927 15:14:35.192058 32029 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260927 15:14:35.192807 32029 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260927 15:14:35.192850 32029 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260927 15:14:35.192899 32029 ts_tablet_manager.cc:610] Registered 0 tablets
I20260927 15:14:35.192927 32029 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260927 15:14:35.201030 32029 rpc_server.cc:307] RPC server started. Bound to: 127.17.136.3:35877
I20260927 15:14:35.201059 32157 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.136.3:35877 every 8 connection(s)
I20260927 15:14:35.201853 32029 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790521920546562-17952-0/minicluster-data/ts-2/data/info.pb
I20260927 15:14:35.205614 17952 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu as pid 32029
I20260927 15:14:35.205722 17952 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790521920546562-17952-0/minicluster-data/ts-2/wal/instance
I20260927 15:14:35.206014 17952 external_mini_cluster.cc:1428] Setting key 77847f5a9529ae421bb767cf91447c3b
Sep 27 15:14:35 dist-test-slave-5s2t krb5kdc[31654](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790522075, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.136.3@KRBTEST.COM for kudu/127.17.136.62@KRBTEST.COM
I20260927 15:14:35.214556 31738 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:14:35.203597 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.136.3:58499 (local address 127.17.136.62:42541)
0927 15:14:35.203737 (+ 140us) server_negotiation.cc:206] Beginning negotiation
0927 15:14:35.203740 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0927 15:14:35.204502 (+ 762us) server_negotiation.cc:407] Connection header received
0927 15:14:35.205920 (+ 1418us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:14:35.205923 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:14:35.205970 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:14:35.206044 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0927 15:14:35.207329 (+ 1285us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:14:35.207901 (+ 572us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:14:35.208984 (+ 1083us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:14:35.209209 (+ 225us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:14:35.209293 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:14:35.211527 (+ 2234us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0927 15:14:35.211530 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0927 15:14:35.211532 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0927 15:14:35.211554 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0927 15:14:35.212659 (+ 1105us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:14:35.213130 (+ 471us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:14:35.213133 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:14:35.213134 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:14:35.213205 (+ 71us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:14:35.213528 (+ 323us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:14:35.213531 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:14:35.213532 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:14:35.213703 (+ 171us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0927 15:14:35.213784 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0927 15:14:35.214268 (+ 484us) server_negotiation.cc:299] Negotiation successful
0927 15:14:35.214383 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260927 15:14:35.215341 32160 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:14:35.203941 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.62:42541 (local address 127.17.136.3:58499)
0927 15:14:35.204367 (+ 426us) negotiation.cc:107] Waiting for socket to connect
0927 15:14:35.204406 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0927 15:14:35.205700 (+ 1294us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0927 15:14:35.206245 (+ 545us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0927 15:14:35.206253 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0927 15:14:35.206629 (+ 376us) client_negotiation.cc:189] Negotiated authn=SASL
0927 15:14:35.207195 (+ 566us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:14:35.207212 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:14:35.208017 (+ 805us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:14:35.208021 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:14:35.208874 (+ 853us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:14:35.208883 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:14:35.209339 (+ 456us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:14:35.209343 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:14:35.209510 (+ 167us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:14:35.209990 (+ 480us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0927 15:14:35.210004 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0927 15:14:35.211371 (+ 1367us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0927 15:14:35.212756 (+ 1385us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0927 15:14:35.212762 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0927 15:14:35.212777 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0927 15:14:35.213043 (+ 266us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0927 15:14:35.213282 (+ 239us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0927 15:14:35.213286 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0927 15:14:35.213288 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0927 15:14:35.213416 (+ 128us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0927 15:14:35.213795 (+ 379us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0927 15:14:35.213802 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0927 15:14:35.214051 (+ 249us) client_negotiation.cc:769] Sending connection context
0927 15:14:35.214211 (+ 160us) client_negotiation.cc:240] Negotiation successful
0927 15:14:35.214518 (+ 307us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":255,"thread_start_us":110,"threads_started":1}
I20260927 15:14:35.216313 32158 heartbeater.cc:347] Connected to a master server at 127.17.136.62:42541
I20260927 15:14:35.216599 32158 heartbeater.cc:464] Registering TS with master...
I20260927 15:14:35.217082 32158 heartbeater.cc:511] Master 127.17.136.62:42541 requested a full tablet report, sending...
I20260927 15:14:35.218106 31699 ts_manager.cc:194] Registered new tserver with Master: a4632fdbe3fd4678a5a57275c077138a (127.17.136.3:35877)
I20260927 15:14:35.218743 31699 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.136.3@KRBTEST.COM'} at 127.17.136.3:58499
I20260927 15:14:35.219746 17952 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260927 15:14:35.228315 31738 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:14:35.221598 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45356 (local address 127.17.136.62:42541)
0927 15:14:35.221700 (+ 102us) server_negotiation.cc:206] Beginning negotiation
0927 15:14:35.221703 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0927 15:14:35.221906 (+ 203us) server_negotiation.cc:407] Connection header received
0927 15:14:35.222014 (+ 108us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:14:35.222016 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:14:35.222049 (+ 33us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:14:35.222108 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0927 15:14:35.222783 (+ 675us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:14:35.223290 (+ 507us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:14:35.224137 (+ 847us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:14:35.224345 (+ 208us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:14:35.224425 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:14:35.225706 (+ 1281us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0927 15:14:35.225709 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0927 15:14:35.225711 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0927 15:14:35.225734 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0927 15:14:35.226899 (+ 1165us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:14:35.227297 (+ 398us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:14:35.227301 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:14:35.227303 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:14:35.227379 (+ 76us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:14:35.227655 (+ 276us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:14:35.227657 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:14:35.227658 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:14:35.227848 (+ 190us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0927 15:14:35.227955 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0927 15:14:35.228113 (+ 158us) server_negotiation.cc:299] Negotiation successful
0927 15:14:35.228201 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260927 15:14:35.231035 31699 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:45356:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:14:35.234138 31699 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:14:35.247705 32170 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:14:35.242194 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.3:35877 (local address 127.0.0.1:38176)
0927 15:14:35.243215 (+ 1021us) negotiation.cc:107] Waiting for socket to connect
0927 15:14:35.243227 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0927 15:14:35.243327 (+ 100us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0927 15:14:35.244004 (+ 677us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0927 15:14:35.244006 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0927 15:14:35.244026 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0927 15:14:35.244114 (+ 88us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:14:35.244120 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:14:35.245399 (+ 1279us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:14:35.245402 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:14:35.246407 (+ 1005us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:14:35.246416 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:14:35.247162 (+ 746us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:14:35.247166 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:14:35.247287 (+ 121us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:14:35.247326 (+ 39us) client_negotiation.cc:769] Sending connection context
0927 15:14:35.247425 (+ 99us) client_negotiation.cc:240] Negotiation successful
0927 15:14:35.247552 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":964,"mutex_wait_us":5,"thread_start_us":77,"threads_started":1}
I20260927 15:14:35.247846 32173 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:14:35.242633 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38176 (local address 127.17.136.3:35877)
0927 15:14:35.243561 (+ 928us) server_negotiation.cc:206] Beginning negotiation
0927 15:14:35.243572 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0927 15:14:35.243593 (+ 21us) server_negotiation.cc:407] Connection header received
0927 15:14:35.243724 (+ 131us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:14:35.243729 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:14:35.243876 (+ 147us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:14:35.244031 (+ 155us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0927 15:14:35.244227 (+ 196us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:14:35.245292 (+ 1065us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:14:35.246512 (+ 1220us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:14:35.247058 (+ 546us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:14:35.247150 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:14:35.247314 (+ 164us) server_negotiation.cc:1035] Waiting for connection context
0927 15:14:35.247605 (+ 291us) server_negotiation.cc:299] Negotiation successful
0927 15:14:35.247704 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":826,"thread_start_us":90,"threads_started":1}
I20260927 15:14:35.248075 32171 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:14:35.242081 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39038 (local address 127.17.136.2:44529)
0927 15:14:35.243033 (+ 952us) server_negotiation.cc:206] Beginning negotiation
0927 15:14:35.243051 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0927 15:14:35.243073 (+ 22us) server_negotiation.cc:407] Connection header received
0927 15:14:35.243148 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:14:35.243153 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:14:35.243384 (+ 231us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:14:35.243565 (+ 181us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0927 15:14:35.243920 (+ 355us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:14:35.245084 (+ 1164us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:14:35.246557 (+ 1473us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:14:35.247326 (+ 769us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:14:35.247416 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:14:35.247523 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0927 15:14:35.247838 (+ 315us) server_negotiation.cc:299] Negotiation successful
0927 15:14:35.247935 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":856,"thread_start_us":170,"threads_started":1}
I20260927 15:14:35.247754 32169 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:14:35.241945 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.2:44529 (local address 127.0.0.1:39038)
0927 15:14:35.242717 (+ 772us) negotiation.cc:107] Waiting for socket to connect
0927 15:14:35.242765 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0927 15:14:35.242906 (+ 141us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0927 15:14:35.243734 (+ 828us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0927 15:14:35.243737 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0927 15:14:35.243750 (+ 13us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0927 15:14:35.243814 (+ 64us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:14:35.243819 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:14:35.245214 (+ 1395us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:14:35.245218 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:14:35.246441 (+ 1223us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:14:35.246449 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:14:35.247426 (+ 977us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:14:35.247429 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:14:35.247512 (+ 83us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:14:35.247532 (+ 20us) client_negotiation.cc:769] Sending connection context
0927 15:14:35.247595 (+ 63us) client_negotiation.cc:240] Negotiation successful
0927 15:14:35.247652 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":609,"mutex_wait_us":107,"spinlock_wait_cycles":65920,"thread_start_us":80,"threads_started":1}
I20260927 15:14:35.247891 32172 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:14:35.242152 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.1:36919 (local address 127.0.0.1:48874)
0927 15:14:35.242718 (+ 566us) negotiation.cc:107] Waiting for socket to connect
0927 15:14:35.242766 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0927 15:14:35.242905 (+ 139us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0927 15:14:35.243636 (+ 731us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0927 15:14:35.243642 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0927 15:14:35.243663 (+ 21us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0927 15:14:35.243782 (+ 119us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:14:35.243788 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:14:35.244963 (+ 1175us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:14:35.244966 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:14:35.246271 (+ 1305us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:14:35.246281 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:14:35.247545 (+ 1264us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:14:35.247549 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:14:35.247634 (+ 85us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:14:35.247655 (+ 21us) client_negotiation.cc:769] Sending connection context
0927 15:14:35.247718 (+ 63us) client_negotiation.cc:240] Negotiation successful
0927 15:14:35.247781 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":469,"thread_start_us":80,"threads_started":1}
I20260927 15:14:35.248206 32174 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:14:35.242720 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48874 (local address 127.17.136.1:36919)
0927 15:14:35.243197 (+ 477us) server_negotiation.cc:206] Beginning negotiation
0927 15:14:35.243207 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0927 15:14:35.243223 (+ 16us) server_negotiation.cc:407] Connection header received
0927 15:14:35.243307 (+ 84us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:14:35.243312 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:14:35.243468 (+ 156us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:14:35.243924 (+ 456us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0927 15:14:35.244102 (+ 178us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:14:35.244847 (+ 745us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:14:35.246402 (+ 1555us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:14:35.247211 (+ 809us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:14:35.247330 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:14:35.247474 (+ 144us) server_negotiation.cc:1035] Waiting for connection context
0927 15:14:35.247979 (+ 505us) server_negotiation.cc:299] Negotiation successful
0927 15:14:35.248077 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":391,"thread_start_us":109,"threads_started":1}
I20260927 15:14:35.250751 32092 tablet_service.cc:1467] Processing CreateTablet for tablet c4e25ed804064ec485ca6bca45abdb06 (DEFAULT_TABLE table=test-table [id=14347e7e5f3d48ba9bd6e9b9da488762]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:14:35.250883 31958 tablet_service.cc:1467] Processing CreateTablet for tablet c4e25ed804064ec485ca6bca45abdb06 (DEFAULT_TABLE table=test-table [id=14347e7e5f3d48ba9bd6e9b9da488762]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:14:35.250883 31824 tablet_service.cc:1467] Processing CreateTablet for tablet c4e25ed804064ec485ca6bca45abdb06 (DEFAULT_TABLE table=test-table [id=14347e7e5f3d48ba9bd6e9b9da488762]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:14:35.251784 32092 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c4e25ed804064ec485ca6bca45abdb06. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:14:35.251883 31958 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c4e25ed804064ec485ca6bca45abdb06. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:14:35.251883 31824 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c4e25ed804064ec485ca6bca45abdb06. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:14:35.258163 32175 tablet_bootstrap.cc:492] T c4e25ed804064ec485ca6bca45abdb06 P a4632fdbe3fd4678a5a57275c077138a: Bootstrap starting.
I20260927 15:14:35.258991 32176 tablet_bootstrap.cc:492] T c4e25ed804064ec485ca6bca45abdb06 P cfe00bf42aff43b5be70835cd6f08b3c: Bootstrap starting.
I20260927 15:14:35.258991 32177 tablet_bootstrap.cc:492] T c4e25ed804064ec485ca6bca45abdb06 P 2c12418b9eda4943b132c69370a1d644: Bootstrap starting.
I20260927 15:14:35.260216 32175 tablet_bootstrap.cc:654] T c4e25ed804064ec485ca6bca45abdb06 P a4632fdbe3fd4678a5a57275c077138a: Neither blocks nor log segments found. Creating new log.
I20260927 15:14:35.261235 32175 log.cc:824] T c4e25ed804064ec485ca6bca45abdb06 P a4632fdbe3fd4678a5a57275c077138a: Log is configured to *not* fsync() on all Append() calls
I20260927 15:14:35.261564 32176 tablet_bootstrap.cc:654] T c4e25ed804064ec485ca6bca45abdb06 P cfe00bf42aff43b5be70835cd6f08b3c: Neither blocks nor log segments found. Creating new log.
I20260927 15:14:35.261557 32177 tablet_bootstrap.cc:654] T c4e25ed804064ec485ca6bca45abdb06 P 2c12418b9eda4943b132c69370a1d644: Neither blocks nor log segments found. Creating new log.
I20260927 15:14:35.262367 32176 log.cc:824] T c4e25ed804064ec485ca6bca45abdb06 P cfe00bf42aff43b5be70835cd6f08b3c: Log is configured to *not* fsync() on all Append() calls
I20260927 15:14:35.262367 32177 log.cc:824] T c4e25ed804064ec485ca6bca45abdb06 P 2c12418b9eda4943b132c69370a1d644: Log is configured to *not* fsync() on all Append() calls
I20260927 15:14:35.263161 32175 tablet_bootstrap.cc:492] T c4e25ed804064ec485ca6bca45abdb06 P a4632fdbe3fd4678a5a57275c077138a: No bootstrap required, opened a new log
I20260927 15:14:35.263420 32175 ts_tablet_manager.cc:1397] T c4e25ed804064ec485ca6bca45abdb06 P a4632fdbe3fd4678a5a57275c077138a: Time spent bootstrapping tablet: real 0.005s user 0.005s sys 0.000s
I20260927 15:14:35.264328 32177 tablet_bootstrap.cc:492] T c4e25ed804064ec485ca6bca45abdb06 P 2c12418b9eda4943b132c69370a1d644: No bootstrap required, opened a new log
I20260927 15:14:35.264490 32177 ts_tablet_manager.cc:1397] T c4e25ed804064ec485ca6bca45abdb06 P 2c12418b9eda4943b132c69370a1d644: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260927 15:14:35.264593 32176 tablet_bootstrap.cc:492] T c4e25ed804064ec485ca6bca45abdb06 P cfe00bf42aff43b5be70835cd6f08b3c: No bootstrap required, opened a new log
I20260927 15:14:35.264780 32176 ts_tablet_manager.cc:1397] T c4e25ed804064ec485ca6bca45abdb06 P cfe00bf42aff43b5be70835cd6f08b3c: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260927 15:14:35.267375 32177 raft_consensus.cc:348] T c4e25ed804064ec485ca6bca45abdb06 P 2c12418b9eda4943b132c69370a1d644 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe00bf42aff43b5be70835cd6f08b3c" member_type: VOTER last_known_addr { host: "127.17.136.2" port: 44529 } } peers { permanent_uuid: "2c12418b9eda4943b132c69370a1d644" member_type: VOTER last_known_addr { host: "127.17.136.1" port: 36919 } } peers { permanent_uuid: "a4632fdbe3fd4678a5a57275c077138a" member_type: VOTER last_known_addr { host: "127.17.136.3" port: 35877 } }
I20260927 15:14:35.267387 32175 raft_consensus.cc:348] T c4e25ed804064ec485ca6bca45abdb06 P a4632fdbe3fd4678a5a57275c077138a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe00bf42aff43b5be70835cd6f08b3c" member_type: VOTER last_known_addr { host: "127.17.136.2" port: 44529 } } peers { permanent_uuid: "2c12418b9eda4943b132c69370a1d644" member_type: VOTER last_known_addr { host: "127.17.136.1" port: 36919 } } peers { permanent_uuid: "a4632fdbe3fd4678a5a57275c077138a" member_type: VOTER last_known_addr { host: "127.17.136.3" port: 35877 } }
I20260927 15:14:35.267597 32177 raft_consensus.cc:374] T c4e25ed804064ec485ca6bca45abdb06 P 2c12418b9eda4943b132c69370a1d644 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:14:35.267616 32175 raft_consensus.cc:374] T c4e25ed804064ec485ca6bca45abdb06 P a4632fdbe3fd4678a5a57275c077138a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:14:35.267659 32175 raft_consensus.cc:729] T c4e25ed804064ec485ca6bca45abdb06 P a4632fdbe3fd4678a5a57275c077138a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a4632fdbe3fd4678a5a57275c077138a, State: Initialized, Role: FOLLOWER
I20260927 15:14:35.267668 32177 raft_consensus.cc:729] T c4e25ed804064ec485ca6bca45abdb06 P 2c12418b9eda4943b132c69370a1d644 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2c12418b9eda4943b132c69370a1d644, State: Initialized, Role: FOLLOWER
I20260927 15:14:35.268059 32177 consensus_queue.cc:260] T c4e25ed804064ec485ca6bca45abdb06 P 2c12418b9eda4943b132c69370a1d644 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe00bf42aff43b5be70835cd6f08b3c" member_type: VOTER last_known_addr { host: "127.17.136.2" port: 44529 } } peers { permanent_uuid: "2c12418b9eda4943b132c69370a1d644" member_type: VOTER last_known_addr { host: "127.17.136.1" port: 36919 } } peers { permanent_uuid: "a4632fdbe3fd4678a5a57275c077138a" member_type: VOTER last_known_addr { host: "127.17.136.3" port: 35877 } }
I20260927 15:14:35.268154 32175 consensus_queue.cc:260] T c4e25ed804064ec485ca6bca45abdb06 P a4632fdbe3fd4678a5a57275c077138a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe00bf42aff43b5be70835cd6f08b3c" member_type: VOTER last_known_addr { host: "127.17.136.2" port: 44529 } } peers { permanent_uuid: "2c12418b9eda4943b132c69370a1d644" member_type: VOTER last_known_addr { host: "127.17.136.1" port: 36919 } } peers { permanent_uuid: "a4632fdbe3fd4678a5a57275c077138a" member_type: VOTER last_known_addr { host: "127.17.136.3" port: 35877 } }
I20260927 15:14:35.268328 32176 raft_consensus.cc:348] T c4e25ed804064ec485ca6bca45abdb06 P cfe00bf42aff43b5be70835cd6f08b3c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe00bf42aff43b5be70835cd6f08b3c" member_type: VOTER last_known_addr { host: "127.17.136.2" port: 44529 } } peers { permanent_uuid: "2c12418b9eda4943b132c69370a1d644" member_type: VOTER last_known_addr { host: "127.17.136.1" port: 36919 } } peers { permanent_uuid: "a4632fdbe3fd4678a5a57275c077138a" member_type: VOTER last_known_addr { host: "127.17.136.3" port: 35877 } }
I20260927 15:14:35.268610 31890 heartbeater.cc:503] Master 127.17.136.62:42541 was elected leader, sending a full tablet report...
I20260927 15:14:35.268615 32176 raft_consensus.cc:374] T c4e25ed804064ec485ca6bca45abdb06 P cfe00bf42aff43b5be70835cd6f08b3c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:14:35.268666 32176 raft_consensus.cc:729] T c4e25ed804064ec485ca6bca45abdb06 P cfe00bf42aff43b5be70835cd6f08b3c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cfe00bf42aff43b5be70835cd6f08b3c, State: Initialized, Role: FOLLOWER
I20260927 15:14:35.268951 32177 ts_tablet_manager.cc:1428] T c4e25ed804064ec485ca6bca45abdb06 P 2c12418b9eda4943b132c69370a1d644: Time spent starting tablet: real 0.004s user 0.005s sys 0.000s
I20260927 15:14:35.269039 32176 consensus_queue.cc:260] T c4e25ed804064ec485ca6bca45abdb06 P cfe00bf42aff43b5be70835cd6f08b3c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe00bf42aff43b5be70835cd6f08b3c" member_type: VOTER last_known_addr { host: "127.17.136.2" port: 44529 } } peers { permanent_uuid: "2c12418b9eda4943b132c69370a1d644" member_type: VOTER last_known_addr { host: "127.17.136.1" port: 36919 } } peers { permanent_uuid: "a4632fdbe3fd4678a5a57275c077138a" member_type: VOTER last_known_addr { host: "127.17.136.3" port: 35877 } }
I20260927 15:14:35.269116 32175 ts_tablet_manager.cc:1428] T c4e25ed804064ec485ca6bca45abdb06 P a4632fdbe3fd4678a5a57275c077138a: Time spent starting tablet: real 0.006s user 0.005s sys 0.000s
I20260927 15:14:35.269420 32158 heartbeater.cc:503] Master 127.17.136.62:42541 was elected leader, sending a full tablet report...
I20260927 15:14:35.269618 32024 heartbeater.cc:503] Master 127.17.136.62:42541 was elected leader, sending a full tablet report...
I20260927 15:14:35.269862 32176 ts_tablet_manager.cc:1428] T c4e25ed804064ec485ca6bca45abdb06 P cfe00bf42aff43b5be70835cd6f08b3c: Time spent starting tablet: real 0.005s user 0.006s sys 0.000s
W20260927 15:14:35.301184 31891 tablet.cc:2369] T c4e25ed804064ec485ca6bca45abdb06 P 2c12418b9eda4943b132c69370a1d644: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260927 15:14:35.422713 32183 raft_consensus.cc:482] T c4e25ed804064ec485ca6bca45abdb06 P cfe00bf42aff43b5be70835cd6f08b3c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:14:35.422931 32183 raft_consensus.cc:504] T c4e25ed804064ec485ca6bca45abdb06 P cfe00bf42aff43b5be70835cd6f08b3c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe00bf42aff43b5be70835cd6f08b3c" member_type: VOTER last_known_addr { host: "127.17.136.2" port: 44529 } } peers { permanent_uuid: "2c12418b9eda4943b132c69370a1d644" member_type: VOTER last_known_addr { host: "127.17.136.1" port: 36919 } } peers { permanent_uuid: "a4632fdbe3fd4678a5a57275c077138a" member_type: VOTER last_known_addr { host: "127.17.136.3" port: 35877 } }
I20260927 15:14:35.424105 32183 leader_election.cc:288] T c4e25ed804064ec485ca6bca45abdb06 P cfe00bf42aff43b5be70835cd6f08b3c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2c12418b9eda4943b132c69370a1d644 (127.17.136.1:36919), a4632fdbe3fd4678a5a57275c077138a (127.17.136.3:35877)
I20260927 15:14:35.427682 32026 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:14:35.424357 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.1:36919 (local address 127.17.136.2:59893)
0927 15:14:35.424476 (+ 119us) negotiation.cc:107] Waiting for socket to connect
0927 15:14:35.424492 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0927 15:14:35.424598 (+ 106us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0927 15:14:35.424822 (+ 224us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0927 15:14:35.424825 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0927 15:14:35.424842 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0927 15:14:35.424946 (+ 104us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:14:35.424951 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:14:35.425642 (+ 691us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:14:35.425646 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:14:35.426453 (+ 807us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:14:35.426461 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:14:35.427287 (+ 826us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:14:35.427290 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:14:35.427396 (+ 106us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:14:35.427413 (+ 17us) client_negotiation.cc:769] Sending connection context
0927 15:14:35.427476 (+ 63us) client_negotiation.cc:240] Negotiation successful
0927 15:14:35.427548 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":32}
I20260927 15:14:35.427685 32174 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:14:35.424448 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.136.2:59893 (local address 127.17.136.1:36919)
0927 15:14:35.424583 (+ 135us) server_negotiation.cc:206] Beginning negotiation
0927 15:14:35.424588 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0927 15:14:35.424603 (+ 15us) server_negotiation.cc:407] Connection header received
0927 15:14:35.424691 (+ 88us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:14:35.424694 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:14:35.424739 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:14:35.424802 (+ 63us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0927 15:14:35.425051 (+ 249us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:14:35.425547 (+ 496us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:14:35.426579 (+ 1032us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:14:35.427147 (+ 568us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:14:35.427270 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:14:35.427331 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0927 15:14:35.427505 (+ 174us) server_negotiation.cc:299] Negotiation successful
0927 15:14:35.427585 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
I20260927 15:14:35.428182 32184 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:14:35.424357 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.3:35877 (local address 127.17.136.2:50607)
0927 15:14:35.424838 (+ 481us) negotiation.cc:107] Waiting for socket to connect
0927 15:14:35.424849 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0927 15:14:35.424944 (+ 95us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0927 15:14:35.425170 (+ 226us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0927 15:14:35.425173 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0927 15:14:35.425187 (+ 14us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0927 15:14:35.425286 (+ 99us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:14:35.425291 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:14:35.425973 (+ 682us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:14:35.425977 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:14:35.426962 (+ 985us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:14:35.426971 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:14:35.427753 (+ 782us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:14:35.427757 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:14:35.427852 (+ 95us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:14:35.427874 (+ 22us) client_negotiation.cc:769] Sending connection context
0927 15:14:35.427977 (+ 103us) client_negotiation.cc:240] Negotiation successful
0927 15:14:35.428045 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":426,"mutex_wait_us":126,"thread_start_us":137,"threads_started":1}
I20260927 15:14:35.428222 32173 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:14:35.424471 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.136.2:50607 (local address 127.17.136.3:35877)
0927 15:14:35.424593 (+ 122us) server_negotiation.cc:206] Beginning negotiation
0927 15:14:35.424598 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0927 15:14:35.424930 (+ 332us) server_negotiation.cc:407] Connection header received
0927 15:14:35.425043 (+ 113us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:14:35.425046 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:14:35.425088 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:14:35.425148 (+ 60us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0927 15:14:35.425388 (+ 240us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:14:35.425877 (+ 489us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:14:35.427096 (+ 1219us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:14:35.427623 (+ 527us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:14:35.427736 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:14:35.427785 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0927 15:14:35.428025 (+ 240us) server_negotiation.cc:299] Negotiation successful
0927 15:14:35.428111 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260927 15:14:35.428385 31844 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c4e25ed804064ec485ca6bca45abdb06" candidate_uuid: "cfe00bf42aff43b5be70835cd6f08b3c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c12418b9eda4943b132c69370a1d644" is_pre_election: true
I20260927 15:14:35.428725 31844 raft_consensus.cc:2454] T c4e25ed804064ec485ca6bca45abdb06 P 2c12418b9eda4943b132c69370a1d644 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cfe00bf42aff43b5be70835cd6f08b3c in term 0.
I20260927 15:14:35.428871 32112 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c4e25ed804064ec485ca6bca45abdb06" candidate_uuid: "cfe00bf42aff43b5be70835cd6f08b3c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a4632fdbe3fd4678a5a57275c077138a" is_pre_election: true
I20260927 15:14:35.429172 32112 raft_consensus.cc:2454] T c4e25ed804064ec485ca6bca45abdb06 P a4632fdbe3fd4678a5a57275c077138a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cfe00bf42aff43b5be70835cd6f08b3c in term 0.
I20260927 15:14:35.429170 31912 leader_election.cc:302] T c4e25ed804064ec485ca6bca45abdb06 P cfe00bf42aff43b5be70835cd6f08b3c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c12418b9eda4943b132c69370a1d644, cfe00bf42aff43b5be70835cd6f08b3c; no voters:
I20260927 15:14:35.429517 32183 raft_consensus.cc:2781] T c4e25ed804064ec485ca6bca45abdb06 P cfe00bf42aff43b5be70835cd6f08b3c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 15:14:35.429589 32183 raft_consensus.cc:482] T c4e25ed804064ec485ca6bca45abdb06 P cfe00bf42aff43b5be70835cd6f08b3c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 15:14:35.429631 32183 raft_consensus.cc:3037] T c4e25ed804064ec485ca6bca45abdb06 P cfe00bf42aff43b5be70835cd6f08b3c [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:14:35.430608 32183 raft_consensus.cc:504] T c4e25ed804064ec485ca6bca45abdb06 P cfe00bf42aff43b5be70835cd6f08b3c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe00bf42aff43b5be70835cd6f08b3c" member_type: VOTER last_known_addr { host: "127.17.136.2" port: 44529 } } peers { permanent_uuid: "2c12418b9eda4943b132c69370a1d644" member_type: VOTER last_known_addr { host: "127.17.136.1" port: 36919 } } peers { permanent_uuid: "a4632fdbe3fd4678a5a57275c077138a" member_type: VOTER last_known_addr { host: "127.17.136.3" port: 35877 } }
I20260927 15:14:35.430932 32183 leader_election.cc:288] T c4e25ed804064ec485ca6bca45abdb06 P cfe00bf42aff43b5be70835cd6f08b3c [CANDIDATE]: Term 1 election: Requested vote from peers 2c12418b9eda4943b132c69370a1d644 (127.17.136.1:36919), a4632fdbe3fd4678a5a57275c077138a (127.17.136.3:35877)
I20260927 15:14:35.431299 32112 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c4e25ed804064ec485ca6bca45abdb06" candidate_uuid: "cfe00bf42aff43b5be70835cd6f08b3c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a4632fdbe3fd4678a5a57275c077138a"
I20260927 15:14:35.431299 31844 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c4e25ed804064ec485ca6bca45abdb06" candidate_uuid: "cfe00bf42aff43b5be70835cd6f08b3c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c12418b9eda4943b132c69370a1d644"
I20260927 15:14:35.431418 32112 raft_consensus.cc:3037] T c4e25ed804064ec485ca6bca45abdb06 P a4632fdbe3fd4678a5a57275c077138a [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:14:35.431418 31844 raft_consensus.cc:3037] T c4e25ed804064ec485ca6bca45abdb06 P 2c12418b9eda4943b132c69370a1d644 [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:14:35.432636 32112 raft_consensus.cc:2454] T c4e25ed804064ec485ca6bca45abdb06 P a4632fdbe3fd4678a5a57275c077138a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cfe00bf42aff43b5be70835cd6f08b3c in term 1.
I20260927 15:14:35.432636 31844 raft_consensus.cc:2454] T c4e25ed804064ec485ca6bca45abdb06 P 2c12418b9eda4943b132c69370a1d644 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cfe00bf42aff43b5be70835cd6f08b3c in term 1.
I20260927 15:14:35.432888 31914 leader_election.cc:302] T c4e25ed804064ec485ca6bca45abdb06 P cfe00bf42aff43b5be70835cd6f08b3c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a4632fdbe3fd4678a5a57275c077138a, cfe00bf42aff43b5be70835cd6f08b3c; no voters:
I20260927 15:14:35.433086 32183 raft_consensus.cc:2781] T c4e25ed804064ec485ca6bca45abdb06 P cfe00bf42aff43b5be70835cd6f08b3c [term 1 FOLLOWER]: Leader election won for term 1
I20260927 15:14:35.433274 32183 raft_consensus.cc:686] T c4e25ed804064ec485ca6bca45abdb06 P cfe00bf42aff43b5be70835cd6f08b3c [term 1 LEADER]: Becoming Leader. State: Replica: cfe00bf42aff43b5be70835cd6f08b3c, State: Running, Role: LEADER
I20260927 15:14:35.433589 32183 consensus_queue.cc:237] T c4e25ed804064ec485ca6bca45abdb06 P cfe00bf42aff43b5be70835cd6f08b3c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe00bf42aff43b5be70835cd6f08b3c" member_type: VOTER last_known_addr { host: "127.17.136.2" port: 44529 } } peers { permanent_uuid: "2c12418b9eda4943b132c69370a1d644" member_type: VOTER last_known_addr { host: "127.17.136.1" port: 36919 } } peers { permanent_uuid: "a4632fdbe3fd4678a5a57275c077138a" member_type: VOTER last_known_addr { host: "127.17.136.3" port: 35877 } }
I20260927 15:14:35.436638 31696 catalog_manager.cc:5495] T c4e25ed804064ec485ca6bca45abdb06 P cfe00bf42aff43b5be70835cd6f08b3c reported cstate change: term changed from 0 to 1, leader changed from <none> to cfe00bf42aff43b5be70835cd6f08b3c (127.17.136.2). New cstate: current_term: 1 leader_uuid: "cfe00bf42aff43b5be70835cd6f08b3c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe00bf42aff43b5be70835cd6f08b3c" member_type: VOTER last_known_addr { host: "127.17.136.2" port: 44529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2c12418b9eda4943b132c69370a1d644" member_type: VOTER last_known_addr { host: "127.17.136.1" port: 36919 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a4632fdbe3fd4678a5a57275c077138a" member_type: VOTER last_known_addr { host: "127.17.136.3" port: 35877 } health_report { overall_health: UNKNOWN } } }
W20260927 15:14:35.452692 32159 tablet.cc:2369] T c4e25ed804064ec485ca6bca45abdb06 P a4632fdbe3fd4678a5a57275c077138a: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260927 15:14:35.480499 32171 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:14:35.477154 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39040 (local address 127.17.136.2:44529)
0927 15:14:35.477281 (+ 127us) server_negotiation.cc:206] Beginning negotiation
0927 15:14:35.477285 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0927 15:14:35.477297 (+ 12us) server_negotiation.cc:407] Connection header received
0927 15:14:35.477425 (+ 128us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:14:35.477427 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:14:35.477486 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:14:35.477578 (+ 92us) server_negotiation.cc:226] Negotiated authn=TOKEN
0927 15:14:35.477752 (+ 174us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:14:35.478247 (+ 495us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:14:35.479283 (+ 1036us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:14:35.479539 (+ 256us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:14:35.479619 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:14:35.479837 (+ 218us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0927 15:14:35.480239 (+ 402us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0927 15:14:35.480320 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0927 15:14:35.480347 (+ 27us) server_negotiation.cc:299] Negotiation successful
0927 15:14:35.480392 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260927 15:14:35.485914 31844 raft_consensus.cc:1261] T c4e25ed804064ec485ca6bca45abdb06 P 2c12418b9eda4943b132c69370a1d644 [term 1 FOLLOWER]: Refusing update from remote peer cfe00bf42aff43b5be70835cd6f08b3c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260927 15:14:35.485913 32112 raft_consensus.cc:1261] T c4e25ed804064ec485ca6bca45abdb06 P a4632fdbe3fd4678a5a57275c077138a [term 1 FOLLOWER]: Refusing update from remote peer cfe00bf42aff43b5be70835cd6f08b3c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260927 15:14:35.486533 32185 consensus_queue.cc:1035] T c4e25ed804064ec485ca6bca45abdb06 P cfe00bf42aff43b5be70835cd6f08b3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c12418b9eda4943b132c69370a1d644" member_type: VOTER last_known_addr { host: "127.17.136.1" port: 36919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260927 15:14:35.486701 32183 consensus_queue.cc:1035] T c4e25ed804064ec485ca6bca45abdb06 P cfe00bf42aff43b5be70835cd6f08b3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4632fdbe3fd4678a5a57275c077138a" member_type: VOTER last_known_addr { host: "127.17.136.3" port: 35877 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260927 15:14:35.494007 32190 mvcc.cc:205] Tried to move back new op lower bound from 7333978421183803392 to 7333978420978573312. Current Snapshot: MvccSnapshot[applied={T|T < 7333978421183803392}]
I20260927 15:14:35.494166 32189 mvcc.cc:205] Tried to move back new op lower bound from 7333978421183803392 to 7333978420978573312. Current Snapshot: MvccSnapshot[applied={T|T < 7333978421183803392}]
I20260927 15:14:35.500383 31697 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:45356:
table { table_name: "test-table" } modify_external_catalogs: true
I20260927 15:14:35.500524 31697 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:45356:
table { table_name: "test-table" } modify_external_catalogs: true
I20260927 15:14:35.502518 31697 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 619c4b9f4fe842a89844dd0897d3bbc0: Sending DeleteTablet for 3 replicas of tablet c4e25ed804064ec485ca6bca45abdb06
I20260927 15:14:35.503152 31824 tablet_service.cc:1514] Processing DeleteTablet for tablet c4e25ed804064ec485ca6bca45abdb06 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:14:35 UTC) from {username='kudu', principal='kudu/127.17.136.62@KRBTEST.COM'} at 127.0.0.1:48874
I20260927 15:14:35.503170 31958 tablet_service.cc:1514] Processing DeleteTablet for tablet c4e25ed804064ec485ca6bca45abdb06 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:14:35 UTC) from {username='kudu', principal='kudu/127.17.136.62@KRBTEST.COM'} at 127.0.0.1:39038
I20260927 15:14:35.503235 32092 tablet_service.cc:1514] Processing DeleteTablet for tablet c4e25ed804064ec485ca6bca45abdb06 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:14:35 UTC) from {username='kudu', principal='kudu/127.17.136.62@KRBTEST.COM'} at 127.0.0.1:38176
I20260927 15:14:35.503679 32199 tablet_replica.cc:330] T c4e25ed804064ec485ca6bca45abdb06 P a4632fdbe3fd4678a5a57275c077138a: stopping tablet replica
I20260927 15:14:35.503836 32197 tablet_replica.cc:330] T c4e25ed804064ec485ca6bca45abdb06 P cfe00bf42aff43b5be70835cd6f08b3c: stopping tablet replica
I20260927 15:14:35.503865 17952 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu with pid 31761
I20260927 15:14:35.503983 32199 raft_consensus.cc:2229] T c4e25ed804064ec485ca6bca45abdb06 P a4632fdbe3fd4678a5a57275c077138a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260927 15:14:35.504079 32197 raft_consensus.cc:2229] T c4e25ed804064ec485ca6bca45abdb06 P cfe00bf42aff43b5be70835cd6f08b3c [term 1 LEADER]: Raft consensus shutting down.
I20260927 15:14:35.504251 32199 raft_consensus.cc:2258] T c4e25ed804064ec485ca6bca45abdb06 P a4632fdbe3fd4678a5a57275c077138a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 15:14:35.504472 32197 raft_consensus.cc:2258] T c4e25ed804064ec485ca6bca45abdb06 P cfe00bf42aff43b5be70835cd6f08b3c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 15:14:35.505653 32199 ts_tablet_manager.cc:1905] T c4e25ed804064ec485ca6bca45abdb06 P a4632fdbe3fd4678a5a57275c077138a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:14:35.505653 32197 ts_tablet_manager.cc:1905] T c4e25ed804064ec485ca6bca45abdb06 P cfe00bf42aff43b5be70835cd6f08b3c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:14:35.508160 32197 ts_tablet_manager.cc:1918] T c4e25ed804064ec485ca6bca45abdb06 P cfe00bf42aff43b5be70835cd6f08b3c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260927 15:14:35.508160 32199 ts_tablet_manager.cc:1918] T c4e25ed804064ec485ca6bca45abdb06 P a4632fdbe3fd4678a5a57275c077138a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260927 15:14:35.508255 32199 log.cc:1196] T c4e25ed804064ec485ca6bca45abdb06 P a4632fdbe3fd4678a5a57275c077138a: Deleting WAL directory at /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790521920546562-17952-0/minicluster-data/ts-2/wal/wals/c4e25ed804064ec485ca6bca45abdb06
I20260927 15:14:35.508262 32197 log.cc:1196] T c4e25ed804064ec485ca6bca45abdb06 P cfe00bf42aff43b5be70835cd6f08b3c: Deleting WAL directory at /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790521920546562-17952-0/minicluster-data/ts-1/wal/wals/c4e25ed804064ec485ca6bca45abdb06
I20260927 15:14:35.508533 32197 ts_tablet_manager.cc:1939] T c4e25ed804064ec485ca6bca45abdb06 P cfe00bf42aff43b5be70835cd6f08b3c: Deleting consensus metadata
I20260927 15:14:35.509598 31683 catalog_manager.cc:4841] TS cfe00bf42aff43b5be70835cd6f08b3c (127.17.136.2:44529): tablet c4e25ed804064ec485ca6bca45abdb06 (table test-table [id=14347e7e5f3d48ba9bd6e9b9da488762]) successfully deleted
I20260927 15:14:35.511986 32199 ts_tablet_manager.cc:1939] T c4e25ed804064ec485ca6bca45abdb06 P a4632fdbe3fd4678a5a57275c077138a: Deleting consensus metadata
W20260927 15:14:35.512485 31684 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.17.136.1:36919 (error 108)
I20260927 15:14:35.512527 17952 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu with pid 31895
I20260927 15:14:35.513934 32170 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:14:35.513464 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.1:36919 (local address 127.0.0.1:48884)
0927 15:14:35.513777 (+ 313us) negotiation.cc:107] Waiting for socket to connect
0927 15:14:35.513848 (+ 71us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.136.1:36919: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":226}
I20260927 15:14:35.514039 31686 catalog_manager.cc:4841] TS a4632fdbe3fd4678a5a57275c077138a (127.17.136.3:35877): tablet c4e25ed804064ec485ca6bca45abdb06 (table test-table [id=14347e7e5f3d48ba9bd6e9b9da488762]) successfully deleted
W20260927 15:14:35.514403 31684 catalog_manager.cc:4584] TS 2c12418b9eda4943b132c69370a1d644 (127.17.136.1:36919): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet c4e25ed804064ec485ca6bca45abdb06: Network error: Client connection negotiation failed: client connection to 127.17.136.1:36919: connect: Connection refused (error 111)
I20260927 15:14:35.517962 17952 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu with pid 32029
I20260927 15:14:35.522639 17952 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu with pid 31667
I20260927 15:14:35.527791 17952 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu
/tmp/dist-test-taskiFOyeW/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790521920546562-17952-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790521920546562-17952-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790521920546562-17952-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790521920546562-17952-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.136.62:42541
--webserver_interface=127.17.136.62
--webserver_port=37927
--keytab_file=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790521920546562-17952-0/krb5kdc/kudu_127.17.136.62.keytab
--principal=kudu/127.17.136.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.136.20:39235
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.136.62:42541
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--ipki_private_key_password_cmd=echo foo with env {KRB5CCNAME=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790521920546562-17952-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790521920546562-17952-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790521920546562-17952-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260927 15:14:35.634081 32201 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260927 15:14:35.634337 32201 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260927 15:14:35.634382 32201 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260927 15:14:35.638317 32201 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260927 15:14:35.638375 32201 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260927 15:14:35.638393 32201 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260927 15:14:35.638408 32201 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260927 15:14:35.638428 32201 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260927 15:14:35.643697 32201 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.136.20:39235
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790521920546562-17952-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790521920546562-17952-0/minicluster-data/master-0/wal
--ipki_private_key_password_cmd=echo foo
--ipki_ca_key_size=768
--master_addresses=127.17.136.62:42541
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790521920546562-17952-0/krb5kdc/kudu_127.17.136.62.keytab
--principal=kudu/127.17.136.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.136.62:42541
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790521920546562-17952-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.17.136.62
--webserver_port=37927
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32201
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790521920546562-17952-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 27 Sep 2026 14:27:13 UTC on ccycloud.quasar-psqrth.root.comops.site
build id 4676138
I20260927 15:14:35.644724 32201 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260927 15:14:35.645721 32201 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260927 15:14:35.658272 32207 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260927 15:14:35.658272 32210 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260927 15:14:35.658388 32201 server_base.cc:1034] running on GCE node
W20260927 15:14:35.658272 32208 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260927 15:14:35.659226 32201 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260927 15:14:35.660439 32201 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260927 15:14:35.661604 32201 hybrid_clock.cc:648] HybridClock initialized: now 1790522075661582 us; error 32 us; skew 500 ppm
Sep 27 15:14:35 dist-test-slave-5s2t krb5kdc[31654](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790522075, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.136.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260927 15:14:35.664242 32201 init.cc:377] Logged in from keytab as kudu/127.17.136.62@KRBTEST.COM (short username kudu)
I20260927 15:14:35.665102 32201 webserver.cc:460] Webserver started at http://127.17.136.62:37927/ using document root <none> and password file <none>
I20260927 15:14:35.665653 32201 fs_manager.cc:359] Metadata directory not provided
I20260927 15:14:35.665729 32201 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260927 15:14:35.669579 32201 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.004s sys 0.000s
I20260927 15:14:35.671762 32217 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260927 15:14:35.672940 32201 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260927 15:14:35.673065 32201 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790521920546562-17952-0/minicluster-data/master-0/data,/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790521920546562-17952-0/minicluster-data/master-0/wal
uuid: "619c4b9f4fe842a89844dd0897d3bbc0"
format_stamp: "Formatted at 2026-09-27 15:14:34 on dist-test-slave-5s2t"
server_key: "6b93fe1a90c20b46f9f06e018dac52af"
server_key_iv: "caaa606c3983b45683431eb6d13c4dd4"
server_key_version: "encryptionkey@0"
I20260927 15:14:35.673635 32201 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790521920546562-17952-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790521920546562-17952-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790521920546562-17952-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260927 15:14:35.692556 32201 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260927 15:14:35.695371 32201 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260927 15:14:35.695544 32201 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260927 15:14:35.701964 32201 rpc_server.cc:307] RPC server started. Bound to: 127.17.136.62:42541
I20260927 15:14:35.702210 32269 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.136.62:42541 every 8 connection(s)
I20260927 15:14:35.703047 32201 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790521920546562-17952-0/minicluster-data/master-0/data/info.pb
I20260927 15:14:35.703720 17952 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu as pid 32201
I20260927 15:14:35.704095 17952 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu
/tmp/dist-test-taskiFOyeW/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790521920546562-17952-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790521920546562-17952-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790521920546562-17952-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790521920546562-17952-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.136.1:36919
--local_ip_for_outbound_sockets=127.17.136.1
--tserver_master_addrs=127.17.136.62:42541
--webserver_port=40831
--webserver_interface=127.17.136.1
--keytab_file=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790521920546562-17952-0/krb5kdc/kudu_127.17.136.1.keytab
--principal=kudu/127.17.136.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.136.20:39235
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790521920546562-17952-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790521920546562-17952-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790521920546562-17952-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260927 15:14:35.707335 32270 sys_catalog.cc:263] Verifying existing consensus state
I20260927 15:14:35.708954 32270 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 619c4b9f4fe842a89844dd0897d3bbc0: Bootstrap starting.
I20260927 15:14:35.725232 32270 log.cc:824] T 00000000000000000000000000000000 P 619c4b9f4fe842a89844dd0897d3bbc0: Log is configured to *not* fsync() on all Append() calls
I20260927 15:14:35.733525 32270 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 619c4b9f4fe842a89844dd0897d3bbc0: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=5 ignored=0} mutations{seen=4 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260927 15:14:35.733839 32270 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 619c4b9f4fe842a89844dd0897d3bbc0: Bootstrap complete.
I20260927 15:14:35.737576 32270 raft_consensus.cc:348] T 00000000000000000000000000000000 P 619c4b9f4fe842a89844dd0897d3bbc0 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "619c4b9f4fe842a89844dd0897d3bbc0" member_type: VOTER last_known_addr { host: "127.17.136.62" port: 42541 } }
I20260927 15:14:35.737951 32270 raft_consensus.cc:729] T 00000000000000000000000000000000 P 619c4b9f4fe842a89844dd0897d3bbc0 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 619c4b9f4fe842a89844dd0897d3bbc0, State: Initialized, Role: FOLLOWER
I20260927 15:14:35.738421 32270 consensus_queue.cc:260] T 00000000000000000000000000000000 P 619c4b9f4fe842a89844dd0897d3bbc0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "619c4b9f4fe842a89844dd0897d3bbc0" member_type: VOTER last_known_addr { host: "127.17.136.62" port: 42541 } }
I20260927 15:14:35.738554 32270 raft_consensus.cc:388] T 00000000000000000000000000000000 P 619c4b9f4fe842a89844dd0897d3bbc0 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260927 15:14:35.738626 32270 raft_consensus.cc:482] T 00000000000000000000000000000000 P 619c4b9f4fe842a89844dd0897d3bbc0 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260927 15:14:35.738718 32270 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 619c4b9f4fe842a89844dd0897d3bbc0 [term 1 FOLLOWER]: Advancing to term 2
I20260927 15:14:35.740576 32270 raft_consensus.cc:504] T 00000000000000000000000000000000 P 619c4b9f4fe842a89844dd0897d3bbc0 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "619c4b9f4fe842a89844dd0897d3bbc0" member_type: VOTER last_known_addr { host: "127.17.136.62" port: 42541 } }
I20260927 15:14:35.740885 32270 leader_election.cc:302] T 00000000000000000000000000000000 P 619c4b9f4fe842a89844dd0897d3bbc0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 619c4b9f4fe842a89844dd0897d3bbc0; no voters:
I20260927 15:14:35.741176 32270 leader_election.cc:288] T 00000000000000000000000000000000 P 619c4b9f4fe842a89844dd0897d3bbc0 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260927 15:14:35.741297 32274 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 619c4b9f4fe842a89844dd0897d3bbc0 [term 2 FOLLOWER]: Leader election won for term 2
I20260927 15:14:35.741532 32274 raft_consensus.cc:686] T 00000000000000000000000000000000 P 619c4b9f4fe842a89844dd0897d3bbc0 [term 2 LEADER]: Becoming Leader. State: Replica: 619c4b9f4fe842a89844dd0897d3bbc0, State: Running, Role: LEADER
I20260927 15:14:35.741865 32274 consensus_queue.cc:237] T 00000000000000000000000000000000 P 619c4b9f4fe842a89844dd0897d3bbc0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "619c4b9f4fe842a89844dd0897d3bbc0" member_type: VOTER last_known_addr { host: "127.17.136.62" port: 42541 } }
I20260927 15:14:35.742376 32270 sys_catalog.cc:564] T 00000000000000000000000000000000 P 619c4b9f4fe842a89844dd0897d3bbc0 [sys.catalog]: configured and running, proceeding with master startup.
I20260927 15:14:35.743232 32276 sys_catalog.cc:455] T 00000000000000000000000000000000 P 619c4b9f4fe842a89844dd0897d3bbc0 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 619c4b9f4fe842a89844dd0897d3bbc0. Latest consensus state: current_term: 2 leader_uuid: "619c4b9f4fe842a89844dd0897d3bbc0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "619c4b9f4fe842a89844dd0897d3bbc0" member_type: VOTER last_known_addr { host: "127.17.136.62" port: 42541 } } }
I20260927 15:14:35.743455 32276 sys_catalog.cc:458] T 00000000000000000000000000000000 P 619c4b9f4fe842a89844dd0897d3bbc0 [sys.catalog]: This master's current role is: LEADER
I20260927 15:14:35.743340 32275 sys_catalog.cc:455] T 00000000000000000000000000000000 P 619c4b9f4fe842a89844dd0897d3bbc0 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "619c4b9f4fe842a89844dd0897d3bbc0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "619c4b9f4fe842a89844dd0897d3bbc0" member_type: VOTER last_known_addr { host: "127.17.136.62" port: 42541 } } }
I20260927 15:14:35.743803 32283 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260927 15:14:35.743824 32275 sys_catalog.cc:458] T 00000000000000000000000000000000 P 619c4b9f4fe842a89844dd0897d3bbc0 [sys.catalog]: This master's current role is: LEADER
I20260927 15:14:35.748286 32283 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260927 15:14:35.748917 32283 catalog_manager.cc:1259] Loaded cluster ID: eec749150f1140fe9b94481d699a02a6
I20260927 15:14:35.748966 32283 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260927 15:14:35.750023 32283 catalog_manager.cc:1314] IPKI private key was stored in cleartext, attempting to encrypt it.
I20260927 15:14:35.752789 32283 catalog_manager.cc:1324] IPKI private key successfully encrypted.
I20260927 15:14:35.757107 32283 catalog_manager.cc:1504] Loading token signing keys...
I20260927 15:14:35.757673 32283 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 619c4b9f4fe842a89844dd0897d3bbc0: Loaded TSK: 0
I20260927 15:14:35.758597 32283 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260927 15:14:35.831362 32272 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260927 15:14:35.831620 32272 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260927 15:14:35.831666 32272 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260927 15:14:35.835696 32272 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260927 15:14:35.835762 32272 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260927 15:14:35.835844 32272 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.136.1
I20260927 15:14:35.841131 32272 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.136.20:39235
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790521920546562-17952-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790521920546562-17952-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790521920546562-17952-0/krb5kdc/kudu_127.17.136.1.keytab
--principal=kudu/127.17.136.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.136.1:36919
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790521920546562-17952-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.17.136.1
--webserver_port=40831
--tserver_master_addrs=127.17.136.62:42541
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32272
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.136.1
--log_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790521920546562-17952-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 27 Sep 2026 14:27:13 UTC on ccycloud.quasar-psqrth.root.comops.site
build id 4676138
I20260927 15:14:35.842435 32272 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260927 15:14:35.843693 32272 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260927 15:14:35.853255 32300 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260927 15:14:35.853248 32298 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260927 15:14:35.853443 32272 server_base.cc:1034] running on GCE node
W20260927 15:14:35.853298 32297 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260927 15:14:35.854010 32272 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260927 15:14:35.854720 32272 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260927 15:14:35.855908 32272 hybrid_clock.cc:648] HybridClock initialized: now 1790522075855887 us; error 40 us; skew 500 ppm
Sep 27 15:14:35 dist-test-slave-5s2t krb5kdc[31654](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790522075, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.136.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260927 15:14:35.858603 32272 init.cc:377] Logged in from keytab as kudu/127.17.136.1@KRBTEST.COM (short username kudu)
I20260927 15:14:35.859556 32272 webserver.cc:460] Webserver started at http://127.17.136.1:40831/ using document root <none> and password file <none>
I20260927 15:14:35.860090 32272 fs_manager.cc:359] Metadata directory not provided
I20260927 15:14:35.860170 32272 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260927 15:14:35.863880 32272 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.003s sys 0.000s
I20260927 15:14:35.866338 32307 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260927 15:14:35.867714 32272 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260927 15:14:35.867830 32272 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790521920546562-17952-0/minicluster-data/ts-0/data,/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790521920546562-17952-0/minicluster-data/ts-0/wal
uuid: "2c12418b9eda4943b132c69370a1d644"
format_stamp: "Formatted at 2026-09-27 15:14:34 on dist-test-slave-5s2t"
server_key: "d2909d8ee09ad198ab012edeaff5ecbf"
server_key_iv: "568890b8d7bc40518cc25c3a14a60f9e"
server_key_version: "encryptionkey@0"
I20260927 15:14:35.868387 32272 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790521920546562-17952-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790521920546562-17952-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790521920546562-17952-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260927 15:14:35.885769 32272 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260927 15:14:35.888945 32272 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260927 15:14:35.889130 32272 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260927 15:14:35.889721 32272 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260927 15:14:35.890868 32314 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260927 15:14:35.896169 32272 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260927 15:14:35.896234 32272 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.006s user 0.000s sys 0.000s
I20260927 15:14:35.896302 32272 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260927 15:14:35.897886 32272 ts_tablet_manager.cc:610] Registered 1 tablets
I20260927 15:14:35.897929 32272 ts_tablet_manager.cc:589] Time spent register tablets: real 0.002s user 0.000s sys 0.000s
I20260927 15:14:35.898211 32314 tablet_bootstrap.cc:492] T c4e25ed804064ec485ca6bca45abdb06 P 2c12418b9eda4943b132c69370a1d644: Bootstrap starting.
I20260927 15:14:35.907306 32272 rpc_server.cc:307] RPC server started. Bound to: 127.17.136.1:36919
I20260927 15:14:35.907374 32421 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.136.1:36919 every 8 connection(s)
I20260927 15:14:35.908236 32272 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790521920546562-17952-0/minicluster-data/ts-0/data/info.pb
I20260927 15:14:35.910235 17952 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu as pid 32272
I20260927 15:14:35.910696 17952 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu
/tmp/dist-test-taskiFOyeW/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790521920546562-17952-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790521920546562-17952-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790521920546562-17952-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790521920546562-17952-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.136.2:44529
--local_ip_for_outbound_sockets=127.17.136.2
--tserver_master_addrs=127.17.136.62:42541
--webserver_port=36037
--webserver_interface=127.17.136.2
--keytab_file=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790521920546562-17952-0/krb5kdc/kudu_127.17.136.2.keytab
--principal=kudu/127.17.136.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.136.20:39235
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790521920546562-17952-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790521920546562-17952-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790521920546562-17952-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260927 15:14:35.917311 32314 log.cc:824] T c4e25ed804064ec485ca6bca45abdb06 P 2c12418b9eda4943b132c69370a1d644: Log is configured to *not* fsync() on all Append() calls
Sep 27 15:14:35 dist-test-slave-5s2t krb5kdc[31654](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790522075, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.136.1@KRBTEST.COM for kudu/127.17.136.62@KRBTEST.COM
I20260927 15:14:35.924136 32424 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:14:35.910300 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.136.1:43437 (local address 127.17.136.62:42541)
0927 15:14:35.910672 (+ 372us) server_negotiation.cc:206] Beginning negotiation
0927 15:14:35.910692 (+ 20us) server_negotiation.cc:399] Waiting for connection header
0927 15:14:35.911331 (+ 639us) server_negotiation.cc:407] Connection header received
0927 15:14:35.912423 (+ 1092us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:14:35.912433 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:14:35.912726 (+ 293us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:14:35.913024 (+ 298us) server_negotiation.cc:226] Negotiated authn=SASL
0927 15:14:35.914143 (+ 1119us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:14:35.915130 (+ 987us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:14:35.916293 (+ 1163us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:14:35.916749 (+ 456us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:14:35.916912 (+ 163us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:14:35.919446 (+ 2534us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0927 15:14:35.919451 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0927 15:14:35.919463 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0927 15:14:35.919490 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0927 15:14:35.921126 (+ 1636us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:14:35.921637 (+ 511us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:14:35.921641 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:14:35.921645 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:14:35.921757 (+ 112us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:14:35.922066 (+ 309us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:14:35.922068 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:14:35.922069 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:14:35.922391 (+ 322us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0927 15:14:35.922514 (+ 123us) server_negotiation.cc:1035] Waiting for connection context
0927 15:14:35.923025 (+ 511us) server_negotiation.cc:299] Negotiation successful
0927 15:14:35.923316 (+ 291us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":216,"thread_start_us":101,"threads_started":1}
I20260927 15:14:35.924155 32425 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:14:35.910292 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.62:42541 (local address 127.17.136.1:43437)
0927 15:14:35.911155 (+ 863us) negotiation.cc:107] Waiting for socket to connect
0927 15:14:35.911209 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0927 15:14:35.912026 (+ 817us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0927 15:14:35.913103 (+ 1077us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0927 15:14:35.913110 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0927 15:14:35.913510 (+ 400us) client_negotiation.cc:189] Negotiated authn=SASL
0927 15:14:35.913966 (+ 456us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:14:35.913980 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:14:35.915300 (+ 1320us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:14:35.915304 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:14:35.916179 (+ 875us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:14:35.916189 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:14:35.916877 (+ 688us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:14:35.916880 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:14:35.917066 (+ 186us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:14:35.917654 (+ 588us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0927 15:14:35.917675 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0927 15:14:35.919243 (+ 1568us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0927 15:14:35.921233 (+ 1990us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0927 15:14:35.921238 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0927 15:14:35.921251 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0927 15:14:35.921527 (+ 276us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0927 15:14:35.921840 (+ 313us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0927 15:14:35.921843 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0927 15:14:35.921845 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0927 15:14:35.921973 (+ 128us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0927 15:14:35.922496 (+ 523us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0927 15:14:35.922502 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0927 15:14:35.922726 (+ 224us) client_negotiation.cc:769] Sending connection context
0927 15:14:35.922881 (+ 155us) client_negotiation.cc:240] Negotiation successful
0927 15:14:35.923214 (+ 333us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":652,"thread_start_us":138,"threads_started":1}
I20260927 15:14:35.926172 32314 tablet_bootstrap.cc:492] T c4e25ed804064ec485ca6bca45abdb06 P 2c12418b9eda4943b132c69370a1d644: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260927 15:14:35.926563 32314 tablet_bootstrap.cc:492] T c4e25ed804064ec485ca6bca45abdb06 P 2c12418b9eda4943b132c69370a1d644: Bootstrap complete.
I20260927 15:14:35.926573 32422 heartbeater.cc:347] Connected to a master server at 127.17.136.62:42541
I20260927 15:14:35.926842 32422 heartbeater.cc:464] Registering TS with master...
I20260927 15:14:35.927345 32422 heartbeater.cc:511] Master 127.17.136.62:42541 requested a full tablet report, sending...
I20260927 15:14:35.927950 32314 ts_tablet_manager.cc:1397] T c4e25ed804064ec485ca6bca45abdb06 P 2c12418b9eda4943b132c69370a1d644: Time spent bootstrapping tablet: real 0.030s user 0.018s sys 0.010s
I20260927 15:14:35.929582 32234 ts_manager.cc:194] Registered new tserver with Master: 2c12418b9eda4943b132c69370a1d644 (127.17.136.1:36919)
I20260927 15:14:35.930819 32314 raft_consensus.cc:348] T c4e25ed804064ec485ca6bca45abdb06 P 2c12418b9eda4943b132c69370a1d644 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe00bf42aff43b5be70835cd6f08b3c" member_type: VOTER last_known_addr { host: "127.17.136.2" port: 44529 } } peers { permanent_uuid: "2c12418b9eda4943b132c69370a1d644" member_type: VOTER last_known_addr { host: "127.17.136.1" port: 36919 } } peers { permanent_uuid: "a4632fdbe3fd4678a5a57275c077138a" member_type: VOTER last_known_addr { host: "127.17.136.3" port: 35877 } }
I20260927 15:14:35.931373 32314 raft_consensus.cc:729] T c4e25ed804064ec485ca6bca45abdb06 P 2c12418b9eda4943b132c69370a1d644 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2c12418b9eda4943b132c69370a1d644, State: Initialized, Role: FOLLOWER
I20260927 15:14:35.931859 32314 consensus_queue.cc:260] T c4e25ed804064ec485ca6bca45abdb06 P 2c12418b9eda4943b132c69370a1d644 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe00bf42aff43b5be70835cd6f08b3c" member_type: VOTER last_known_addr { host: "127.17.136.2" port: 44529 } } peers { permanent_uuid: "2c12418b9eda4943b132c69370a1d644" member_type: VOTER last_known_addr { host: "127.17.136.1" port: 36919 } } peers { permanent_uuid: "a4632fdbe3fd4678a5a57275c077138a" member_type: VOTER last_known_addr { host: "127.17.136.3" port: 35877 } }
I20260927 15:14:35.932868 32314 ts_tablet_manager.cc:1428] T c4e25ed804064ec485ca6bca45abdb06 P 2c12418b9eda4943b132c69370a1d644: Time spent starting tablet: real 0.005s user 0.004s sys 0.000s
I20260927 15:14:35.932946 32234 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.136.1@KRBTEST.COM'} at 127.17.136.1:43437
I20260927 15:14:35.935326 32422 heartbeater.cc:503] Master 127.17.136.62:42541 was elected leader, sending a full tablet report...
I20260927 15:14:35.938712 32429 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:14:35.932325 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.1:36919 (local address 127.0.0.1:48886)
0927 15:14:35.933683 (+ 1358us) negotiation.cc:107] Waiting for socket to connect
0927 15:14:35.933733 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0927 15:14:35.933864 (+ 131us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0927 15:14:35.934703 (+ 839us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0927 15:14:35.934709 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0927 15:14:35.934734 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0927 15:14:35.934854 (+ 120us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:14:35.934861 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:14:35.936280 (+ 1419us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:14:35.936284 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:14:35.937308 (+ 1024us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:14:35.937318 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:14:35.938302 (+ 984us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:14:35.938305 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:14:35.938380 (+ 75us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:14:35.938409 (+ 29us) client_negotiation.cc:769] Sending connection context
0927 15:14:35.938500 (+ 91us) client_negotiation.cc:240] Negotiation successful
0927 15:14:35.938600 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1188,"thread_start_us":111,"threads_started":1}
I20260927 15:14:35.938768 32430 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:14:35.933062 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48886 (local address 127.17.136.1:36919)
0927 15:14:35.933429 (+ 367us) server_negotiation.cc:206] Beginning negotiation
0927 15:14:35.933439 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0927 15:14:35.933983 (+ 544us) server_negotiation.cc:407] Connection header received
0927 15:14:35.934051 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:14:35.934056 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:14:35.934535 (+ 479us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:14:35.934684 (+ 149us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0927 15:14:35.934959 (+ 275us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:14:35.936161 (+ 1202us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:14:35.937418 (+ 1257us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:14:35.938198 (+ 780us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:14:35.938310 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:14:35.938442 (+ 132us) server_negotiation.cc:1035] Waiting for connection context
0927 15:14:35.938537 (+ 95us) server_negotiation.cc:299] Negotiation successful
0927 15:14:35.938642 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":272,"thread_start_us":95,"threads_started":1}
I20260927 15:14:35.939730 32356 tablet_service.cc:1514] Processing DeleteTablet for tablet c4e25ed804064ec485ca6bca45abdb06 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:14:35 UTC) from {username='kudu', principal='kudu/127.17.136.62@KRBTEST.COM'} at 127.0.0.1:48886
I20260927 15:14:35.940672 32431 tablet_replica.cc:330] stopping tablet replica
I20260927 15:14:35.940924 32431 raft_consensus.cc:2229] T c4e25ed804064ec485ca6bca45abdb06 P 2c12418b9eda4943b132c69370a1d644 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260927 15:14:35.941131 32431 raft_consensus.cc:2258] T c4e25ed804064ec485ca6bca45abdb06 P 2c12418b9eda4943b132c69370a1d644 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 15:14:35.942008 32431 ts_tablet_manager.cc:1905] T c4e25ed804064ec485ca6bca45abdb06 P 2c12418b9eda4943b132c69370a1d644: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:14:35.945523 32431 ts_tablet_manager.cc:1918] T c4e25ed804064ec485ca6bca45abdb06 P 2c12418b9eda4943b132c69370a1d644: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260927 15:14:35.945606 32431 log.cc:1196] T c4e25ed804064ec485ca6bca45abdb06 P 2c12418b9eda4943b132c69370a1d644: Deleting WAL directory at /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790521920546562-17952-0/minicluster-data/ts-0/wal/wals/c4e25ed804064ec485ca6bca45abdb06
I20260927 15:14:35.945818 32431 ts_tablet_manager.cc:1939] T c4e25ed804064ec485ca6bca45abdb06 P 2c12418b9eda4943b132c69370a1d644: Deleting consensus metadata
I20260927 15:14:35.947461 32219 catalog_manager.cc:4841] TS 2c12418b9eda4943b132c69370a1d644 (127.17.136.1:36919): tablet c4e25ed804064ec485ca6bca45abdb06 (table test-table [id=14347e7e5f3d48ba9bd6e9b9da488762]) successfully deleted
W20260927 15:14:36.028344 32426 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260927 15:14:36.028602 32426 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260927 15:14:36.028649 32426 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260927 15:14:36.032747 32426 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260927 15:14:36.032801 32426 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260927 15:14:36.032863 32426 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.136.2
I20260927 15:14:36.038064 32426 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.136.20:39235
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790521920546562-17952-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790521920546562-17952-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790521920546562-17952-0/krb5kdc/kudu_127.17.136.2.keytab
--principal=kudu/127.17.136.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.136.2:44529
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790521920546562-17952-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.17.136.2
--webserver_port=36037
--tserver_master_addrs=127.17.136.62:42541
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32426
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.136.2
--log_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790521920546562-17952-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 27 Sep 2026 14:27:13 UTC on ccycloud.quasar-psqrth.root.comops.site
build id 4676138
I20260927 15:14:36.039108 32426 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260927 15:14:36.040102 32426 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260927 15:14:36.049463 32439 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260927 15:14:36.049458 32436 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260927 15:14:36.049711 32426 server_base.cc:1034] running on GCE node
W20260927 15:14:36.049458 32437 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260927 15:14:36.050208 32426 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260927 15:14:36.050804 32426 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260927 15:14:36.051954 32426 hybrid_clock.cc:648] HybridClock initialized: now 1790522076051933 us; error 52 us; skew 500 ppm
Sep 27 15:14:36 dist-test-slave-5s2t krb5kdc[31654](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790522076, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.136.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260927 15:14:36.054417 32426 init.cc:377] Logged in from keytab as kudu/127.17.136.2@KRBTEST.COM (short username kudu)
I20260927 15:14:36.055289 32426 webserver.cc:460] Webserver started at http://127.17.136.2:36037/ using document root <none> and password file <none>
I20260927 15:14:36.055810 32426 fs_manager.cc:359] Metadata directory not provided
I20260927 15:14:36.055886 32426 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260927 15:14:36.059577 32426 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.004s sys 0.000s
I20260927 15:14:36.061581 32446 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260927 15:14:36.062736 32426 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260927 15:14:36.062834 32426 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790521920546562-17952-0/minicluster-data/ts-1/data,/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790521920546562-17952-0/minicluster-data/ts-1/wal
uuid: "cfe00bf42aff43b5be70835cd6f08b3c"
format_stamp: "Formatted at 2026-09-27 15:14:34 on dist-test-slave-5s2t"
server_key: "41bfc98fb0319e4faf6c7cb286a1c4f4"
server_key_iv: "8fe0f887629898ad580486e7d93f5bd3"
server_key_version: "encryptionkey@0"
I20260927 15:14:36.063380 32426 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790521920546562-17952-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790521920546562-17952-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790521920546562-17952-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260927 15:14:36.083657 32426 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260927 15:14:36.086474 32426 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260927 15:14:36.086648 32426 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260927 15:14:36.087206 32426 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260927 15:14:36.087992 32426 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260927 15:14:36.088054 32426 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260927 15:14:36.088116 32426 ts_tablet_manager.cc:610] Registered 0 tablets
I20260927 15:14:36.088145 32426 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260927 15:14:36.096172 32426 rpc_server.cc:307] RPC server started. Bound to: 127.17.136.2:44529
I20260927 15:14:36.096201 32559 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.136.2:44529 every 8 connection(s)
I20260927 15:14:36.097088 32426 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790521920546562-17952-0/minicluster-data/ts-1/data/info.pb
I20260927 15:14:36.101419 17952 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu as pid 32426
I20260927 15:14:36.101775 17952 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu
/tmp/dist-test-taskiFOyeW/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790521920546562-17952-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790521920546562-17952-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790521920546562-17952-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790521920546562-17952-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.136.3:35877
--local_ip_for_outbound_sockets=127.17.136.3
--tserver_master_addrs=127.17.136.62:42541
--webserver_port=45393
--webserver_interface=127.17.136.3
--keytab_file=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790521920546562-17952-0/krb5kdc/kudu_127.17.136.3.keytab
--principal=kudu/127.17.136.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.136.20:39235
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790521920546562-17952-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790521920546562-17952-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790521920546562-17952-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Sep 27 15:14:36 dist-test-slave-5s2t krb5kdc[31654](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790522076, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.136.2@KRBTEST.COM for kudu/127.17.136.62@KRBTEST.COM
I20260927 15:14:36.110726 32424 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:14:36.098692 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.136.2:33671 (local address 127.17.136.62:42541)
0927 15:14:36.098828 (+ 136us) server_negotiation.cc:206] Beginning negotiation
0927 15:14:36.098833 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0927 15:14:36.099677 (+ 844us) server_negotiation.cc:407] Connection header received
0927 15:14:36.100893 (+ 1216us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:14:36.100895 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:14:36.100945 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:14:36.101014 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0927 15:14:36.102190 (+ 1176us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:14:36.102907 (+ 717us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:14:36.104469 (+ 1562us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:14:36.104709 (+ 240us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:14:36.104784 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:14:36.107467 (+ 2683us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0927 15:14:36.107470 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0927 15:14:36.107472 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0927 15:14:36.107497 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0927 15:14:36.108777 (+ 1280us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:14:36.109329 (+ 552us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:14:36.109332 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:14:36.109333 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:14:36.109399 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:14:36.109729 (+ 330us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:14:36.109730 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:14:36.109731 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:14:36.109887 (+ 156us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0927 15:14:36.109951 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0927 15:14:36.110504 (+ 553us) server_negotiation.cc:299] Negotiation successful
0927 15:14:36.110606 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260927 15:14:36.111855 32562 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:14:36.099100 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.62:42541 (local address 127.17.136.2:33671)
0927 15:14:36.099546 (+ 446us) negotiation.cc:107] Waiting for socket to connect
0927 15:14:36.099585 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0927 15:14:36.100719 (+ 1134us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0927 15:14:36.101167 (+ 448us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0927 15:14:36.101173 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0927 15:14:36.101518 (+ 345us) client_negotiation.cc:189] Negotiated authn=SASL
0927 15:14:36.102054 (+ 536us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:14:36.102069 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:14:36.103046 (+ 977us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:14:36.103049 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:14:36.104371 (+ 1322us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:14:36.104381 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:14:36.104839 (+ 458us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:14:36.104842 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:14:36.105025 (+ 183us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:14:36.105574 (+ 549us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0927 15:14:36.105592 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0927 15:14:36.107306 (+ 1714us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0927 15:14:36.108882 (+ 1576us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0927 15:14:36.108889 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0927 15:14:36.108904 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0927 15:14:36.109242 (+ 338us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0927 15:14:36.109472 (+ 230us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0927 15:14:36.109476 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0927 15:14:36.109478 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0927 15:14:36.109650 (+ 172us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0927 15:14:36.109972 (+ 322us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0927 15:14:36.109978 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0927 15:14:36.110281 (+ 303us) client_negotiation.cc:769] Sending connection context
0927 15:14:36.110478 (+ 197us) client_negotiation.cc:240] Negotiation successful
0927 15:14:36.110798 (+ 320us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":274,"thread_start_us":137,"threads_started":1}
I20260927 15:14:36.112941 32560 heartbeater.cc:347] Connected to a master server at 127.17.136.62:42541
I20260927 15:14:36.113179 32560 heartbeater.cc:464] Registering TS with master...
I20260927 15:14:36.113677 32560 heartbeater.cc:511] Master 127.17.136.62:42541 requested a full tablet report, sending...
I20260927 15:14:36.114691 32234 ts_manager.cc:194] Registered new tserver with Master: cfe00bf42aff43b5be70835cd6f08b3c (127.17.136.2:44529)
I20260927 15:14:36.115439 32234 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.136.2@KRBTEST.COM'} at 127.17.136.2:33671
W20260927 15:14:36.209863 32563 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260927 15:14:36.210124 32563 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260927 15:14:36.210168 32563 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260927 15:14:36.214097 32563 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260927 15:14:36.214147 32563 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260927 15:14:36.214201 32563 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.136.3
I20260927 15:14:36.219184 32563 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.136.20:39235
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790521920546562-17952-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790521920546562-17952-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790521920546562-17952-0/krb5kdc/kudu_127.17.136.3.keytab
--principal=kudu/127.17.136.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.136.3:35877
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790521920546562-17952-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.17.136.3
--webserver_port=45393
--tserver_master_addrs=127.17.136.62:42541
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32563
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.136.3
--log_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790521920546562-17952-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 27 Sep 2026 14:27:13 UTC on ccycloud.quasar-psqrth.root.comops.site
build id 4676138
I20260927 15:14:36.220167 32563 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260927 15:14:36.221125 32563 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260927 15:14:36.230139 32568 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260927 15:14:36.230175 32569 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260927 15:14:36.230393 32563 server_base.cc:1034] running on GCE node
W20260927 15:14:36.230173 32571 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260927 15:14:36.230787 32563 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260927 15:14:36.231437 32563 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260927 15:14:36.232584 32563 hybrid_clock.cc:648] HybridClock initialized: now 1790522076232566 us; error 30 us; skew 500 ppm
Sep 27 15:14:36 dist-test-slave-5s2t krb5kdc[31654](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790522076, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.136.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260927 15:14:36.235075 32563 init.cc:377] Logged in from keytab as kudu/127.17.136.3@KRBTEST.COM (short username kudu)
I20260927 15:14:36.235911 32563 webserver.cc:460] Webserver started at http://127.17.136.3:45393/ using document root <none> and password file <none>
I20260927 15:14:36.236517 32563 fs_manager.cc:359] Metadata directory not provided
I20260927 15:14:36.236600 32563 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260927 15:14:36.240334 32563 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.001s sys 0.003s
I20260927 15:14:36.242283 32578 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260927 15:14:36.243583 32563 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260927 15:14:36.243690 32563 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790521920546562-17952-0/minicluster-data/ts-2/data,/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790521920546562-17952-0/minicluster-data/ts-2/wal
uuid: "a4632fdbe3fd4678a5a57275c077138a"
format_stamp: "Formatted at 2026-09-27 15:14:35 on dist-test-slave-5s2t"
server_key: "5dae5570bf038468319d4de5bb6e5611"
server_key_iv: "e61e7e89875face082bce425b10b7c36"
server_key_version: "encryptionkey@0"
I20260927 15:14:36.244237 32563 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790521920546562-17952-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790521920546562-17952-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790521920546562-17952-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260927 15:14:36.261875 32563 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260927 15:14:36.264791 32563 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260927 15:14:36.264946 32563 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260927 15:14:36.265477 32563 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260927 15:14:36.266287 32563 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260927 15:14:36.266342 32563 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260927 15:14:36.266383 32563 ts_tablet_manager.cc:610] Registered 0 tablets
I20260927 15:14:36.266403 32563 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260927 15:14:36.274595 32563 rpc_server.cc:307] RPC server started. Bound to: 127.17.136.3:35877
I20260927 15:14:36.274626 32691 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.136.3:35877 every 8 connection(s)
I20260927 15:14:36.275556 32563 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790521920546562-17952-0/minicluster-data/ts-2/data/info.pb
I20260927 15:14:36.277973 17952 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu as pid 32563
Sep 27 15:14:36 dist-test-slave-5s2t krb5kdc[31654](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790522076, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.136.3@KRBTEST.COM for kudu/127.17.136.62@KRBTEST.COM
I20260927 15:14:36.285969 32696 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:14:36.278633 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45372 (local address 127.17.136.62:42541)
0927 15:14:36.278849 (+ 216us) server_negotiation.cc:206] Beginning negotiation
0927 15:14:36.278853 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0927 15:14:36.278910 (+ 57us) server_negotiation.cc:407] Connection header received
0927 15:14:36.279054 (+ 144us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:14:36.279057 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:14:36.279110 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:14:36.279205 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0927 15:14:36.279925 (+ 720us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:14:36.280462 (+ 537us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:14:36.281280 (+ 818us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:14:36.281542 (+ 262us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:14:36.281627 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:14:36.282892 (+ 1265us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0927 15:14:36.282895 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0927 15:14:36.282898 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0927 15:14:36.282922 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0927 15:14:36.284345 (+ 1423us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:14:36.284734 (+ 389us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:14:36.284738 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:14:36.284739 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:14:36.284825 (+ 86us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:14:36.285105 (+ 280us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:14:36.285108 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:14:36.285110 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:14:36.285324 (+ 214us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0927 15:14:36.285488 (+ 164us) server_negotiation.cc:1035] Waiting for connection context
0927 15:14:36.285687 (+ 199us) server_negotiation.cc:299] Negotiation successful
0927 15:14:36.285810 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":31,"server-negotiator.queue_time_us":149,"thread_start_us":62,"threads_started":1}
I20260927 15:14:36.288795 32424 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:14:36.277270 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.136.3:38979 (local address 127.17.136.62:42541)
0927 15:14:36.277392 (+ 122us) server_negotiation.cc:206] Beginning negotiation
0927 15:14:36.277396 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0927 15:14:36.278387 (+ 991us) server_negotiation.cc:407] Connection header received
0927 15:14:36.279900 (+ 1513us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:14:36.279903 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:14:36.279950 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:14:36.280026 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0927 15:14:36.281118 (+ 1092us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:14:36.281636 (+ 518us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:14:36.282831 (+ 1195us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:14:36.283046 (+ 215us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:14:36.283127 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:14:36.285409 (+ 2282us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0927 15:14:36.285413 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0927 15:14:36.285416 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0927 15:14:36.285440 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0927 15:14:36.286938 (+ 1498us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:14:36.287433 (+ 495us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:14:36.287436 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:14:36.287438 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:14:36.287514 (+ 76us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:14:36.287807 (+ 293us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:14:36.287811 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:14:36.287812 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:14:36.287966 (+ 154us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0927 15:14:36.288051 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0927 15:14:36.288537 (+ 486us) server_negotiation.cc:299] Negotiation successful
0927 15:14:36.288648 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":1,"server-negotiator.queue_time_us":42}
I20260927 15:14:36.289649 32694 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:14:36.277705 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.62:42541 (local address 127.17.136.3:38979)
0927 15:14:36.278245 (+ 540us) negotiation.cc:107] Waiting for socket to connect
0927 15:14:36.278299 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0927 15:14:36.279717 (+ 1418us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0927 15:14:36.280213 (+ 496us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0927 15:14:36.280219 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0927 15:14:36.280545 (+ 326us) client_negotiation.cc:189] Negotiated authn=SASL
0927 15:14:36.280992 (+ 447us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:14:36.281007 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:14:36.281744 (+ 737us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:14:36.281747 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:14:36.282721 (+ 974us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:14:36.282730 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:14:36.283174 (+ 444us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:14:36.283178 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:14:36.283378 (+ 200us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:14:36.283804 (+ 426us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0927 15:14:36.283819 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0927 15:14:36.285257 (+ 1438us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0927 15:14:36.287037 (+ 1780us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0927 15:14:36.287042 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0927 15:14:36.287057 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0927 15:14:36.287343 (+ 286us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0927 15:14:36.287587 (+ 244us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0927 15:14:36.287589 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0927 15:14:36.287591 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0927 15:14:36.287718 (+ 127us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0927 15:14:36.288063 (+ 345us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0927 15:14:36.288069 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0927 15:14:36.288295 (+ 226us) client_negotiation.cc:769] Sending connection context
0927 15:14:36.288462 (+ 167us) client_negotiation.cc:240] Negotiation successful
0927 15:14:36.288783 (+ 321us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":271,"thread_start_us":103,"threads_started":1}
I20260927 15:14:36.290663 32692 heartbeater.cc:347] Connected to a master server at 127.17.136.62:42541
I20260927 15:14:36.290895 32692 heartbeater.cc:464] Registering TS with master...
I20260927 15:14:36.291433 32692 heartbeater.cc:511] Master 127.17.136.62:42541 requested a full tablet report, sending...
I20260927 15:14:36.292364 32234 ts_manager.cc:194] Registered new tserver with Master: a4632fdbe3fd4678a5a57275c077138a (127.17.136.3:35877)
I20260927 15:14:36.292910 32234 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.136.3@KRBTEST.COM'} at 127.17.136.3:38979
I20260927 15:14:36.299271 17952 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260927 15:14:36.303063 32424 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:14:36.299848 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45376 (local address 127.17.136.62:42541)
0927 15:14:36.299967 (+ 119us) server_negotiation.cc:206] Beginning negotiation
0927 15:14:36.299971 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0927 15:14:36.300173 (+ 202us) server_negotiation.cc:407] Connection header received
0927 15:14:36.300280 (+ 107us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:14:36.300282 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:14:36.300375 (+ 93us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:14:36.300452 (+ 77us) server_negotiation.cc:226] Negotiated authn=TOKEN
0927 15:14:36.300635 (+ 183us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:14:36.301112 (+ 477us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:14:36.301946 (+ 834us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:14:36.302149 (+ 203us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:14:36.302208 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:14:36.302443 (+ 235us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0927 15:14:36.302788 (+ 345us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0927 15:14:36.302865 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0927 15:14:36.302918 (+ 53us) server_negotiation.cc:299] Negotiation successful
0927 15:14:36.302957 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260927 15:14:36.303620 32234 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin'} at 127.0.0.1:45376:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:14:36.306640 32234 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:14:36.313819 32356 tablet_service.cc:1467] Processing CreateTablet for tablet 8b2950c002724470931004273a75fcf1 (DEFAULT_TABLE table=test-table [id=ba70e9fdb9ca4d769988a3e05bce8c8c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:14:36.314455 32356 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8b2950c002724470931004273a75fcf1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:14:36.318825 32314 tablet_bootstrap.cc:492] T 8b2950c002724470931004273a75fcf1 P 2c12418b9eda4943b132c69370a1d644: Bootstrap starting.
I20260927 15:14:36.319497 32429 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:14:36.312835 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.2:44529 (local address 127.0.0.1:39042)
0927 15:14:36.312956 (+ 121us) negotiation.cc:107] Waiting for socket to connect
0927 15:14:36.312972 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0927 15:14:36.313065 (+ 93us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0927 15:14:36.313966 (+ 901us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0927 15:14:36.313970 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0927 15:14:36.313986 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0927 15:14:36.314092 (+ 106us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:14:36.314099 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:14:36.316885 (+ 2786us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:14:36.316888 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:14:36.317981 (+ 1093us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:14:36.317991 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:14:36.319096 (+ 1105us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:14:36.319100 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:14:36.319185 (+ 85us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:14:36.319212 (+ 27us) client_negotiation.cc:769] Sending connection context
0927 15:14:36.319292 (+ 80us) client_negotiation.cc:240] Negotiation successful
0927 15:14:36.319370 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":46,"mutex_wait_us":25}
I20260927 15:14:36.319712 32314 tablet_bootstrap.cc:654] T 8b2950c002724470931004273a75fcf1 P 2c12418b9eda4943b132c69370a1d644: Neither blocks nor log segments found. Creating new log.
I20260927 15:14:36.320185 32701 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:14:36.313000 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39042 (local address 127.17.136.2:44529)
0927 15:14:36.313526 (+ 526us) server_negotiation.cc:206] Beginning negotiation
0927 15:14:36.313538 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0927 15:14:36.313563 (+ 25us) server_negotiation.cc:407] Connection header received
0927 15:14:36.313642 (+ 79us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:14:36.313648 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:14:36.313838 (+ 190us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:14:36.313978 (+ 140us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0927 15:14:36.314199 (+ 221us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:14:36.315200 (+ 1001us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:14:36.318116 (+ 2916us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:14:36.318966 (+ 850us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:14:36.319745 (+ 779us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:14:36.319900 (+ 155us) server_negotiation.cc:1035] Waiting for connection context
0927 15:14:36.319952 (+ 52us) server_negotiation.cc:299] Negotiation successful
0927 15:14:36.320045 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":417,"thread_start_us":98,"threads_started":1}
I20260927 15:14:36.320468 32702 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:14:36.313250 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.3:35877 (local address 127.0.0.1:38192)
0927 15:14:36.313600 (+ 350us) negotiation.cc:107] Waiting for socket to connect
0927 15:14:36.313613 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0927 15:14:36.313693 (+ 80us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0927 15:14:36.314496 (+ 803us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0927 15:14:36.314499 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0927 15:14:36.314518 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0927 15:14:36.314603 (+ 85us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:14:36.314608 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:14:36.316344 (+ 1736us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:14:36.316348 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:14:36.317996 (+ 1648us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:14:36.318008 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:14:36.320123 (+ 2115us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:14:36.320127 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:14:36.320209 (+ 82us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:14:36.320233 (+ 24us) client_negotiation.cc:769] Sending connection context
0927 15:14:36.320281 (+ 48us) client_negotiation.cc:240] Negotiation successful
0927 15:14:36.320345 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":294,"mutex_wait_us":23,"thread_start_us":94,"threads_started":1}
I20260927 15:14:36.321393 32703 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:14:36.313414 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38192 (local address 127.17.136.3:35877)
0927 15:14:36.313924 (+ 510us) server_negotiation.cc:206] Beginning negotiation
0927 15:14:36.313940 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0927 15:14:36.313962 (+ 22us) server_negotiation.cc:407] Connection header received
0927 15:14:36.314165 (+ 203us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:14:36.314170 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:14:36.314356 (+ 186us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:14:36.314498 (+ 142us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0927 15:14:36.314756 (+ 258us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:14:36.316195 (+ 1439us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:14:36.318136 (+ 1941us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:14:36.319990 (+ 1854us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:14:36.320964 (+ 974us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:14:36.321120 (+ 156us) server_negotiation.cc:1035] Waiting for connection context
0927 15:14:36.321171 (+ 51us) server_negotiation.cc:299] Negotiation successful
0927 15:14:36.321259 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":414,"thread_start_us":145,"threads_started":1}
I20260927 15:14:36.321416 32314 tablet_bootstrap.cc:492] T 8b2950c002724470931004273a75fcf1 P 2c12418b9eda4943b132c69370a1d644: No bootstrap required, opened a new log
I20260927 15:14:36.321491 32314 ts_tablet_manager.cc:1397] T 8b2950c002724470931004273a75fcf1 P 2c12418b9eda4943b132c69370a1d644: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20260927 15:14:36.322177 32314 raft_consensus.cc:348] T 8b2950c002724470931004273a75fcf1 P 2c12418b9eda4943b132c69370a1d644 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe00bf42aff43b5be70835cd6f08b3c" member_type: VOTER last_known_addr { host: "127.17.136.2" port: 44529 } } peers { permanent_uuid: "a4632fdbe3fd4678a5a57275c077138a" member_type: VOTER last_known_addr { host: "127.17.136.3" port: 35877 } } peers { permanent_uuid: "2c12418b9eda4943b132c69370a1d644" member_type: VOTER last_known_addr { host: "127.17.136.1" port: 36919 } }
I20260927 15:14:36.322291 32314 raft_consensus.cc:374] T 8b2950c002724470931004273a75fcf1 P 2c12418b9eda4943b132c69370a1d644 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:14:36.322325 32314 raft_consensus.cc:729] T 8b2950c002724470931004273a75fcf1 P 2c12418b9eda4943b132c69370a1d644 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2c12418b9eda4943b132c69370a1d644, State: Initialized, Role: FOLLOWER
I20260927 15:14:36.322435 32314 consensus_queue.cc:260] T 8b2950c002724470931004273a75fcf1 P 2c12418b9eda4943b132c69370a1d644 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe00bf42aff43b5be70835cd6f08b3c" member_type: VOTER last_known_addr { host: "127.17.136.2" port: 44529 } } peers { permanent_uuid: "a4632fdbe3fd4678a5a57275c077138a" member_type: VOTER last_known_addr { host: "127.17.136.3" port: 35877 } } peers { permanent_uuid: "2c12418b9eda4943b132c69370a1d644" member_type: VOTER last_known_addr { host: "127.17.136.1" port: 36919 } }
I20260927 15:14:36.322667 32314 ts_tablet_manager.cc:1428] T 8b2950c002724470931004273a75fcf1 P 2c12418b9eda4943b132c69370a1d644: Time spent starting tablet: real 0.001s user 0.002s sys 0.000s
I20260927 15:14:36.323349 32494 tablet_service.cc:1467] Processing CreateTablet for tablet 8b2950c002724470931004273a75fcf1 (DEFAULT_TABLE table=test-table [id=ba70e9fdb9ca4d769988a3e05bce8c8c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:14:36.324462 32494 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8b2950c002724470931004273a75fcf1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:14:36.325341 32626 tablet_service.cc:1467] Processing CreateTablet for tablet 8b2950c002724470931004273a75fcf1 (DEFAULT_TABLE table=test-table [id=ba70e9fdb9ca4d769988a3e05bce8c8c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:14:36.326334 32626 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8b2950c002724470931004273a75fcf1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:14:36.332325 32705 tablet_bootstrap.cc:492] T 8b2950c002724470931004273a75fcf1 P cfe00bf42aff43b5be70835cd6f08b3c: Bootstrap starting.
I20260927 15:14:36.333890 32706 tablet_bootstrap.cc:492] T 8b2950c002724470931004273a75fcf1 P a4632fdbe3fd4678a5a57275c077138a: Bootstrap starting.
I20260927 15:14:36.334692 32705 tablet_bootstrap.cc:654] T 8b2950c002724470931004273a75fcf1 P cfe00bf42aff43b5be70835cd6f08b3c: Neither blocks nor log segments found. Creating new log.
I20260927 15:14:36.335415 32705 log.cc:824] T 8b2950c002724470931004273a75fcf1 P cfe00bf42aff43b5be70835cd6f08b3c: Log is configured to *not* fsync() on all Append() calls
I20260927 15:14:36.335985 32706 tablet_bootstrap.cc:654] T 8b2950c002724470931004273a75fcf1 P a4632fdbe3fd4678a5a57275c077138a: Neither blocks nor log segments found. Creating new log.
I20260927 15:14:36.336603 32706 log.cc:824] T 8b2950c002724470931004273a75fcf1 P a4632fdbe3fd4678a5a57275c077138a: Log is configured to *not* fsync() on all Append() calls
I20260927 15:14:36.337062 32705 tablet_bootstrap.cc:492] T 8b2950c002724470931004273a75fcf1 P cfe00bf42aff43b5be70835cd6f08b3c: No bootstrap required, opened a new log
I20260927 15:14:36.337229 32705 ts_tablet_manager.cc:1397] T 8b2950c002724470931004273a75fcf1 P cfe00bf42aff43b5be70835cd6f08b3c: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s
I20260927 15:14:36.338126 32706 tablet_bootstrap.cc:492] T 8b2950c002724470931004273a75fcf1 P a4632fdbe3fd4678a5a57275c077138a: No bootstrap required, opened a new log
I20260927 15:14:36.338275 32706 ts_tablet_manager.cc:1397] T 8b2950c002724470931004273a75fcf1 P a4632fdbe3fd4678a5a57275c077138a: Time spent bootstrapping tablet: real 0.005s user 0.003s sys 0.000s
I20260927 15:14:36.340247 32705 raft_consensus.cc:348] T 8b2950c002724470931004273a75fcf1 P cfe00bf42aff43b5be70835cd6f08b3c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe00bf42aff43b5be70835cd6f08b3c" member_type: VOTER last_known_addr { host: "127.17.136.2" port: 44529 } } peers { permanent_uuid: "a4632fdbe3fd4678a5a57275c077138a" member_type: VOTER last_known_addr { host: "127.17.136.3" port: 35877 } } peers { permanent_uuid: "2c12418b9eda4943b132c69370a1d644" member_type: VOTER last_known_addr { host: "127.17.136.1" port: 36919 } }
I20260927 15:14:36.340456 32705 raft_consensus.cc:374] T 8b2950c002724470931004273a75fcf1 P cfe00bf42aff43b5be70835cd6f08b3c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:14:36.340507 32705 raft_consensus.cc:729] T 8b2950c002724470931004273a75fcf1 P cfe00bf42aff43b5be70835cd6f08b3c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cfe00bf42aff43b5be70835cd6f08b3c, State: Initialized, Role: FOLLOWER
I20260927 15:14:36.340904 32705 consensus_queue.cc:260] T 8b2950c002724470931004273a75fcf1 P cfe00bf42aff43b5be70835cd6f08b3c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe00bf42aff43b5be70835cd6f08b3c" member_type: VOTER last_known_addr { host: "127.17.136.2" port: 44529 } } peers { permanent_uuid: "a4632fdbe3fd4678a5a57275c077138a" member_type: VOTER last_known_addr { host: "127.17.136.3" port: 35877 } } peers { permanent_uuid: "2c12418b9eda4943b132c69370a1d644" member_type: VOTER last_known_addr { host: "127.17.136.1" port: 36919 } }
I20260927 15:14:36.341171 32706 raft_consensus.cc:348] T 8b2950c002724470931004273a75fcf1 P a4632fdbe3fd4678a5a57275c077138a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe00bf42aff43b5be70835cd6f08b3c" member_type: VOTER last_known_addr { host: "127.17.136.2" port: 44529 } } peers { permanent_uuid: "a4632fdbe3fd4678a5a57275c077138a" member_type: VOTER last_known_addr { host: "127.17.136.3" port: 35877 } } peers { permanent_uuid: "2c12418b9eda4943b132c69370a1d644" member_type: VOTER last_known_addr { host: "127.17.136.1" port: 36919 } }
I20260927 15:14:36.341360 32706 raft_consensus.cc:374] T 8b2950c002724470931004273a75fcf1 P a4632fdbe3fd4678a5a57275c077138a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:14:36.341415 32706 raft_consensus.cc:729] T 8b2950c002724470931004273a75fcf1 P a4632fdbe3fd4678a5a57275c077138a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a4632fdbe3fd4678a5a57275c077138a, State: Initialized, Role: FOLLOWER
I20260927 15:14:36.341521 32560 heartbeater.cc:503] Master 127.17.136.62:42541 was elected leader, sending a full tablet report...
I20260927 15:14:36.341765 32705 ts_tablet_manager.cc:1428] T 8b2950c002724470931004273a75fcf1 P cfe00bf42aff43b5be70835cd6f08b3c: Time spent starting tablet: real 0.004s user 0.001s sys 0.004s
I20260927 15:14:36.341815 32706 consensus_queue.cc:260] T 8b2950c002724470931004273a75fcf1 P a4632fdbe3fd4678a5a57275c077138a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe00bf42aff43b5be70835cd6f08b3c" member_type: VOTER last_known_addr { host: "127.17.136.2" port: 44529 } } peers { permanent_uuid: "a4632fdbe3fd4678a5a57275c077138a" member_type: VOTER last_known_addr { host: "127.17.136.3" port: 35877 } } peers { permanent_uuid: "2c12418b9eda4943b132c69370a1d644" member_type: VOTER last_known_addr { host: "127.17.136.1" port: 36919 } }
I20260927 15:14:36.342351 32692 heartbeater.cc:503] Master 127.17.136.62:42541 was elected leader, sending a full tablet report...
I20260927 15:14:36.343742 32706 ts_tablet_manager.cc:1428] T 8b2950c002724470931004273a75fcf1 P a4632fdbe3fd4678a5a57275c077138a: Time spent starting tablet: real 0.005s user 0.005s sys 0.000s
W20260927 15:14:36.347874 32561 tablet.cc:2369] T 8b2950c002724470931004273a75fcf1 P cfe00bf42aff43b5be70835cd6f08b3c: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260927 15:14:36.409353 32423 tablet.cc:2369] T 8b2950c002724470931004273a75fcf1 P 2c12418b9eda4943b132c69370a1d644: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260927 15:14:36.461304 32710 raft_consensus.cc:482] T 8b2950c002724470931004273a75fcf1 P a4632fdbe3fd4678a5a57275c077138a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:14:36.461509 32710 raft_consensus.cc:504] T 8b2950c002724470931004273a75fcf1 P a4632fdbe3fd4678a5a57275c077138a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe00bf42aff43b5be70835cd6f08b3c" member_type: VOTER last_known_addr { host: "127.17.136.2" port: 44529 } } peers { permanent_uuid: "a4632fdbe3fd4678a5a57275c077138a" member_type: VOTER last_known_addr { host: "127.17.136.3" port: 35877 } } peers { permanent_uuid: "2c12418b9eda4943b132c69370a1d644" member_type: VOTER last_known_addr { host: "127.17.136.1" port: 36919 } }
I20260927 15:14:36.462603 32710 leader_election.cc:288] T 8b2950c002724470931004273a75fcf1 P a4632fdbe3fd4678a5a57275c077138a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cfe00bf42aff43b5be70835cd6f08b3c (127.17.136.2:44529), 2c12418b9eda4943b132c69370a1d644 (127.17.136.1:36919)
I20260927 15:14:36.466540 32701 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:14:36.463022 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.136.3:37651 (local address 127.17.136.2:44529)
0927 15:14:36.463139 (+ 117us) server_negotiation.cc:206] Beginning negotiation
0927 15:14:36.463144 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0927 15:14:36.463434 (+ 290us) server_negotiation.cc:407] Connection header received
0927 15:14:36.463560 (+ 126us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:14:36.463563 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:14:36.463613 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:14:36.463694 (+ 81us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0927 15:14:36.463927 (+ 233us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:14:36.464431 (+ 504us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:14:36.465571 (+ 1140us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:14:36.466023 (+ 452us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:14:36.466128 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:14:36.466181 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0927 15:14:36.466343 (+ 162us) server_negotiation.cc:299] Negotiation successful
0927 15:14:36.466422 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260927 15:14:36.466580 32712 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:14:36.462854 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.2:44529 (local address 127.17.136.3:37651)
0927 15:14:36.463352 (+ 498us) negotiation.cc:107] Waiting for socket to connect
0927 15:14:36.463365 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0927 15:14:36.463453 (+ 88us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0927 15:14:36.463711 (+ 258us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0927 15:14:36.463714 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0927 15:14:36.463730 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0927 15:14:36.463835 (+ 105us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:14:36.463841 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:14:36.464555 (+ 714us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:14:36.464557 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:14:36.465458 (+ 901us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:14:36.465470 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:14:36.466129 (+ 659us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:14:36.466132 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:14:36.466230 (+ 98us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:14:36.466250 (+ 20us) client_negotiation.cc:769] Sending connection context
0927 15:14:36.466330 (+ 80us) client_negotiation.cc:240] Negotiation successful
0927 15:14:36.466397 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":427,"mutex_wait_us":127,"thread_start_us":105,"threads_started":1}
I20260927 15:14:36.466588 32711 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:14:36.462918 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.136.3:47747 (local address 127.17.136.1:36919)
0927 15:14:36.463193 (+ 275us) server_negotiation.cc:206] Beginning negotiation
0927 15:14:36.463198 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0927 15:14:36.463212 (+ 14us) server_negotiation.cc:407] Connection header received
0927 15:14:36.463291 (+ 79us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:14:36.463294 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:14:36.463344 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:14:36.463445 (+ 101us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0927 15:14:36.463747 (+ 302us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:14:36.464332 (+ 585us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:14:36.465502 (+ 1170us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:14:36.465987 (+ 485us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:14:36.466196 (+ 209us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:14:36.466250 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0927 15:14:36.466392 (+ 142us) server_negotiation.cc:299] Negotiation successful
0927 15:14:36.466466 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":209,"thread_start_us":73,"threads_started":1}
I20260927 15:14:36.466581 32694 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:14:36.462854 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.1:36919 (local address 127.17.136.3:47747)
0927 15:14:36.462977 (+ 123us) negotiation.cc:107] Waiting for socket to connect
0927 15:14:36.462990 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0927 15:14:36.463088 (+ 98us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0927 15:14:36.463488 (+ 400us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0927 15:14:36.463491 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0927 15:14:36.463520 (+ 29us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0927 15:14:36.463633 (+ 113us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:14:36.463640 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:14:36.464433 (+ 793us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:14:36.464436 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:14:36.465367 (+ 931us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:14:36.465377 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:14:36.466160 (+ 783us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:14:36.466164 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:14:36.466274 (+ 110us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:14:36.466295 (+ 21us) client_negotiation.cc:769] Sending connection context
0927 15:14:36.466359 (+ 64us) client_negotiation.cc:240] Negotiation successful
0927 15:14:36.466430 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":46}
I20260927 15:14:36.467226 32514 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8b2950c002724470931004273a75fcf1" candidate_uuid: "a4632fdbe3fd4678a5a57275c077138a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cfe00bf42aff43b5be70835cd6f08b3c" is_pre_election: true
I20260927 15:14:36.467466 32376 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8b2950c002724470931004273a75fcf1" candidate_uuid: "a4632fdbe3fd4678a5a57275c077138a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c12418b9eda4943b132c69370a1d644" is_pre_election: true
I20260927 15:14:36.467561 32514 raft_consensus.cc:2454] T 8b2950c002724470931004273a75fcf1 P cfe00bf42aff43b5be70835cd6f08b3c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a4632fdbe3fd4678a5a57275c077138a in term 0.
I20260927 15:14:36.467734 32376 raft_consensus.cc:2454] T 8b2950c002724470931004273a75fcf1 P 2c12418b9eda4943b132c69370a1d644 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a4632fdbe3fd4678a5a57275c077138a in term 0.
I20260927 15:14:36.468037 32579 leader_election.cc:302] T 8b2950c002724470931004273a75fcf1 P a4632fdbe3fd4678a5a57275c077138a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a4632fdbe3fd4678a5a57275c077138a, cfe00bf42aff43b5be70835cd6f08b3c; no voters:
I20260927 15:14:36.468298 32710 raft_consensus.cc:2781] T 8b2950c002724470931004273a75fcf1 P a4632fdbe3fd4678a5a57275c077138a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 15:14:36.468374 32710 raft_consensus.cc:482] T 8b2950c002724470931004273a75fcf1 P a4632fdbe3fd4678a5a57275c077138a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 15:14:36.468420 32710 raft_consensus.cc:3037] T 8b2950c002724470931004273a75fcf1 P a4632fdbe3fd4678a5a57275c077138a [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:14:36.469376 32710 raft_consensus.cc:504] T 8b2950c002724470931004273a75fcf1 P a4632fdbe3fd4678a5a57275c077138a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe00bf42aff43b5be70835cd6f08b3c" member_type: VOTER last_known_addr { host: "127.17.136.2" port: 44529 } } peers { permanent_uuid: "a4632fdbe3fd4678a5a57275c077138a" member_type: VOTER last_known_addr { host: "127.17.136.3" port: 35877 } } peers { permanent_uuid: "2c12418b9eda4943b132c69370a1d644" member_type: VOTER last_known_addr { host: "127.17.136.1" port: 36919 } }
I20260927 15:14:36.469686 32710 leader_election.cc:288] T 8b2950c002724470931004273a75fcf1 P a4632fdbe3fd4678a5a57275c077138a [CANDIDATE]: Term 1 election: Requested vote from peers cfe00bf42aff43b5be70835cd6f08b3c (127.17.136.2:44529), 2c12418b9eda4943b132c69370a1d644 (127.17.136.1:36919)
I20260927 15:14:36.469986 32376 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8b2950c002724470931004273a75fcf1" candidate_uuid: "a4632fdbe3fd4678a5a57275c077138a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c12418b9eda4943b132c69370a1d644"
I20260927 15:14:36.470106 32376 raft_consensus.cc:3037] T 8b2950c002724470931004273a75fcf1 P 2c12418b9eda4943b132c69370a1d644 [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:14:36.470992 32376 raft_consensus.cc:2454] T 8b2950c002724470931004273a75fcf1 P 2c12418b9eda4943b132c69370a1d644 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a4632fdbe3fd4678a5a57275c077138a in term 1.
I20260927 15:14:36.471220 32514 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8b2950c002724470931004273a75fcf1" candidate_uuid: "a4632fdbe3fd4678a5a57275c077138a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cfe00bf42aff43b5be70835cd6f08b3c"
I20260927 15:14:36.471292 32580 leader_election.cc:302] T 8b2950c002724470931004273a75fcf1 P a4632fdbe3fd4678a5a57275c077138a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c12418b9eda4943b132c69370a1d644, a4632fdbe3fd4678a5a57275c077138a; no voters:
I20260927 15:14:36.471350 32514 raft_consensus.cc:3037] T 8b2950c002724470931004273a75fcf1 P cfe00bf42aff43b5be70835cd6f08b3c [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:14:36.471457 32710 raft_consensus.cc:2781] T 8b2950c002724470931004273a75fcf1 P a4632fdbe3fd4678a5a57275c077138a [term 1 FOLLOWER]: Leader election won for term 1
I20260927 15:14:36.471683 32710 raft_consensus.cc:686] T 8b2950c002724470931004273a75fcf1 P a4632fdbe3fd4678a5a57275c077138a [term 1 LEADER]: Becoming Leader. State: Replica: a4632fdbe3fd4678a5a57275c077138a, State: Running, Role: LEADER
I20260927 15:14:36.472015 32710 consensus_queue.cc:237] T 8b2950c002724470931004273a75fcf1 P a4632fdbe3fd4678a5a57275c077138a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe00bf42aff43b5be70835cd6f08b3c" member_type: VOTER last_known_addr { host: "127.17.136.2" port: 44529 } } peers { permanent_uuid: "a4632fdbe3fd4678a5a57275c077138a" member_type: VOTER last_known_addr { host: "127.17.136.3" port: 35877 } } peers { permanent_uuid: "2c12418b9eda4943b132c69370a1d644" member_type: VOTER last_known_addr { host: "127.17.136.1" port: 36919 } }
I20260927 15:14:36.472558 32514 raft_consensus.cc:2454] T 8b2950c002724470931004273a75fcf1 P cfe00bf42aff43b5be70835cd6f08b3c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a4632fdbe3fd4678a5a57275c077138a in term 1.
I20260927 15:14:36.475282 32232 catalog_manager.cc:5495] T 8b2950c002724470931004273a75fcf1 P a4632fdbe3fd4678a5a57275c077138a reported cstate change: term changed from 0 to 1, leader changed from <none> to a4632fdbe3fd4678a5a57275c077138a (127.17.136.3). New cstate: current_term: 1 leader_uuid: "a4632fdbe3fd4678a5a57275c077138a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe00bf42aff43b5be70835cd6f08b3c" member_type: VOTER last_known_addr { host: "127.17.136.2" port: 44529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a4632fdbe3fd4678a5a57275c077138a" member_type: VOTER last_known_addr { host: "127.17.136.3" port: 35877 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2c12418b9eda4943b132c69370a1d644" member_type: VOTER last_known_addr { host: "127.17.136.1" port: 36919 } health_report { overall_health: UNKNOWN } } }
I20260927 15:14:36.510380 32703 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:14:36.507064 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38196 (local address 127.17.136.3:35877)
0927 15:14:36.507193 (+ 129us) server_negotiation.cc:206] Beginning negotiation
0927 15:14:36.507198 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0927 15:14:36.507212 (+ 14us) server_negotiation.cc:407] Connection header received
0927 15:14:36.507360 (+ 148us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:14:36.507362 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:14:36.507417 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:14:36.507503 (+ 86us) server_negotiation.cc:226] Negotiated authn=TOKEN
0927 15:14:36.507732 (+ 229us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:14:36.508218 (+ 486us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:14:36.509012 (+ 794us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:14:36.509219 (+ 207us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:14:36.509302 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:14:36.509589 (+ 287us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0927 15:14:36.509988 (+ 399us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0927 15:14:36.510094 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0927 15:14:36.510172 (+ 78us) server_negotiation.cc:299] Negotiation successful
0927 15:14:36.510229 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260927 15:14:36.516018 32376 raft_consensus.cc:1261] T 8b2950c002724470931004273a75fcf1 P 2c12418b9eda4943b132c69370a1d644 [term 1 FOLLOWER]: Refusing update from remote peer a4632fdbe3fd4678a5a57275c077138a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260927 15:14:36.516654 32710 consensus_queue.cc:1035] T 8b2950c002724470931004273a75fcf1 P a4632fdbe3fd4678a5a57275c077138a [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c12418b9eda4943b132c69370a1d644" member_type: VOTER last_known_addr { host: "127.17.136.1" port: 36919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260927 15:14:36.516746 32514 raft_consensus.cc:1261] T 8b2950c002724470931004273a75fcf1 P cfe00bf42aff43b5be70835cd6f08b3c [term 1 FOLLOWER]: Refusing update from remote peer a4632fdbe3fd4678a5a57275c077138a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260927 15:14:36.517333 32710 consensus_queue.cc:1035] T 8b2950c002724470931004273a75fcf1 P a4632fdbe3fd4678a5a57275c077138a [LEADER]: Connected to new peer: Peer: permanent_uuid: "cfe00bf42aff43b5be70835cd6f08b3c" member_type: VOTER last_known_addr { host: "127.17.136.2" port: 44529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260927 15:14:36.521873 32716 mvcc.cc:205] Tried to move back new op lower bound from 7333978425402298368 to 7333978425232498688. Current Snapshot: MvccSnapshot[applied={T|T < 7333978425402298368}]
I20260927 15:14:36.522670 32717 mvcc.cc:205] Tried to move back new op lower bound from 7333978425402298368 to 7333978425232498688. Current Snapshot: MvccSnapshot[applied={T|T < 7333978425402298368}]
I20260927 15:14:36.529579 32719 mvcc.cc:205] Tried to move back new op lower bound from 7333978425402298368 to 7333978425232498688. Current Snapshot: MvccSnapshot[applied={T|T < 7333978425402298368 or (T in {7333978425402298368})}]
I20260927 15:14:36.530390 32232 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin'} at 127.0.0.1:45376:
table { table_name: "test-table" } modify_external_catalogs: true
I20260927 15:14:36.530561 32232 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin'} at 127.0.0.1:45376:
table { table_name: "test-table" } modify_external_catalogs: true
I20260927 15:14:36.533016 32232 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 619c4b9f4fe842a89844dd0897d3bbc0: Sending DeleteTablet for 3 replicas of tablet 8b2950c002724470931004273a75fcf1
I20260927 15:14:36.533630 32356 tablet_service.cc:1514] Processing DeleteTablet for tablet 8b2950c002724470931004273a75fcf1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:14:36 UTC) from {username='kudu', principal='kudu/127.17.136.62@KRBTEST.COM'} at 127.0.0.1:48886
I20260927 15:14:36.533667 32626 tablet_service.cc:1514] Processing DeleteTablet for tablet 8b2950c002724470931004273a75fcf1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:14:36 UTC) from {username='kudu', principal='kudu/127.17.136.62@KRBTEST.COM'} at 127.0.0.1:38192
I20260927 15:14:36.533677 32494 tablet_service.cc:1514] Processing DeleteTablet for tablet 8b2950c002724470931004273a75fcf1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:14:36 UTC) from {username='kudu', principal='kudu/127.17.136.62@KRBTEST.COM'} at 127.0.0.1:39042
I20260927 15:14:36.534058 32725 tablet_replica.cc:330] T 8b2950c002724470931004273a75fcf1 P 2c12418b9eda4943b132c69370a1d644: stopping tablet replica
I20260927 15:14:36.534192 32725 raft_consensus.cc:2229] T 8b2950c002724470931004273a75fcf1 P 2c12418b9eda4943b132c69370a1d644 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260927 15:14:36.534318 32725 raft_consensus.cc:2258] T 8b2950c002724470931004273a75fcf1 P 2c12418b9eda4943b132c69370a1d644 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 15:14:36.534415 32726 tablet_replica.cc:330] T 8b2950c002724470931004273a75fcf1 P a4632fdbe3fd4678a5a57275c077138a: stopping tablet replica
I20260927 15:14:36.534462 17952 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu with pid 32272
I20260927 15:14:36.535045 32727 tablet_replica.cc:330] T 8b2950c002724470931004273a75fcf1 P cfe00bf42aff43b5be70835cd6f08b3c: stopping tablet replica
I20260927 15:14:36.535336 32727 raft_consensus.cc:2229] T 8b2950c002724470931004273a75fcf1 P cfe00bf42aff43b5be70835cd6f08b3c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260927 15:14:36.535604 32727 raft_consensus.cc:2258] T 8b2950c002724470931004273a75fcf1 P cfe00bf42aff43b5be70835cd6f08b3c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 15:14:36.535974 32726 raft_consensus.cc:2229] T 8b2950c002724470931004273a75fcf1 P a4632fdbe3fd4678a5a57275c077138a [term 1 LEADER]: Raft consensus shutting down.
I20260927 15:14:36.536283 32726 raft_consensus.cc:2258] T 8b2950c002724470931004273a75fcf1 P a4632fdbe3fd4678a5a57275c077138a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 15:14:36.537812 32727 ts_tablet_manager.cc:1905] T 8b2950c002724470931004273a75fcf1 P cfe00bf42aff43b5be70835cd6f08b3c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:14:36.540238 32726 ts_tablet_manager.cc:1905] T 8b2950c002724470931004273a75fcf1 P a4632fdbe3fd4678a5a57275c077138a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:14:36.540508 32727 ts_tablet_manager.cc:1918] T 8b2950c002724470931004273a75fcf1 P cfe00bf42aff43b5be70835cd6f08b3c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260927 15:14:36.540604 32727 log.cc:1196] T 8b2950c002724470931004273a75fcf1 P cfe00bf42aff43b5be70835cd6f08b3c: Deleting WAL directory at /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790521920546562-17952-0/minicluster-data/ts-1/wal/wals/8b2950c002724470931004273a75fcf1
I20260927 15:14:36.540913 32727 ts_tablet_manager.cc:1939] T 8b2950c002724470931004273a75fcf1 P cfe00bf42aff43b5be70835cd6f08b3c: Deleting consensus metadata
I20260927 15:14:36.542120 32218 catalog_manager.cc:4841] TS cfe00bf42aff43b5be70835cd6f08b3c (127.17.136.2:44529): tablet 8b2950c002724470931004273a75fcf1 (table test-table [id=ba70e9fdb9ca4d769988a3e05bce8c8c]) successfully deleted
W20260927 15:14:36.542142 32219 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.17.136.1:36919 (error 108)
I20260927 15:14:36.543215 32726 ts_tablet_manager.cc:1918] T 8b2950c002724470931004273a75fcf1 P a4632fdbe3fd4678a5a57275c077138a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
W20260927 15:14:36.543378 32702 negotiation.cc:337] Failed RPC negotiation. Trace:
0927 15:14:36.543077 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.1:36919 (local address 127.0.0.1:48902)
0927 15:14:36.543192 (+ 115us) negotiation.cc:107] Waiting for socket to connect
0927 15:14:36.543282 (+ 90us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.136.1:36919: connect: Connection reset by peer (error 104)
Metrics: {"client-negotiator.queue_time_us":39}
I20260927 15:14:36.543398 32726 log.cc:1196] T 8b2950c002724470931004273a75fcf1 P a4632fdbe3fd4678a5a57275c077138a: Deleting WAL directory at /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790521920546562-17952-0/minicluster-data/ts-2/wal/wals/8b2950c002724470931004273a75fcf1
I20260927 15:14:36.543850 32726 ts_tablet_manager.cc:1939] T 8b2950c002724470931004273a75fcf1 P a4632fdbe3fd4678a5a57275c077138a: Deleting consensus metadata
W20260927 15:14:36.543504 32219 catalog_manager.cc:4584] TS 2c12418b9eda4943b132c69370a1d644 (127.17.136.1:36919): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 8b2950c002724470931004273a75fcf1: Network error: Client connection negotiation failed: client connection to 127.17.136.1:36919: connect: Connection reset by peer (error 104)
I20260927 15:14:36.544282 17952 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu with pid 32426
I20260927 15:14:36.544981 32221 catalog_manager.cc:4841] TS a4632fdbe3fd4678a5a57275c077138a (127.17.136.3:35877): tablet 8b2950c002724470931004273a75fcf1 (table test-table [id=ba70e9fdb9ca4d769988a3e05bce8c8c]) successfully deleted
I20260927 15:14:36.549710 17952 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu with pid 32563
I20260927 15:14:36.554860 17952 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu with pid 32201
I20260927 15:14:36.560547 17952 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu
/tmp/dist-test-taskiFOyeW/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790521920546562-17952-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790521920546562-17952-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790521920546562-17952-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790521920546562-17952-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.136.62:42541
--webserver_interface=127.17.136.62
--webserver_port=37927
--keytab_file=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790521920546562-17952-0/krb5kdc/kudu_127.17.136.62.keytab
--principal=kudu/127.17.136.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.136.20:39235
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.136.62:42541
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790521920546562-17952-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790521920546562-17952-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790521920546562-17952-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260927 15:14:36.666290 32729 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260927 15:14:36.666538 32729 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260927 15:14:36.666579 32729 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260927 15:14:36.670501 32729 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260927 15:14:36.670562 32729 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260927 15:14:36.670578 32729 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260927 15:14:36.670593 32729 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260927 15:14:36.670611 32729 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260927 15:14:36.675786 32729 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.136.20:39235
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790521920546562-17952-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790521920546562-17952-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.17.136.62:42541
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790521920546562-17952-0/krb5kdc/kudu_127.17.136.62.keytab
--principal=kudu/127.17.136.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.136.62:42541
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790521920546562-17952-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.17.136.62
--webserver_port=37927
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32729
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790521920546562-17952-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 27 Sep 2026 14:27:13 UTC on ccycloud.quasar-psqrth.root.comops.site
build id 4676138
I20260927 15:14:36.676790 32729 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260927 15:14:36.677784 32729 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260927 15:14:36.685786 32734 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260927 15:14:36.685801 32737 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260927 15:14:36.685793 32735 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260927 15:14:36.685863 32729 server_base.cc:1034] running on GCE node
I20260927 15:14:36.686534 32729 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260927 15:14:36.687606 32729 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260927 15:14:36.688753 32729 hybrid_clock.cc:648] HybridClock initialized: now 1790522076688729 us; error 38 us; skew 500 ppm
Sep 27 15:14:36 dist-test-slave-5s2t krb5kdc[31654](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790522076, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.136.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260927 15:14:36.691330 32729 init.cc:377] Logged in from keytab as kudu/127.17.136.62@KRBTEST.COM (short username kudu)
I20260927 15:14:36.692140 32729 webserver.cc:460] Webserver started at http://127.17.136.62:37927/ using document root <none> and password file <none>
I20260927 15:14:36.692639 32729 fs_manager.cc:359] Metadata directory not provided
I20260927 15:14:36.692701 32729 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260927 15:14:36.696280 32729 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.003s sys 0.000s
I20260927 15:14:36.698184 32744 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260927 15:14:36.699352 32729 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260927 15:14:36.699453 32729 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790521920546562-17952-0/minicluster-data/master-0/data,/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790521920546562-17952-0/minicluster-data/master-0/wal
uuid: "619c4b9f4fe842a89844dd0897d3bbc0"
format_stamp: "Formatted at 2026-09-27 15:14:34 on dist-test-slave-5s2t"
server_key: "6b93fe1a90c20b46f9f06e018dac52af"
server_key_iv: "caaa606c3983b45683431eb6d13c4dd4"
server_key_version: "encryptionkey@0"
I20260927 15:14:36.699955 32729 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790521920546562-17952-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790521920546562-17952-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790521920546562-17952-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260927 15:14:36.715452 32729 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260927 15:14:36.718183 32729 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260927 15:14:36.718349 32729 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260927 15:14:36.724735 32729 rpc_server.cc:307] RPC server started. Bound to: 127.17.136.62:42541
I20260927 15:14:36.724998 328 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.136.62:42541 every 8 connection(s)
I20260927 15:14:36.725730 32729 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790521920546562-17952-0/minicluster-data/master-0/data/info.pb
I20260927 15:14:36.726208 17952 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu as pid 32729
I20260927 15:14:36.726603 17952 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu
/tmp/dist-test-taskiFOyeW/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790521920546562-17952-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790521920546562-17952-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790521920546562-17952-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790521920546562-17952-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.136.1:36919
--local_ip_for_outbound_sockets=127.17.136.1
--tserver_master_addrs=127.17.136.62:42541
--webserver_port=40831
--webserver_interface=127.17.136.1
--keytab_file=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790521920546562-17952-0/krb5kdc/kudu_127.17.136.1.keytab
--principal=kudu/127.17.136.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.136.20:39235
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790521920546562-17952-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790521920546562-17952-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790521920546562-17952-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260927 15:14:36.729930 329 sys_catalog.cc:263] Verifying existing consensus state
I20260927 15:14:36.731673 329 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 619c4b9f4fe842a89844dd0897d3bbc0: Bootstrap starting.
I20260927 15:14:36.748369 329 log.cc:824] T 00000000000000000000000000000000 P 619c4b9f4fe842a89844dd0897d3bbc0: Log is configured to *not* fsync() on all Append() calls
I20260927 15:14:36.759342 329 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 619c4b9f4fe842a89844dd0897d3bbc0: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=0 applied=14 ignored=0} inserts{seen=7 ignored=0} mutations{seen=9 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260927 15:14:36.759667 329 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 619c4b9f4fe842a89844dd0897d3bbc0: Bootstrap complete.
I20260927 15:14:36.763437 329 raft_consensus.cc:348] T 00000000000000000000000000000000 P 619c4b9f4fe842a89844dd0897d3bbc0 [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "619c4b9f4fe842a89844dd0897d3bbc0" member_type: VOTER last_known_addr { host: "127.17.136.62" port: 42541 } }
I20260927 15:14:36.763818 329 raft_consensus.cc:729] T 00000000000000000000000000000000 P 619c4b9f4fe842a89844dd0897d3bbc0 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 619c4b9f4fe842a89844dd0897d3bbc0, State: Initialized, Role: FOLLOWER
I20260927 15:14:36.764250 329 consensus_queue.cc:260] T 00000000000000000000000000000000 P 619c4b9f4fe842a89844dd0897d3bbc0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "619c4b9f4fe842a89844dd0897d3bbc0" member_type: VOTER last_known_addr { host: "127.17.136.62" port: 42541 } }
I20260927 15:14:36.764364 329 raft_consensus.cc:388] T 00000000000000000000000000000000 P 619c4b9f4fe842a89844dd0897d3bbc0 [term 2 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260927 15:14:36.764424 329 raft_consensus.cc:482] T 00000000000000000000000000000000 P 619c4b9f4fe842a89844dd0897d3bbc0 [term 2 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260927 15:14:36.764514 329 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 619c4b9f4fe842a89844dd0897d3bbc0 [term 2 FOLLOWER]: Advancing to term 3
I20260927 15:14:36.766269 329 raft_consensus.cc:504] T 00000000000000000000000000000000 P 619c4b9f4fe842a89844dd0897d3bbc0 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "619c4b9f4fe842a89844dd0897d3bbc0" member_type: VOTER last_known_addr { host: "127.17.136.62" port: 42541 } }
I20260927 15:14:36.766567 329 leader_election.cc:302] T 00000000000000000000000000000000 P 619c4b9f4fe842a89844dd0897d3bbc0 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 619c4b9f4fe842a89844dd0897d3bbc0; no voters:
I20260927 15:14:36.766867 329 leader_election.cc:288] T 00000000000000000000000000000000 P 619c4b9f4fe842a89844dd0897d3bbc0 [CANDIDATE]: Term 3 election: Requested vote from peers
I20260927 15:14:36.766954 333 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 619c4b9f4fe842a89844dd0897d3bbc0 [term 3 FOLLOWER]: Leader election won for term 3
I20260927 15:14:36.767143 333 raft_consensus.cc:686] T 00000000000000000000000000000000 P 619c4b9f4fe842a89844dd0897d3bbc0 [term 3 LEADER]: Becoming Leader. State: Replica: 619c4b9f4fe842a89844dd0897d3bbc0, State: Running, Role: LEADER
I20260927 15:14:36.767462 333 consensus_queue.cc:237] T 00000000000000000000000000000000 P 619c4b9f4fe842a89844dd0897d3bbc0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 3, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "619c4b9f4fe842a89844dd0897d3bbc0" member_type: VOTER last_known_addr { host: "127.17.136.62" port: 42541 } }
I20260927 15:14:36.768076 329 sys_catalog.cc:564] T 00000000000000000000000000000000 P 619c4b9f4fe842a89844dd0897d3bbc0 [sys.catalog]: configured and running, proceeding with master startup.
I20260927 15:14:36.768375 333 sys_catalog.cc:455] T 00000000000000000000000000000000 P 619c4b9f4fe842a89844dd0897d3bbc0 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 619c4b9f4fe842a89844dd0897d3bbc0. Latest consensus state: current_term: 3 leader_uuid: "619c4b9f4fe842a89844dd0897d3bbc0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "619c4b9f4fe842a89844dd0897d3bbc0" member_type: VOTER last_known_addr { host: "127.17.136.62" port: 42541 } } }
I20260927 15:14:36.768489 333 sys_catalog.cc:458] T 00000000000000000000000000000000 P 619c4b9f4fe842a89844dd0897d3bbc0 [sys.catalog]: This master's current role is: LEADER
I20260927 15:14:36.769557 337 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260927 15:14:36.769692 334 sys_catalog.cc:455] T 00000000000000000000000000000000 P 619c4b9f4fe842a89844dd0897d3bbc0 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 3 leader_uuid: "619c4b9f4fe842a89844dd0897d3bbc0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "619c4b9f4fe842a89844dd0897d3bbc0" member_type: VOTER last_known_addr { host: "127.17.136.62" port: 42541 } } }
I20260927 15:14:36.769853 334 sys_catalog.cc:458] T 00000000000000000000000000000000 P 619c4b9f4fe842a89844dd0897d3bbc0 [sys.catalog]: This master's current role is: LEADER
I20260927 15:14:36.774474 337 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260927 15:14:36.775135 337 catalog_manager.cc:1259] Loaded cluster ID: eec749150f1140fe9b94481d699a02a6
I20260927 15:14:36.775198 337 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
F20260927 15:14:36.776226 337 catalog_manager.cc:1466] Initializing Kudu internal certificate authority failed: Runtime error: unable to load data from memory: error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=RSA error:04093004:rsa routines:OLD_RSA_PRIV_DECODE:RSA lib:rsa_ameth.c:121 error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=PKCS8_PRIV_KEY_INFO
*** Check failure stack trace: ***
@ 0x7f6b3044b9ad google::LogMessage::Fail() at ??:0
@ 0x7f6b3044e88a google::LogMessage::SendToLog() at ??:0
@ 0x7f6b3044b4de google::LogMessage::Flush() at ??:0
@ 0x7f6b3044ca19 google::LogMessageFatal::~LogMessageFatal() at ??:0
@ 0x7f6b3ad8afdd _ZZN4kudu6master14CatalogManager24PrepareForLeadershipTaskEvENKUlSt8functionIFNS_6StatusEvEERKNS_9consensus13RaftConsensusElPKcE_clES5_S9_lSB_ at ??:0
@ 0x7f6b3ad8bd2f kudu::master::CatalogManager::PrepareForLeadershipTask() at ??:0
@ 0x7f6b3ad88579 _ZZN4kudu6master14CatalogManager17ElectedAsLeaderCbEvENKUlvE_clEv at ??:0
@ 0x7f6b3adcc640 _ZNSt17_Function_handlerIFvvEZN4kudu6master14CatalogManager17ElectedAsLeaderCbEvEUlvE_E9_M_invokeERKSt9_Any_data at ??:0
@ 0x61d838 std::function<>::operator()() at ??:0
@ 0x7f6b3269d3d7 kudu::ThreadPool::DispatchThread() at ??:0
@ 0x7f6b3269dc83 _ZZN4kudu10ThreadPool12CreateThreadEvENKUlvE_clEv at ??:0
@ 0x7f6b3269f3f2 _ZNSt17_Function_handlerIFvvEZN4kudu10ThreadPool12CreateThreadEvEUlvE_E9_M_invokeERKSt9_Any_data at ??:0
@ 0x61d838 std::function<>::operator()() at ??:0
@ 0x7f6b3268e512 kudu::Thread::SuperviseThread() at ??:0
@ 0x7f6b33cd26db start_thread at ??:0
@ 0x7f6b2ef4961f clone at ??:0
W20260927 15:14:36.855948 331 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260927 15:14:36.856205 331 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260927 15:14:36.856251 331 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260927 15:14:36.860373 331 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260927 15:14:36.860426 331 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260927 15:14:36.860491 331 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.136.1
I20260927 15:14:36.865773 331 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.136.20:39235
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790521920546562-17952-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790521920546562-17952-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790521920546562-17952-0/krb5kdc/kudu_127.17.136.1.keytab
--principal=kudu/127.17.136.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.136.1:36919
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790521920546562-17952-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.17.136.1
--webserver_port=40831
--tserver_master_addrs=127.17.136.62:42541
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.331
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.136.1
--log_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790521920546562-17952-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 27 Sep 2026 14:27:13 UTC on ccycloud.quasar-psqrth.root.comops.site
build id 4676138
I20260927 15:14:36.866842 331 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260927 15:14:36.867877 331 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260927 15:14:36.876994 371 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260927 15:14:36.877002 370 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260927 15:14:36.877007 373 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260927 15:14:36.877974 331 server_base.cc:1034] running on GCE node
I20260927 15:14:36.878379 331 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260927 15:14:36.879006 331 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260927 15:14:36.880162 331 hybrid_clock.cc:648] HybridClock initialized: now 1790522076880122 us; error 57 us; skew 500 ppm
Sep 27 15:14:36 dist-test-slave-5s2t krb5kdc[31654](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790522076, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.136.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260927 15:14:36.882814 331 init.cc:377] Logged in from keytab as kudu/127.17.136.1@KRBTEST.COM (short username kudu)
I20260927 15:14:36.883692 331 webserver.cc:460] Webserver started at http://127.17.136.1:40831/ using document root <none> and password file <none>
I20260927 15:14:36.884217 331 fs_manager.cc:359] Metadata directory not provided
I20260927 15:14:36.884282 331 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260927 15:14:36.888134 331 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.003s sys 0.000s
I20260927 15:14:36.890247 380 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260927 15:14:36.891552 331 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260927 15:14:36.891651 331 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790521920546562-17952-0/minicluster-data/ts-0/data,/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790521920546562-17952-0/minicluster-data/ts-0/wal
uuid: "2c12418b9eda4943b132c69370a1d644"
format_stamp: "Formatted at 2026-09-27 15:14:34 on dist-test-slave-5s2t"
server_key: "d2909d8ee09ad198ab012edeaff5ecbf"
server_key_iv: "568890b8d7bc40518cc25c3a14a60f9e"
server_key_version: "encryptionkey@0"
I20260927 15:14:36.892186 331 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790521920546562-17952-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790521920546562-17952-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790521920546562-17952-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260927 15:14:36.910127 331 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260927 15:14:36.913334 331 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260927 15:14:36.913506 331 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260927 15:14:36.914067 331 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260927 15:14:36.915102 387 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260927 15:14:36.920603 331 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260927 15:14:36.920665 331 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.006s user 0.000s sys 0.000s
I20260927 15:14:36.920729 331 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260927 15:14:36.922468 331 ts_tablet_manager.cc:610] Registered 1 tablets
I20260927 15:14:36.922523 331 ts_tablet_manager.cc:589] Time spent register tablets: real 0.002s user 0.000s sys 0.000s
I20260927 15:14:36.922825 387 tablet_bootstrap.cc:492] T 8b2950c002724470931004273a75fcf1 P 2c12418b9eda4943b132c69370a1d644: Bootstrap starting.
I20260927 15:14:36.932061 331 rpc_server.cc:307] RPC server started. Bound to: 127.17.136.1:36919
I20260927 15:14:36.932310 494 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.136.1:36919 every 8 connection(s)
I20260927 15:14:36.933075 331 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790521920546562-17952-0/minicluster-data/ts-0/data/info.pb
I20260927 15:14:36.942966 17952 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu as pid 331
I20260927 15:14:36.943369 17952 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu
/tmp/dist-test-taskiFOyeW/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790521920546562-17952-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790521920546562-17952-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790521920546562-17952-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790521920546562-17952-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.136.2:44529
--local_ip_for_outbound_sockets=127.17.136.2
--tserver_master_addrs=127.17.136.62:42541
--webserver_port=36037
--webserver_interface=127.17.136.2
--keytab_file=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790521920546562-17952-0/krb5kdc/kudu_127.17.136.2.keytab
--principal=kudu/127.17.136.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.136.20:39235
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790521920546562-17952-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790521920546562-17952-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790521920546562-17952-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260927 15:14:36.943662 387 log.cc:824] T 8b2950c002724470931004273a75fcf1 P 2c12418b9eda4943b132c69370a1d644: Log is configured to *not* fsync() on all Append() calls
I20260927 15:14:36.952548 387 tablet_bootstrap.cc:492] T 8b2950c002724470931004273a75fcf1 P 2c12418b9eda4943b132c69370a1d644: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260927 15:14:36.952950 387 tablet_bootstrap.cc:492] T 8b2950c002724470931004273a75fcf1 P 2c12418b9eda4943b132c69370a1d644: Bootstrap complete.
I20260927 15:14:36.954214 387 ts_tablet_manager.cc:1397] T 8b2950c002724470931004273a75fcf1 P 2c12418b9eda4943b132c69370a1d644: Time spent bootstrapping tablet: real 0.032s user 0.021s sys 0.007s
I20260927 15:14:36.957365 387 raft_consensus.cc:348] T 8b2950c002724470931004273a75fcf1 P 2c12418b9eda4943b132c69370a1d644 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe00bf42aff43b5be70835cd6f08b3c" member_type: VOTER last_known_addr { host: "127.17.136.2" port: 44529 } } peers { permanent_uuid: "a4632fdbe3fd4678a5a57275c077138a" member_type: VOTER last_known_addr { host: "127.17.136.3" port: 35877 } } peers { permanent_uuid: "2c12418b9eda4943b132c69370a1d644" member_type: VOTER last_known_addr { host: "127.17.136.1" port: 36919 } }
I20260927 15:14:36.957911 387 raft_consensus.cc:729] T 8b2950c002724470931004273a75fcf1 P 2c12418b9eda4943b132c69370a1d644 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2c12418b9eda4943b132c69370a1d644, State: Initialized, Role: FOLLOWER
I20260927 15:14:36.958433 387 consensus_queue.cc:260] T 8b2950c002724470931004273a75fcf1 P 2c12418b9eda4943b132c69370a1d644 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe00bf42aff43b5be70835cd6f08b3c" member_type: VOTER last_known_addr { host: "127.17.136.2" port: 44529 } } peers { permanent_uuid: "a4632fdbe3fd4678a5a57275c077138a" member_type: VOTER last_known_addr { host: "127.17.136.3" port: 35877 } } peers { permanent_uuid: "2c12418b9eda4943b132c69370a1d644" member_type: VOTER last_known_addr { host: "127.17.136.1" port: 36919 } }
I20260927 15:14:36.959486 387 ts_tablet_manager.cc:1428] T 8b2950c002724470931004273a75fcf1 P 2c12418b9eda4943b132c69370a1d644: Time spent starting tablet: real 0.005s user 0.008s sys 0.000s
W20260927 15:14:36.993884 497 negotiation.cc:337] Failed RPC negotiation. Trace:
0927 15:14:36.934833 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.62:42541 (local address 127.17.136.1:38199)
0927 15:14:36.935329 (+ 496us) negotiation.cc:107] Waiting for socket to connect
0927 15:14:36.935382 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0927 15:14:36.936162 (+ 780us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0927 15:14:36.993115 (+ 56953us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.136.62:42541: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"client-negotiator.queue_time_us":255,"thread_start_us":113,"threads_started":1}
W20260927 15:14:36.994354 495 heartbeater.cc:644] Failed to heartbeat to 127.17.136.62:42541 (0 consecutive failures): Network error: Failed to ping master at 127.17.136.62:42541: Client connection negotiation failed: client connection to 127.17.136.62:42541: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260927 15:14:36.995127 497 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:14:36.994835 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.62:42541 (local address 127.17.136.1:52629)
0927 15:14:36.995004 (+ 169us) negotiation.cc:107] Waiting for socket to connect
0927 15:14:36.995069 (+ 65us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.136.62:42541: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":82}
I20260927 15:14:36.995852 497 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:14:36.995631 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.62:42541 (local address 127.17.136.1:46375)
0927 15:14:36.995737 (+ 106us) negotiation.cc:107] Waiting for socket to connect
0927 15:14:36.995792 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.136.62:42541: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":36}
W20260927 15:14:36.996070 495 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260927 15:14:37.054658 499 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260927 15:14:37.054919 499 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260927 15:14:37.054960 499 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260927 15:14:37.058866 499 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260927 15:14:37.058931 499 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260927 15:14:37.058991 499 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.136.2
I20260927 15:14:37.064312 499 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.136.20:39235
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790521920546562-17952-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790521920546562-17952-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790521920546562-17952-0/krb5kdc/kudu_127.17.136.2.keytab
--principal=kudu/127.17.136.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.136.2:44529
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790521920546562-17952-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.17.136.2
--webserver_port=36037
--tserver_master_addrs=127.17.136.62:42541
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.499
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.136.2
--log_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790521920546562-17952-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 27 Sep 2026 14:27:13 UTC on ccycloud.quasar-psqrth.root.comops.site
build id 4676138
I20260927 15:14:37.065371 499 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260927 15:14:37.066341 499 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260927 15:14:37.075762 508 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260927 15:14:37.075768 505 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260927 15:14:37.075768 506 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260927 15:14:37.075819 499 server_base.cc:1034] running on GCE node
I20260927 15:14:37.076380 499 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260927 15:14:37.076992 499 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260927 15:14:37.078146 499 hybrid_clock.cc:648] HybridClock initialized: now 1790522077078131 us; error 26 us; skew 500 ppm
Sep 27 15:14:37 dist-test-slave-5s2t krb5kdc[31654](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790522077, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.136.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260927 15:14:37.080730 499 init.cc:377] Logged in from keytab as kudu/127.17.136.2@KRBTEST.COM (short username kudu)
I20260927 15:14:37.081526 499 webserver.cc:460] Webserver started at http://127.17.136.2:36037/ using document root <none> and password file <none>
I20260927 15:14:37.082031 499 fs_manager.cc:359] Metadata directory not provided
I20260927 15:14:37.082089 499 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260927 15:14:37.085801 499 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.002s sys 0.000s
I20260927 15:14:37.087700 515 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260927 15:14:37.088835 499 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260927 15:14:37.088925 499 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790521920546562-17952-0/minicluster-data/ts-1/data,/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790521920546562-17952-0/minicluster-data/ts-1/wal
uuid: "cfe00bf42aff43b5be70835cd6f08b3c"
format_stamp: "Formatted at 2026-09-27 15:14:34 on dist-test-slave-5s2t"
server_key: "41bfc98fb0319e4faf6c7cb286a1c4f4"
server_key_iv: "8fe0f887629898ad580486e7d93f5bd3"
server_key_version: "encryptionkey@0"
I20260927 15:14:37.089427 499 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790521920546562-17952-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790521920546562-17952-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790521920546562-17952-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260927 15:14:37.107157 499 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260927 15:14:37.110191 499 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260927 15:14:37.110356 499 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260927 15:14:37.110914 499 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260927 15:14:37.111752 499 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260927 15:14:37.111804 499 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260927 15:14:37.111847 499 ts_tablet_manager.cc:610] Registered 0 tablets
I20260927 15:14:37.111862 499 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260927 15:14:37.119925 499 rpc_server.cc:307] RPC server started. Bound to: 127.17.136.2:44529
I20260927 15:14:37.119998 628 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.136.2:44529 every 8 connection(s)
I20260927 15:14:37.120934 499 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790521920546562-17952-0/minicluster-data/ts-1/data/info.pb
I20260927 15:14:37.121117 17952 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu as pid 499
I20260927 15:14:37.121583 17952 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu
/tmp/dist-test-taskiFOyeW/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790521920546562-17952-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790521920546562-17952-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790521920546562-17952-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790521920546562-17952-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.136.3:35877
--local_ip_for_outbound_sockets=127.17.136.3
--tserver_master_addrs=127.17.136.62:42541
--webserver_port=45393
--webserver_interface=127.17.136.3
--keytab_file=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790521920546562-17952-0/krb5kdc/kudu_127.17.136.3.keytab
--principal=kudu/127.17.136.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.136.20:39235
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790521920546562-17952-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790521920546562-17952-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790521920546562-17952-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260927 15:14:37.125407 632 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:14:37.123145 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.62:42541 (local address 127.17.136.2:50617)
0927 15:14:37.123653 (+ 508us) negotiation.cc:107] Waiting for socket to connect
0927 15:14:37.123803 (+ 150us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.136.62:42541: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":278,"thread_start_us":132,"threads_started":1}
W20260927 15:14:37.125837 629 heartbeater.cc:644] Failed to heartbeat to 127.17.136.62:42541 (0 consecutive failures): Network error: Failed to ping master at 127.17.136.62:42541: Client connection negotiation failed: client connection to 127.17.136.62:42541: connect: Connection refused (error 111)
I20260927 15:14:37.126416 632 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:14:37.126179 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.62:42541 (local address 127.17.136.2:46593)
0927 15:14:37.126294 (+ 115us) negotiation.cc:107] Waiting for socket to connect
0927 15:14:37.126351 (+ 57us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.136.62:42541: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":40}
I20260927 15:14:37.127012 632 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:14:37.126792 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.62:42541 (local address 127.17.136.2:51675)
0927 15:14:37.126892 (+ 100us) negotiation.cc:107] Waiting for socket to connect
0927 15:14:37.126940 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.136.62:42541: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":38}
W20260927 15:14:37.127187 629 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260927 15:14:37.228230 631 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260927 15:14:37.228475 631 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260927 15:14:37.228516 631 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260927 15:14:37.232384 631 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260927 15:14:37.232434 631 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260927 15:14:37.232496 631 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.136.3
I20260927 15:14:37.237557 631 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.136.20:39235
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790521920546562-17952-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790521920546562-17952-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790521920546562-17952-0/krb5kdc/kudu_127.17.136.3.keytab
--principal=kudu/127.17.136.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.136.3:35877
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790521920546562-17952-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.17.136.3
--webserver_port=45393
--tserver_master_addrs=127.17.136.62:42541
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.631
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.136.3
--log_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790521920546562-17952-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 27 Sep 2026 14:27:13 UTC on ccycloud.quasar-psqrth.root.comops.site
build id 4676138
I20260927 15:14:37.238507 631 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260927 15:14:37.239451 631 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260927 15:14:37.248482 640 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260927 15:14:37.248490 638 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260927 15:14:37.248572 637 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260927 15:14:37.248817 631 server_base.cc:1034] running on GCE node
I20260927 15:14:37.249176 631 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260927 15:14:37.249749 631 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260927 15:14:37.250893 631 hybrid_clock.cc:648] HybridClock initialized: now 1790522077250856 us; error 54 us; skew 500 ppm
Sep 27 15:14:37 dist-test-slave-5s2t krb5kdc[31654](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790522077, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.136.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260927 15:14:37.253374 631 init.cc:377] Logged in from keytab as kudu/127.17.136.3@KRBTEST.COM (short username kudu)
I20260927 15:14:37.254122 631 webserver.cc:460] Webserver started at http://127.17.136.3:45393/ using document root <none> and password file <none>
I20260927 15:14:37.254603 631 fs_manager.cc:359] Metadata directory not provided
I20260927 15:14:37.254657 631 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260927 15:14:37.258160 631 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.002s sys 0.000s
I20260927 15:14:37.260070 647 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260927 15:14:37.261267 631 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260927 15:14:37.261356 631 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790521920546562-17952-0/minicluster-data/ts-2/data,/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790521920546562-17952-0/minicluster-data/ts-2/wal
uuid: "a4632fdbe3fd4678a5a57275c077138a"
format_stamp: "Formatted at 2026-09-27 15:14:35 on dist-test-slave-5s2t"
server_key: "5dae5570bf038468319d4de5bb6e5611"
server_key_iv: "e61e7e89875face082bce425b10b7c36"
server_key_version: "encryptionkey@0"
I20260927 15:14:37.261868 631 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790521920546562-17952-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790521920546562-17952-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790521920546562-17952-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260927 15:14:37.280218 631 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260927 15:14:37.282856 631 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260927 15:14:37.283008 631 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260927 15:14:37.283560 631 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260927 15:14:37.284341 631 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260927 15:14:37.284384 631 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260927 15:14:37.284423 631 ts_tablet_manager.cc:610] Registered 0 tablets
I20260927 15:14:37.284442 631 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260927 15:14:37.292598 631 rpc_server.cc:307] RPC server started. Bound to: 127.17.136.3:35877
I20260927 15:14:37.292640 760 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.136.3:35877 every 8 connection(s)
I20260927 15:14:37.293560 631 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790521920546562-17952-0/minicluster-data/ts-2/data/info.pb
I20260927 15:14:37.297266 763 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:14:37.295571 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.62:42541 (local address 127.17.136.3:37813)
0927 15:14:37.295987 (+ 416us) negotiation.cc:107] Waiting for socket to connect
0927 15:14:37.296102 (+ 115us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.136.62:42541: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":231,"thread_start_us":104,"threads_started":1}
W20260927 15:14:37.297727 761 heartbeater.cc:644] Failed to heartbeat to 127.17.136.62:42541 (0 consecutive failures): Network error: Failed to ping master at 127.17.136.62:42541: Client connection negotiation failed: client connection to 127.17.136.62:42541: connect: Connection refused (error 111)
I20260927 15:14:37.297931 17952 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu as pid 631
I20260927 15:14:37.298287 763 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:14:37.298068 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.62:42541 (local address 127.17.136.3:42261)
0927 15:14:37.298172 (+ 104us) negotiation.cc:107] Waiting for socket to connect
0927 15:14:37.298225 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.136.62:42541: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":35}
I20260927 15:14:37.298846 763 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:14:37.298649 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.62:42541 (local address 127.17.136.3:39935)
0927 15:14:37.298741 (+ 92us) negotiation.cc:107] Waiting for socket to connect
0927 15:14:37.298789 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.136.62:42541: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":35}
W20260927 15:14:37.299023 761 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260927 15:14:37.997047 765 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:14:37.996607 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.62:42541 (local address 127.17.136.1:36417)
0927 15:14:37.996853 (+ 246us) negotiation.cc:107] Waiting for socket to connect
0927 15:14:37.996936 (+ 83us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.136.62:42541: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":174,"thread_start_us":75,"threads_started":1}
I20260927 15:14:38.128015 766 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:14:38.127636 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.62:42541 (local address 127.17.136.2:53633)
0927 15:14:38.127856 (+ 220us) negotiation.cc:107] Waiting for socket to connect
0927 15:14:38.127907 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.136.62:42541: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":155,"thread_start_us":63,"threads_started":1}
I20260927 15:14:38.299865 767 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:14:38.299494 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.62:42541 (local address 127.17.136.3:52135)
0927 15:14:38.299719 (+ 225us) negotiation.cc:107] Waiting for socket to connect
0927 15:14:38.299770 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.136.62:42541: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":159,"thread_start_us":74,"threads_started":1}
I20260927 15:14:38.453285 768 raft_consensus.cc:482] T 8b2950c002724470931004273a75fcf1 P 2c12418b9eda4943b132c69370a1d644 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:14:38.453473 768 raft_consensus.cc:504] T 8b2950c002724470931004273a75fcf1 P 2c12418b9eda4943b132c69370a1d644 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe00bf42aff43b5be70835cd6f08b3c" member_type: VOTER last_known_addr { host: "127.17.136.2" port: 44529 } } peers { permanent_uuid: "a4632fdbe3fd4678a5a57275c077138a" member_type: VOTER last_known_addr { host: "127.17.136.3" port: 35877 } } peers { permanent_uuid: "2c12418b9eda4943b132c69370a1d644" member_type: VOTER last_known_addr { host: "127.17.136.1" port: 36919 } }
I20260927 15:14:38.454564 768 leader_election.cc:288] T 8b2950c002724470931004273a75fcf1 P 2c12418b9eda4943b132c69370a1d644 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cfe00bf42aff43b5be70835cd6f08b3c (127.17.136.2:44529), a4632fdbe3fd4678a5a57275c077138a (127.17.136.3:35877)
Sep 27 15:14:38 dist-test-slave-5s2t krb5kdc[31654](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790522076, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.136.1@KRBTEST.COM for kudu/127.17.136.3@KRBTEST.COM
Sep 27 15:14:38 dist-test-slave-5s2t krb5kdc[31654](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790522076, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.136.1@KRBTEST.COM for kudu/127.17.136.2@KRBTEST.COM
I20260927 15:14:38.477658 765 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:14:38.454760 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.2:44529 (local address 127.17.136.1:33249)
0927 15:14:38.454890 (+ 130us) negotiation.cc:107] Waiting for socket to connect
0927 15:14:38.454906 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0927 15:14:38.455026 (+ 120us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0927 15:14:38.457237 (+ 2211us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0927 15:14:38.457242 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0927 15:14:38.457612 (+ 370us) client_negotiation.cc:189] Negotiated authn=SASL
0927 15:14:38.458102 (+ 490us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:14:38.458118 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:14:38.459354 (+ 1236us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:14:38.459358 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:14:38.460228 (+ 870us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:14:38.460238 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:14:38.461060 (+ 822us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:14:38.461064 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:14:38.461172 (+ 108us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:14:38.471512 (+ 10340us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0927 15:14:38.471536 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0927 15:14:38.473390 (+ 1854us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0927 15:14:38.475450 (+ 2060us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0927 15:14:38.475453 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0927 15:14:38.475455 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0927 15:14:38.475689 (+ 234us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0927 15:14:38.476011 (+ 322us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0927 15:14:38.476014 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0927 15:14:38.476016 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0927 15:14:38.476145 (+ 129us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0927 15:14:38.476748 (+ 603us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0927 15:14:38.476751 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0927 15:14:38.476983 (+ 232us) client_negotiation.cc:769] Sending connection context
0927 15:14:38.477145 (+ 162us) client_negotiation.cc:240] Negotiation successful
0927 15:14:38.477465 (+ 320us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":39,"mutex_wait_us":41,"spinlock_wait_cycles":10880}
I20260927 15:14:38.477679 771 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:14:38.455080 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.136.1:33249 (local address 127.17.136.2:44529)
0927 15:14:38.455434 (+ 354us) server_negotiation.cc:206] Beginning negotiation
0927 15:14:38.455460 (+ 26us) server_negotiation.cc:399] Waiting for connection header
0927 15:14:38.455507 (+ 47us) server_negotiation.cc:407] Connection header received
0927 15:14:38.456365 (+ 858us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:14:38.456374 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:14:38.456831 (+ 457us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:14:38.457172 (+ 341us) server_negotiation.cc:226] Negotiated authn=SASL
0927 15:14:38.458263 (+ 1091us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:14:38.459210 (+ 947us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:14:38.460373 (+ 1163us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:14:38.460944 (+ 571us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:14:38.461104 (+ 160us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:14:38.473597 (+ 12493us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0927 15:14:38.473602 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0927 15:14:38.473615 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0927 15:14:38.473646 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0927 15:14:38.475342 (+ 1696us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:14:38.475787 (+ 445us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:14:38.475794 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:14:38.475799 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:14:38.475909 (+ 110us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:14:38.476226 (+ 317us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:14:38.476229 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:14:38.476231 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:14:38.476636 (+ 405us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0927 15:14:38.476744 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0927 15:14:38.477264 (+ 520us) server_negotiation.cc:299] Negotiation successful
0927 15:14:38.477523 (+ 259us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":248,"thread_start_us":76,"threads_started":1}
I20260927 15:14:38.477699 770 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:14:38.455029 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.136.1:52393 (local address 127.17.136.3:35877)
0927 15:14:38.455434 (+ 405us) server_negotiation.cc:206] Beginning negotiation
0927 15:14:38.455460 (+ 26us) server_negotiation.cc:399] Waiting for connection header
0927 15:14:38.455527 (+ 67us) server_negotiation.cc:407] Connection header received
0927 15:14:38.456365 (+ 838us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:14:38.456374 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:14:38.456830 (+ 456us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:14:38.457172 (+ 342us) server_negotiation.cc:226] Negotiated authn=SASL
0927 15:14:38.458272 (+ 1100us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:14:38.459220 (+ 948us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:14:38.460339 (+ 1119us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:14:38.460891 (+ 552us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:14:38.461016 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:14:38.473352 (+ 12336us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0927 15:14:38.473358 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0927 15:14:38.473373 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0927 15:14:38.473405 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0927 15:14:38.475190 (+ 1785us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:14:38.475789 (+ 599us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:14:38.475794 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:14:38.475798 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:14:38.475912 (+ 114us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:14:38.476236 (+ 324us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:14:38.476239 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:14:38.476240 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:14:38.476636 (+ 396us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0927 15:14:38.476746 (+ 110us) server_negotiation.cc:1035] Waiting for connection context
0927 15:14:38.477266 (+ 520us) server_negotiation.cc:299] Negotiation successful
0927 15:14:38.477514 (+ 248us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":313,"thread_start_us":60,"threads_started":1}
I20260927 15:14:38.477700 769 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:14:38.454760 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.3:35877 (local address 127.17.136.1:52393)
0927 15:14:38.455186 (+ 426us) negotiation.cc:107] Waiting for socket to connect
0927 15:14:38.455195 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0927 15:14:38.455288 (+ 93us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0927 15:14:38.457652 (+ 2364us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0927 15:14:38.457655 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0927 15:14:38.457806 (+ 151us) client_negotiation.cc:189] Negotiated authn=SASL
0927 15:14:38.458102 (+ 296us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:14:38.458118 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:14:38.459362 (+ 1244us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:14:38.459364 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:14:38.460221 (+ 857us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:14:38.460232 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:14:38.461009 (+ 777us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:14:38.461013 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:14:38.461170 (+ 157us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:14:38.471512 (+ 10342us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0927 15:14:38.471539 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0927 15:14:38.473108 (+ 1569us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0927 15:14:38.475347 (+ 2239us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0927 15:14:38.475354 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0927 15:14:38.475369 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0927 15:14:38.475679 (+ 310us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0927 15:14:38.476001 (+ 322us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0927 15:14:38.476004 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0927 15:14:38.476006 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0927 15:14:38.476153 (+ 147us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0927 15:14:38.476744 (+ 591us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0927 15:14:38.476750 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0927 15:14:38.476983 (+ 233us) client_negotiation.cc:769] Sending connection context
0927 15:14:38.477144 (+ 161us) client_negotiation.cc:240] Negotiation successful
0927 15:14:38.477544 (+ 400us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":375,"mutex_wait_us":302,"spinlock_wait_cycles":20224,"thread_start_us":63,"threads_started":1}
W20260927 15:14:38.480796 384 leader_election.cc:341] T 8b2950c002724470931004273a75fcf1 P 2c12418b9eda4943b132c69370a1d644 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer a4632fdbe3fd4678a5a57275c077138a (127.17.136.3:35877): Not found: Tablet not found: 8b2950c002724470931004273a75fcf1
W20260927 15:14:38.480966 381 leader_election.cc:341] T 8b2950c002724470931004273a75fcf1 P 2c12418b9eda4943b132c69370a1d644 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer cfe00bf42aff43b5be70835cd6f08b3c (127.17.136.2:44529): Not found: Tablet not found: 8b2950c002724470931004273a75fcf1
I20260927 15:14:38.481038 381 leader_election.cc:302] T 8b2950c002724470931004273a75fcf1 P 2c12418b9eda4943b132c69370a1d644 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c12418b9eda4943b132c69370a1d644; no voters: a4632fdbe3fd4678a5a57275c077138a, cfe00bf42aff43b5be70835cd6f08b3c
I20260927 15:14:38.481263 768 raft_consensus.cc:2726] T 8b2950c002724470931004273a75fcf1 P 2c12418b9eda4943b132c69370a1d644 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260927 15:14:38.998169 772 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:14:38.997740 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.62:42541 (local address 127.17.136.1:40181)
0927 15:14:38.998007 (+ 267us) negotiation.cc:107] Waiting for socket to connect
0927 15:14:38.998068 (+ 61us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.136.62:42541: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":190,"thread_start_us":74,"threads_started":1}
I20260927 15:14:39.128979 773 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:14:39.128629 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.62:42541 (local address 127.17.136.2:50941)
0927 15:14:39.128844 (+ 215us) negotiation.cc:107] Waiting for socket to connect
0927 15:14:39.128896 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.136.62:42541: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":151,"thread_start_us":68,"threads_started":1}
I20260927 15:14:39.300770 774 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:14:39.300423 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.62:42541 (local address 127.17.136.3:36205)
0927 15:14:39.300642 (+ 219us) negotiation.cc:107] Waiting for socket to connect
0927 15:14:39.300691 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.136.62:42541: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":153,"thread_start_us":66,"threads_started":1}
I20260927 15:14:39.999464 775 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:14:39.998943 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.62:42541 (local address 127.17.136.1:37001)
0927 15:14:39.999209 (+ 266us) negotiation.cc:107] Waiting for socket to connect
0927 15:14:39.999304 (+ 95us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.136.62:42541: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":184,"thread_start_us":70,"threads_started":1}
I20260927 15:14:40.130009 776 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:14:40.129625 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.62:42541 (local address 127.17.136.2:35919)
0927 15:14:40.129852 (+ 227us) negotiation.cc:107] Waiting for socket to connect
0927 15:14:40.129907 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.136.62:42541: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":159,"thread_start_us":68,"threads_started":1}
I20260927 15:14:40.189440 777 raft_consensus.cc:482] T 8b2950c002724470931004273a75fcf1 P 2c12418b9eda4943b132c69370a1d644 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:14:40.189564 777 raft_consensus.cc:504] T 8b2950c002724470931004273a75fcf1 P 2c12418b9eda4943b132c69370a1d644 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe00bf42aff43b5be70835cd6f08b3c" member_type: VOTER last_known_addr { host: "127.17.136.2" port: 44529 } } peers { permanent_uuid: "a4632fdbe3fd4678a5a57275c077138a" member_type: VOTER last_known_addr { host: "127.17.136.3" port: 35877 } } peers { permanent_uuid: "2c12418b9eda4943b132c69370a1d644" member_type: VOTER last_known_addr { host: "127.17.136.1" port: 36919 } }
I20260927 15:14:40.189919 777 leader_election.cc:288] T 8b2950c002724470931004273a75fcf1 P 2c12418b9eda4943b132c69370a1d644 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cfe00bf42aff43b5be70835cd6f08b3c (127.17.136.2:44529), a4632fdbe3fd4678a5a57275c077138a (127.17.136.3:35877)
W20260927 15:14:40.190703 384 leader_election.cc:341] T 8b2950c002724470931004273a75fcf1 P 2c12418b9eda4943b132c69370a1d644 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer a4632fdbe3fd4678a5a57275c077138a (127.17.136.3:35877): Not found: Tablet not found: 8b2950c002724470931004273a75fcf1
W20260927 15:14:40.190837 381 leader_election.cc:341] T 8b2950c002724470931004273a75fcf1 P 2c12418b9eda4943b132c69370a1d644 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer cfe00bf42aff43b5be70835cd6f08b3c (127.17.136.2:44529): Not found: Tablet not found: 8b2950c002724470931004273a75fcf1
I20260927 15:14:40.190919 381 leader_election.cc:302] T 8b2950c002724470931004273a75fcf1 P 2c12418b9eda4943b132c69370a1d644 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c12418b9eda4943b132c69370a1d644; no voters: a4632fdbe3fd4678a5a57275c077138a, cfe00bf42aff43b5be70835cd6f08b3c
I20260927 15:14:40.191076 777 raft_consensus.cc:2726] T 8b2950c002724470931004273a75fcf1 P 2c12418b9eda4943b132c69370a1d644 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260927 15:14:40.301733 778 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:14:40.301367 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.62:42541 (local address 127.17.136.3:41997)
0927 15:14:40.301600 (+ 233us) negotiation.cc:107] Waiting for socket to connect
0927 15:14:40.301650 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.136.62:42541: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":168,"thread_start_us":65,"threads_started":1}
I20260927 15:14:41.000686 779 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:14:41.000270 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.62:42541 (local address 127.17.136.1:42973)
0927 15:14:41.000537 (+ 267us) negotiation.cc:107] Waiting for socket to connect
0927 15:14:41.000588 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.136.62:42541: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":199,"thread_start_us":85,"threads_started":1}
I20260927 15:14:41.130990 780 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:14:41.130632 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.62:42541 (local address 127.17.136.2:47759)
0927 15:14:41.130854 (+ 222us) negotiation.cc:107] Waiting for socket to connect
0927 15:14:41.130904 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.136.62:42541: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":153,"thread_start_us":69,"threads_started":1}
I20260927 15:14:41.302675 781 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:14:41.302316 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.62:42541 (local address 127.17.136.3:52039)
0927 15:14:41.302541 (+ 225us) negotiation.cc:107] Waiting for socket to connect
0927 15:14:41.302590 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.136.62:42541: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":164,"thread_start_us":82,"threads_started":1}
I20260927 15:14:42.002102 782 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:14:42.001546 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.62:42541 (local address 127.17.136.1:45013)
0927 15:14:42.001897 (+ 351us) negotiation.cc:107] Waiting for socket to connect
0927 15:14:42.001978 (+ 81us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.136.62:42541: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":258,"thread_start_us":75,"threads_started":1}
I20260927 15:14:42.132263 783 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:14:42.131780 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.62:42541 (local address 127.17.136.2:46569)
0927 15:14:42.132102 (+ 322us) negotiation.cc:107] Waiting for socket to connect
0927 15:14:42.132170 (+ 68us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.136.62:42541: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":233,"thread_start_us":107,"threads_started":1}
I20260927 15:14:42.264142 784 raft_consensus.cc:482] T 8b2950c002724470931004273a75fcf1 P 2c12418b9eda4943b132c69370a1d644 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:14:42.264271 784 raft_consensus.cc:504] T 8b2950c002724470931004273a75fcf1 P 2c12418b9eda4943b132c69370a1d644 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe00bf42aff43b5be70835cd6f08b3c" member_type: VOTER last_known_addr { host: "127.17.136.2" port: 44529 } } peers { permanent_uuid: "a4632fdbe3fd4678a5a57275c077138a" member_type: VOTER last_known_addr { host: "127.17.136.3" port: 35877 } } peers { permanent_uuid: "2c12418b9eda4943b132c69370a1d644" member_type: VOTER last_known_addr { host: "127.17.136.1" port: 36919 } }
I20260927 15:14:42.264670 784 leader_election.cc:288] T 8b2950c002724470931004273a75fcf1 P 2c12418b9eda4943b132c69370a1d644 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cfe00bf42aff43b5be70835cd6f08b3c (127.17.136.2:44529), a4632fdbe3fd4678a5a57275c077138a (127.17.136.3:35877)
W20260927 15:14:42.265343 384 leader_election.cc:341] T 8b2950c002724470931004273a75fcf1 P 2c12418b9eda4943b132c69370a1d644 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer a4632fdbe3fd4678a5a57275c077138a (127.17.136.3:35877): Not found: Tablet not found: 8b2950c002724470931004273a75fcf1
W20260927 15:14:42.265442 381 leader_election.cc:341] T 8b2950c002724470931004273a75fcf1 P 2c12418b9eda4943b132c69370a1d644 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer cfe00bf42aff43b5be70835cd6f08b3c (127.17.136.2:44529): Not found: Tablet not found: 8b2950c002724470931004273a75fcf1
I20260927 15:14:42.265537 381 leader_election.cc:302] T 8b2950c002724470931004273a75fcf1 P 2c12418b9eda4943b132c69370a1d644 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c12418b9eda4943b132c69370a1d644; no voters: a4632fdbe3fd4678a5a57275c077138a, cfe00bf42aff43b5be70835cd6f08b3c
I20260927 15:14:42.265662 784 raft_consensus.cc:2726] T 8b2950c002724470931004273a75fcf1 P 2c12418b9eda4943b132c69370a1d644 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260927 15:14:42.303742 785 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:14:42.303379 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.62:42541 (local address 127.17.136.3:55425)
0927 15:14:42.303600 (+ 221us) negotiation.cc:107] Waiting for socket to connect
0927 15:14:42.303655 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.136.62:42541: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":150,"thread_start_us":64,"threads_started":1}
I20260927 15:14:43.003268 786 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:14:43.002799 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.62:42541 (local address 127.17.136.1:34973)
0927 15:14:43.003078 (+ 279us) negotiation.cc:107] Waiting for socket to connect
0927 15:14:43.003144 (+ 66us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.136.62:42541: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":201,"thread_start_us":72,"threads_started":1}
I20260927 15:14:43.133292 787 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:14:43.132893 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.62:42541 (local address 127.17.136.2:50981)
0927 15:14:43.133151 (+ 258us) negotiation.cc:107] Waiting for socket to connect
0927 15:14:43.133206 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.136.62:42541: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":167,"thread_start_us":85,"threads_started":1}
I20260927 15:14:43.304723 788 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:14:43.304358 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.62:42541 (local address 127.17.136.3:45199)
0927 15:14:43.304584 (+ 226us) negotiation.cc:107] Waiting for socket to connect
0927 15:14:43.304635 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.136.62:42541: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":162,"thread_start_us":78,"threads_started":1}
I20260927 15:14:44.004344 789 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:14:44.003940 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.62:42541 (local address 127.17.136.1:57215)
0927 15:14:44.004186 (+ 246us) negotiation.cc:107] Waiting for socket to connect
0927 15:14:44.004245 (+ 59us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.136.62:42541: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":170,"thread_start_us":73,"threads_started":1}
I20260927 15:14:44.134349 790 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:14:44.133922 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.62:42541 (local address 127.17.136.2:55927)
0927 15:14:44.134205 (+ 283us) negotiation.cc:107] Waiting for socket to connect
0927 15:14:44.134259 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.136.62:42541: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":213,"thread_start_us":75,"threads_started":1}
I20260927 15:14:44.305799 791 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:14:44.305350 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.62:42541 (local address 127.17.136.3:56863)
0927 15:14:44.305655 (+ 305us) negotiation.cc:107] Waiting for socket to connect
0927 15:14:44.305711 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.136.62:42541: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":232,"thread_start_us":79,"threads_started":1}
I20260927 15:14:45.005436 792 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:14:45.005023 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.62:42541 (local address 127.17.136.1:48023)
0927 15:14:45.005284 (+ 261us) negotiation.cc:107] Waiting for socket to connect
0927 15:14:45.005338 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.136.62:42541: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":187,"thread_start_us":85,"threads_started":1}
I20260927 15:14:45.024591 793 raft_consensus.cc:482] T 8b2950c002724470931004273a75fcf1 P 2c12418b9eda4943b132c69370a1d644 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:14:45.024729 793 raft_consensus.cc:504] T 8b2950c002724470931004273a75fcf1 P 2c12418b9eda4943b132c69370a1d644 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe00bf42aff43b5be70835cd6f08b3c" member_type: VOTER last_known_addr { host: "127.17.136.2" port: 44529 } } peers { permanent_uuid: "a4632fdbe3fd4678a5a57275c077138a" member_type: VOTER last_known_addr { host: "127.17.136.3" port: 35877 } } peers { permanent_uuid: "2c12418b9eda4943b132c69370a1d644" member_type: VOTER last_known_addr { host: "127.17.136.1" port: 36919 } }
I20260927 15:14:45.025194 793 leader_election.cc:288] T 8b2950c002724470931004273a75fcf1 P 2c12418b9eda4943b132c69370a1d644 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cfe00bf42aff43b5be70835cd6f08b3c (127.17.136.2:44529), a4632fdbe3fd4678a5a57275c077138a (127.17.136.3:35877)
W20260927 15:14:45.025892 384 leader_election.cc:341] T 8b2950c002724470931004273a75fcf1 P 2c12418b9eda4943b132c69370a1d644 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer a4632fdbe3fd4678a5a57275c077138a (127.17.136.3:35877): Not found: Tablet not found: 8b2950c002724470931004273a75fcf1
W20260927 15:14:45.026017 381 leader_election.cc:341] T 8b2950c002724470931004273a75fcf1 P 2c12418b9eda4943b132c69370a1d644 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer cfe00bf42aff43b5be70835cd6f08b3c (127.17.136.2:44529): Not found: Tablet not found: 8b2950c002724470931004273a75fcf1
I20260927 15:14:45.026106 381 leader_election.cc:302] T 8b2950c002724470931004273a75fcf1 P 2c12418b9eda4943b132c69370a1d644 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c12418b9eda4943b132c69370a1d644; no voters: a4632fdbe3fd4678a5a57275c077138a, cfe00bf42aff43b5be70835cd6f08b3c
I20260927 15:14:45.026253 793 raft_consensus.cc:2726] T 8b2950c002724470931004273a75fcf1 P 2c12418b9eda4943b132c69370a1d644 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260927 15:14:45.135480 794 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:14:45.135032 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.62:42541 (local address 127.17.136.2:39663)
0927 15:14:45.135320 (+ 288us) negotiation.cc:107] Waiting for socket to connect
0927 15:14:45.135390 (+ 70us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.136.62:42541: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":178,"thread_start_us":79,"threads_started":1}
I20260927 15:14:45.306749 795 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:14:45.306410 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.62:42541 (local address 127.17.136.3:57437)
0927 15:14:45.306618 (+ 208us) negotiation.cc:107] Waiting for socket to connect
0927 15:14:45.306667 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.136.62:42541: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":148,"thread_start_us":70,"threads_started":1}
I20260927 15:14:46.006541 796 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:14:46.006119 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.62:42541 (local address 127.17.136.1:39619)
0927 15:14:46.006373 (+ 254us) negotiation.cc:107] Waiting for socket to connect
0927 15:14:46.006425 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.136.62:42541: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":184,"thread_start_us":89,"threads_started":1}
I20260927 15:14:46.136472 797 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:14:46.136083 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.62:42541 (local address 127.17.136.2:35131)
0927 15:14:46.136324 (+ 241us) negotiation.cc:107] Waiting for socket to connect
0927 15:14:46.136375 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.136.62:42541: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":171,"thread_start_us":81,"threads_started":1}
I20260927 15:14:46.307816 798 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:14:46.307374 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.62:42541 (local address 127.17.136.3:46465)
0927 15:14:46.307644 (+ 270us) negotiation.cc:107] Waiting for socket to connect
0927 15:14:46.307706 (+ 62us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.136.62:42541: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":194,"thread_start_us":81,"threads_started":1}
I20260927 15:14:47.007721 799 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:14:47.007325 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.62:42541 (local address 127.17.136.1:35065)
0927 15:14:47.007571 (+ 246us) negotiation.cc:107] Waiting for socket to connect
0927 15:14:47.007627 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.136.62:42541: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":175,"thread_start_us":67,"threads_started":1}
I20260927 15:14:47.137512 800 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:14:47.137128 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.62:42541 (local address 127.17.136.2:48873)
0927 15:14:47.137368 (+ 240us) negotiation.cc:107] Waiting for socket to connect
0927 15:14:47.137422 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.136.62:42541: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":166,"thread_start_us":67,"threads_started":1}
I20260927 15:14:47.308866 801 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:14:47.308502 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.62:42541 (local address 127.17.136.3:47669)
0927 15:14:47.308725 (+ 223us) negotiation.cc:107] Waiting for socket to connect
0927 15:14:47.308778 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.136.62:42541: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":158,"thread_start_us":78,"threads_started":1}
I20260927 15:14:48.008800 802 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:14:48.008388 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.62:42541 (local address 127.17.136.1:46629)
0927 15:14:48.008646 (+ 258us) negotiation.cc:107] Waiting for socket to connect
0927 15:14:48.008704 (+ 58us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.136.62:42541: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":179,"thread_start_us":75,"threads_started":1}
I20260927 15:14:48.138615 803 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:14:48.138192 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.62:42541 (local address 127.17.136.2:42835)
0927 15:14:48.138472 (+ 280us) negotiation.cc:107] Waiting for socket to connect
0927 15:14:48.138526 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.136.62:42541: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":209,"thread_start_us":67,"threads_started":1}
I20260927 15:14:48.309926 804 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:14:48.309503 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.62:42541 (local address 127.17.136.3:59993)
0927 15:14:48.309774 (+ 271us) negotiation.cc:107] Waiting for socket to connect
0927 15:14:48.309838 (+ 64us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.136.62:42541: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":195,"thread_start_us":79,"threads_started":1}
I20260927 15:14:49.009931 805 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:14:49.009479 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.62:42541 (local address 127.17.136.1:55005)
0927 15:14:49.009769 (+ 290us) negotiation.cc:107] Waiting for socket to connect
0927 15:14:49.009833 (+ 64us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.136.62:42541: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":204,"thread_start_us":88,"threads_started":1}
I20260927 15:14:49.139848 806 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:14:49.139444 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.62:42541 (local address 127.17.136.2:53197)
0927 15:14:49.139700 (+ 256us) negotiation.cc:107] Waiting for socket to connect
0927 15:14:49.139757 (+ 57us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.136.62:42541: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":180,"thread_start_us":88,"threads_started":1}
I20260927 15:14:49.310935 807 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:14:49.310567 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.62:42541 (local address 127.17.136.3:39755)
0927 15:14:49.310792 (+ 225us) negotiation.cc:107] Waiting for socket to connect
0927 15:14:49.310846 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.136.62:42541: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":156,"thread_start_us":66,"threads_started":1}
I20260927 15:14:49.654918 808 raft_consensus.cc:482] T 8b2950c002724470931004273a75fcf1 P 2c12418b9eda4943b132c69370a1d644 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:14:49.655038 808 raft_consensus.cc:504] T 8b2950c002724470931004273a75fcf1 P 2c12418b9eda4943b132c69370a1d644 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfe00bf42aff43b5be70835cd6f08b3c" member_type: VOTER last_known_addr { host: "127.17.136.2" port: 44529 } } peers { permanent_uuid: "a4632fdbe3fd4678a5a57275c077138a" member_type: VOTER last_known_addr { host: "127.17.136.3" port: 35877 } } peers { permanent_uuid: "2c12418b9eda4943b132c69370a1d644" member_type: VOTER last_known_addr { host: "127.17.136.1" port: 36919 } }
I20260927 15:14:49.655469 808 leader_election.cc:288] T 8b2950c002724470931004273a75fcf1 P 2c12418b9eda4943b132c69370a1d644 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cfe00bf42aff43b5be70835cd6f08b3c (127.17.136.2:44529), a4632fdbe3fd4678a5a57275c077138a (127.17.136.3:35877)
W20260927 15:14:49.656180 381 leader_election.cc:341] T 8b2950c002724470931004273a75fcf1 P 2c12418b9eda4943b132c69370a1d644 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer cfe00bf42aff43b5be70835cd6f08b3c (127.17.136.2:44529): Not found: Tablet not found: 8b2950c002724470931004273a75fcf1
W20260927 15:14:49.656282 384 leader_election.cc:341] T 8b2950c002724470931004273a75fcf1 P 2c12418b9eda4943b132c69370a1d644 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer a4632fdbe3fd4678a5a57275c077138a (127.17.136.3:35877): Not found: Tablet not found: 8b2950c002724470931004273a75fcf1
I20260927 15:14:49.656394 384 leader_election.cc:302] T 8b2950c002724470931004273a75fcf1 P 2c12418b9eda4943b132c69370a1d644 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c12418b9eda4943b132c69370a1d644; no voters: a4632fdbe3fd4678a5a57275c077138a, cfe00bf42aff43b5be70835cd6f08b3c
I20260927 15:14:49.656530 808 raft_consensus.cc:2726] T 8b2950c002724470931004273a75fcf1 P 2c12418b9eda4943b132c69370a1d644 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260927 15:14:50.011173 809 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:14:50.010763 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.62:42541 (local address 127.17.136.1:55423)
0927 15:14:50.011002 (+ 239us) negotiation.cc:107] Waiting for socket to connect
0927 15:14:50.011076 (+ 74us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.136.62:42541: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":161,"thread_start_us":73,"threads_started":1}
I20260927 15:14:50.140872 810 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:14:50.140509 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.62:42541 (local address 127.17.136.2:51841)
0927 15:14:50.140728 (+ 219us) negotiation.cc:107] Waiting for socket to connect
0927 15:14:50.140781 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.136.62:42541: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":153,"thread_start_us":70,"threads_started":1}
I20260927 15:14:50.312026 811 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:14:50.311655 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.62:42541 (local address 127.17.136.3:48697)
0927 15:14:50.311883 (+ 228us) negotiation.cc:107] Waiting for socket to connect
0927 15:14:50.311936 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.136.62:42541: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":163,"thread_start_us":78,"threads_started":1}
I20260927 15:14:51.012168 812 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:14:51.011797 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.62:42541 (local address 127.17.136.1:52953)
0927 15:14:51.012019 (+ 222us) negotiation.cc:107] Waiting for socket to connect
0927 15:14:51.012071 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.136.62:42541: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":154,"thread_start_us":68,"threads_started":1}
I20260927 15:14:51.141888 813 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:14:51.141518 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.62:42541 (local address 127.17.136.2:56083)
0927 15:14:51.141743 (+ 225us) negotiation.cc:107] Waiting for socket to connect
0927 15:14:51.141796 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.136.62:42541: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":160,"thread_start_us":74,"threads_started":1}
I20260927 15:14:51.313103 814 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:14:51.312694 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.62:42541 (local address 127.17.136.3:38089)
0927 15:14:51.312934 (+ 240us) negotiation.cc:107] Waiting for socket to connect
0927 15:14:51.313013 (+ 79us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.136.62:42541: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":164,"thread_start_us":70,"threads_started":1}
I20260927 15:14:52.013334 815 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:14:52.012972 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.62:42541 (local address 127.17.136.1:55019)
0927 15:14:52.013193 (+ 221us) negotiation.cc:107] Waiting for socket to connect
0927 15:14:52.013243 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.136.62:42541: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":156,"thread_start_us":78,"threads_started":1}
I20260927 15:14:52.143047 816 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:14:52.142674 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.62:42541 (local address 127.17.136.2:35361)
0927 15:14:52.142883 (+ 209us) negotiation.cc:107] Waiting for socket to connect
0927 15:14:52.142936 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.136.62:42541: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":146,"thread_start_us":67,"threads_started":1}
I20260927 15:14:52.304137 17952 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu with pid 331
I20260927 15:14:52.309259 17952 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu with pid 499
I20260927 15:14:52.313891 17952 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu with pid 631
2026-09-27T15:14:52Z chronyd exiting
[ OK ] SecurityITest.TestEnableAndDisableEncryptedIPKICert (18996 ms)
[ RUN ] SecurityITest.TestEnableAndDisableEncryptedTSK
Loading random data
Initializing database '/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790521920546562-17952-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 27 15:14:52 dist-test-slave-5s2t krb5kdc[819](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 27 15:14:52 dist-test-slave-5s2t krb5kdc[819](info): set up 2 sockets
Sep 27 15:14:52 dist-test-slave-5s2t krb5kdc[819](info): commencing operation
krb5kdc: starting...
W20260927 15:14:53.259172 17952 mini_kdc.cc:121] Time spent starting KDC: real 0.929s user 0.000s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790521920546562-17952-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790521920546562-17952-0/krb5kdc/test-user.keytab.
Sep 27 15:14:53 dist-test-slave-5s2t krb5kdc[819](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790522093, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-27T15:14:53Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-27T15:14:53Z Disabled control of system clock
WARNING: no policy specified for kudu/127.17.136.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.136.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.136.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790521920546562-17952-0/krb5kdc/kudu_127.17.136.62.keytab.
Entry for principal kudu/127.17.136.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790521920546562-17952-0/krb5kdc/kudu_127.17.136.62.keytab.
I20260927 15:14:53.376307 17952 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu
/tmp/dist-test-taskiFOyeW/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790521920546562-17952-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790521920546562-17952-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790521920546562-17952-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790521920546562-17952-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.136.62:37201
--webserver_interface=127.17.136.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790521920546562-17952-0/krb5kdc/kudu_127.17.136.62.keytab
--principal=kudu/127.17.136.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.136.20:41831
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.136.62:37201
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20 with env {KRB5CCNAME=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790521920546562-17952-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790521920546562-17952-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790521920546562-17952-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260927 15:14:53.483994 832 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260927 15:14:53.484234 832 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260927 15:14:53.484298 832 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260927 15:14:53.488214 832 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260927 15:14:53.488263 832 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260927 15:14:53.488291 832 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260927 15:14:53.488307 832 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260927 15:14:53.488332 832 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260927 15:14:53.488363 832 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260927 15:14:53.488394 832 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260927 15:14:53.488421 832 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260927 15:14:53.493605 832 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.136.20:41831
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790521920546562-17952-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790521920546562-17952-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.17.136.62:37201
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790521920546562-17952-0/krb5kdc/kudu_127.17.136.62.keytab
--principal=kudu/127.17.136.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.136.62:37201
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790521920546562-17952-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.17.136.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.832
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790521920546562-17952-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 27 Sep 2026 14:27:13 UTC on ccycloud.quasar-psqrth.root.comops.site
build id 4676138
I20260927 15:14:53.494604 832 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260927 15:14:53.495608 832 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260927 15:14:53.503525 837 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260927 15:14:53.503526 840 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260927 15:14:53.503528 838 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260927 15:14:53.503568 832 server_base.cc:1034] running on GCE node
I20260927 15:14:53.504256 832 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260927 15:14:53.505251 832 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260927 15:14:53.506417 832 hybrid_clock.cc:648] HybridClock initialized: now 1790522093506391 us; error 35 us; skew 500 ppm
Sep 27 15:14:53 dist-test-slave-5s2t krb5kdc[819](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790522093, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.136.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260927 15:14:53.508975 832 init.cc:377] Logged in from keytab as kudu/127.17.136.62@KRBTEST.COM (short username kudu)
I20260927 15:14:53.509794 832 webserver.cc:460] Webserver started at http://127.17.136.62:33551/ using document root <none> and password file <none>
I20260927 15:14:53.510295 832 fs_manager.cc:359] Metadata directory not provided
I20260927 15:14:53.510353 832 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260927 15:14:53.510535 832 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260927 15:14:53.512497 832 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790521920546562-17952-0/minicluster-data/master-0/data/instance:
uuid: "ac838ba341bc469b8d25adb5e7aba771"
format_stamp: "Formatted at 2026-09-27 15:14:53 on dist-test-slave-5s2t"
server_key: "3979f68da0f38982c2df91f9dfda4632"
server_key_iv: "b5eb044c28a409ba8dfa338f7a3af8bd"
server_key_version: "encryptionkey@0"
I20260927 15:14:53.513012 832 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790521920546562-17952-0/minicluster-data/master-0/wal/instance:
uuid: "ac838ba341bc469b8d25adb5e7aba771"
format_stamp: "Formatted at 2026-09-27 15:14:53 on dist-test-slave-5s2t"
server_key: "3979f68da0f38982c2df91f9dfda4632"
server_key_iv: "b5eb044c28a409ba8dfa338f7a3af8bd"
server_key_version: "encryptionkey@0"
I20260927 15:14:53.516429 832 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260927 15:14:53.518659 847 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260927 15:14:53.519833 832 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260927 15:14:53.519933 832 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790521920546562-17952-0/minicluster-data/master-0/data,/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790521920546562-17952-0/minicluster-data/master-0/wal
uuid: "ac838ba341bc469b8d25adb5e7aba771"
format_stamp: "Formatted at 2026-09-27 15:14:53 on dist-test-slave-5s2t"
server_key: "3979f68da0f38982c2df91f9dfda4632"
server_key_iv: "b5eb044c28a409ba8dfa338f7a3af8bd"
server_key_version: "encryptionkey@0"
I20260927 15:14:53.520040 832 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790521920546562-17952-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790521920546562-17952-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790521920546562-17952-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260927 15:14:53.533511 832 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260927 15:14:53.536329 832 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260927 15:14:53.536491 832 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260927 15:14:53.542879 832 rpc_server.cc:307] RPC server started. Bound to: 127.17.136.62:37201
I20260927 15:14:53.543147 899 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.136.62:37201 every 8 connection(s)
I20260927 15:14:53.543792 832 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790521920546562-17952-0/minicluster-data/master-0/data/info.pb
I20260927 15:14:53.546392 900 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:14:53.551612 900 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ac838ba341bc469b8d25adb5e7aba771: Bootstrap starting.
I20260927 15:14:53.551779 17952 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu as pid 832
I20260927 15:14:53.551893 17952 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790521920546562-17952-0/minicluster-data/master-0/wal/instance
I20260927 15:14:53.552186 17952 external_mini_cluster.cc:1428] Setting key 1353dca78ad9a3a8e8f5bbd3f5f06c18
I20260927 15:14:53.554164 900 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ac838ba341bc469b8d25adb5e7aba771: Neither blocks nor log segments found. Creating new log.
I20260927 15:14:53.554824 900 log.cc:824] T 00000000000000000000000000000000 P ac838ba341bc469b8d25adb5e7aba771: Log is configured to *not* fsync() on all Append() calls
I20260927 15:14:53.556515 900 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ac838ba341bc469b8d25adb5e7aba771: No bootstrap required, opened a new log
I20260927 15:14:53.559894 900 raft_consensus.cc:348] T 00000000000000000000000000000000 P ac838ba341bc469b8d25adb5e7aba771 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ac838ba341bc469b8d25adb5e7aba771" member_type: VOTER last_known_addr { host: "127.17.136.62" port: 37201 } }
I20260927 15:14:53.560158 900 raft_consensus.cc:374] T 00000000000000000000000000000000 P ac838ba341bc469b8d25adb5e7aba771 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:14:53.560210 900 raft_consensus.cc:729] T 00000000000000000000000000000000 P ac838ba341bc469b8d25adb5e7aba771 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ac838ba341bc469b8d25adb5e7aba771, State: Initialized, Role: FOLLOWER
Sep 27 15:14:53 dist-test-slave-5s2t krb5kdc[819](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790522093, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.136.62@KRBTEST.COM
I20260927 15:14:53.560616 900 consensus_queue.cc:260] T 00000000000000000000000000000000 P ac838ba341bc469b8d25adb5e7aba771 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ac838ba341bc469b8d25adb5e7aba771" member_type: VOTER last_known_addr { host: "127.17.136.62" port: 37201 } }
I20260927 15:14:53.560741 900 raft_consensus.cc:388] T 00000000000000000000000000000000 P ac838ba341bc469b8d25adb5e7aba771 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260927 15:14:53.560803 900 raft_consensus.cc:482] T 00000000000000000000000000000000 P ac838ba341bc469b8d25adb5e7aba771 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260927 15:14:53.560895 900 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ac838ba341bc469b8d25adb5e7aba771 [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:14:53.561827 900 raft_consensus.cc:504] T 00000000000000000000000000000000 P ac838ba341bc469b8d25adb5e7aba771 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ac838ba341bc469b8d25adb5e7aba771" member_type: VOTER last_known_addr { host: "127.17.136.62" port: 37201 } }
I20260927 15:14:53.562150 900 leader_election.cc:302] T 00000000000000000000000000000000 P ac838ba341bc469b8d25adb5e7aba771 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ac838ba341bc469b8d25adb5e7aba771; no voters:
I20260927 15:14:53.562409 900 leader_election.cc:288] T 00000000000000000000000000000000 P ac838ba341bc469b8d25adb5e7aba771 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260927 15:14:53.562501 905 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ac838ba341bc469b8d25adb5e7aba771 [term 1 FOLLOWER]: Leader election won for term 1
I20260927 15:14:53.562656 905 raft_consensus.cc:686] T 00000000000000000000000000000000 P ac838ba341bc469b8d25adb5e7aba771 [term 1 LEADER]: Becoming Leader. State: Replica: ac838ba341bc469b8d25adb5e7aba771, State: Running, Role: LEADER
I20260927 15:14:53.562991 905 consensus_queue.cc:237] T 00000000000000000000000000000000 P ac838ba341bc469b8d25adb5e7aba771 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ac838ba341bc469b8d25adb5e7aba771" member_type: VOTER last_known_addr { host: "127.17.136.62" port: 37201 } }
I20260927 15:14:53.563907 900 sys_catalog.cc:564] T 00000000000000000000000000000000 P ac838ba341bc469b8d25adb5e7aba771 [sys.catalog]: configured and running, proceeding with master startup.
I20260927 15:14:53.564139 906 sys_catalog.cc:455] T 00000000000000000000000000000000 P ac838ba341bc469b8d25adb5e7aba771 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "ac838ba341bc469b8d25adb5e7aba771" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ac838ba341bc469b8d25adb5e7aba771" member_type: VOTER last_known_addr { host: "127.17.136.62" port: 37201 } } }
I20260927 15:14:53.564261 906 sys_catalog.cc:458] T 00000000000000000000000000000000 P ac838ba341bc469b8d25adb5e7aba771 [sys.catalog]: This master's current role is: LEADER
I20260927 15:14:53.564558 907 sys_catalog.cc:455] T 00000000000000000000000000000000 P ac838ba341bc469b8d25adb5e7aba771 [sys.catalog]: SysCatalogTable state changed. Reason: New leader ac838ba341bc469b8d25adb5e7aba771. Latest consensus state: current_term: 1 leader_uuid: "ac838ba341bc469b8d25adb5e7aba771" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ac838ba341bc469b8d25adb5e7aba771" member_type: VOTER last_known_addr { host: "127.17.136.62" port: 37201 } } }
I20260927 15:14:53.564734 907 sys_catalog.cc:458] T 00000000000000000000000000000000 P ac838ba341bc469b8d25adb5e7aba771 [sys.catalog]: This master's current role is: LEADER
I20260927 15:14:53.566469 909 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260927 15:14:53.566496 903 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:14:53.553460 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34080 (local address 127.17.136.62:37201)
0927 15:14:53.553849 (+ 389us) server_negotiation.cc:206] Beginning negotiation
0927 15:14:53.553862 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0927 15:14:53.553896 (+ 34us) server_negotiation.cc:407] Connection header received
0927 15:14:53.554516 (+ 620us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:14:53.554534 (+ 18us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:14:53.554845 (+ 311us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:14:53.555148 (+ 303us) server_negotiation.cc:226] Negotiated authn=SASL
0927 15:14:53.555917 (+ 769us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:14:53.556885 (+ 968us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:14:53.557687 (+ 802us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:14:53.558147 (+ 460us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:14:53.558283 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:14:53.560802 (+ 2519us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0927 15:14:53.560809 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0927 15:14:53.560829 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0927 15:14:53.560860 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0927 15:14:53.562719 (+ 1859us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:14:53.563197 (+ 478us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:14:53.563202 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:14:53.563207 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:14:53.563364 (+ 157us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:14:53.563692 (+ 328us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:14:53.563695 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:14:53.563696 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:14:53.564225 (+ 529us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0927 15:14:53.564424 (+ 199us) server_negotiation.cc:1035] Waiting for connection context
0927 15:14:53.565131 (+ 707us) server_negotiation.cc:299] Negotiation successful
0927 15:14:53.565354 (+ 223us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":260,"thread_start_us":109,"threads_started":1}
I20260927 15:14:53.569588 909 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260927 15:14:53.575287 909 catalog_manager.cc:1347] Generated new cluster ID: 0ec6b0399cd3417b91198c866ec0ceec
I20260927 15:14:53.575342 909 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260927 15:14:53.596316 909 catalog_manager.cc:1370] Generated new certificate authority record
I20260927 15:14:53.597255 909 catalog_manager.cc:1504] Loading token signing keys...
I20260927 15:14:53.602654 909 catalog_manager.cc:5868] T 00000000000000000000000000000000 P ac838ba341bc469b8d25adb5e7aba771: Generated new TSK 0
I20260927 15:14:53.603456 909 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.17.136.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.136.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.136.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790521920546562-17952-0/krb5kdc/kudu_127.17.136.1.keytab.
Entry for principal kudu/127.17.136.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790521920546562-17952-0/krb5kdc/kudu_127.17.136.1.keytab.
I20260927 15:14:53.638967 17952 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu
/tmp/dist-test-taskiFOyeW/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790521920546562-17952-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790521920546562-17952-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790521920546562-17952-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790521920546562-17952-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.136.1:0
--local_ip_for_outbound_sockets=127.17.136.1
--webserver_interface=127.17.136.1
--webserver_port=0
--tserver_master_addrs=127.17.136.62:37201
--keytab_file=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790521920546562-17952-0/krb5kdc/kudu_127.17.136.1.keytab
--principal=kudu/127.17.136.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.136.20:41831
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790521920546562-17952-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790521920546562-17952-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790521920546562-17952-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260927 15:14:53.744180 926 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260927 15:14:53.744428 926 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260927 15:14:53.744485 926 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260927 15:14:53.748364 926 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260927 15:14:53.748413 926 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260927 15:14:53.748492 926 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.136.1
I20260927 15:14:53.753489 926 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.136.20:41831
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790521920546562-17952-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790521920546562-17952-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790521920546562-17952-0/krb5kdc/kudu_127.17.136.1.keytab
--principal=kudu/127.17.136.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.136.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790521920546562-17952-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.17.136.1
--webserver_port=0
--tserver_master_addrs=127.17.136.62:37201
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.926
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.136.1
--log_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790521920546562-17952-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 27 Sep 2026 14:27:13 UTC on ccycloud.quasar-psqrth.root.comops.site
build id 4676138
I20260927 15:14:53.754448 926 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260927 15:14:53.755424 926 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260927 15:14:53.764389 931 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260927 15:14:53.764472 932 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260927 15:14:53.764487 926 server_base.cc:1034] running on GCE node
W20260927 15:14:53.764721 934 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260927 15:14:53.765084 926 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260927 15:14:53.765658 926 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260927 15:14:53.766805 926 hybrid_clock.cc:648] HybridClock initialized: now 1790522093766788 us; error 34 us; skew 500 ppm
Sep 27 15:14:53 dist-test-slave-5s2t krb5kdc[819](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790522093, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.136.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260927 15:14:53.773096 926 init.cc:377] Logged in from keytab as kudu/127.17.136.1@KRBTEST.COM (short username kudu)
I20260927 15:14:53.773957 926 webserver.cc:460] Webserver started at http://127.17.136.1:46741/ using document root <none> and password file <none>
I20260927 15:14:53.774523 926 fs_manager.cc:359] Metadata directory not provided
I20260927 15:14:53.774590 926 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260927 15:14:53.774782 926 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260927 15:14:53.776783 926 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790521920546562-17952-0/minicluster-data/ts-0/data/instance:
uuid: "0d6699fa47f047bcb6dafd9ef13170de"
format_stamp: "Formatted at 2026-09-27 15:14:53 on dist-test-slave-5s2t"
server_key: "858b8373a613fe83c4c153c0c9a3c4a0"
server_key_iv: "2eb608dcfa909357c88ed646da3b717d"
server_key_version: "encryptionkey@0"
I20260927 15:14:53.777293 926 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790521920546562-17952-0/minicluster-data/ts-0/wal/instance:
uuid: "0d6699fa47f047bcb6dafd9ef13170de"
format_stamp: "Formatted at 2026-09-27 15:14:53 on dist-test-slave-5s2t"
server_key: "858b8373a613fe83c4c153c0c9a3c4a0"
server_key_iv: "2eb608dcfa909357c88ed646da3b717d"
server_key_version: "encryptionkey@0"
I20260927 15:14:53.780732 926 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260927 15:14:53.782958 941 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260927 15:14:53.784126 926 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260927 15:14:53.784227 926 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790521920546562-17952-0/minicluster-data/ts-0/data,/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790521920546562-17952-0/minicluster-data/ts-0/wal
uuid: "0d6699fa47f047bcb6dafd9ef13170de"
format_stamp: "Formatted at 2026-09-27 15:14:53 on dist-test-slave-5s2t"
server_key: "858b8373a613fe83c4c153c0c9a3c4a0"
server_key_iv: "2eb608dcfa909357c88ed646da3b717d"
server_key_version: "encryptionkey@0"
I20260927 15:14:53.784323 926 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790521920546562-17952-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790521920546562-17952-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790521920546562-17952-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260927 15:14:53.804416 926 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260927 15:14:53.807478 926 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260927 15:14:53.807647 926 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260927 15:14:53.808251 926 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260927 15:14:53.809070 926 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260927 15:14:53.809116 926 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260927 15:14:53.809158 926 ts_tablet_manager.cc:610] Registered 0 tablets
I20260927 15:14:53.809187 926 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260927 15:14:53.817013 926 rpc_server.cc:307] RPC server started. Bound to: 127.17.136.1:39793
I20260927 15:14:53.817059 1054 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.136.1:39793 every 8 connection(s)
I20260927 15:14:53.817915 926 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790521920546562-17952-0/minicluster-data/ts-0/data/info.pb
I20260927 15:14:53.825132 17952 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu as pid 926
I20260927 15:14:53.825253 17952 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790521920546562-17952-0/minicluster-data/ts-0/wal/instance
I20260927 15:14:53.825546 17952 external_mini_cluster.cc:1428] Setting key afa1a9598c39d4a9eeeb79eae389ee8a
Sep 27 15:14:53 dist-test-slave-5s2t krb5kdc[819](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790522093, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.136.1@KRBTEST.COM for kudu/127.17.136.62@KRBTEST.COM
I20260927 15:14:53.830997 903 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:14:53.819613 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.136.1:48441 (local address 127.17.136.62:37201)
0927 15:14:53.819742 (+ 129us) server_negotiation.cc:206] Beginning negotiation
0927 15:14:53.819746 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0927 15:14:53.820539 (+ 793us) server_negotiation.cc:407] Connection header received
0927 15:14:53.821824 (+ 1285us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:14:53.821828 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:14:53.821881 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:14:53.821968 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0927 15:14:53.823125 (+ 1157us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:14:53.823741 (+ 616us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:14:53.824851 (+ 1110us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:14:53.825172 (+ 321us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:14:53.825277 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:14:53.827710 (+ 2433us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0927 15:14:53.827713 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0927 15:14:53.827716 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0927 15:14:53.827743 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0927 15:14:53.829079 (+ 1336us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:14:53.829574 (+ 495us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:14:53.829578 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:14:53.829579 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:14:53.829662 (+ 83us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:14:53.829944 (+ 282us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:14:53.829947 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:14:53.829949 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:14:53.830140 (+ 191us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0927 15:14:53.830228 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0927 15:14:53.830692 (+ 464us) server_negotiation.cc:299] Negotiation successful
0927 15:14:53.830817 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260927 15:14:53.831768 1057 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:14:53.819988 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.62:37201 (local address 127.17.136.1:48441)
0927 15:14:53.820388 (+ 400us) negotiation.cc:107] Waiting for socket to connect
0927 15:14:53.820446 (+ 58us) client_negotiation.cc:174] Beginning negotiation
0927 15:14:53.821630 (+ 1184us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0927 15:14:53.822134 (+ 504us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0927 15:14:53.822140 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0927 15:14:53.822486 (+ 346us) client_negotiation.cc:189] Negotiated authn=SASL
0927 15:14:53.822992 (+ 506us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:14:53.823006 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:14:53.823855 (+ 849us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:14:53.823858 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:14:53.824736 (+ 878us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:14:53.824746 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:14:53.825331 (+ 585us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:14:53.825336 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:14:53.825496 (+ 160us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:14:53.826025 (+ 529us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0927 15:14:53.826044 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0927 15:14:53.827563 (+ 1519us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0927 15:14:53.829184 (+ 1621us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0927 15:14:53.829190 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0927 15:14:53.829206 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0927 15:14:53.829489 (+ 283us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0927 15:14:53.829740 (+ 251us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0927 15:14:53.829742 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0927 15:14:53.829744 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0927 15:14:53.829864 (+ 120us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0927 15:14:53.830223 (+ 359us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0927 15:14:53.830228 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0927 15:14:53.830454 (+ 226us) client_negotiation.cc:769] Sending connection context
0927 15:14:53.830628 (+ 174us) client_negotiation.cc:240] Negotiation successful
0927 15:14:53.830881 (+ 253us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":222,"thread_start_us":95,"threads_started":1}
I20260927 15:14:53.832887 1055 heartbeater.cc:347] Connected to a master server at 127.17.136.62:37201
I20260927 15:14:53.833148 1055 heartbeater.cc:464] Registering TS with master...
I20260927 15:14:53.833719 1055 heartbeater.cc:511] Master 127.17.136.62:37201 requested a full tablet report, sending...
WARNING: no policy specified for kudu/127.17.136.2@KRBTEST.COM; defaulting to no policy
I20260927 15:14:53.835377 864 ts_manager.cc:194] Registered new tserver with Master: 0d6699fa47f047bcb6dafd9ef13170de (127.17.136.1:39793)
I20260927 15:14:53.836488 864 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.136.1@KRBTEST.COM'} at 127.17.136.1:48441
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.136.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.136.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790521920546562-17952-0/krb5kdc/kudu_127.17.136.2.keytab.
Entry for principal kudu/127.17.136.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790521920546562-17952-0/krb5kdc/kudu_127.17.136.2.keytab.
I20260927 15:14:53.850564 17952 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu
/tmp/dist-test-taskiFOyeW/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790521920546562-17952-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790521920546562-17952-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790521920546562-17952-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790521920546562-17952-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.136.2:0
--local_ip_for_outbound_sockets=127.17.136.2
--webserver_interface=127.17.136.2
--webserver_port=0
--tserver_master_addrs=127.17.136.62:37201
--keytab_file=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790521920546562-17952-0/krb5kdc/kudu_127.17.136.2.keytab
--principal=kudu/127.17.136.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.136.20:41831
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790521920546562-17952-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790521920546562-17952-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790521920546562-17952-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260927 15:14:53.956051 1060 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260927 15:14:53.956293 1060 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260927 15:14:53.956334 1060 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260927 15:14:53.960251 1060 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260927 15:14:53.960305 1060 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260927 15:14:53.960366 1060 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.136.2
I20260927 15:14:53.965523 1060 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.136.20:41831
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790521920546562-17952-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790521920546562-17952-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790521920546562-17952-0/krb5kdc/kudu_127.17.136.2.keytab
--principal=kudu/127.17.136.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.136.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790521920546562-17952-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.17.136.2
--webserver_port=0
--tserver_master_addrs=127.17.136.62:37201
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1060
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.136.2
--log_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790521920546562-17952-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 27 Sep 2026 14:27:13 UTC on ccycloud.quasar-psqrth.root.comops.site
build id 4676138
I20260927 15:14:53.966485 1060 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260927 15:14:53.967478 1060 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260927 15:14:53.976459 1066 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260927 15:14:53.976488 1065 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260927 15:14:53.976524 1068 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260927 15:14:53.976610 1060 server_base.cc:1034] running on GCE node
I20260927 15:14:53.977038 1060 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260927 15:14:53.977614 1060 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260927 15:14:53.978765 1060 hybrid_clock.cc:648] HybridClock initialized: now 1790522093978746 us; error 29 us; skew 500 ppm
Sep 27 15:14:53 dist-test-slave-5s2t krb5kdc[819](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790522093, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.136.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260927 15:14:53.981251 1060 init.cc:377] Logged in from keytab as kudu/127.17.136.2@KRBTEST.COM (short username kudu)
I20260927 15:14:53.982054 1060 webserver.cc:460] Webserver started at http://127.17.136.2:46249/ using document root <none> and password file <none>
I20260927 15:14:53.982569 1060 fs_manager.cc:359] Metadata directory not provided
I20260927 15:14:53.982630 1060 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260927 15:14:53.982807 1060 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260927 15:14:53.984757 1060 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790521920546562-17952-0/minicluster-data/ts-1/data/instance:
uuid: "437c32e490224ee59166772390280f3f"
format_stamp: "Formatted at 2026-09-27 15:14:53 on dist-test-slave-5s2t"
server_key: "ea4dff3ebf9920264cba02c8f7f3aa73"
server_key_iv: "466d429d2eec40da294248052ddc62b3"
server_key_version: "encryptionkey@0"
I20260927 15:14:53.985249 1060 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790521920546562-17952-0/minicluster-data/ts-1/wal/instance:
uuid: "437c32e490224ee59166772390280f3f"
format_stamp: "Formatted at 2026-09-27 15:14:53 on dist-test-slave-5s2t"
server_key: "ea4dff3ebf9920264cba02c8f7f3aa73"
server_key_iv: "466d429d2eec40da294248052ddc62b3"
server_key_version: "encryptionkey@0"
I20260927 15:14:53.988832 1060 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.000s sys 0.004s
I20260927 15:14:53.991101 1075 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260927 15:14:53.992256 1060 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260927 15:14:53.992357 1060 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790521920546562-17952-0/minicluster-data/ts-1/data,/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790521920546562-17952-0/minicluster-data/ts-1/wal
uuid: "437c32e490224ee59166772390280f3f"
format_stamp: "Formatted at 2026-09-27 15:14:53 on dist-test-slave-5s2t"
server_key: "ea4dff3ebf9920264cba02c8f7f3aa73"
server_key_iv: "466d429d2eec40da294248052ddc62b3"
server_key_version: "encryptionkey@0"
I20260927 15:14:53.992466 1060 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790521920546562-17952-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790521920546562-17952-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790521920546562-17952-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260927 15:14:54.017401 1060 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260927 15:14:54.020432 1060 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260927 15:14:54.020587 1060 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260927 15:14:54.021095 1060 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260927 15:14:54.021865 1060 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260927 15:14:54.021911 1060 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260927 15:14:54.021950 1060 ts_tablet_manager.cc:610] Registered 0 tablets
I20260927 15:14:54.021965 1060 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260927 15:14:54.030508 1060 rpc_server.cc:307] RPC server started. Bound to: 127.17.136.2:46571
I20260927 15:14:54.030550 1188 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.136.2:46571 every 8 connection(s)
I20260927 15:14:54.031421 1060 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790521920546562-17952-0/minicluster-data/ts-1/data/info.pb
I20260927 15:14:54.036504 17952 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu as pid 1060
I20260927 15:14:54.036616 17952 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790521920546562-17952-0/minicluster-data/ts-1/wal/instance
I20260927 15:14:54.036916 17952 external_mini_cluster.cc:1428] Setting key c067d51495b30a0c669028e2ddd98059
Sep 27 15:14:54 dist-test-slave-5s2t krb5kdc[819](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790522093, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.136.2@KRBTEST.COM for kudu/127.17.136.62@KRBTEST.COM
I20260927 15:14:54.045229 903 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:14:54.033145 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.136.2:48515 (local address 127.17.136.62:37201)
0927 15:14:54.033268 (+ 123us) server_negotiation.cc:206] Beginning negotiation
0927 15:14:54.033271 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0927 15:14:54.034097 (+ 826us) server_negotiation.cc:407] Connection header received
0927 15:14:54.035431 (+ 1334us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:14:54.035434 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:14:54.035484 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:14:54.035550 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0927 15:14:54.036738 (+ 1188us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:14:54.037441 (+ 703us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:14:54.038649 (+ 1208us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:14:54.038873 (+ 224us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:14:54.038960 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:14:54.041694 (+ 2734us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0927 15:14:54.041697 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0927 15:14:54.041699 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0927 15:14:54.041724 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0927 15:14:54.043173 (+ 1449us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:14:54.043703 (+ 530us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:14:54.043707 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:14:54.043709 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:14:54.043789 (+ 80us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:14:54.044107 (+ 318us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:14:54.044110 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:14:54.044112 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:14:54.044295 (+ 183us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0927 15:14:54.044379 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0927 15:14:54.044915 (+ 536us) server_negotiation.cc:299] Negotiation successful
0927 15:14:54.045051 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
WARNING: no policy specified for kudu/127.17.136.3@KRBTEST.COM; defaulting to no policy
I20260927 15:14:54.046168 1191 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:14:54.033507 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.62:37201 (local address 127.17.136.2:48515)
0927 15:14:54.033944 (+ 437us) negotiation.cc:107] Waiting for socket to connect
0927 15:14:54.033986 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0927 15:14:54.035182 (+ 1196us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0927 15:14:54.035700 (+ 518us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0927 15:14:54.035706 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0927 15:14:54.036084 (+ 378us) client_negotiation.cc:189] Negotiated authn=SASL
0927 15:14:54.036554 (+ 470us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:14:54.036568 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:14:54.037561 (+ 993us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:14:54.037564 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:14:54.038537 (+ 973us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:14:54.038547 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:14:54.039030 (+ 483us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:14:54.039034 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:14:54.039189 (+ 155us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:14:54.039812 (+ 623us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0927 15:14:54.039831 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0927 15:14:54.041520 (+ 1689us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0927 15:14:54.043309 (+ 1789us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0927 15:14:54.043315 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0927 15:14:54.043333 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0927 15:14:54.043606 (+ 273us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0927 15:14:54.043869 (+ 263us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0927 15:14:54.043872 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0927 15:14:54.043874 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0927 15:14:54.044011 (+ 137us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0927 15:14:54.044406 (+ 395us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0927 15:14:54.044413 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0927 15:14:54.044665 (+ 252us) client_negotiation.cc:769] Sending connection context
0927 15:14:54.044830 (+ 165us) client_negotiation.cc:240] Negotiation successful
0927 15:14:54.045175 (+ 345us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":237,"thread_start_us":102,"threads_started":1}
I20260927 15:14:54.047369 1189 heartbeater.cc:347] Connected to a master server at 127.17.136.62:37201
I20260927 15:14:54.047658 1189 heartbeater.cc:464] Registering TS with master...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.136.3@KRBTEST.COM" created.
I20260927 15:14:54.048177 1189 heartbeater.cc:511] Master 127.17.136.62:37201 requested a full tablet report, sending...
I20260927 15:14:54.049376 864 ts_manager.cc:194] Registered new tserver with Master: 437c32e490224ee59166772390280f3f (127.17.136.2:46571)
I20260927 15:14:54.049979 864 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.136.2@KRBTEST.COM'} at 127.17.136.2:48515
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.136.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790521920546562-17952-0/krb5kdc/kudu_127.17.136.3.keytab.
Entry for principal kudu/127.17.136.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790521920546562-17952-0/krb5kdc/kudu_127.17.136.3.keytab.
I20260927 15:14:54.062088 17952 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu
/tmp/dist-test-taskiFOyeW/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790521920546562-17952-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790521920546562-17952-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790521920546562-17952-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790521920546562-17952-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.136.3:0
--local_ip_for_outbound_sockets=127.17.136.3
--webserver_interface=127.17.136.3
--webserver_port=0
--tserver_master_addrs=127.17.136.62:37201
--keytab_file=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790521920546562-17952-0/krb5kdc/kudu_127.17.136.3.keytab
--principal=kudu/127.17.136.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.136.20:41831
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790521920546562-17952-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790521920546562-17952-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790521920546562-17952-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260927 15:14:54.167403 1194 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260927 15:14:54.167670 1194 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260927 15:14:54.167726 1194 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260927 15:14:54.171697 1194 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260927 15:14:54.171756 1194 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260927 15:14:54.171830 1194 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.136.3
I20260927 15:14:54.177162 1194 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.136.20:41831
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790521920546562-17952-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790521920546562-17952-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790521920546562-17952-0/krb5kdc/kudu_127.17.136.3.keytab
--principal=kudu/127.17.136.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.136.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790521920546562-17952-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.17.136.3
--webserver_port=0
--tserver_master_addrs=127.17.136.62:37201
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1194
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.136.3
--log_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790521920546562-17952-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 27 Sep 2026 14:27:13 UTC on ccycloud.quasar-psqrth.root.comops.site
build id 4676138
I20260927 15:14:54.178164 1194 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260927 15:14:54.179141 1194 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260927 15:14:54.188256 1202 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260927 15:14:54.188279 1200 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260927 15:14:54.188265 1199 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260927 15:14:54.188604 1194 server_base.cc:1034] running on GCE node
I20260927 15:14:54.188968 1194 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260927 15:14:54.189589 1194 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260927 15:14:54.190739 1194 hybrid_clock.cc:648] HybridClock initialized: now 1790522094190720 us; error 31 us; skew 500 ppm
Sep 27 15:14:54 dist-test-slave-5s2t krb5kdc[819](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790522094, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.136.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260927 15:14:54.193342 1194 init.cc:377] Logged in from keytab as kudu/127.17.136.3@KRBTEST.COM (short username kudu)
I20260927 15:14:54.194137 1194 webserver.cc:460] Webserver started at http://127.17.136.3:42569/ using document root <none> and password file <none>
I20260927 15:14:54.194653 1194 fs_manager.cc:359] Metadata directory not provided
I20260927 15:14:54.194715 1194 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260927 15:14:54.194911 1194 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260927 15:14:54.196897 1194 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790521920546562-17952-0/minicluster-data/ts-2/data/instance:
uuid: "1771ad00221b4329844cced239d7ddcf"
format_stamp: "Formatted at 2026-09-27 15:14:54 on dist-test-slave-5s2t"
server_key: "73ae13fc40df686fc099d5135586f7c0"
server_key_iv: "2cb71c111ed52a32a9c6cc9c5db704c9"
server_key_version: "encryptionkey@0"
I20260927 15:14:54.197425 1194 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790521920546562-17952-0/minicluster-data/ts-2/wal/instance:
uuid: "1771ad00221b4329844cced239d7ddcf"
format_stamp: "Formatted at 2026-09-27 15:14:54 on dist-test-slave-5s2t"
server_key: "73ae13fc40df686fc099d5135586f7c0"
server_key_iv: "2cb71c111ed52a32a9c6cc9c5db704c9"
server_key_version: "encryptionkey@0"
I20260927 15:14:54.200949 1194 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.001s sys 0.003s
I20260927 15:14:54.203152 1209 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260927 15:14:54.204440 1194 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260927 15:14:54.204556 1194 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790521920546562-17952-0/minicluster-data/ts-2/data,/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790521920546562-17952-0/minicluster-data/ts-2/wal
uuid: "1771ad00221b4329844cced239d7ddcf"
format_stamp: "Formatted at 2026-09-27 15:14:54 on dist-test-slave-5s2t"
server_key: "73ae13fc40df686fc099d5135586f7c0"
server_key_iv: "2cb71c111ed52a32a9c6cc9c5db704c9"
server_key_version: "encryptionkey@0"
I20260927 15:14:54.204656 1194 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790521920546562-17952-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790521920546562-17952-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790521920546562-17952-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260927 15:14:54.263370 1194 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260927 15:14:54.266408 1194 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260927 15:14:54.266563 1194 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260927 15:14:54.267091 1194 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260927 15:14:54.267872 1194 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260927 15:14:54.267916 1194 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260927 15:14:54.267956 1194 ts_tablet_manager.cc:610] Registered 0 tablets
I20260927 15:14:54.267975 1194 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260927 15:14:54.276072 1194 rpc_server.cc:307] RPC server started. Bound to: 127.17.136.3:43107
I20260927 15:14:54.276099 1322 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.136.3:43107 every 8 connection(s)
I20260927 15:14:54.276924 1194 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790521920546562-17952-0/minicluster-data/ts-2/data/info.pb
I20260927 15:14:54.278426 17952 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu as pid 1194
I20260927 15:14:54.278533 17952 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790521920546562-17952-0/minicluster-data/ts-2/wal/instance
I20260927 15:14:54.278821 17952 external_mini_cluster.cc:1428] Setting key 598439d66af54245eab3ff397facddea
Sep 27 15:14:54 dist-test-slave-5s2t krb5kdc[819](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790522094, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.136.3@KRBTEST.COM for kudu/127.17.136.62@KRBTEST.COM
I20260927 15:14:54.289808 903 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:14:54.278619 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.136.3:60703 (local address 127.17.136.62:37201)
0927 15:14:54.278775 (+ 156us) server_negotiation.cc:206] Beginning negotiation
0927 15:14:54.278780 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0927 15:14:54.280122 (+ 1342us) server_negotiation.cc:407] Connection header received
0927 15:14:54.281059 (+ 937us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:14:54.281062 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:14:54.281115 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:14:54.281182 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0927 15:14:54.282347 (+ 1165us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:14:54.282959 (+ 612us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:14:54.284082 (+ 1123us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:14:54.284309 (+ 227us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:14:54.284393 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:14:54.286647 (+ 2254us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0927 15:14:54.286650 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0927 15:14:54.286652 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0927 15:14:54.286677 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0927 15:14:54.287882 (+ 1205us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:14:54.288332 (+ 450us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:14:54.288336 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:14:54.288338 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:14:54.288421 (+ 83us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:14:54.288737 (+ 316us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:14:54.288740 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:14:54.288742 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:14:54.288924 (+ 182us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0927 15:14:54.289024 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0927 15:14:54.289508 (+ 484us) server_negotiation.cc:299] Negotiation successful
0927 15:14:54.289632 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260927 15:14:54.290644 1325 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:14:54.279039 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.62:37201 (local address 127.17.136.3:60703)
0927 15:14:54.279987 (+ 948us) negotiation.cc:107] Waiting for socket to connect
0927 15:14:54.280038 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0927 15:14:54.280866 (+ 828us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0927 15:14:54.281345 (+ 479us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0927 15:14:54.281352 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0927 15:14:54.281705 (+ 353us) client_negotiation.cc:189] Negotiated authn=SASL
0927 15:14:54.282213 (+ 508us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:14:54.282232 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:14:54.283076 (+ 844us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:14:54.283079 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:14:54.283972 (+ 893us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:14:54.283982 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:14:54.284448 (+ 466us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:14:54.284452 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:14:54.284606 (+ 154us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:14:54.285101 (+ 495us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0927 15:14:54.285116 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0927 15:14:54.286475 (+ 1359us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0927 15:14:54.287977 (+ 1502us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0927 15:14:54.287983 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0927 15:14:54.287999 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0927 15:14:54.288243 (+ 244us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0927 15:14:54.288499 (+ 256us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0927 15:14:54.288502 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0927 15:14:54.288505 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0927 15:14:54.288653 (+ 148us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0927 15:14:54.289033 (+ 380us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0927 15:14:54.289040 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0927 15:14:54.289283 (+ 243us) client_negotiation.cc:769] Sending connection context
0927 15:14:54.289463 (+ 180us) client_negotiation.cc:240] Negotiation successful
0927 15:14:54.289811 (+ 348us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":746,"thread_start_us":613,"threads_started":1}
I20260927 15:14:54.291791 1323 heartbeater.cc:347] Connected to a master server at 127.17.136.62:37201
I20260927 15:14:54.292040 1323 heartbeater.cc:464] Registering TS with master...
I20260927 15:14:54.292536 1323 heartbeater.cc:511] Master 127.17.136.62:37201 requested a full tablet report, sending...
I20260927 15:14:54.293488 863 ts_manager.cc:194] Registered new tserver with Master: 1771ad00221b4329844cced239d7ddcf (127.17.136.3:43107)
I20260927 15:14:54.294040 863 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.136.3@KRBTEST.COM'} at 127.17.136.3:60703
I20260927 15:14:54.303962 17952 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260927 15:14:54.312270 903 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:14:54.305763 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34090 (local address 127.17.136.62:37201)
0927 15:14:54.305882 (+ 119us) server_negotiation.cc:206] Beginning negotiation
0927 15:14:54.305885 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0927 15:14:54.306052 (+ 167us) server_negotiation.cc:407] Connection header received
0927 15:14:54.306158 (+ 106us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:14:54.306160 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:14:54.306197 (+ 37us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:14:54.306253 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0927 15:14:54.306840 (+ 587us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:14:54.307388 (+ 548us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:14:54.308177 (+ 789us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:14:54.308407 (+ 230us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:14:54.308482 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:14:54.309700 (+ 1218us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0927 15:14:54.309703 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0927 15:14:54.309705 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0927 15:14:54.309726 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0927 15:14:54.310991 (+ 1265us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:14:54.311371 (+ 380us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:14:54.311373 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:14:54.311374 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:14:54.311447 (+ 73us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:14:54.311621 (+ 174us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:14:54.311622 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:14:54.311623 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:14:54.311815 (+ 192us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0927 15:14:54.311906 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0927 15:14:54.312064 (+ 158us) server_negotiation.cc:299] Negotiation successful
0927 15:14:54.312152 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260927 15:14:54.314895 863 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:34090:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:14:54.319129 863 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:14:54.332732 1337 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:14:54.327372 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.3:43107 (local address 127.0.0.1:59930)
0927 15:14:54.328538 (+ 1166us) negotiation.cc:107] Waiting for socket to connect
0927 15:14:54.328550 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0927 15:14:54.328629 (+ 79us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0927 15:14:54.329001 (+ 372us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0927 15:14:54.329004 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0927 15:14:54.329016 (+ 12us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0927 15:14:54.329144 (+ 128us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:14:54.329151 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:14:54.330289 (+ 1138us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:14:54.330292 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:14:54.331208 (+ 916us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:14:54.331217 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:14:54.332060 (+ 843us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:14:54.332063 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:14:54.332334 (+ 271us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:14:54.332369 (+ 35us) client_negotiation.cc:769] Sending connection context
0927 15:14:54.332466 (+ 97us) client_negotiation.cc:240] Negotiation successful
0927 15:14:54.332583 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1109,"mutex_wait_us":36,"thread_start_us":89,"threads_started":1}
I20260927 15:14:54.332743 1339 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:14:54.328125 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59930 (local address 127.17.136.3:43107)
0927 15:14:54.328591 (+ 466us) server_negotiation.cc:206] Beginning negotiation
0927 15:14:54.328602 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0927 15:14:54.328621 (+ 19us) server_negotiation.cc:407] Connection header received
0927 15:14:54.328735 (+ 114us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:14:54.328740 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:14:54.328890 (+ 150us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:14:54.329016 (+ 126us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0927 15:14:54.329253 (+ 237us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:14:54.330187 (+ 934us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:14:54.331351 (+ 1164us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:14:54.331954 (+ 603us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:14:54.332048 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:14:54.332193 (+ 145us) server_negotiation.cc:1035] Waiting for connection context
0927 15:14:54.332512 (+ 319us) server_negotiation.cc:299] Negotiation successful
0927 15:14:54.332603 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":375,"thread_start_us":153,"threads_started":1}
I20260927 15:14:54.333958 1334 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:14:54.327908 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.2:46571 (local address 127.0.0.1:54968)
0927 15:14:54.329201 (+ 1293us) negotiation.cc:107] Waiting for socket to connect
0927 15:14:54.329214 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0927 15:14:54.329303 (+ 89us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0927 15:14:54.329729 (+ 426us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0927 15:14:54.329732 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0927 15:14:54.329750 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0927 15:14:54.329852 (+ 102us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:14:54.329858 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:14:54.331136 (+ 1278us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:14:54.331138 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:14:54.332406 (+ 1268us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:14:54.332417 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:14:54.333650 (+ 1233us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:14:54.333653 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:14:54.333737 (+ 84us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:14:54.333756 (+ 19us) client_negotiation.cc:769] Sending connection context
0927 15:14:54.333808 (+ 52us) client_negotiation.cc:240] Negotiation successful
0927 15:14:54.333858 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1238,"mutex_wait_us":36,"thread_start_us":98,"threads_started":1}
I20260927 15:14:54.334086 1338 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:14:54.328075 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54968 (local address 127.17.136.2:46571)
0927 15:14:54.328873 (+ 798us) server_negotiation.cc:206] Beginning negotiation
0927 15:14:54.328885 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0927 15:14:54.329300 (+ 415us) server_negotiation.cc:407] Connection header received
0927 15:14:54.329400 (+ 100us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:14:54.329405 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:14:54.329590 (+ 185us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:14:54.329745 (+ 155us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0927 15:14:54.329961 (+ 216us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:14:54.330992 (+ 1031us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:14:54.332544 (+ 1552us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:14:54.333540 (+ 996us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:14:54.333636 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:14:54.333757 (+ 121us) server_negotiation.cc:1035] Waiting for connection context
0927 15:14:54.333849 (+ 92us) server_negotiation.cc:299] Negotiation successful
0927 15:14:54.333942 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":701,"thread_start_us":84,"threads_started":1}
I20260927 15:14:54.335687 1335 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:14:54.327320 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.1:39793 (local address 127.0.0.1:60302)
0927 15:14:54.328148 (+ 828us) negotiation.cc:107] Waiting for socket to connect
0927 15:14:54.328197 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0927 15:14:54.328329 (+ 132us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0927 15:14:54.328932 (+ 603us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0927 15:14:54.328937 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0927 15:14:54.328957 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0927 15:14:54.329144 (+ 187us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:14:54.329151 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:14:54.330581 (+ 1430us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:14:54.330585 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:14:54.332411 (+ 1826us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:14:54.332417 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:14:54.335306 (+ 2889us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:14:54.335309 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:14:54.335394 (+ 85us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:14:54.335412 (+ 18us) client_negotiation.cc:769] Sending connection context
0927 15:14:54.335494 (+ 82us) client_negotiation.cc:240] Negotiation successful
0927 15:14:54.335562 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":653,"mutex_wait_us":45,"thread_start_us":86,"threads_started":1}
I20260927 15:14:54.335999 1336 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:14:54.327469 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60302 (local address 127.17.136.1:39793)
0927 15:14:54.327738 (+ 269us) server_negotiation.cc:206] Beginning negotiation
0927 15:14:54.327755 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0927 15:14:54.328481 (+ 726us) server_negotiation.cc:407] Connection header received
0927 15:14:54.328566 (+ 85us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:14:54.328571 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:14:54.328783 (+ 212us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:14:54.328959 (+ 176us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0927 15:14:54.329279 (+ 320us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:14:54.330436 (+ 1157us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:14:54.332544 (+ 2108us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:14:54.333347 (+ 803us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:14:54.333456 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:14:54.333595 (+ 139us) server_negotiation.cc:1035] Waiting for connection context
0927 15:14:54.335537 (+ 1942us) server_negotiation.cc:299] Negotiation successful
0927 15:14:54.335631 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":168,"thread_start_us":84,"threads_started":1}
I20260927 15:14:54.336018 1257 tablet_service.cc:1467] Processing CreateTablet for tablet 78a917538cfb461f9e606e31a0488138 (DEFAULT_TABLE table=test-table [id=da82246cac73438f991273e7ed71f49f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:14:54.337173 1257 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 78a917538cfb461f9e606e31a0488138. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:14:54.336779 1123 tablet_service.cc:1467] Processing CreateTablet for tablet 78a917538cfb461f9e606e31a0488138 (DEFAULT_TABLE table=test-table [id=da82246cac73438f991273e7ed71f49f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:14:54.337761 1123 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 78a917538cfb461f9e606e31a0488138. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:14:54.337952 989 tablet_service.cc:1467] Processing CreateTablet for tablet 78a917538cfb461f9e606e31a0488138 (DEFAULT_TABLE table=test-table [id=da82246cac73438f991273e7ed71f49f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:14:54.338869 989 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 78a917538cfb461f9e606e31a0488138. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:14:54.344156 1340 tablet_bootstrap.cc:492] T 78a917538cfb461f9e606e31a0488138 P 0d6699fa47f047bcb6dafd9ef13170de: Bootstrap starting.
I20260927 15:14:54.344767 1341 tablet_bootstrap.cc:492] T 78a917538cfb461f9e606e31a0488138 P 437c32e490224ee59166772390280f3f: Bootstrap starting.
I20260927 15:14:54.346230 1340 tablet_bootstrap.cc:654] T 78a917538cfb461f9e606e31a0488138 P 0d6699fa47f047bcb6dafd9ef13170de: Neither blocks nor log segments found. Creating new log.
I20260927 15:14:54.346805 1341 tablet_bootstrap.cc:654] T 78a917538cfb461f9e606e31a0488138 P 437c32e490224ee59166772390280f3f: Neither blocks nor log segments found. Creating new log.
I20260927 15:14:54.346948 1340 log.cc:824] T 78a917538cfb461f9e606e31a0488138 P 0d6699fa47f047bcb6dafd9ef13170de: Log is configured to *not* fsync() on all Append() calls
I20260927 15:14:54.347566 1342 tablet_bootstrap.cc:492] T 78a917538cfb461f9e606e31a0488138 P 1771ad00221b4329844cced239d7ddcf: Bootstrap starting.
I20260927 15:14:54.348765 1340 tablet_bootstrap.cc:492] T 78a917538cfb461f9e606e31a0488138 P 0d6699fa47f047bcb6dafd9ef13170de: No bootstrap required, opened a new log
I20260927 15:14:54.348948 1340 ts_tablet_manager.cc:1397] T 78a917538cfb461f9e606e31a0488138 P 0d6699fa47f047bcb6dafd9ef13170de: Time spent bootstrapping tablet: real 0.005s user 0.003s sys 0.000s
I20260927 15:14:54.349269 1342 tablet_bootstrap.cc:654] T 78a917538cfb461f9e606e31a0488138 P 1771ad00221b4329844cced239d7ddcf: Neither blocks nor log segments found. Creating new log.
I20260927 15:14:54.350184 1342 log.cc:824] T 78a917538cfb461f9e606e31a0488138 P 1771ad00221b4329844cced239d7ddcf: Log is configured to *not* fsync() on all Append() calls
I20260927 15:14:54.350741 1341 log.cc:824] T 78a917538cfb461f9e606e31a0488138 P 437c32e490224ee59166772390280f3f: Log is configured to *not* fsync() on all Append() calls
I20260927 15:14:54.352259 1342 tablet_bootstrap.cc:492] T 78a917538cfb461f9e606e31a0488138 P 1771ad00221b4329844cced239d7ddcf: No bootstrap required, opened a new log
I20260927 15:14:54.352447 1342 ts_tablet_manager.cc:1397] T 78a917538cfb461f9e606e31a0488138 P 1771ad00221b4329844cced239d7ddcf: Time spent bootstrapping tablet: real 0.005s user 0.003s sys 0.000s
I20260927 15:14:54.352481 1340 raft_consensus.cc:348] T 78a917538cfb461f9e606e31a0488138 P 0d6699fa47f047bcb6dafd9ef13170de [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d6699fa47f047bcb6dafd9ef13170de" member_type: VOTER last_known_addr { host: "127.17.136.1" port: 39793 } } peers { permanent_uuid: "1771ad00221b4329844cced239d7ddcf" member_type: VOTER last_known_addr { host: "127.17.136.3" port: 43107 } } peers { permanent_uuid: "437c32e490224ee59166772390280f3f" member_type: VOTER last_known_addr { host: "127.17.136.2" port: 46571 } }
I20260927 15:14:54.352640 1341 tablet_bootstrap.cc:492] T 78a917538cfb461f9e606e31a0488138 P 437c32e490224ee59166772390280f3f: No bootstrap required, opened a new log
I20260927 15:14:54.352701 1340 raft_consensus.cc:374] T 78a917538cfb461f9e606e31a0488138 P 0d6699fa47f047bcb6dafd9ef13170de [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:14:54.352752 1340 raft_consensus.cc:729] T 78a917538cfb461f9e606e31a0488138 P 0d6699fa47f047bcb6dafd9ef13170de [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0d6699fa47f047bcb6dafd9ef13170de, State: Initialized, Role: FOLLOWER
I20260927 15:14:54.352803 1341 ts_tablet_manager.cc:1397] T 78a917538cfb461f9e606e31a0488138 P 437c32e490224ee59166772390280f3f: Time spent bootstrapping tablet: real 0.008s user 0.004s sys 0.000s
I20260927 15:14:54.353163 1340 consensus_queue.cc:260] T 78a917538cfb461f9e606e31a0488138 P 0d6699fa47f047bcb6dafd9ef13170de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d6699fa47f047bcb6dafd9ef13170de" member_type: VOTER last_known_addr { host: "127.17.136.1" port: 39793 } } peers { permanent_uuid: "1771ad00221b4329844cced239d7ddcf" member_type: VOTER last_known_addr { host: "127.17.136.3" port: 43107 } } peers { permanent_uuid: "437c32e490224ee59166772390280f3f" member_type: VOTER last_known_addr { host: "127.17.136.2" port: 46571 } }
I20260927 15:14:54.353737 1055 heartbeater.cc:503] Master 127.17.136.62:37201 was elected leader, sending a full tablet report...
I20260927 15:14:54.354081 1340 ts_tablet_manager.cc:1428] T 78a917538cfb461f9e606e31a0488138 P 0d6699fa47f047bcb6dafd9ef13170de: Time spent starting tablet: real 0.005s user 0.006s sys 0.000s
I20260927 15:14:54.356139 1342 raft_consensus.cc:348] T 78a917538cfb461f9e606e31a0488138 P 1771ad00221b4329844cced239d7ddcf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d6699fa47f047bcb6dafd9ef13170de" member_type: VOTER last_known_addr { host: "127.17.136.1" port: 39793 } } peers { permanent_uuid: "1771ad00221b4329844cced239d7ddcf" member_type: VOTER last_known_addr { host: "127.17.136.3" port: 43107 } } peers { permanent_uuid: "437c32e490224ee59166772390280f3f" member_type: VOTER last_known_addr { host: "127.17.136.2" port: 46571 } }
I20260927 15:14:54.356396 1342 raft_consensus.cc:374] T 78a917538cfb461f9e606e31a0488138 P 1771ad00221b4329844cced239d7ddcf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:14:54.356438 1342 raft_consensus.cc:729] T 78a917538cfb461f9e606e31a0488138 P 1771ad00221b4329844cced239d7ddcf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1771ad00221b4329844cced239d7ddcf, State: Initialized, Role: FOLLOWER
I20260927 15:14:54.356388 1341 raft_consensus.cc:348] T 78a917538cfb461f9e606e31a0488138 P 437c32e490224ee59166772390280f3f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d6699fa47f047bcb6dafd9ef13170de" member_type: VOTER last_known_addr { host: "127.17.136.1" port: 39793 } } peers { permanent_uuid: "1771ad00221b4329844cced239d7ddcf" member_type: VOTER last_known_addr { host: "127.17.136.3" port: 43107 } } peers { permanent_uuid: "437c32e490224ee59166772390280f3f" member_type: VOTER last_known_addr { host: "127.17.136.2" port: 46571 } }
I20260927 15:14:54.356637 1341 raft_consensus.cc:374] T 78a917538cfb461f9e606e31a0488138 P 437c32e490224ee59166772390280f3f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:14:54.356695 1341 raft_consensus.cc:729] T 78a917538cfb461f9e606e31a0488138 P 437c32e490224ee59166772390280f3f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 437c32e490224ee59166772390280f3f, State: Initialized, Role: FOLLOWER
I20260927 15:14:54.356897 1342 consensus_queue.cc:260] T 78a917538cfb461f9e606e31a0488138 P 1771ad00221b4329844cced239d7ddcf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d6699fa47f047bcb6dafd9ef13170de" member_type: VOTER last_known_addr { host: "127.17.136.1" port: 39793 } } peers { permanent_uuid: "1771ad00221b4329844cced239d7ddcf" member_type: VOTER last_known_addr { host: "127.17.136.3" port: 43107 } } peers { permanent_uuid: "437c32e490224ee59166772390280f3f" member_type: VOTER last_known_addr { host: "127.17.136.2" port: 46571 } }
I20260927 15:14:54.357095 1341 consensus_queue.cc:260] T 78a917538cfb461f9e606e31a0488138 P 437c32e490224ee59166772390280f3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d6699fa47f047bcb6dafd9ef13170de" member_type: VOTER last_known_addr { host: "127.17.136.1" port: 39793 } } peers { permanent_uuid: "1771ad00221b4329844cced239d7ddcf" member_type: VOTER last_known_addr { host: "127.17.136.3" port: 43107 } } peers { permanent_uuid: "437c32e490224ee59166772390280f3f" member_type: VOTER last_known_addr { host: "127.17.136.2" port: 46571 } }
I20260927 15:14:54.357523 1323 heartbeater.cc:503] Master 127.17.136.62:37201 was elected leader, sending a full tablet report...
I20260927 15:14:54.357767 1189 heartbeater.cc:503] Master 127.17.136.62:37201 was elected leader, sending a full tablet report...
I20260927 15:14:54.358724 1342 ts_tablet_manager.cc:1428] T 78a917538cfb461f9e606e31a0488138 P 1771ad00221b4329844cced239d7ddcf: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20260927 15:14:54.358724 1341 ts_tablet_manager.cc:1428] T 78a917538cfb461f9e606e31a0488138 P 437c32e490224ee59166772390280f3f: Time spent starting tablet: real 0.006s user 0.005s sys 0.000s
I20260927 15:14:54.508734 1348 raft_consensus.cc:482] T 78a917538cfb461f9e606e31a0488138 P 437c32e490224ee59166772390280f3f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:14:54.508937 1348 raft_consensus.cc:504] T 78a917538cfb461f9e606e31a0488138 P 437c32e490224ee59166772390280f3f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d6699fa47f047bcb6dafd9ef13170de" member_type: VOTER last_known_addr { host: "127.17.136.1" port: 39793 } } peers { permanent_uuid: "1771ad00221b4329844cced239d7ddcf" member_type: VOTER last_known_addr { host: "127.17.136.3" port: 43107 } } peers { permanent_uuid: "437c32e490224ee59166772390280f3f" member_type: VOTER last_known_addr { host: "127.17.136.2" port: 46571 } }
I20260927 15:14:54.510085 1348 leader_election.cc:288] T 78a917538cfb461f9e606e31a0488138 P 437c32e490224ee59166772390280f3f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0d6699fa47f047bcb6dafd9ef13170de (127.17.136.1:39793), 1771ad00221b4329844cced239d7ddcf (127.17.136.3:43107)
I20260927 15:14:54.513690 1191 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:14:54.510298 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.1:39793 (local address 127.17.136.2:43669)
0927 15:14:54.510491 (+ 193us) negotiation.cc:107] Waiting for socket to connect
0927 15:14:54.510505 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0927 15:14:54.510598 (+ 93us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0927 15:14:54.510847 (+ 249us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0927 15:14:54.510850 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0927 15:14:54.510867 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0927 15:14:54.510993 (+ 126us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:14:54.510999 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:14:54.511756 (+ 757us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:14:54.511759 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:14:54.512582 (+ 823us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:14:54.512591 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:14:54.513292 (+ 701us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:14:54.513296 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:14:54.513397 (+ 101us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:14:54.513433 (+ 36us) client_negotiation.cc:769] Sending connection context
0927 15:14:54.513494 (+ 61us) client_negotiation.cc:240] Negotiation successful
0927 15:14:54.513561 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":102,"mutex_wait_us":1}
I20260927 15:14:54.513849 1336 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:14:54.510408 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.136.2:43669 (local address 127.17.136.1:39793)
0927 15:14:54.510534 (+ 126us) server_negotiation.cc:206] Beginning negotiation
0927 15:14:54.510539 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0927 15:14:54.510556 (+ 17us) server_negotiation.cc:407] Connection header received
0927 15:14:54.510708 (+ 152us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:14:54.510712 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:14:54.510764 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:14:54.510837 (+ 73us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0927 15:14:54.511096 (+ 259us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:14:54.511662 (+ 566us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:14:54.512697 (+ 1035us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:14:54.513183 (+ 486us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:14:54.513294 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:14:54.513344 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0927 15:14:54.513660 (+ 316us) server_negotiation.cc:299] Negotiation successful
0927 15:14:54.513734 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260927 15:14:54.513863 1339 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:14:54.510503 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.136.2:51157 (local address 127.17.136.3:43107)
0927 15:14:54.510615 (+ 112us) server_negotiation.cc:206] Beginning negotiation
0927 15:14:54.510619 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0927 15:14:54.510758 (+ 139us) server_negotiation.cc:407] Connection header received
0927 15:14:54.510865 (+ 107us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:14:54.510868 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:14:54.510911 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:14:54.511001 (+ 90us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0927 15:14:54.511283 (+ 282us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:14:54.511785 (+ 502us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:14:54.512847 (+ 1062us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:14:54.513351 (+ 504us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:14:54.513461 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:14:54.513508 (+ 47us) server_negotiation.cc:1035] Waiting for connection context
0927 15:14:54.513700 (+ 192us) server_negotiation.cc:299] Negotiation successful
0927 15:14:54.513765 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260927 15:14:54.514153 1349 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:14:54.510335 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.3:43107 (local address 127.17.136.2:51157)
0927 15:14:54.510672 (+ 337us) negotiation.cc:107] Waiting for socket to connect
0927 15:14:54.510685 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0927 15:14:54.510780 (+ 95us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0927 15:14:54.511019 (+ 239us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0927 15:14:54.511034 (+ 15us) client_negotiation.cc:394] Received NEGOTIATE response from server
0927 15:14:54.511049 (+ 15us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0927 15:14:54.511160 (+ 111us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:14:54.511166 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:14:54.511887 (+ 721us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:14:54.511890 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:14:54.512698 (+ 808us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:14:54.512708 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:14:54.513463 (+ 755us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:14:54.513466 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:14:54.513565 (+ 99us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:14:54.513586 (+ 21us) client_negotiation.cc:769] Sending connection context
0927 15:14:54.513986 (+ 400us) client_negotiation.cc:240] Negotiation successful
0927 15:14:54.514054 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":283,"mutex_wait_us":20,"thread_start_us":106,"threads_started":1}
I20260927 15:14:54.514418 1009 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "78a917538cfb461f9e606e31a0488138" candidate_uuid: "437c32e490224ee59166772390280f3f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d6699fa47f047bcb6dafd9ef13170de" is_pre_election: true
I20260927 15:14:54.514703 1009 raft_consensus.cc:2454] T 78a917538cfb461f9e606e31a0488138 P 0d6699fa47f047bcb6dafd9ef13170de [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 437c32e490224ee59166772390280f3f in term 0.
I20260927 15:14:54.514698 1277 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "78a917538cfb461f9e606e31a0488138" candidate_uuid: "437c32e490224ee59166772390280f3f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1771ad00221b4329844cced239d7ddcf" is_pre_election: true
I20260927 15:14:54.514926 1277 raft_consensus.cc:2454] T 78a917538cfb461f9e606e31a0488138 P 1771ad00221b4329844cced239d7ddcf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 437c32e490224ee59166772390280f3f in term 0.
I20260927 15:14:54.515117 1076 leader_election.cc:302] T 78a917538cfb461f9e606e31a0488138 P 437c32e490224ee59166772390280f3f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d6699fa47f047bcb6dafd9ef13170de, 437c32e490224ee59166772390280f3f; no voters:
I20260927 15:14:54.515379 1348 raft_consensus.cc:2781] T 78a917538cfb461f9e606e31a0488138 P 437c32e490224ee59166772390280f3f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 15:14:54.515458 1348 raft_consensus.cc:482] T 78a917538cfb461f9e606e31a0488138 P 437c32e490224ee59166772390280f3f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 15:14:54.515501 1348 raft_consensus.cc:3037] T 78a917538cfb461f9e606e31a0488138 P 437c32e490224ee59166772390280f3f [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:14:54.516469 1348 raft_consensus.cc:504] T 78a917538cfb461f9e606e31a0488138 P 437c32e490224ee59166772390280f3f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d6699fa47f047bcb6dafd9ef13170de" member_type: VOTER last_known_addr { host: "127.17.136.1" port: 39793 } } peers { permanent_uuid: "1771ad00221b4329844cced239d7ddcf" member_type: VOTER last_known_addr { host: "127.17.136.3" port: 43107 } } peers { permanent_uuid: "437c32e490224ee59166772390280f3f" member_type: VOTER last_known_addr { host: "127.17.136.2" port: 46571 } }
I20260927 15:14:54.516768 1348 leader_election.cc:288] T 78a917538cfb461f9e606e31a0488138 P 437c32e490224ee59166772390280f3f [CANDIDATE]: Term 1 election: Requested vote from peers 0d6699fa47f047bcb6dafd9ef13170de (127.17.136.1:39793), 1771ad00221b4329844cced239d7ddcf (127.17.136.3:43107)
I20260927 15:14:54.517086 1277 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "78a917538cfb461f9e606e31a0488138" candidate_uuid: "437c32e490224ee59166772390280f3f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1771ad00221b4329844cced239d7ddcf"
I20260927 15:14:54.517086 1009 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "78a917538cfb461f9e606e31a0488138" candidate_uuid: "437c32e490224ee59166772390280f3f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d6699fa47f047bcb6dafd9ef13170de"
I20260927 15:14:54.517199 1277 raft_consensus.cc:3037] T 78a917538cfb461f9e606e31a0488138 P 1771ad00221b4329844cced239d7ddcf [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:14:54.517199 1009 raft_consensus.cc:3037] T 78a917538cfb461f9e606e31a0488138 P 0d6699fa47f047bcb6dafd9ef13170de [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:14:54.518373 1009 raft_consensus.cc:2454] T 78a917538cfb461f9e606e31a0488138 P 0d6699fa47f047bcb6dafd9ef13170de [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 437c32e490224ee59166772390280f3f in term 1.
I20260927 15:14:54.518373 1277 raft_consensus.cc:2454] T 78a917538cfb461f9e606e31a0488138 P 1771ad00221b4329844cced239d7ddcf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 437c32e490224ee59166772390280f3f in term 1.
I20260927 15:14:54.518652 1076 leader_election.cc:302] T 78a917538cfb461f9e606e31a0488138 P 437c32e490224ee59166772390280f3f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 0d6699fa47f047bcb6dafd9ef13170de, 1771ad00221b4329844cced239d7ddcf, 437c32e490224ee59166772390280f3f; no voters:
I20260927 15:14:54.518808 1348 raft_consensus.cc:2781] T 78a917538cfb461f9e606e31a0488138 P 437c32e490224ee59166772390280f3f [term 1 FOLLOWER]: Leader election won for term 1
I20260927 15:14:54.519011 1348 raft_consensus.cc:686] T 78a917538cfb461f9e606e31a0488138 P 437c32e490224ee59166772390280f3f [term 1 LEADER]: Becoming Leader. State: Replica: 437c32e490224ee59166772390280f3f, State: Running, Role: LEADER
I20260927 15:14:54.519487 1348 consensus_queue.cc:237] T 78a917538cfb461f9e606e31a0488138 P 437c32e490224ee59166772390280f3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d6699fa47f047bcb6dafd9ef13170de" member_type: VOTER last_known_addr { host: "127.17.136.1" port: 39793 } } peers { permanent_uuid: "1771ad00221b4329844cced239d7ddcf" member_type: VOTER last_known_addr { host: "127.17.136.3" port: 43107 } } peers { permanent_uuid: "437c32e490224ee59166772390280f3f" member_type: VOTER last_known_addr { host: "127.17.136.2" port: 46571 } }
I20260927 15:14:54.522403 864 catalog_manager.cc:5495] T 78a917538cfb461f9e606e31a0488138 P 437c32e490224ee59166772390280f3f reported cstate change: term changed from 0 to 1, leader changed from <none> to 437c32e490224ee59166772390280f3f (127.17.136.2). New cstate: current_term: 1 leader_uuid: "437c32e490224ee59166772390280f3f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d6699fa47f047bcb6dafd9ef13170de" member_type: VOTER last_known_addr { host: "127.17.136.1" port: 39793 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1771ad00221b4329844cced239d7ddcf" member_type: VOTER last_known_addr { host: "127.17.136.3" port: 43107 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "437c32e490224ee59166772390280f3f" member_type: VOTER last_known_addr { host: "127.17.136.2" port: 46571 } health_report { overall_health: HEALTHY } } }
W20260927 15:14:54.527908 1324 tablet.cc:2369] T 78a917538cfb461f9e606e31a0488138 P 1771ad00221b4329844cced239d7ddcf: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260927 15:14:54.532433 1190 tablet.cc:2369] T 78a917538cfb461f9e606e31a0488138 P 437c32e490224ee59166772390280f3f: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260927 15:14:54.566722 1338 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:14:54.563323 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54972 (local address 127.17.136.2:46571)
0927 15:14:54.563449 (+ 126us) server_negotiation.cc:206] Beginning negotiation
0927 15:14:54.563452 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0927 15:14:54.563508 (+ 56us) server_negotiation.cc:407] Connection header received
0927 15:14:54.563648 (+ 140us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:14:54.563651 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:14:54.563704 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:14:54.563782 (+ 78us) server_negotiation.cc:226] Negotiated authn=TOKEN
0927 15:14:54.563989 (+ 207us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:14:54.564528 (+ 539us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:14:54.565375 (+ 847us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:14:54.565599 (+ 224us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:14:54.565695 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:14:54.565982 (+ 287us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0927 15:14:54.566363 (+ 381us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0927 15:14:54.566474 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0927 15:14:54.566527 (+ 53us) server_negotiation.cc:299] Negotiation successful
0927 15:14:54.566582 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
W20260927 15:14:54.569149 1056 tablet.cc:2369] T 78a917538cfb461f9e606e31a0488138 P 0d6699fa47f047bcb6dafd9ef13170de: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260927 15:14:54.572463 1009 raft_consensus.cc:1261] T 78a917538cfb461f9e606e31a0488138 P 0d6699fa47f047bcb6dafd9ef13170de [term 1 FOLLOWER]: Refusing update from remote peer 437c32e490224ee59166772390280f3f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260927 15:14:54.572463 1277 raft_consensus.cc:1261] T 78a917538cfb461f9e606e31a0488138 P 1771ad00221b4329844cced239d7ddcf [term 1 FOLLOWER]: Refusing update from remote peer 437c32e490224ee59166772390280f3f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260927 15:14:54.573158 1348 consensus_queue.cc:1035] T 78a917538cfb461f9e606e31a0488138 P 437c32e490224ee59166772390280f3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0d6699fa47f047bcb6dafd9ef13170de" member_type: VOTER last_known_addr { host: "127.17.136.1" port: 39793 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260927 15:14:54.573346 1350 consensus_queue.cc:1035] T 78a917538cfb461f9e606e31a0488138 P 437c32e490224ee59166772390280f3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1771ad00221b4329844cced239d7ddcf" member_type: VOTER last_known_addr { host: "127.17.136.3" port: 43107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260927 15:14:54.579807 1353 mvcc.cc:205] Tried to move back new op lower bound from 7333978499361550336 to 7333978499154391040. Current Snapshot: MvccSnapshot[applied={T|T < 7333978499361550336}]
I20260927 15:14:54.581967 1355 mvcc.cc:205] Tried to move back new op lower bound from 7333978499361550336 to 7333978499154391040. Current Snapshot: MvccSnapshot[applied={T|T < 7333978499361550336}]
I20260927 15:14:54.589908 864 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:34090:
table { table_name: "test-table" } modify_external_catalogs: true
I20260927 15:14:54.590054 864 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:34090:
table { table_name: "test-table" } modify_external_catalogs: true
I20260927 15:14:54.592159 864 catalog_manager.cc:5782] T 00000000000000000000000000000000 P ac838ba341bc469b8d25adb5e7aba771: Sending DeleteTablet for 3 replicas of tablet 78a917538cfb461f9e606e31a0488138
I20260927 15:14:54.592816 1257 tablet_service.cc:1514] Processing DeleteTablet for tablet 78a917538cfb461f9e606e31a0488138 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:14:54 UTC) from {username='kudu', principal='kudu/127.17.136.62@KRBTEST.COM'} at 127.0.0.1:59930
I20260927 15:14:54.592938 1123 tablet_service.cc:1514] Processing DeleteTablet for tablet 78a917538cfb461f9e606e31a0488138 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:14:54 UTC) from {username='kudu', principal='kudu/127.17.136.62@KRBTEST.COM'} at 127.0.0.1:54968
I20260927 15:14:54.593082 17952 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu with pid 926
I20260927 15:14:54.593909 1363 tablet_replica.cc:330] T 78a917538cfb461f9e606e31a0488138 P 437c32e490224ee59166772390280f3f: stopping tablet replica
I20260927 15:14:54.594190 1362 tablet_replica.cc:330] T 78a917538cfb461f9e606e31a0488138 P 1771ad00221b4329844cced239d7ddcf: stopping tablet replica
I20260927 15:14:54.594225 1363 raft_consensus.cc:2229] T 78a917538cfb461f9e606e31a0488138 P 437c32e490224ee59166772390280f3f [term 1 LEADER]: Raft consensus shutting down.
I20260927 15:14:54.594449 1362 raft_consensus.cc:2229] T 78a917538cfb461f9e606e31a0488138 P 1771ad00221b4329844cced239d7ddcf [term 1 FOLLOWER]: Raft consensus shutting down.
I20260927 15:14:54.594730 1362 raft_consensus.cc:2258] T 78a917538cfb461f9e606e31a0488138 P 1771ad00221b4329844cced239d7ddcf [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 15:14:54.594753 1363 raft_consensus.cc:2258] T 78a917538cfb461f9e606e31a0488138 P 437c32e490224ee59166772390280f3f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 15:14:54.596477 1362 ts_tablet_manager.cc:1905] T 78a917538cfb461f9e606e31a0488138 P 1771ad00221b4329844cced239d7ddcf: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:14:54.596561 1363 ts_tablet_manager.cc:1905] T 78a917538cfb461f9e606e31a0488138 P 437c32e490224ee59166772390280f3f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:14:54.598991 1362 ts_tablet_manager.cc:1918] T 78a917538cfb461f9e606e31a0488138 P 1771ad00221b4329844cced239d7ddcf: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260927 15:14:54.599079 1362 log.cc:1196] T 78a917538cfb461f9e606e31a0488138 P 1771ad00221b4329844cced239d7ddcf: Deleting WAL directory at /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790521920546562-17952-0/minicluster-data/ts-2/wal/wals/78a917538cfb461f9e606e31a0488138
I20260927 15:14:54.599107 1363 ts_tablet_manager.cc:1918] T 78a917538cfb461f9e606e31a0488138 P 437c32e490224ee59166772390280f3f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260927 15:14:54.599197 1363 log.cc:1196] T 78a917538cfb461f9e606e31a0488138 P 437c32e490224ee59166772390280f3f: Deleting WAL directory at /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790521920546562-17952-0/minicluster-data/ts-1/wal/wals/78a917538cfb461f9e606e31a0488138
I20260927 15:14:54.599396 1362 ts_tablet_manager.cc:1939] T 78a917538cfb461f9e606e31a0488138 P 1771ad00221b4329844cced239d7ddcf: Deleting consensus metadata
I20260927 15:14:54.599511 1363 ts_tablet_manager.cc:1939] T 78a917538cfb461f9e606e31a0488138 P 437c32e490224ee59166772390280f3f: Deleting consensus metadata
I20260927 15:14:54.600487 850 catalog_manager.cc:4841] TS 1771ad00221b4329844cced239d7ddcf (127.17.136.3:43107): tablet 78a917538cfb461f9e606e31a0488138 (table test-table [id=da82246cac73438f991273e7ed71f49f]) successfully deleted
W20260927 15:14:54.600612 848 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.17.136.1:39793 (error 108)
I20260927 15:14:54.600499 849 catalog_manager.cc:4841] TS 437c32e490224ee59166772390280f3f (127.17.136.2:46571): tablet 78a917538cfb461f9e606e31a0488138 (table test-table [id=da82246cac73438f991273e7ed71f49f]) successfully deleted
I20260927 15:14:54.601269 17952 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu with pid 1060
I20260927 15:14:54.601617 1335 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:14:54.601323 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.1:39793 (local address 127.0.0.1:60318)
0927 15:14:54.601481 (+ 158us) negotiation.cc:107] Waiting for socket to connect
0927 15:14:54.601540 (+ 59us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.136.1:39793: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":81}
W20260927 15:14:54.601892 848 catalog_manager.cc:4584] TS 0d6699fa47f047bcb6dafd9ef13170de (127.17.136.1:39793): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 78a917538cfb461f9e606e31a0488138: Network error: Client connection negotiation failed: client connection to 127.17.136.1:39793: connect: Connection refused (error 111)
I20260927 15:14:54.606201 17952 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu with pid 1194
I20260927 15:14:54.610685 17952 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu with pid 832
I20260927 15:15:14.615809 17952 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu
/tmp/dist-test-taskiFOyeW/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790521920546562-17952-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790521920546562-17952-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790521920546562-17952-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790521920546562-17952-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.136.62:37201
--webserver_interface=127.17.136.62
--webserver_port=33551
--keytab_file=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790521920546562-17952-0/krb5kdc/kudu_127.17.136.62.keytab
--principal=kudu/127.17.136.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.136.20:41831
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.136.62:37201
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--tsk_private_key_password_cmd=echo foo with env {KRB5CCNAME=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790521920546562-17952-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790521920546562-17952-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790521920546562-17952-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260927 15:15:14.725728 1365 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260927 15:15:14.725976 1365 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260927 15:15:14.726013 1365 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260927 15:15:14.729990 1365 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260927 15:15:14.730037 1365 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260927 15:15:14.730051 1365 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260927 15:15:14.730064 1365 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260927 15:15:14.730094 1365 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260927 15:15:14.730124 1365 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260927 15:15:14.730149 1365 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260927 15:15:14.730176 1365 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260927 15:15:14.735338 1365 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.136.20:41831
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790521920546562-17952-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790521920546562-17952-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_private_key_password_cmd=echo foo
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.17.136.62:37201
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790521920546562-17952-0/krb5kdc/kudu_127.17.136.62.keytab
--principal=kudu/127.17.136.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.136.62:37201
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790521920546562-17952-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.17.136.62
--webserver_port=33551
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1365
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790521920546562-17952-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 27 Sep 2026 14:27:13 UTC on ccycloud.quasar-psqrth.root.comops.site
build id 4676138
I20260927 15:15:14.736338 1365 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260927 15:15:14.737335 1365 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260927 15:15:14.750121 1371 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260927 15:15:14.750169 1374 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260927 15:15:14.750121 1372 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260927 15:15:14.750245 1365 server_base.cc:1034] running on GCE node
I20260927 15:15:14.751015 1365 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260927 15:15:14.752158 1365 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260927 15:15:14.753336 1365 hybrid_clock.cc:648] HybridClock initialized: now 1790522114753307 us; error 43 us; skew 500 ppm
Sep 27 15:15:14 dist-test-slave-5s2t krb5kdc[819](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790522114, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.136.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260927 15:15:14.762442 1365 init.cc:377] Logged in from keytab as kudu/127.17.136.62@KRBTEST.COM (short username kudu)
I20260927 15:15:14.763427 1365 webserver.cc:460] Webserver started at http://127.17.136.62:33551/ using document root <none> and password file <none>
I20260927 15:15:14.763996 1365 fs_manager.cc:359] Metadata directory not provided
I20260927 15:15:14.764068 1365 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260927 15:15:14.768061 1365 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.004s sys 0.000s
I20260927 15:15:14.770219 1381 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260927 15:15:14.771545 1365 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260927 15:15:14.771656 1365 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790521920546562-17952-0/minicluster-data/master-0/data,/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790521920546562-17952-0/minicluster-data/master-0/wal
uuid: "ac838ba341bc469b8d25adb5e7aba771"
format_stamp: "Formatted at 2026-09-27 15:14:53 on dist-test-slave-5s2t"
server_key: "3979f68da0f38982c2df91f9dfda4632"
server_key_iv: "b5eb044c28a409ba8dfa338f7a3af8bd"
server_key_version: "encryptionkey@0"
I20260927 15:15:14.772220 1365 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790521920546562-17952-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790521920546562-17952-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790521920546562-17952-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260927 15:15:14.791296 1365 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260927 15:15:14.794453 1365 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260927 15:15:14.794631 1365 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260927 15:15:14.801424 1365 rpc_server.cc:307] RPC server started. Bound to: 127.17.136.62:37201
I20260927 15:15:14.801791 1433 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.136.62:37201 every 8 connection(s)
I20260927 15:15:14.802529 1365 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790521920546562-17952-0/minicluster-data/master-0/data/info.pb
I20260927 15:15:14.807027 1434 sys_catalog.cc:263] Verifying existing consensus state
I20260927 15:15:14.808715 1434 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ac838ba341bc469b8d25adb5e7aba771: Bootstrap starting.
I20260927 15:15:14.812078 17952 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu as pid 1365
I20260927 15:15:14.812471 17952 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu
/tmp/dist-test-taskiFOyeW/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790521920546562-17952-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790521920546562-17952-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790521920546562-17952-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790521920546562-17952-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.136.1:39793
--local_ip_for_outbound_sockets=127.17.136.1
--tserver_master_addrs=127.17.136.62:37201
--webserver_port=46741
--webserver_interface=127.17.136.1
--keytab_file=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790521920546562-17952-0/krb5kdc/kudu_127.17.136.1.keytab
--principal=kudu/127.17.136.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.136.20:41831
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790521920546562-17952-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790521920546562-17952-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790521920546562-17952-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260927 15:15:14.829752 1434 log.cc:824] T 00000000000000000000000000000000 P ac838ba341bc469b8d25adb5e7aba771: Log is configured to *not* fsync() on all Append() calls
I20260927 15:15:14.841408 1434 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ac838ba341bc469b8d25adb5e7aba771: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=5 ignored=0} mutations{seen=4 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260927 15:15:14.841845 1434 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ac838ba341bc469b8d25adb5e7aba771: Bootstrap complete.
I20260927 15:15:14.847335 1434 raft_consensus.cc:348] T 00000000000000000000000000000000 P ac838ba341bc469b8d25adb5e7aba771 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ac838ba341bc469b8d25adb5e7aba771" member_type: VOTER last_known_addr { host: "127.17.136.62" port: 37201 } }
I20260927 15:15:14.847844 1434 raft_consensus.cc:729] T 00000000000000000000000000000000 P ac838ba341bc469b8d25adb5e7aba771 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ac838ba341bc469b8d25adb5e7aba771, State: Initialized, Role: FOLLOWER
I20260927 15:15:14.848410 1434 consensus_queue.cc:260] T 00000000000000000000000000000000 P ac838ba341bc469b8d25adb5e7aba771 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ac838ba341bc469b8d25adb5e7aba771" member_type: VOTER last_known_addr { host: "127.17.136.62" port: 37201 } }
I20260927 15:15:14.848563 1434 raft_consensus.cc:388] T 00000000000000000000000000000000 P ac838ba341bc469b8d25adb5e7aba771 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260927 15:15:14.848641 1434 raft_consensus.cc:482] T 00000000000000000000000000000000 P ac838ba341bc469b8d25adb5e7aba771 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260927 15:15:14.848740 1434 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ac838ba341bc469b8d25adb5e7aba771 [term 1 FOLLOWER]: Advancing to term 2
I20260927 15:15:14.851218 1434 raft_consensus.cc:504] T 00000000000000000000000000000000 P ac838ba341bc469b8d25adb5e7aba771 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ac838ba341bc469b8d25adb5e7aba771" member_type: VOTER last_known_addr { host: "127.17.136.62" port: 37201 } }
I20260927 15:15:14.851617 1434 leader_election.cc:302] T 00000000000000000000000000000000 P ac838ba341bc469b8d25adb5e7aba771 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ac838ba341bc469b8d25adb5e7aba771; no voters:
I20260927 15:15:14.851996 1434 leader_election.cc:288] T 00000000000000000000000000000000 P ac838ba341bc469b8d25adb5e7aba771 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260927 15:15:14.852099 1438 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ac838ba341bc469b8d25adb5e7aba771 [term 2 FOLLOWER]: Leader election won for term 2
I20260927 15:15:14.852350 1438 raft_consensus.cc:686] T 00000000000000000000000000000000 P ac838ba341bc469b8d25adb5e7aba771 [term 2 LEADER]: Becoming Leader. State: Replica: ac838ba341bc469b8d25adb5e7aba771, State: Running, Role: LEADER
I20260927 15:15:14.852705 1438 consensus_queue.cc:237] T 00000000000000000000000000000000 P ac838ba341bc469b8d25adb5e7aba771 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ac838ba341bc469b8d25adb5e7aba771" member_type: VOTER last_known_addr { host: "127.17.136.62" port: 37201 } }
I20260927 15:15:14.853333 1434 sys_catalog.cc:564] T 00000000000000000000000000000000 P ac838ba341bc469b8d25adb5e7aba771 [sys.catalog]: configured and running, proceeding with master startup.
I20260927 15:15:14.854020 1439 sys_catalog.cc:455] T 00000000000000000000000000000000 P ac838ba341bc469b8d25adb5e7aba771 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "ac838ba341bc469b8d25adb5e7aba771" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ac838ba341bc469b8d25adb5e7aba771" member_type: VOTER last_known_addr { host: "127.17.136.62" port: 37201 } } }
I20260927 15:15:14.854022 1440 sys_catalog.cc:455] T 00000000000000000000000000000000 P ac838ba341bc469b8d25adb5e7aba771 [sys.catalog]: SysCatalogTable state changed. Reason: New leader ac838ba341bc469b8d25adb5e7aba771. Latest consensus state: current_term: 2 leader_uuid: "ac838ba341bc469b8d25adb5e7aba771" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ac838ba341bc469b8d25adb5e7aba771" member_type: VOTER last_known_addr { host: "127.17.136.62" port: 37201 } } }
I20260927 15:15:14.854161 1440 sys_catalog.cc:458] T 00000000000000000000000000000000 P ac838ba341bc469b8d25adb5e7aba771 [sys.catalog]: This master's current role is: LEADER
I20260927 15:15:14.854161 1439 sys_catalog.cc:458] T 00000000000000000000000000000000 P ac838ba341bc469b8d25adb5e7aba771 [sys.catalog]: This master's current role is: LEADER
I20260927 15:15:14.854586 1444 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260927 15:15:14.859784 1444 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260927 15:15:14.860585 1444 catalog_manager.cc:1259] Loaded cluster ID: 0ec6b0399cd3417b91198c866ec0ceec
I20260927 15:15:14.860666 1444 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260927 15:15:14.862430 1444 catalog_manager.cc:1504] Loading token signing keys...
I20260927 15:15:14.863027 1444 catalog_manager.cc:5879] T 00000000000000000000000000000000 P ac838ba341bc469b8d25adb5e7aba771: Loaded TSK: 0
I20260927 15:15:14.876273 1444 catalog_manager.cc:5868] T 00000000000000000000000000000000 P ac838ba341bc469b8d25adb5e7aba771: Generated new TSK 1
I20260927 15:15:14.876547 1444 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260927 15:15:14.943339 1436 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260927 15:15:14.943580 1436 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260927 15:15:14.943624 1436 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260927 15:15:14.947603 1436 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260927 15:15:14.947654 1436 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260927 15:15:14.947718 1436 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.136.1
I20260927 15:15:14.952805 1436 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.136.20:41831
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790521920546562-17952-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790521920546562-17952-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790521920546562-17952-0/krb5kdc/kudu_127.17.136.1.keytab
--principal=kudu/127.17.136.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.136.1:39793
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790521920546562-17952-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.17.136.1
--webserver_port=46741
--tserver_master_addrs=127.17.136.62:37201
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1436
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.136.1
--log_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790521920546562-17952-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 27 Sep 2026 14:27:13 UTC on ccycloud.quasar-psqrth.root.comops.site
build id 4676138
I20260927 15:15:14.953794 1436 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260927 15:15:14.954799 1436 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260927 15:15:14.963948 1461 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260927 15:15:14.963955 1462 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260927 15:15:14.963996 1464 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260927 15:15:14.964313 1436 server_base.cc:1034] running on GCE node
I20260927 15:15:14.964757 1436 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260927 15:15:14.965534 1436 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260927 15:15:14.966738 1436 hybrid_clock.cc:648] HybridClock initialized: now 1790522114966708 us; error 43 us; skew 500 ppm
Sep 27 15:15:14 dist-test-slave-5s2t krb5kdc[819](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790522114, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.136.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260927 15:15:14.969920 1436 init.cc:377] Logged in from keytab as kudu/127.17.136.1@KRBTEST.COM (short username kudu)
I20260927 15:15:14.970734 1436 webserver.cc:460] Webserver started at http://127.17.136.1:46741/ using document root <none> and password file <none>
I20260927 15:15:14.971277 1436 fs_manager.cc:359] Metadata directory not provided
I20260927 15:15:14.971354 1436 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260927 15:15:14.975036 1436 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.003s sys 0.000s
I20260927 15:15:14.977249 1471 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260927 15:15:14.978541 1436 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.000s sys 0.002s
I20260927 15:15:14.978638 1436 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790521920546562-17952-0/minicluster-data/ts-0/data,/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790521920546562-17952-0/minicluster-data/ts-0/wal
uuid: "0d6699fa47f047bcb6dafd9ef13170de"
format_stamp: "Formatted at 2026-09-27 15:14:53 on dist-test-slave-5s2t"
server_key: "858b8373a613fe83c4c153c0c9a3c4a0"
server_key_iv: "2eb608dcfa909357c88ed646da3b717d"
server_key_version: "encryptionkey@0"
I20260927 15:15:14.979146 1436 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790521920546562-17952-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790521920546562-17952-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790521920546562-17952-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260927 15:15:14.998178 1436 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260927 15:15:15.001338 1436 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260927 15:15:15.001521 1436 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260927 15:15:15.002094 1436 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260927 15:15:15.003120 1478 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260927 15:15:15.007136 1436 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260927 15:15:15.007195 1436 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.004s user 0.000s sys 0.000s
I20260927 15:15:15.007280 1436 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260927 15:15:15.008885 1436 ts_tablet_manager.cc:610] Registered 1 tablets
I20260927 15:15:15.008929 1436 ts_tablet_manager.cc:589] Time spent register tablets: real 0.002s user 0.000s sys 0.000s
I20260927 15:15:15.009219 1478 tablet_bootstrap.cc:492] T 78a917538cfb461f9e606e31a0488138 P 0d6699fa47f047bcb6dafd9ef13170de: Bootstrap starting.
I20260927 15:15:15.018214 1436 rpc_server.cc:307] RPC server started. Bound to: 127.17.136.1:39793
I20260927 15:15:15.018292 1585 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.136.1:39793 every 8 connection(s)
I20260927 15:15:15.019137 1436 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790521920546562-17952-0/minicluster-data/ts-0/data/info.pb
I20260927 15:15:15.027210 1478 log.cc:824] T 78a917538cfb461f9e606e31a0488138 P 0d6699fa47f047bcb6dafd9ef13170de: Log is configured to *not* fsync() on all Append() calls
I20260927 15:15:15.029306 17952 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu as pid 1436
I20260927 15:15:15.030066 17952 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu
/tmp/dist-test-taskiFOyeW/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790521920546562-17952-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790521920546562-17952-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790521920546562-17952-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790521920546562-17952-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.136.2:46571
--local_ip_for_outbound_sockets=127.17.136.2
--tserver_master_addrs=127.17.136.62:37201
--webserver_port=46249
--webserver_interface=127.17.136.2
--keytab_file=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790521920546562-17952-0/krb5kdc/kudu_127.17.136.2.keytab
--principal=kudu/127.17.136.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.136.20:41831
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790521920546562-17952-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790521920546562-17952-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790521920546562-17952-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Sep 27 15:15:15 dist-test-slave-5s2t krb5kdc[819](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790522114, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.136.1@KRBTEST.COM for kudu/127.17.136.62@KRBTEST.COM
I20260927 15:15:15.034845 1478 tablet_bootstrap.cc:492] T 78a917538cfb461f9e606e31a0488138 P 0d6699fa47f047bcb6dafd9ef13170de: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260927 15:15:15.035175 1478 tablet_bootstrap.cc:492] T 78a917538cfb461f9e606e31a0488138 P 0d6699fa47f047bcb6dafd9ef13170de: Bootstrap complete.
I20260927 15:15:15.036353 1478 ts_tablet_manager.cc:1397] T 78a917538cfb461f9e606e31a0488138 P 0d6699fa47f047bcb6dafd9ef13170de: Time spent bootstrapping tablet: real 0.027s user 0.014s sys 0.012s
I20260927 15:15:15.037140 1589 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:15:15.021153 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.136.1:43653 (local address 127.17.136.62:37201)
0927 15:15:15.023224 (+ 2071us) server_negotiation.cc:206] Beginning negotiation
0927 15:15:15.023270 (+ 46us) server_negotiation.cc:399] Waiting for connection header
0927 15:15:15.023315 (+ 45us) server_negotiation.cc:407] Connection header received
0927 15:15:15.023643 (+ 328us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:15:15.023663 (+ 20us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:15:15.024141 (+ 478us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:15:15.024502 (+ 361us) server_negotiation.cc:226] Negotiated authn=SASL
0927 15:15:15.025533 (+ 1031us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:15:15.026964 (+ 1431us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:15:15.028180 (+ 1216us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:15:15.028854 (+ 674us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:15:15.029028 (+ 174us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:15:15.031888 (+ 2860us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0927 15:15:15.031895 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0927 15:15:15.031911 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0927 15:15:15.031944 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0927 15:15:15.033666 (+ 1722us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:15:15.034239 (+ 573us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:15:15.034245 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:15:15.034250 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:15:15.034407 (+ 157us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:15:15.034762 (+ 355us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:15:15.034766 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:15:15.034768 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:15:15.035222 (+ 454us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0927 15:15:15.035386 (+ 164us) server_negotiation.cc:1035] Waiting for connection context
0927 15:15:15.035969 (+ 583us) server_negotiation.cc:299] Negotiation successful
0927 15:15:15.036272 (+ 303us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1925,"thread_start_us":103,"threads_started":1}
I20260927 15:15:15.037142 1588 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:15:15.021011 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.62:37201 (local address 127.17.136.1:43653)
0927 15:15:15.021580 (+ 569us) negotiation.cc:107] Waiting for socket to connect
0927 15:15:15.021638 (+ 58us) client_negotiation.cc:174] Beginning negotiation
0927 15:15:15.022731 (+ 1093us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0927 15:15:15.024569 (+ 1838us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0927 15:15:15.024576 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0927 15:15:15.024905 (+ 329us) client_negotiation.cc:189] Negotiated authn=SASL
0927 15:15:15.025353 (+ 448us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:15:15.025377 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:15:15.027121 (+ 1744us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:15:15.027124 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:15:15.028070 (+ 946us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:15:15.028080 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:15:15.028983 (+ 903us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:15:15.028986 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:15:15.029152 (+ 166us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:15:15.029769 (+ 617us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0927 15:15:15.029789 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0927 15:15:15.031656 (+ 1867us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0927 15:15:15.033780 (+ 2124us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0927 15:15:15.033785 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0927 15:15:15.033797 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0927 15:15:15.034119 (+ 322us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0927 15:15:15.034501 (+ 382us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0927 15:15:15.034504 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0927 15:15:15.034506 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0927 15:15:15.034669 (+ 163us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0927 15:15:15.035370 (+ 701us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0927 15:15:15.035377 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0927 15:15:15.035644 (+ 267us) client_negotiation.cc:769] Sending connection context
0927 15:15:15.035822 (+ 178us) client_negotiation.cc:240] Negotiation successful
0927 15:15:15.036135 (+ 313us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":332,"thread_start_us":155,"threads_started":1}
I20260927 15:15:15.039057 1478 raft_consensus.cc:348] T 78a917538cfb461f9e606e31a0488138 P 0d6699fa47f047bcb6dafd9ef13170de [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d6699fa47f047bcb6dafd9ef13170de" member_type: VOTER last_known_addr { host: "127.17.136.1" port: 39793 } } peers { permanent_uuid: "1771ad00221b4329844cced239d7ddcf" member_type: VOTER last_known_addr { host: "127.17.136.3" port: 43107 } } peers { permanent_uuid: "437c32e490224ee59166772390280f3f" member_type: VOTER last_known_addr { host: "127.17.136.2" port: 46571 } }
I20260927 15:15:15.039486 1478 raft_consensus.cc:729] T 78a917538cfb461f9e606e31a0488138 P 0d6699fa47f047bcb6dafd9ef13170de [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0d6699fa47f047bcb6dafd9ef13170de, State: Initialized, Role: FOLLOWER
I20260927 15:15:15.039965 1478 consensus_queue.cc:260] T 78a917538cfb461f9e606e31a0488138 P 0d6699fa47f047bcb6dafd9ef13170de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d6699fa47f047bcb6dafd9ef13170de" member_type: VOTER last_known_addr { host: "127.17.136.1" port: 39793 } } peers { permanent_uuid: "1771ad00221b4329844cced239d7ddcf" member_type: VOTER last_known_addr { host: "127.17.136.3" port: 43107 } } peers { permanent_uuid: "437c32e490224ee59166772390280f3f" member_type: VOTER last_known_addr { host: "127.17.136.2" port: 46571 } }
I20260927 15:15:15.040102 1586 heartbeater.cc:347] Connected to a master server at 127.17.136.62:37201
I20260927 15:15:15.040292 1586 heartbeater.cc:464] Registering TS with master...
I20260927 15:15:15.040721 1586 heartbeater.cc:511] Master 127.17.136.62:37201 requested a full tablet report, sending...
I20260927 15:15:15.040851 1478 ts_tablet_manager.cc:1428] T 78a917538cfb461f9e606e31a0488138 P 0d6699fa47f047bcb6dafd9ef13170de: Time spent starting tablet: real 0.004s user 0.005s sys 0.000s
I20260927 15:15:15.043445 1397 ts_manager.cc:194] Registered new tserver with Master: 0d6699fa47f047bcb6dafd9ef13170de (127.17.136.1:39793)
I20260927 15:15:15.047204 1397 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.136.1@KRBTEST.COM'} at 127.17.136.1:43653
I20260927 15:15:15.049527 1586 heartbeater.cc:503] Master 127.17.136.62:37201 was elected leader, sending a full tablet report...
Sep 27 15:15:15 dist-test-slave-5s2t krb5kdc[819](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790522114, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.136.62@KRBTEST.COM for kudu/127.17.136.1@KRBTEST.COM
I20260927 15:15:15.057179 1594 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:15:15.046718 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48588 (local address 127.17.136.1:39793)
0927 15:15:15.047072 (+ 354us) server_negotiation.cc:206] Beginning negotiation
0927 15:15:15.047083 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0927 15:15:15.047459 (+ 376us) server_negotiation.cc:407] Connection header received
0927 15:15:15.047643 (+ 184us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:15:15.047647 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:15:15.047796 (+ 149us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:15:15.047937 (+ 141us) server_negotiation.cc:226] Negotiated authn=SASL
0927 15:15:15.048586 (+ 649us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:15:15.049717 (+ 1131us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:15:15.050831 (+ 1114us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:15:15.051402 (+ 571us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:15:15.051502 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:15:15.053688 (+ 2186us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0927 15:15:15.053698 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0927 15:15:15.053712 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0927 15:15:15.053736 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0927 15:15:15.055388 (+ 1652us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:15:15.055931 (+ 543us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:15:15.055936 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:15:15.055937 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:15:15.056013 (+ 76us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:15:15.056265 (+ 252us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:15:15.056267 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:15:15.056268 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:15:15.056485 (+ 217us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0927 15:15:15.056580 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0927 15:15:15.056922 (+ 342us) server_negotiation.cc:299] Negotiation successful
0927 15:15:15.057054 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":270,"thread_start_us":85,"threads_started":1}
I20260927 15:15:15.057193 1593 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:15:15.046537 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.1:39793 (local address 127.0.0.1:48588)
0927 15:15:15.047319 (+ 782us) negotiation.cc:107] Waiting for socket to connect
0927 15:15:15.047366 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0927 15:15:15.047511 (+ 145us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0927 15:15:15.047931 (+ 420us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0927 15:15:15.047936 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0927 15:15:15.048331 (+ 395us) client_negotiation.cc:189] Negotiated authn=SASL
0927 15:15:15.048466 (+ 135us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:15:15.048474 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:15:15.049851 (+ 1377us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:15:15.049854 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:15:15.050712 (+ 858us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:15:15.050723 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:15:15.051505 (+ 782us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:15:15.051508 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:15:15.051585 (+ 77us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:15:15.052097 (+ 512us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0927 15:15:15.052108 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0927 15:15:15.053555 (+ 1447us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0927 15:15:15.055492 (+ 1937us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0927 15:15:15.055500 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0927 15:15:15.055506 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0927 15:15:15.055826 (+ 320us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0927 15:15:15.056092 (+ 266us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0927 15:15:15.056095 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0927 15:15:15.056097 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0927 15:15:15.056188 (+ 91us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0927 15:15:15.056579 (+ 391us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0927 15:15:15.056584 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0927 15:15:15.056704 (+ 120us) client_negotiation.cc:769] Sending connection context
0927 15:15:15.056836 (+ 132us) client_negotiation.cc:240] Negotiation successful
0927 15:15:15.057021 (+ 185us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":611,"thread_start_us":112,"threads_started":1}
I20260927 15:15:15.058205 1520 tablet_service.cc:1514] Processing DeleteTablet for tablet 78a917538cfb461f9e606e31a0488138 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:14:54 UTC) from {username='kudu', principal='kudu/127.17.136.62@KRBTEST.COM'} at 127.0.0.1:48588
I20260927 15:15:15.059186 1595 tablet_replica.cc:330] stopping tablet replica
I20260927 15:15:15.059523 1595 raft_consensus.cc:2229] T 78a917538cfb461f9e606e31a0488138 P 0d6699fa47f047bcb6dafd9ef13170de [term 1 FOLLOWER]: Raft consensus shutting down.
I20260927 15:15:15.059760 1595 raft_consensus.cc:2258] T 78a917538cfb461f9e606e31a0488138 P 0d6699fa47f047bcb6dafd9ef13170de [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 15:15:15.060899 1595 ts_tablet_manager.cc:1905] T 78a917538cfb461f9e606e31a0488138 P 0d6699fa47f047bcb6dafd9ef13170de: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:15:15.064508 1595 ts_tablet_manager.cc:1918] T 78a917538cfb461f9e606e31a0488138 P 0d6699fa47f047bcb6dafd9ef13170de: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260927 15:15:15.064594 1595 log.cc:1196] T 78a917538cfb461f9e606e31a0488138 P 0d6699fa47f047bcb6dafd9ef13170de: Deleting WAL directory at /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790521920546562-17952-0/minicluster-data/ts-0/wal/wals/78a917538cfb461f9e606e31a0488138
I20260927 15:15:15.064800 1595 ts_tablet_manager.cc:1939] T 78a917538cfb461f9e606e31a0488138 P 0d6699fa47f047bcb6dafd9ef13170de: Deleting consensus metadata
I20260927 15:15:15.066390 1382 catalog_manager.cc:4841] TS 0d6699fa47f047bcb6dafd9ef13170de (127.17.136.1:39793): tablet 78a917538cfb461f9e606e31a0488138 (table test-table [id=da82246cac73438f991273e7ed71f49f]) successfully deleted
W20260927 15:15:15.144332 1591 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260927 15:15:15.144594 1591 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260927 15:15:15.144639 1591 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260927 15:15:15.148656 1591 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260927 15:15:15.148715 1591 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260927 15:15:15.148783 1591 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.136.2
I20260927 15:15:15.154038 1591 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.136.20:41831
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790521920546562-17952-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790521920546562-17952-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790521920546562-17952-0/krb5kdc/kudu_127.17.136.2.keytab
--principal=kudu/127.17.136.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.136.2:46571
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790521920546562-17952-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.17.136.2
--webserver_port=46249
--tserver_master_addrs=127.17.136.62:37201
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1591
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.136.2
--log_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790521920546562-17952-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 27 Sep 2026 14:27:13 UTC on ccycloud.quasar-psqrth.root.comops.site
build id 4676138
I20260927 15:15:15.155050 1591 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260927 15:15:15.156081 1591 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260927 15:15:15.165292 1600 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260927 15:15:15.165388 1591 server_base.cc:1034] running on GCE node
W20260927 15:15:15.165292 1603 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260927 15:15:15.165449 1601 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260927 15:15:15.165962 1591 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260927 15:15:15.166582 1591 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260927 15:15:15.167738 1591 hybrid_clock.cc:648] HybridClock initialized: now 1790522115167725 us; error 28 us; skew 500 ppm
Sep 27 15:15:15 dist-test-slave-5s2t krb5kdc[819](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790522115, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.136.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260927 15:15:15.170312 1591 init.cc:377] Logged in from keytab as kudu/127.17.136.2@KRBTEST.COM (short username kudu)
I20260927 15:15:15.171146 1591 webserver.cc:460] Webserver started at http://127.17.136.2:46249/ using document root <none> and password file <none>
I20260927 15:15:15.171695 1591 fs_manager.cc:359] Metadata directory not provided
I20260927 15:15:15.171808 1591 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260927 15:15:15.175529 1591 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.004s sys 0.000s
I20260927 15:15:15.177723 1610 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260927 15:15:15.178969 1591 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260927 15:15:15.179082 1591 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790521920546562-17952-0/minicluster-data/ts-1/data,/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790521920546562-17952-0/minicluster-data/ts-1/wal
uuid: "437c32e490224ee59166772390280f3f"
format_stamp: "Formatted at 2026-09-27 15:14:53 on dist-test-slave-5s2t"
server_key: "ea4dff3ebf9920264cba02c8f7f3aa73"
server_key_iv: "466d429d2eec40da294248052ddc62b3"
server_key_version: "encryptionkey@0"
I20260927 15:15:15.179708 1591 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790521920546562-17952-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790521920546562-17952-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790521920546562-17952-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260927 15:15:15.194823 1591 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260927 15:15:15.197527 1591 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260927 15:15:15.197688 1591 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260927 15:15:15.198247 1591 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260927 15:15:15.198998 1591 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260927 15:15:15.199043 1591 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260927 15:15:15.199091 1591 ts_tablet_manager.cc:610] Registered 0 tablets
I20260927 15:15:15.199120 1591 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260927 15:15:15.207197 1591 rpc_server.cc:307] RPC server started. Bound to: 127.17.136.2:46571
I20260927 15:15:15.207231 1723 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.136.2:46571 every 8 connection(s)
I20260927 15:15:15.208149 1591 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790521920546562-17952-0/minicluster-data/ts-1/data/info.pb
Sep 27 15:15:15 dist-test-slave-5s2t krb5kdc[819](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790522115, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.136.2@KRBTEST.COM for kudu/127.17.136.62@KRBTEST.COM
I20260927 15:15:15.217777 17952 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu as pid 1591
I20260927 15:15:15.218233 17952 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu
/tmp/dist-test-taskiFOyeW/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790521920546562-17952-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790521920546562-17952-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790521920546562-17952-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790521920546562-17952-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.136.3:43107
--local_ip_for_outbound_sockets=127.17.136.3
--tserver_master_addrs=127.17.136.62:37201
--webserver_port=42569
--webserver_interface=127.17.136.3
--keytab_file=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790521920546562-17952-0/krb5kdc/kudu_127.17.136.3.keytab
--principal=kudu/127.17.136.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.136.20:41831
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790521920546562-17952-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790521920546562-17952-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790521920546562-17952-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260927 15:15:15.221115 1589 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:15:15.209823 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.136.2:50367 (local address 127.17.136.62:37201)
0927 15:15:15.209958 (+ 135us) server_negotiation.cc:206] Beginning negotiation
0927 15:15:15.209961 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0927 15:15:15.210726 (+ 765us) server_negotiation.cc:407] Connection header received
0927 15:15:15.212005 (+ 1279us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:15:15.212009 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:15:15.212062 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:15:15.212144 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0927 15:15:15.213245 (+ 1101us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:15:15.213845 (+ 600us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:15:15.214923 (+ 1078us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:15:15.215162 (+ 239us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:15:15.215283 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:15:15.217587 (+ 2304us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0927 15:15:15.217591 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0927 15:15:15.217594 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0927 15:15:15.217623 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0927 15:15:15.219160 (+ 1537us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:15:15.219660 (+ 500us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:15:15.219663 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:15:15.219664 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:15:15.219746 (+ 82us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:15:15.220060 (+ 314us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:15:15.220063 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:15:15.220064 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:15:15.220245 (+ 181us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0927 15:15:15.220333 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0927 15:15:15.220813 (+ 480us) server_negotiation.cc:299] Negotiation successful
0927 15:15:15.220951 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260927 15:15:15.221876 1726 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:15:15.210155 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.62:37201 (local address 127.17.136.2:50367)
0927 15:15:15.210579 (+ 424us) negotiation.cc:107] Waiting for socket to connect
0927 15:15:15.210619 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0927 15:15:15.211800 (+ 1181us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0927 15:15:15.212288 (+ 488us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0927 15:15:15.212295 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0927 15:15:15.212617 (+ 322us) client_negotiation.cc:189] Negotiated authn=SASL
0927 15:15:15.213089 (+ 472us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:15:15.213101 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:15:15.213950 (+ 849us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:15:15.213953 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:15:15.214799 (+ 846us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:15:15.214808 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:15:15.215321 (+ 513us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:15:15.215324 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:15:15.215460 (+ 136us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:15:15.215988 (+ 528us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0927 15:15:15.216004 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0927 15:15:15.217404 (+ 1400us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0927 15:15:15.219291 (+ 1887us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0927 15:15:15.219296 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0927 15:15:15.219307 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0927 15:15:15.219556 (+ 249us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0927 15:15:15.219827 (+ 271us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0927 15:15:15.219830 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0927 15:15:15.219832 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0927 15:15:15.219965 (+ 133us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0927 15:15:15.220345 (+ 380us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0927 15:15:15.220352 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0927 15:15:15.220580 (+ 228us) client_negotiation.cc:769] Sending connection context
0927 15:15:15.220737 (+ 157us) client_negotiation.cc:240] Negotiation successful
0927 15:15:15.221068 (+ 331us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":252,"thread_start_us":112,"threads_started":1}
I20260927 15:15:15.222961 1724 heartbeater.cc:347] Connected to a master server at 127.17.136.62:37201
I20260927 15:15:15.223173 1724 heartbeater.cc:464] Registering TS with master...
I20260927 15:15:15.223667 1724 heartbeater.cc:511] Master 127.17.136.62:37201 requested a full tablet report, sending...
I20260927 15:15:15.224680 1397 ts_manager.cc:194] Registered new tserver with Master: 437c32e490224ee59166772390280f3f (127.17.136.2:46571)
I20260927 15:15:15.225445 1397 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.136.2@KRBTEST.COM'} at 127.17.136.2:50367
W20260927 15:15:15.325829 1727 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260927 15:15:15.326063 1727 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260927 15:15:15.326102 1727 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260927 15:15:15.329955 1727 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260927 15:15:15.330017 1727 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260927 15:15:15.330086 1727 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.136.3
I20260927 15:15:15.335136 1727 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.136.20:41831
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790521920546562-17952-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790521920546562-17952-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790521920546562-17952-0/krb5kdc/kudu_127.17.136.3.keytab
--principal=kudu/127.17.136.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.136.3:43107
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790521920546562-17952-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.17.136.3
--webserver_port=42569
--tserver_master_addrs=127.17.136.62:37201
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1727
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.136.3
--log_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790521920546562-17952-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 27 Sep 2026 14:27:13 UTC on ccycloud.quasar-psqrth.root.comops.site
build id 4676138
I20260927 15:15:15.336139 1727 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260927 15:15:15.337050 1727 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260927 15:15:15.346429 1733 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260927 15:15:15.346442 1732 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260927 15:15:15.346505 1727 server_base.cc:1034] running on GCE node
W20260927 15:15:15.346450 1735 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260927 15:15:15.347226 1727 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260927 15:15:15.347867 1727 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260927 15:15:15.349022 1727 hybrid_clock.cc:648] HybridClock initialized: now 1790522115349004 us; error 30 us; skew 500 ppm
Sep 27 15:15:15 dist-test-slave-5s2t krb5kdc[819](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790522115, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.136.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260927 15:15:15.351617 1727 init.cc:377] Logged in from keytab as kudu/127.17.136.3@KRBTEST.COM (short username kudu)
I20260927 15:15:15.352428 1727 webserver.cc:460] Webserver started at http://127.17.136.3:42569/ using document root <none> and password file <none>
I20260927 15:15:15.352922 1727 fs_manager.cc:359] Metadata directory not provided
I20260927 15:15:15.352988 1727 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260927 15:15:15.356725 1727 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.000s sys 0.003s
I20260927 15:15:15.358629 1742 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260927 15:15:15.359835 1727 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.001s
I20260927 15:15:15.359930 1727 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790521920546562-17952-0/minicluster-data/ts-2/data,/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790521920546562-17952-0/minicluster-data/ts-2/wal
uuid: "1771ad00221b4329844cced239d7ddcf"
format_stamp: "Formatted at 2026-09-27 15:14:54 on dist-test-slave-5s2t"
server_key: "73ae13fc40df686fc099d5135586f7c0"
server_key_iv: "2cb71c111ed52a32a9c6cc9c5db704c9"
server_key_version: "encryptionkey@0"
I20260927 15:15:15.360451 1727 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790521920546562-17952-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790521920546562-17952-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790521920546562-17952-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260927 15:15:15.375084 1727 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260927 15:15:15.378119 1727 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260927 15:15:15.378293 1727 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260927 15:15:15.378854 1727 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260927 15:15:15.379685 1727 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260927 15:15:15.379729 1727 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260927 15:15:15.379771 1727 ts_tablet_manager.cc:610] Registered 0 tablets
I20260927 15:15:15.379801 1727 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260927 15:15:15.388254 1727 rpc_server.cc:307] RPC server started. Bound to: 127.17.136.3:43107
I20260927 15:15:15.388283 1855 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.136.3:43107 every 8 connection(s)
I20260927 15:15:15.389189 1727 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790521920546562-17952-0/minicluster-data/ts-2/data/info.pb
I20260927 15:15:15.394604 17952 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu as pid 1727
Sep 27 15:15:15 dist-test-slave-5s2t krb5kdc[819](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790522115, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.136.3@KRBTEST.COM for kudu/127.17.136.62@KRBTEST.COM
I20260927 15:15:15.402992 1859 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:15:15.395203 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47542 (local address 127.17.136.62:37201)
0927 15:15:15.395439 (+ 236us) server_negotiation.cc:206] Beginning negotiation
0927 15:15:15.395443 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0927 15:15:15.395608 (+ 165us) server_negotiation.cc:407] Connection header received
0927 15:15:15.395743 (+ 135us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:15:15.395746 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:15:15.395782 (+ 36us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:15:15.395852 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0927 15:15:15.396660 (+ 808us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:15:15.397244 (+ 584us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:15:15.398357 (+ 1113us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:15:15.398712 (+ 355us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:15:15.398812 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:15:15.399996 (+ 1184us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0927 15:15:15.399999 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0927 15:15:15.400001 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0927 15:15:15.400032 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0927 15:15:15.401425 (+ 1393us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:15:15.401828 (+ 403us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:15:15.401832 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:15:15.401833 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:15:15.401908 (+ 75us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:15:15.402155 (+ 247us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:15:15.402158 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:15:15.402160 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:15:15.402316 (+ 156us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0927 15:15:15.402532 (+ 216us) server_negotiation.cc:1035] Waiting for connection context
0927 15:15:15.402657 (+ 125us) server_negotiation.cc:299] Negotiation successful
0927 15:15:15.402790 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":157,"thread_start_us":83,"threads_started":1}
I20260927 15:15:15.403036 1589 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:15:15.390850 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.136.3:57091 (local address 127.17.136.62:37201)
0927 15:15:15.390996 (+ 146us) server_negotiation.cc:206] Beginning negotiation
0927 15:15:15.391000 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0927 15:15:15.391806 (+ 806us) server_negotiation.cc:407] Connection header received
0927 15:15:15.393103 (+ 1297us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:15:15.393107 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:15:15.393162 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:15:15.393236 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0927 15:15:15.394409 (+ 1173us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:15:15.394956 (+ 547us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:15:15.396533 (+ 1577us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:15:15.396816 (+ 283us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:15:15.396926 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:15:15.399557 (+ 2631us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0927 15:15:15.399561 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0927 15:15:15.399564 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0927 15:15:15.399588 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0927 15:15:15.400945 (+ 1357us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:15:15.401476 (+ 531us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:15:15.401488 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:15:15.401489 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:15:15.401586 (+ 97us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:15:15.401969 (+ 383us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:15:15.401971 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:15:15.401973 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:15:15.402135 (+ 162us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0927 15:15:15.402227 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0927 15:15:15.402711 (+ 484us) server_negotiation.cc:299] Negotiation successful
0927 15:15:15.402860 (+ 149us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":24,"server-negotiator.queue_time_us":51}
I20260927 15:15:15.403971 1858 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:15:15.391229 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.62:37201 (local address 127.17.136.3:57091)
0927 15:15:15.391669 (+ 440us) negotiation.cc:107] Waiting for socket to connect
0927 15:15:15.391709 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0927 15:15:15.392904 (+ 1195us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0927 15:15:15.393415 (+ 511us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0927 15:15:15.393422 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0927 15:15:15.393771 (+ 349us) client_negotiation.cc:189] Negotiated authn=SASL
0927 15:15:15.394248 (+ 477us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:15:15.394261 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:15:15.395071 (+ 810us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:15:15.395074 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:15:15.396417 (+ 1343us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:15:15.396427 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:15:15.396952 (+ 525us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:15:15.396955 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:15:15.397096 (+ 141us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:15:15.397613 (+ 517us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0927 15:15:15.397633 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0927 15:15:15.399413 (+ 1780us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0927 15:15:15.401047 (+ 1634us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0927 15:15:15.401052 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0927 15:15:15.401067 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0927 15:15:15.401307 (+ 240us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0927 15:15:15.401701 (+ 394us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0927 15:15:15.401704 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0927 15:15:15.401706 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0927 15:15:15.401867 (+ 161us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0927 15:15:15.402243 (+ 376us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0927 15:15:15.402258 (+ 15us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0927 15:15:15.402483 (+ 225us) client_negotiation.cc:769] Sending connection context
0927 15:15:15.402637 (+ 154us) client_negotiation.cc:240] Negotiation successful
0927 15:15:15.402984 (+ 347us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":238,"thread_start_us":104,"threads_started":1}
I20260927 15:15:15.405057 1856 heartbeater.cc:347] Connected to a master server at 127.17.136.62:37201
I20260927 15:15:15.405263 1856 heartbeater.cc:464] Registering TS with master...
I20260927 15:15:15.405714 1856 heartbeater.cc:511] Master 127.17.136.62:37201 requested a full tablet report, sending...
I20260927 15:15:15.406661 1397 ts_manager.cc:194] Registered new tserver with Master: 1771ad00221b4329844cced239d7ddcf (127.17.136.3:43107)
I20260927 15:15:15.407156 1397 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.136.3@KRBTEST.COM'} at 127.17.136.3:57091
I20260927 15:15:15.416385 17952 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260927 15:15:15.419986 1589 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:15:15.416945 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47550 (local address 127.17.136.62:37201)
0927 15:15:15.417078 (+ 133us) server_negotiation.cc:206] Beginning negotiation
0927 15:15:15.417082 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0927 15:15:15.417252 (+ 170us) server_negotiation.cc:407] Connection header received
0927 15:15:15.417349 (+ 97us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:15:15.417352 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:15:15.417443 (+ 91us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:15:15.417525 (+ 82us) server_negotiation.cc:226] Negotiated authn=TOKEN
0927 15:15:15.417697 (+ 172us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:15:15.418185 (+ 488us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:15:15.418956 (+ 771us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:15:15.419161 (+ 205us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:15:15.419235 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:15:15.419540 (+ 305us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0927 15:15:15.419667 (+ 127us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_AUTHENTICATION_TOKEN: Not authorized: token expired
0927 15:15:15.419867 (+ 200us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:47550: token expired
Metrics: {"server-negotiator.queue_time_us":50}
W20260927 15:15:15.420058 1589 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:47550: token expired
W20260927 15:15:15.420385 1328 master_proxy_rpc.cc:203] Re-attempting CreateTable request to leader Master (127.17.136.62:37201)
I20260927 15:15:15.426537 1589 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:15:15.420706 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47560 (local address 127.17.136.62:37201)
0927 15:15:15.420823 (+ 117us) server_negotiation.cc:206] Beginning negotiation
0927 15:15:15.420826 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0927 15:15:15.420837 (+ 11us) server_negotiation.cc:407] Connection header received
0927 15:15:15.420866 (+ 29us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:15:15.420868 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:15:15.420900 (+ 32us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:15:15.420962 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0927 15:15:15.421464 (+ 502us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:15:15.421909 (+ 445us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:15:15.422589 (+ 680us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:15:15.422777 (+ 188us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:15:15.422834 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:15:15.424014 (+ 1180us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0927 15:15:15.424017 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0927 15:15:15.424018 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0927 15:15:15.424038 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0927 15:15:15.425197 (+ 1159us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:15:15.425602 (+ 405us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:15:15.425605 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:15:15.425606 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:15:15.425686 (+ 80us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:15:15.425877 (+ 191us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:15:15.425879 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:15:15.425880 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:15:15.426030 (+ 150us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0927 15:15:15.426121 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0927 15:15:15.426330 (+ 209us) server_negotiation.cc:299] Negotiation successful
0927 15:15:15.426431 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260927 15:15:15.428761 1397 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:47560:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:15:15.431901 1397 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:15:15.439306 1520 tablet_service.cc:1467] Processing CreateTablet for tablet 0d23603687b840ab8b8577f0d747caf0 (DEFAULT_TABLE table=test-table [id=4fb7c6fc714f40dd8354e9a9142c386d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:15:15.439957 1520 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0d23603687b840ab8b8577f0d747caf0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:15:15.442642 1593 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:15:15.437861 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.3:43107 (local address 127.0.0.1:54828)
0927 15:15:15.438029 (+ 168us) negotiation.cc:107] Waiting for socket to connect
0927 15:15:15.438043 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0927 15:15:15.438116 (+ 73us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0927 15:15:15.439065 (+ 949us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0927 15:15:15.439068 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0927 15:15:15.439087 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0927 15:15:15.439177 (+ 90us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:15:15.439183 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:15:15.440371 (+ 1188us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:15:15.440375 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:15:15.441425 (+ 1050us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:15:15.441435 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:15:15.442231 (+ 796us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:15:15.442235 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:15:15.442333 (+ 98us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:15:15.442372 (+ 39us) client_negotiation.cc:769] Sending connection context
0927 15:15:15.442444 (+ 72us) client_negotiation.cc:240] Negotiation successful
0927 15:15:15.442524 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":95}
I20260927 15:15:15.442694 1865 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:15:15.438024 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54828 (local address 127.17.136.3:43107)
0927 15:15:15.438506 (+ 482us) server_negotiation.cc:206] Beginning negotiation
0927 15:15:15.438519 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0927 15:15:15.438542 (+ 23us) server_negotiation.cc:407] Connection header received
0927 15:15:15.438652 (+ 110us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:15:15.438657 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:15:15.438913 (+ 256us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:15:15.439080 (+ 167us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0927 15:15:15.439314 (+ 234us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:15:15.440282 (+ 968us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:15:15.441540 (+ 1258us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:15:15.442121 (+ 581us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:15:15.442216 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:15:15.442358 (+ 142us) server_negotiation.cc:1035] Waiting for connection context
0927 15:15:15.442482 (+ 124us) server_negotiation.cc:299] Negotiation successful
0927 15:15:15.442573 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":326,"thread_start_us":109,"threads_started":1}
I20260927 15:15:15.442698 1478 tablet_bootstrap.cc:492] T 0d23603687b840ab8b8577f0d747caf0 P 0d6699fa47f047bcb6dafd9ef13170de: Bootstrap starting.
I20260927 15:15:15.443583 1478 tablet_bootstrap.cc:654] T 0d23603687b840ab8b8577f0d747caf0 P 0d6699fa47f047bcb6dafd9ef13170de: Neither blocks nor log segments found. Creating new log.
I20260927 15:15:15.444046 1866 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:15:15.438268 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.2:46571 (local address 127.0.0.1:60206)
0927 15:15:15.438500 (+ 232us) negotiation.cc:107] Waiting for socket to connect
0927 15:15:15.438514 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0927 15:15:15.438596 (+ 82us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0927 15:15:15.439853 (+ 1257us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0927 15:15:15.439856 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0927 15:15:15.439875 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0927 15:15:15.439955 (+ 80us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:15:15.439961 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:15:15.441302 (+ 1341us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:15:15.441306 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:15:15.442379 (+ 1073us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:15:15.442390 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:15:15.443635 (+ 1245us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:15:15.443638 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:15:15.443727 (+ 89us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:15:15.443751 (+ 24us) client_negotiation.cc:769] Sending connection context
0927 15:15:15.443823 (+ 72us) client_negotiation.cc:240] Negotiation successful
0927 15:15:15.443909 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":176,"thread_start_us":93,"threads_started":1}
I20260927 15:15:15.444443 1867 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:15:15.438908 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60206 (local address 127.17.136.2:46571)
0927 15:15:15.439418 (+ 510us) server_negotiation.cc:206] Beginning negotiation
0927 15:15:15.439429 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0927 15:15:15.439452 (+ 23us) server_negotiation.cc:407] Connection header received
0927 15:15:15.439525 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:15:15.439531 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:15:15.439716 (+ 185us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:15:15.439861 (+ 145us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0927 15:15:15.440143 (+ 282us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:15:15.441176 (+ 1033us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:15:15.442517 (+ 1341us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:15:15.443341 (+ 824us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:15:15.443436 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:15:15.443569 (+ 133us) server_negotiation.cc:1035] Waiting for connection context
0927 15:15:15.444205 (+ 636us) server_negotiation.cc:299] Negotiation successful
0927 15:15:15.444298 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":408,"thread_start_us":146,"threads_started":1}
I20260927 15:15:15.445169 1478 tablet_bootstrap.cc:492] T 0d23603687b840ab8b8577f0d747caf0 P 0d6699fa47f047bcb6dafd9ef13170de: No bootstrap required, opened a new log
I20260927 15:15:15.445246 1478 ts_tablet_manager.cc:1397] T 0d23603687b840ab8b8577f0d747caf0 P 0d6699fa47f047bcb6dafd9ef13170de: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260927 15:15:15.445667 1478 raft_consensus.cc:348] T 0d23603687b840ab8b8577f0d747caf0 P 0d6699fa47f047bcb6dafd9ef13170de [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1771ad00221b4329844cced239d7ddcf" member_type: VOTER last_known_addr { host: "127.17.136.3" port: 43107 } } peers { permanent_uuid: "437c32e490224ee59166772390280f3f" member_type: VOTER last_known_addr { host: "127.17.136.2" port: 46571 } } peers { permanent_uuid: "0d6699fa47f047bcb6dafd9ef13170de" member_type: VOTER last_known_addr { host: "127.17.136.1" port: 39793 } }
I20260927 15:15:15.445763 1478 raft_consensus.cc:374] T 0d23603687b840ab8b8577f0d747caf0 P 0d6699fa47f047bcb6dafd9ef13170de [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:15:15.445798 1478 raft_consensus.cc:729] T 0d23603687b840ab8b8577f0d747caf0 P 0d6699fa47f047bcb6dafd9ef13170de [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0d6699fa47f047bcb6dafd9ef13170de, State: Initialized, Role: FOLLOWER
I20260927 15:15:15.445914 1478 consensus_queue.cc:260] T 0d23603687b840ab8b8577f0d747caf0 P 0d6699fa47f047bcb6dafd9ef13170de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1771ad00221b4329844cced239d7ddcf" member_type: VOTER last_known_addr { host: "127.17.136.3" port: 43107 } } peers { permanent_uuid: "437c32e490224ee59166772390280f3f" member_type: VOTER last_known_addr { host: "127.17.136.2" port: 46571 } } peers { permanent_uuid: "0d6699fa47f047bcb6dafd9ef13170de" member_type: VOTER last_known_addr { host: "127.17.136.1" port: 39793 } }
I20260927 15:15:15.446241 1478 ts_tablet_manager.cc:1428] T 0d23603687b840ab8b8577f0d747caf0 P 0d6699fa47f047bcb6dafd9ef13170de: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260927 15:15:15.445874 1790 tablet_service.cc:1467] Processing CreateTablet for tablet 0d23603687b840ab8b8577f0d747caf0 (DEFAULT_TABLE table=test-table [id=4fb7c6fc714f40dd8354e9a9142c386d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:15:15.446967 1790 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0d23603687b840ab8b8577f0d747caf0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:15:15.447122 1658 tablet_service.cc:1467] Processing CreateTablet for tablet 0d23603687b840ab8b8577f0d747caf0 (DEFAULT_TABLE table=test-table [id=4fb7c6fc714f40dd8354e9a9142c386d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:15:15.448117 1658 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0d23603687b840ab8b8577f0d747caf0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:15:15.454943 1869 tablet_bootstrap.cc:492] T 0d23603687b840ab8b8577f0d747caf0 P 1771ad00221b4329844cced239d7ddcf: Bootstrap starting.
I20260927 15:15:15.455386 1870 tablet_bootstrap.cc:492] T 0d23603687b840ab8b8577f0d747caf0 P 437c32e490224ee59166772390280f3f: Bootstrap starting.
I20260927 15:15:15.457238 1869 tablet_bootstrap.cc:654] T 0d23603687b840ab8b8577f0d747caf0 P 1771ad00221b4329844cced239d7ddcf: Neither blocks nor log segments found. Creating new log.
I20260927 15:15:15.457847 1870 tablet_bootstrap.cc:654] T 0d23603687b840ab8b8577f0d747caf0 P 437c32e490224ee59166772390280f3f: Neither blocks nor log segments found. Creating new log.
I20260927 15:15:15.458523 1869 log.cc:824] T 0d23603687b840ab8b8577f0d747caf0 P 1771ad00221b4329844cced239d7ddcf: Log is configured to *not* fsync() on all Append() calls
I20260927 15:15:15.458544 1870 log.cc:824] T 0d23603687b840ab8b8577f0d747caf0 P 437c32e490224ee59166772390280f3f: Log is configured to *not* fsync() on all Append() calls
I20260927 15:15:15.460270 1870 tablet_bootstrap.cc:492] T 0d23603687b840ab8b8577f0d747caf0 P 437c32e490224ee59166772390280f3f: No bootstrap required, opened a new log
I20260927 15:15:15.460280 1869 tablet_bootstrap.cc:492] T 0d23603687b840ab8b8577f0d747caf0 P 1771ad00221b4329844cced239d7ddcf: No bootstrap required, opened a new log
I20260927 15:15:15.460441 1869 ts_tablet_manager.cc:1397] T 0d23603687b840ab8b8577f0d747caf0 P 1771ad00221b4329844cced239d7ddcf: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260927 15:15:15.460443 1870 ts_tablet_manager.cc:1397] T 0d23603687b840ab8b8577f0d747caf0 P 437c32e490224ee59166772390280f3f: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s
I20260927 15:15:15.463462 1869 raft_consensus.cc:348] T 0d23603687b840ab8b8577f0d747caf0 P 1771ad00221b4329844cced239d7ddcf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1771ad00221b4329844cced239d7ddcf" member_type: VOTER last_known_addr { host: "127.17.136.3" port: 43107 } } peers { permanent_uuid: "437c32e490224ee59166772390280f3f" member_type: VOTER last_known_addr { host: "127.17.136.2" port: 46571 } } peers { permanent_uuid: "0d6699fa47f047bcb6dafd9ef13170de" member_type: VOTER last_known_addr { host: "127.17.136.1" port: 39793 } }
I20260927 15:15:15.463462 1870 raft_consensus.cc:348] T 0d23603687b840ab8b8577f0d747caf0 P 437c32e490224ee59166772390280f3f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1771ad00221b4329844cced239d7ddcf" member_type: VOTER last_known_addr { host: "127.17.136.3" port: 43107 } } peers { permanent_uuid: "437c32e490224ee59166772390280f3f" member_type: VOTER last_known_addr { host: "127.17.136.2" port: 46571 } } peers { permanent_uuid: "0d6699fa47f047bcb6dafd9ef13170de" member_type: VOTER last_known_addr { host: "127.17.136.1" port: 39793 } }
I20260927 15:15:15.463697 1870 raft_consensus.cc:374] T 0d23603687b840ab8b8577f0d747caf0 P 437c32e490224ee59166772390280f3f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:15:15.463702 1869 raft_consensus.cc:374] T 0d23603687b840ab8b8577f0d747caf0 P 1771ad00221b4329844cced239d7ddcf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:15:15.463744 1870 raft_consensus.cc:729] T 0d23603687b840ab8b8577f0d747caf0 P 437c32e490224ee59166772390280f3f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 437c32e490224ee59166772390280f3f, State: Initialized, Role: FOLLOWER
I20260927 15:15:15.463759 1869 raft_consensus.cc:729] T 0d23603687b840ab8b8577f0d747caf0 P 1771ad00221b4329844cced239d7ddcf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1771ad00221b4329844cced239d7ddcf, State: Initialized, Role: FOLLOWER
I20260927 15:15:15.464162 1870 consensus_queue.cc:260] T 0d23603687b840ab8b8577f0d747caf0 P 437c32e490224ee59166772390280f3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1771ad00221b4329844cced239d7ddcf" member_type: VOTER last_known_addr { host: "127.17.136.3" port: 43107 } } peers { permanent_uuid: "437c32e490224ee59166772390280f3f" member_type: VOTER last_known_addr { host: "127.17.136.2" port: 46571 } } peers { permanent_uuid: "0d6699fa47f047bcb6dafd9ef13170de" member_type: VOTER last_known_addr { host: "127.17.136.1" port: 39793 } }
I20260927 15:15:15.464186 1869 consensus_queue.cc:260] T 0d23603687b840ab8b8577f0d747caf0 P 1771ad00221b4329844cced239d7ddcf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1771ad00221b4329844cced239d7ddcf" member_type: VOTER last_known_addr { host: "127.17.136.3" port: 43107 } } peers { permanent_uuid: "437c32e490224ee59166772390280f3f" member_type: VOTER last_known_addr { host: "127.17.136.2" port: 46571 } } peers { permanent_uuid: "0d6699fa47f047bcb6dafd9ef13170de" member_type: VOTER last_known_addr { host: "127.17.136.1" port: 39793 } }
I20260927 15:15:15.464753 1724 heartbeater.cc:503] Master 127.17.136.62:37201 was elected leader, sending a full tablet report...
I20260927 15:15:15.464758 1856 heartbeater.cc:503] Master 127.17.136.62:37201 was elected leader, sending a full tablet report...
I20260927 15:15:15.465114 1870 ts_tablet_manager.cc:1428] T 0d23603687b840ab8b8577f0d747caf0 P 437c32e490224ee59166772390280f3f: Time spent starting tablet: real 0.005s user 0.002s sys 0.003s
I20260927 15:15:15.465116 1869 ts_tablet_manager.cc:1428] T 0d23603687b840ab8b8577f0d747caf0 P 1771ad00221b4329844cced239d7ddcf: Time spent starting tablet: real 0.005s user 0.005s sys 0.000s
W20260927 15:15:15.520396 1587 tablet.cc:2369] T 0d23603687b840ab8b8577f0d747caf0 P 0d6699fa47f047bcb6dafd9ef13170de: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260927 15:15:15.588802 1873 raft_consensus.cc:482] T 0d23603687b840ab8b8577f0d747caf0 P 437c32e490224ee59166772390280f3f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:15:15.588989 1873 raft_consensus.cc:504] T 0d23603687b840ab8b8577f0d747caf0 P 437c32e490224ee59166772390280f3f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1771ad00221b4329844cced239d7ddcf" member_type: VOTER last_known_addr { host: "127.17.136.3" port: 43107 } } peers { permanent_uuid: "437c32e490224ee59166772390280f3f" member_type: VOTER last_known_addr { host: "127.17.136.2" port: 46571 } } peers { permanent_uuid: "0d6699fa47f047bcb6dafd9ef13170de" member_type: VOTER last_known_addr { host: "127.17.136.1" port: 39793 } }
I20260927 15:15:15.590049 1873 leader_election.cc:288] T 0d23603687b840ab8b8577f0d747caf0 P 437c32e490224ee59166772390280f3f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1771ad00221b4329844cced239d7ddcf (127.17.136.3:43107), 0d6699fa47f047bcb6dafd9ef13170de (127.17.136.1:39793)
I20260927 15:15:15.593792 1726 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:15:15.590239 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.3:43107 (local address 127.17.136.2:50061)
0927 15:15:15.590414 (+ 175us) negotiation.cc:107] Waiting for socket to connect
0927 15:15:15.590428 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0927 15:15:15.590513 (+ 85us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0927 15:15:15.590815 (+ 302us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0927 15:15:15.590818 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0927 15:15:15.590837 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0927 15:15:15.590993 (+ 156us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:15:15.591000 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:15:15.591773 (+ 773us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:15:15.591776 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:15:15.592625 (+ 849us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:15:15.592634 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:15:15.593379 (+ 745us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:15:15.593383 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:15:15.593490 (+ 107us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:15:15.593515 (+ 25us) client_negotiation.cc:769] Sending connection context
0927 15:15:15.593590 (+ 75us) client_negotiation.cc:240] Negotiation successful
0927 15:15:15.593663 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":102}
I20260927 15:15:15.593905 1865 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:15:15.590382 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.136.2:50061 (local address 127.17.136.3:43107)
0927 15:15:15.590497 (+ 115us) server_negotiation.cc:206] Beginning negotiation
0927 15:15:15.590501 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0927 15:15:15.590515 (+ 14us) server_negotiation.cc:407] Connection header received
0927 15:15:15.590652 (+ 137us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:15:15.590656 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:15:15.590708 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:15:15.590795 (+ 87us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0927 15:15:15.591091 (+ 296us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:15:15.591674 (+ 583us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:15:15.592774 (+ 1100us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:15:15.593272 (+ 498us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:15:15.593360 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:15:15.593399 (+ 39us) server_negotiation.cc:1035] Waiting for connection context
0927 15:15:15.593706 (+ 307us) server_negotiation.cc:299] Negotiation successful
0927 15:15:15.593789 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260927 15:15:15.594110 1875 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:15:15.590295 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.1:39793 (local address 127.17.136.2:59289)
0927 15:15:15.590689 (+ 394us) negotiation.cc:107] Waiting for socket to connect
0927 15:15:15.590702 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0927 15:15:15.590803 (+ 101us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0927 15:15:15.591091 (+ 288us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0927 15:15:15.591094 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0927 15:15:15.591109 (+ 15us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0927 15:15:15.591220 (+ 111us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:15:15.591226 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:15:15.592037 (+ 811us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:15:15.592039 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:15:15.592958 (+ 919us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:15:15.592969 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:15:15.593713 (+ 744us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:15:15.593717 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:15:15.593835 (+ 118us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:15:15.593859 (+ 24us) client_negotiation.cc:769] Sending connection context
0927 15:15:15.593926 (+ 67us) client_negotiation.cc:240] Negotiation successful
0927 15:15:15.593990 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":334,"thread_start_us":129,"threads_started":1}
I20260927 15:15:15.594399 1876 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:15:15.590432 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.136.2:59289 (local address 127.17.136.1:39793)
0927 15:15:15.590681 (+ 249us) server_negotiation.cc:206] Beginning negotiation
0927 15:15:15.590685 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0927 15:15:15.590778 (+ 93us) server_negotiation.cc:407] Connection header received
0927 15:15:15.590883 (+ 105us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:15:15.590886 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:15:15.590963 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:15:15.591076 (+ 113us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0927 15:15:15.591335 (+ 259us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:15:15.591909 (+ 574us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:15:15.593079 (+ 1170us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:15:15.593591 (+ 512us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:15:15.593690 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:15:15.593830 (+ 140us) server_negotiation.cc:1035] Waiting for connection context
0927 15:15:15.594119 (+ 289us) server_negotiation.cc:299] Negotiation successful
0927 15:15:15.594268 (+ 149us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":172,"thread_start_us":91,"threads_started":1}
I20260927 15:15:15.594501 1810 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0d23603687b840ab8b8577f0d747caf0" candidate_uuid: "437c32e490224ee59166772390280f3f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1771ad00221b4329844cced239d7ddcf" is_pre_election: true
I20260927 15:15:15.594798 1810 raft_consensus.cc:2454] T 0d23603687b840ab8b8577f0d747caf0 P 1771ad00221b4329844cced239d7ddcf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 437c32e490224ee59166772390280f3f in term 0.
I20260927 15:15:15.594826 1540 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0d23603687b840ab8b8577f0d747caf0" candidate_uuid: "437c32e490224ee59166772390280f3f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d6699fa47f047bcb6dafd9ef13170de" is_pre_election: true
I20260927 15:15:15.595084 1540 raft_consensus.cc:2454] T 0d23603687b840ab8b8577f0d747caf0 P 0d6699fa47f047bcb6dafd9ef13170de [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 437c32e490224ee59166772390280f3f in term 0.
I20260927 15:15:15.595287 1613 leader_election.cc:302] T 0d23603687b840ab8b8577f0d747caf0 P 437c32e490224ee59166772390280f3f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1771ad00221b4329844cced239d7ddcf, 437c32e490224ee59166772390280f3f; no voters:
I20260927 15:15:15.595547 1873 raft_consensus.cc:2781] T 0d23603687b840ab8b8577f0d747caf0 P 437c32e490224ee59166772390280f3f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 15:15:15.595630 1873 raft_consensus.cc:482] T 0d23603687b840ab8b8577f0d747caf0 P 437c32e490224ee59166772390280f3f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 15:15:15.595661 1873 raft_consensus.cc:3037] T 0d23603687b840ab8b8577f0d747caf0 P 437c32e490224ee59166772390280f3f [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:15:15.596613 1873 raft_consensus.cc:504] T 0d23603687b840ab8b8577f0d747caf0 P 437c32e490224ee59166772390280f3f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1771ad00221b4329844cced239d7ddcf" member_type: VOTER last_known_addr { host: "127.17.136.3" port: 43107 } } peers { permanent_uuid: "437c32e490224ee59166772390280f3f" member_type: VOTER last_known_addr { host: "127.17.136.2" port: 46571 } } peers { permanent_uuid: "0d6699fa47f047bcb6dafd9ef13170de" member_type: VOTER last_known_addr { host: "127.17.136.1" port: 39793 } }
I20260927 15:15:15.596913 1873 leader_election.cc:288] T 0d23603687b840ab8b8577f0d747caf0 P 437c32e490224ee59166772390280f3f [CANDIDATE]: Term 1 election: Requested vote from peers 1771ad00221b4329844cced239d7ddcf (127.17.136.3:43107), 0d6699fa47f047bcb6dafd9ef13170de (127.17.136.1:39793)
I20260927 15:15:15.597208 1540 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0d23603687b840ab8b8577f0d747caf0" candidate_uuid: "437c32e490224ee59166772390280f3f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d6699fa47f047bcb6dafd9ef13170de"
I20260927 15:15:15.597206 1810 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0d23603687b840ab8b8577f0d747caf0" candidate_uuid: "437c32e490224ee59166772390280f3f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1771ad00221b4329844cced239d7ddcf"
I20260927 15:15:15.597316 1540 raft_consensus.cc:3037] T 0d23603687b840ab8b8577f0d747caf0 P 0d6699fa47f047bcb6dafd9ef13170de [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:15:15.597323 1810 raft_consensus.cc:3037] T 0d23603687b840ab8b8577f0d747caf0 P 1771ad00221b4329844cced239d7ddcf [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:15:15.598191 1540 raft_consensus.cc:2454] T 0d23603687b840ab8b8577f0d747caf0 P 0d6699fa47f047bcb6dafd9ef13170de [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 437c32e490224ee59166772390280f3f in term 1.
I20260927 15:15:15.598327 1810 raft_consensus.cc:2454] T 0d23603687b840ab8b8577f0d747caf0 P 1771ad00221b4329844cced239d7ddcf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 437c32e490224ee59166772390280f3f in term 1.
I20260927 15:15:15.598439 1611 leader_election.cc:302] T 0d23603687b840ab8b8577f0d747caf0 P 437c32e490224ee59166772390280f3f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d6699fa47f047bcb6dafd9ef13170de, 437c32e490224ee59166772390280f3f; no voters:
I20260927 15:15:15.598599 1873 raft_consensus.cc:2781] T 0d23603687b840ab8b8577f0d747caf0 P 437c32e490224ee59166772390280f3f [term 1 FOLLOWER]: Leader election won for term 1
I20260927 15:15:15.598802 1873 raft_consensus.cc:686] T 0d23603687b840ab8b8577f0d747caf0 P 437c32e490224ee59166772390280f3f [term 1 LEADER]: Becoming Leader. State: Replica: 437c32e490224ee59166772390280f3f, State: Running, Role: LEADER
I20260927 15:15:15.599116 1873 consensus_queue.cc:237] T 0d23603687b840ab8b8577f0d747caf0 P 437c32e490224ee59166772390280f3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1771ad00221b4329844cced239d7ddcf" member_type: VOTER last_known_addr { host: "127.17.136.3" port: 43107 } } peers { permanent_uuid: "437c32e490224ee59166772390280f3f" member_type: VOTER last_known_addr { host: "127.17.136.2" port: 46571 } } peers { permanent_uuid: "0d6699fa47f047bcb6dafd9ef13170de" member_type: VOTER last_known_addr { host: "127.17.136.1" port: 39793 } }
I20260927 15:15:15.601958 1397 catalog_manager.cc:5495] T 0d23603687b840ab8b8577f0d747caf0 P 437c32e490224ee59166772390280f3f reported cstate change: term changed from 0 to 1, leader changed from <none> to 437c32e490224ee59166772390280f3f (127.17.136.2). New cstate: current_term: 1 leader_uuid: "437c32e490224ee59166772390280f3f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1771ad00221b4329844cced239d7ddcf" member_type: VOTER last_known_addr { host: "127.17.136.3" port: 43107 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "437c32e490224ee59166772390280f3f" member_type: VOTER last_known_addr { host: "127.17.136.2" port: 46571 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0d6699fa47f047bcb6dafd9ef13170de" member_type: VOTER last_known_addr { host: "127.17.136.1" port: 39793 } health_report { overall_health: UNKNOWN } } }
I20260927 15:15:15.632026 1867 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:15:15.628616 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60218 (local address 127.17.136.2:46571)
0927 15:15:15.628765 (+ 149us) server_negotiation.cc:206] Beginning negotiation
0927 15:15:15.628769 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0927 15:15:15.628783 (+ 14us) server_negotiation.cc:407] Connection header received
0927 15:15:15.628918 (+ 135us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:15:15.628921 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:15:15.628975 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:15:15.629062 (+ 87us) server_negotiation.cc:226] Negotiated authn=TOKEN
0927 15:15:15.629329 (+ 267us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:15:15.629809 (+ 480us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:15:15.630627 (+ 818us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:15:15.630838 (+ 211us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:15:15.630921 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:15:15.631207 (+ 286us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0927 15:15:15.631640 (+ 433us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0927 15:15:15.631742 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0927 15:15:15.631823 (+ 81us) server_negotiation.cc:299] Negotiation successful
0927 15:15:15.631878 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260927 15:15:15.637418 1540 raft_consensus.cc:1261] T 0d23603687b840ab8b8577f0d747caf0 P 0d6699fa47f047bcb6dafd9ef13170de [term 1 FOLLOWER]: Refusing update from remote peer 437c32e490224ee59166772390280f3f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260927 15:15:15.637413 1810 raft_consensus.cc:1261] T 0d23603687b840ab8b8577f0d747caf0 P 1771ad00221b4329844cced239d7ddcf [term 1 FOLLOWER]: Refusing update from remote peer 437c32e490224ee59166772390280f3f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260927 15:15:15.638067 1873 consensus_queue.cc:1035] T 0d23603687b840ab8b8577f0d747caf0 P 437c32e490224ee59166772390280f3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0d6699fa47f047bcb6dafd9ef13170de" member_type: VOTER last_known_addr { host: "127.17.136.1" port: 39793 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260927 15:15:15.638252 1877 consensus_queue.cc:1035] T 0d23603687b840ab8b8577f0d747caf0 P 437c32e490224ee59166772390280f3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1771ad00221b4329844cced239d7ddcf" member_type: VOTER last_known_addr { host: "127.17.136.3" port: 43107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260927 15:15:15.640024 1857 tablet.cc:2369] T 0d23603687b840ab8b8577f0d747caf0 P 1771ad00221b4329844cced239d7ddcf: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260927 15:15:15.642912 1879 mvcc.cc:205] Tried to move back new op lower bound from 7333978585644027904 to 7333978585496485888. Current Snapshot: MvccSnapshot[applied={T|T < 7333978585644027904}]
I20260927 15:15:15.650787 1397 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:47560:
table { table_name: "test-table" } modify_external_catalogs: true
I20260927 15:15:15.650957 1397 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:47560:
table { table_name: "test-table" } modify_external_catalogs: true
I20260927 15:15:15.653070 1397 catalog_manager.cc:5782] T 00000000000000000000000000000000 P ac838ba341bc469b8d25adb5e7aba771: Sending DeleteTablet for 3 replicas of tablet 0d23603687b840ab8b8577f0d747caf0
I20260927 15:15:15.653671 1658 tablet_service.cc:1514] Processing DeleteTablet for tablet 0d23603687b840ab8b8577f0d747caf0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:15:15 UTC) from {username='kudu', principal='kudu/127.17.136.62@KRBTEST.COM'} at 127.0.0.1:60206
I20260927 15:15:15.653662 1790 tablet_service.cc:1514] Processing DeleteTablet for tablet 0d23603687b840ab8b8577f0d747caf0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:15:15 UTC) from {username='kudu', principal='kudu/127.17.136.62@KRBTEST.COM'} at 127.0.0.1:54828
I20260927 15:15:15.653824 17952 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu with pid 1436
I20260927 15:15:15.655224 1889 tablet_replica.cc:330] T 0d23603687b840ab8b8577f0d747caf0 P 437c32e490224ee59166772390280f3f: stopping tablet replica
I20260927 15:15:15.655519 1889 raft_consensus.cc:2229] T 0d23603687b840ab8b8577f0d747caf0 P 437c32e490224ee59166772390280f3f [term 1 LEADER]: Raft consensus shutting down.
I20260927 15:15:15.655800 1889 raft_consensus.cc:2258] T 0d23603687b840ab8b8577f0d747caf0 P 437c32e490224ee59166772390280f3f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 15:15:15.656435 1890 tablet_replica.cc:330] T 0d23603687b840ab8b8577f0d747caf0 P 1771ad00221b4329844cced239d7ddcf: stopping tablet replica
I20260927 15:15:15.656693 1890 raft_consensus.cc:2229] T 0d23603687b840ab8b8577f0d747caf0 P 1771ad00221b4329844cced239d7ddcf [term 1 FOLLOWER]: Raft consensus shutting down.
I20260927 15:15:15.656962 1890 raft_consensus.cc:2258] T 0d23603687b840ab8b8577f0d747caf0 P 1771ad00221b4329844cced239d7ddcf [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 15:15:15.657349 1889 ts_tablet_manager.cc:1905] T 0d23603687b840ab8b8577f0d747caf0 P 437c32e490224ee59166772390280f3f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:15:15.658234 1890 ts_tablet_manager.cc:1905] T 0d23603687b840ab8b8577f0d747caf0 P 1771ad00221b4329844cced239d7ddcf: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:15:15.660313 1889 ts_tablet_manager.cc:1918] T 0d23603687b840ab8b8577f0d747caf0 P 437c32e490224ee59166772390280f3f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260927 15:15:15.660470 1889 log.cc:1196] T 0d23603687b840ab8b8577f0d747caf0 P 437c32e490224ee59166772390280f3f: Deleting WAL directory at /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790521920546562-17952-0/minicluster-data/ts-1/wal/wals/0d23603687b840ab8b8577f0d747caf0
W20260927 15:15:15.660429 1382 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.17.136.1:39793 (error 108)
I20260927 15:15:15.660887 1889 ts_tablet_manager.cc:1939] T 0d23603687b840ab8b8577f0d747caf0 P 437c32e490224ee59166772390280f3f: Deleting consensus metadata
I20260927 15:15:15.661161 1890 ts_tablet_manager.cc:1918] T 0d23603687b840ab8b8577f0d747caf0 P 1771ad00221b4329844cced239d7ddcf: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260927 15:15:15.661252 1890 log.cc:1196] T 0d23603687b840ab8b8577f0d747caf0 P 1771ad00221b4329844cced239d7ddcf: Deleting WAL directory at /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790521920546562-17952-0/minicluster-data/ts-2/wal/wals/0d23603687b840ab8b8577f0d747caf0
I20260927 15:15:15.661510 17952 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu with pid 1591
I20260927 15:15:15.661556 1890 ts_tablet_manager.cc:1939] T 0d23603687b840ab8b8577f0d747caf0 P 1771ad00221b4329844cced239d7ddcf: Deleting consensus metadata
I20260927 15:15:15.662619 1384 catalog_manager.cc:4841] TS 1771ad00221b4329844cced239d7ddcf (127.17.136.3:43107): tablet 0d23603687b840ab8b8577f0d747caf0 (table test-table [id=4fb7c6fc714f40dd8354e9a9142c386d]) successfully deleted
I20260927 15:15:15.663923 1866 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:15:15.663624 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.1:39793 (local address 127.0.0.1:48596)
0927 15:15:15.663788 (+ 164us) negotiation.cc:107] Waiting for socket to connect
0927 15:15:15.663852 (+ 64us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.136.1:39793: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":90}
W20260927 15:15:15.664085 1382 catalog_manager.cc:4584] TS 0d6699fa47f047bcb6dafd9ef13170de (127.17.136.1:39793): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 0d23603687b840ab8b8577f0d747caf0: Network error: Client connection negotiation failed: client connection to 127.17.136.1:39793: connect: Connection refused (error 111)
I20260927 15:15:15.667071 17952 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu with pid 1727
I20260927 15:15:15.668766 1866 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:15:15.668507 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.2:46571 (local address 127.0.0.1:60228)
0927 15:15:15.668623 (+ 116us) negotiation.cc:107] Waiting for socket to connect
0927 15:15:15.668680 (+ 57us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.136.2:46571: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":34}
I20260927 15:15:15.671833 17952 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu with pid 1365
I20260927 15:15:35.677277 17952 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu
/tmp/dist-test-taskiFOyeW/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790521920546562-17952-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790521920546562-17952-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790521920546562-17952-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790521920546562-17952-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.136.62:37201
--webserver_interface=127.17.136.62
--webserver_port=33551
--keytab_file=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790521920546562-17952-0/krb5kdc/kudu_127.17.136.62.keytab
--principal=kudu/127.17.136.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.136.20:41831
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.136.62:37201
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20 with env {KRB5CCNAME=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790521920546562-17952-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790521920546562-17952-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790521920546562-17952-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260927 15:15:35.783437 1892 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260927 15:15:35.783692 1892 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260927 15:15:35.783731 1892 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260927 15:15:35.787642 1892 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260927 15:15:35.787698 1892 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260927 15:15:35.787714 1892 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260927 15:15:35.787726 1892 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260927 15:15:35.787743 1892 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260927 15:15:35.787772 1892 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260927 15:15:35.787799 1892 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260927 15:15:35.787817 1892 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260927 15:15:35.793160 1892 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.136.20:41831
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790521920546562-17952-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790521920546562-17952-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.17.136.62:37201
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790521920546562-17952-0/krb5kdc/kudu_127.17.136.62.keytab
--principal=kudu/127.17.136.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.136.62:37201
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790521920546562-17952-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.17.136.62
--webserver_port=33551
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1892
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790521920546562-17952-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 27 Sep 2026 14:27:13 UTC on ccycloud.quasar-psqrth.root.comops.site
build id 4676138
I20260927 15:15:35.794173 1892 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260927 15:15:35.795159 1892 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260927 15:15:35.803170 1900 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260927 15:15:35.803182 1897 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260927 15:15:35.803205 1898 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260927 15:15:35.803356 1892 server_base.cc:1034] running on GCE node
I20260927 15:15:35.804080 1892 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260927 15:15:35.805141 1892 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260927 15:15:35.806298 1892 hybrid_clock.cc:648] HybridClock initialized: now 1790522135806275 us; error 44 us; skew 500 ppm
Sep 27 15:15:35 dist-test-slave-5s2t krb5kdc[819](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790522135, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.136.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260927 15:15:35.814805 1892 init.cc:377] Logged in from keytab as kudu/127.17.136.62@KRBTEST.COM (short username kudu)
I20260927 15:15:35.815831 1892 webserver.cc:460] Webserver started at http://127.17.136.62:33551/ using document root <none> and password file <none>
I20260927 15:15:35.816375 1892 fs_manager.cc:359] Metadata directory not provided
I20260927 15:15:35.816440 1892 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260927 15:15:35.820282 1892 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.004s sys 0.000s
I20260927 15:15:35.822364 1907 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260927 15:15:35.823755 1892 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260927 15:15:35.823889 1892 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790521920546562-17952-0/minicluster-data/master-0/data,/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790521920546562-17952-0/minicluster-data/master-0/wal
uuid: "ac838ba341bc469b8d25adb5e7aba771"
format_stamp: "Formatted at 2026-09-27 15:14:53 on dist-test-slave-5s2t"
server_key: "3979f68da0f38982c2df91f9dfda4632"
server_key_iv: "b5eb044c28a409ba8dfa338f7a3af8bd"
server_key_version: "encryptionkey@0"
I20260927 15:15:35.824440 1892 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790521920546562-17952-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790521920546562-17952-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790521920546562-17952-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260927 15:15:35.844014 1892 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260927 15:15:35.847380 1892 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260927 15:15:35.847579 1892 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260927 15:15:35.854887 1892 rpc_server.cc:307] RPC server started. Bound to: 127.17.136.62:37201
I20260927 15:15:35.855142 1959 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.136.62:37201 every 8 connection(s)
I20260927 15:15:35.856011 1892 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790521920546562-17952-0/minicluster-data/master-0/data/info.pb
I20260927 15:15:35.860111 1960 sys_catalog.cc:263] Verifying existing consensus state
I20260927 15:15:35.861697 1960 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ac838ba341bc469b8d25adb5e7aba771: Bootstrap starting.
I20260927 15:15:35.863812 17952 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu as pid 1892
I20260927 15:15:35.864212 17952 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu
/tmp/dist-test-taskiFOyeW/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790521920546562-17952-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790521920546562-17952-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790521920546562-17952-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790521920546562-17952-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.136.1:39793
--local_ip_for_outbound_sockets=127.17.136.1
--tserver_master_addrs=127.17.136.62:37201
--webserver_port=46741
--webserver_interface=127.17.136.1
--keytab_file=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790521920546562-17952-0/krb5kdc/kudu_127.17.136.1.keytab
--principal=kudu/127.17.136.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.136.20:41831
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790521920546562-17952-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790521920546562-17952-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790521920546562-17952-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260927 15:15:35.878474 1960 log.cc:824] T 00000000000000000000000000000000 P ac838ba341bc469b8d25adb5e7aba771: Log is configured to *not* fsync() on all Append() calls
I20260927 15:15:35.889322 1960 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ac838ba341bc469b8d25adb5e7aba771: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=0 applied=14 ignored=0} inserts{seen=8 ignored=0} mutations{seen=8 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260927 15:15:35.889650 1960 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ac838ba341bc469b8d25adb5e7aba771: Bootstrap complete.
I20260927 15:15:35.893429 1960 raft_consensus.cc:348] T 00000000000000000000000000000000 P ac838ba341bc469b8d25adb5e7aba771 [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ac838ba341bc469b8d25adb5e7aba771" member_type: VOTER last_known_addr { host: "127.17.136.62" port: 37201 } }
I20260927 15:15:35.893807 1960 raft_consensus.cc:729] T 00000000000000000000000000000000 P ac838ba341bc469b8d25adb5e7aba771 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: ac838ba341bc469b8d25adb5e7aba771, State: Initialized, Role: FOLLOWER
I20260927 15:15:35.894285 1960 consensus_queue.cc:260] T 00000000000000000000000000000000 P ac838ba341bc469b8d25adb5e7aba771 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ac838ba341bc469b8d25adb5e7aba771" member_type: VOTER last_known_addr { host: "127.17.136.62" port: 37201 } }
I20260927 15:15:35.894409 1960 raft_consensus.cc:388] T 00000000000000000000000000000000 P ac838ba341bc469b8d25adb5e7aba771 [term 2 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260927 15:15:35.894477 1960 raft_consensus.cc:482] T 00000000000000000000000000000000 P ac838ba341bc469b8d25adb5e7aba771 [term 2 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260927 15:15:35.894574 1960 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ac838ba341bc469b8d25adb5e7aba771 [term 2 FOLLOWER]: Advancing to term 3
I20260927 15:15:35.896368 1960 raft_consensus.cc:504] T 00000000000000000000000000000000 P ac838ba341bc469b8d25adb5e7aba771 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ac838ba341bc469b8d25adb5e7aba771" member_type: VOTER last_known_addr { host: "127.17.136.62" port: 37201 } }
I20260927 15:15:35.896656 1960 leader_election.cc:302] T 00000000000000000000000000000000 P ac838ba341bc469b8d25adb5e7aba771 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ac838ba341bc469b8d25adb5e7aba771; no voters:
I20260927 15:15:35.896934 1960 leader_election.cc:288] T 00000000000000000000000000000000 P ac838ba341bc469b8d25adb5e7aba771 [CANDIDATE]: Term 3 election: Requested vote from peers
I20260927 15:15:35.897065 1964 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ac838ba341bc469b8d25adb5e7aba771 [term 3 FOLLOWER]: Leader election won for term 3
I20260927 15:15:35.897315 1964 raft_consensus.cc:686] T 00000000000000000000000000000000 P ac838ba341bc469b8d25adb5e7aba771 [term 3 LEADER]: Becoming Leader. State: Replica: ac838ba341bc469b8d25adb5e7aba771, State: Running, Role: LEADER
I20260927 15:15:35.897617 1964 consensus_queue.cc:237] T 00000000000000000000000000000000 P ac838ba341bc469b8d25adb5e7aba771 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 3, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ac838ba341bc469b8d25adb5e7aba771" member_type: VOTER last_known_addr { host: "127.17.136.62" port: 37201 } }
I20260927 15:15:35.898030 1960 sys_catalog.cc:564] T 00000000000000000000000000000000 P ac838ba341bc469b8d25adb5e7aba771 [sys.catalog]: configured and running, proceeding with master startup.
I20260927 15:15:35.899019 1965 sys_catalog.cc:455] T 00000000000000000000000000000000 P ac838ba341bc469b8d25adb5e7aba771 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 3 leader_uuid: "ac838ba341bc469b8d25adb5e7aba771" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ac838ba341bc469b8d25adb5e7aba771" member_type: VOTER last_known_addr { host: "127.17.136.62" port: 37201 } } }
I20260927 15:15:35.899142 1965 sys_catalog.cc:458] T 00000000000000000000000000000000 P ac838ba341bc469b8d25adb5e7aba771 [sys.catalog]: This master's current role is: LEADER
I20260927 15:15:35.899911 1966 sys_catalog.cc:455] T 00000000000000000000000000000000 P ac838ba341bc469b8d25adb5e7aba771 [sys.catalog]: SysCatalogTable state changed. Reason: New leader ac838ba341bc469b8d25adb5e7aba771. Latest consensus state: current_term: 3 leader_uuid: "ac838ba341bc469b8d25adb5e7aba771" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ac838ba341bc469b8d25adb5e7aba771" member_type: VOTER last_known_addr { host: "127.17.136.62" port: 37201 } } }
I20260927 15:15:35.900206 1966 sys_catalog.cc:458] T 00000000000000000000000000000000 P ac838ba341bc469b8d25adb5e7aba771 [sys.catalog]: This master's current role is: LEADER
I20260927 15:15:35.902621 1980 catalog_manager.cc:1259] Loaded cluster ID: 0ec6b0399cd3417b91198c866ec0ceec
I20260927 15:15:35.902674 1980 catalog_manager.cc:1552] T 00000000000000000000000000000000 P ac838ba341bc469b8d25adb5e7aba771: loading cluster ID for follower catalog manager: success
I20260927 15:15:35.905201 1980 catalog_manager.cc:1574] T 00000000000000000000000000000000 P ac838ba341bc469b8d25adb5e7aba771: acquiring CA information for follower catalog manager: success
F20260927 15:15:35.906373 1980 token_signing_key.cc:66] Check failed: _s.ok() Bad status: Runtime error: unable to load data from memory: error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=RSA error:04093004:rsa routines:OLD_RSA_PRIV_DECODE:RSA lib:rsa_ameth.c:121 error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=PKCS8_PRIV_KEY_INFO
*** Check failure stack trace: ***
@ 0x7f11057679ad google::LogMessage::Fail() at ??:0
@ 0x7f110576a88a google::LogMessage::SendToLog() at ??:0
@ 0x7f11057674de google::LogMessage::Flush() at ??:0
@ 0x7f1105768a19 google::LogMessageFatal::~LogMessageFatal() at ??:0
@ 0x7f110842b18d kudu::security::TokenSigningPrivateKey::TokenSigningPrivateKey() at ??:0
@ 0x7f11100cc989 kudu::master::CatalogManager::LoadTspkEntries() at ??:0
@ 0x7f11100a9023 kudu::master::CatalogManager::PrepareFollowerTokenVerifier() at ??:0
@ 0x7f11100a954b kudu::master::CatalogManager::PrepareFollower() at ??:0
@ 0x7f11100a2652 kudu::master::CatalogManagerBgTasks::Run() at ??:0
@ 0x7f11100a19e9 _ZZN4kudu6master21CatalogManagerBgTasks4InitEvENKUlvE_clEv at ??:0
@ 0x7f11100e8541 _ZNSt17_Function_handlerIFvvEZN4kudu6master21CatalogManagerBgTasks4InitEvEUlvE_E9_M_invokeERKSt9_Any_data at ??:0
@ 0x61d838 std::function<>::operator()() at ??:0
@ 0x7f11079aa512 kudu::Thread::SuperviseThread() at ??:0
@ 0x7f1108fee6db start_thread at ??:0
@ 0x7f110426561f clone at ??:0
W20260927 15:15:35.992985 1962 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260927 15:15:35.993263 1962 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260927 15:15:35.993309 1962 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260927 15:15:35.997377 1962 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260927 15:15:35.997440 1962 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260927 15:15:35.997501 1962 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.136.1
I20260927 15:15:36.002826 1962 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.136.20:41831
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790521920546562-17952-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790521920546562-17952-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790521920546562-17952-0/krb5kdc/kudu_127.17.136.1.keytab
--principal=kudu/127.17.136.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.136.1:39793
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790521920546562-17952-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.17.136.1
--webserver_port=46741
--tserver_master_addrs=127.17.136.62:37201
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1962
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.136.1
--log_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790521920546562-17952-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 27 Sep 2026 14:27:13 UTC on ccycloud.quasar-psqrth.root.comops.site
build id 4676138
I20260927 15:15:36.003924 1962 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260927 15:15:36.004987 1962 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260927 15:15:36.015578 2001 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260927 15:15:36.015582 2000 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260927 15:15:36.015599 2003 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260927 15:15:36.015755 1962 server_base.cc:1034] running on GCE node
I20260927 15:15:36.016353 1962 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260927 15:15:36.016981 1962 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260927 15:15:36.018179 1962 hybrid_clock.cc:648] HybridClock initialized: now 1790522136018157 us; error 33 us; skew 500 ppm
Sep 27 15:15:36 dist-test-slave-5s2t krb5kdc[819](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790522136, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.136.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260927 15:15:36.021099 1962 init.cc:377] Logged in from keytab as kudu/127.17.136.1@KRBTEST.COM (short username kudu)
I20260927 15:15:36.022187 1962 webserver.cc:460] Webserver started at http://127.17.136.1:46741/ using document root <none> and password file <none>
I20260927 15:15:36.022747 1962 fs_manager.cc:359] Metadata directory not provided
I20260927 15:15:36.022819 1962 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260927 15:15:36.026774 1962 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.002s sys 0.000s
I20260927 15:15:36.028971 2010 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260927 15:15:36.030257 1962 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260927 15:15:36.030356 1962 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790521920546562-17952-0/minicluster-data/ts-0/data,/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790521920546562-17952-0/minicluster-data/ts-0/wal
uuid: "0d6699fa47f047bcb6dafd9ef13170de"
format_stamp: "Formatted at 2026-09-27 15:14:53 on dist-test-slave-5s2t"
server_key: "858b8373a613fe83c4c153c0c9a3c4a0"
server_key_iv: "2eb608dcfa909357c88ed646da3b717d"
server_key_version: "encryptionkey@0"
I20260927 15:15:36.030925 1962 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790521920546562-17952-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790521920546562-17952-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790521920546562-17952-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260927 15:15:36.052757 1962 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260927 15:15:36.056039 1962 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260927 15:15:36.056244 1962 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260927 15:15:36.056872 1962 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260927 15:15:36.058013 2017 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260927 15:15:36.062042 1962 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260927 15:15:36.062101 1962 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.004s user 0.000s sys 0.000s
I20260927 15:15:36.062161 1962 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260927 15:15:36.063869 1962 ts_tablet_manager.cc:610] Registered 1 tablets
I20260927 15:15:36.063930 1962 ts_tablet_manager.cc:589] Time spent register tablets: real 0.002s user 0.000s sys 0.001s
I20260927 15:15:36.064204 2017 tablet_bootstrap.cc:492] T 0d23603687b840ab8b8577f0d747caf0 P 0d6699fa47f047bcb6dafd9ef13170de: Bootstrap starting.
I20260927 15:15:36.075171 1962 rpc_server.cc:307] RPC server started. Bound to: 127.17.136.1:39793
I20260927 15:15:36.076519 1962 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790521920546562-17952-0/minicluster-data/ts-0/data/info.pb
I20260927 15:15:36.076805 2124 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.136.1:39793 every 8 connection(s)
I20260927 15:15:36.080765 17952 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu as pid 1962
I20260927 15:15:36.081359 17952 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu
/tmp/dist-test-taskiFOyeW/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790521920546562-17952-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790521920546562-17952-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790521920546562-17952-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790521920546562-17952-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.136.2:46571
--local_ip_for_outbound_sockets=127.17.136.2
--tserver_master_addrs=127.17.136.62:37201
--webserver_port=46249
--webserver_interface=127.17.136.2
--keytab_file=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790521920546562-17952-0/krb5kdc/kudu_127.17.136.2.keytab
--principal=kudu/127.17.136.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.136.20:41831
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790521920546562-17952-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790521920546562-17952-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790521920546562-17952-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260927 15:15:36.084772 2017 log.cc:824] T 0d23603687b840ab8b8577f0d747caf0 P 0d6699fa47f047bcb6dafd9ef13170de: Log is configured to *not* fsync() on all Append() calls
W20260927 15:15:36.092779 2127 negotiation.cc:337] Failed RPC negotiation. Trace:
0927 15:15:36.078985 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.62:37201 (local address 127.17.136.1:40687)
0927 15:15:36.079679 (+ 694us) negotiation.cc:107] Waiting for socket to connect
0927 15:15:36.079738 (+ 59us) client_negotiation.cc:174] Beginning negotiation
0927 15:15:36.080790 (+ 1052us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0927 15:15:36.092055 (+ 11265us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.136.62:37201: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"client-negotiator.queue_time_us":451,"thread_start_us":186,"threads_started":1}
W20260927 15:15:36.093580 2125 heartbeater.cc:644] Failed to heartbeat to 127.17.136.62:37201 (0 consecutive failures): Network error: Failed to ping master at 127.17.136.62:37201: Client connection negotiation failed: client connection to 127.17.136.62:37201: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260927 15:15:36.094192 2127 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:15:36.093964 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.62:37201 (local address 127.17.136.1:54013)
0927 15:15:36.094081 (+ 117us) negotiation.cc:107] Waiting for socket to connect
0927 15:15:36.094140 (+ 59us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.136.62:37201: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":47}
I20260927 15:15:36.094347 2017 tablet_bootstrap.cc:492] T 0d23603687b840ab8b8577f0d747caf0 P 0d6699fa47f047bcb6dafd9ef13170de: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260927 15:15:36.094743 2017 tablet_bootstrap.cc:492] T 0d23603687b840ab8b8577f0d747caf0 P 0d6699fa47f047bcb6dafd9ef13170de: Bootstrap complete.
I20260927 15:15:36.094818 2127 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:15:36.094602 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.62:37201 (local address 127.17.136.1:58381)
0927 15:15:36.094700 (+ 98us) negotiation.cc:107] Waiting for socket to connect
0927 15:15:36.094740 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.136.62:37201: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":39}
W20260927 15:15:36.094973 2125 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260927 15:15:36.096052 2017 ts_tablet_manager.cc:1397] T 0d23603687b840ab8b8577f0d747caf0 P 0d6699fa47f047bcb6dafd9ef13170de: Time spent bootstrapping tablet: real 0.032s user 0.023s sys 0.008s
I20260927 15:15:36.099031 2017 raft_consensus.cc:348] T 0d23603687b840ab8b8577f0d747caf0 P 0d6699fa47f047bcb6dafd9ef13170de [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1771ad00221b4329844cced239d7ddcf" member_type: VOTER last_known_addr { host: "127.17.136.3" port: 43107 } } peers { permanent_uuid: "437c32e490224ee59166772390280f3f" member_type: VOTER last_known_addr { host: "127.17.136.2" port: 46571 } } peers { permanent_uuid: "0d6699fa47f047bcb6dafd9ef13170de" member_type: VOTER last_known_addr { host: "127.17.136.1" port: 39793 } }
I20260927 15:15:36.099581 2017 raft_consensus.cc:729] T 0d23603687b840ab8b8577f0d747caf0 P 0d6699fa47f047bcb6dafd9ef13170de [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0d6699fa47f047bcb6dafd9ef13170de, State: Initialized, Role: FOLLOWER
I20260927 15:15:36.100063 2017 consensus_queue.cc:260] T 0d23603687b840ab8b8577f0d747caf0 P 0d6699fa47f047bcb6dafd9ef13170de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1771ad00221b4329844cced239d7ddcf" member_type: VOTER last_known_addr { host: "127.17.136.3" port: 43107 } } peers { permanent_uuid: "437c32e490224ee59166772390280f3f" member_type: VOTER last_known_addr { host: "127.17.136.2" port: 46571 } } peers { permanent_uuid: "0d6699fa47f047bcb6dafd9ef13170de" member_type: VOTER last_known_addr { host: "127.17.136.1" port: 39793 } }
I20260927 15:15:36.101058 2017 ts_tablet_manager.cc:1428] T 0d23603687b840ab8b8577f0d747caf0 P 0d6699fa47f047bcb6dafd9ef13170de: Time spent starting tablet: real 0.005s user 0.005s sys 0.000s
I20260927 15:15:36.101063 2127 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:15:36.100852 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.62:37201 (local address 127.17.136.1:56087)
0927 15:15:36.100957 (+ 105us) negotiation.cc:107] Waiting for socket to connect
0927 15:15:36.101012 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.136.62:37201: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":41}
I20260927 15:15:36.101783 2127 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:15:36.101564 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.62:37201 (local address 127.17.136.1:50571)
0927 15:15:36.101673 (+ 109us) negotiation.cc:107] Waiting for socket to connect
0927 15:15:36.101726 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.136.62:37201: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":47}
W20260927 15:15:36.193907 2128 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260927 15:15:36.194159 2128 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260927 15:15:36.194198 2128 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260927 15:15:36.198136 2128 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260927 15:15:36.198191 2128 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260927 15:15:36.198246 2128 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.136.2
I20260927 15:15:36.203284 2128 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.136.20:41831
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790521920546562-17952-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790521920546562-17952-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790521920546562-17952-0/krb5kdc/kudu_127.17.136.2.keytab
--principal=kudu/127.17.136.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.136.2:46571
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790521920546562-17952-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.17.136.2
--webserver_port=46249
--tserver_master_addrs=127.17.136.62:37201
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2128
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.136.2
--log_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790521920546562-17952-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 27 Sep 2026 14:27:13 UTC on ccycloud.quasar-psqrth.root.comops.site
build id 4676138
I20260927 15:15:36.204295 2128 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260927 15:15:36.205258 2128 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260927 15:15:36.214362 2138 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260927 15:15:36.214373 2135 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260927 15:15:36.214349 2136 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260927 15:15:36.214704 2128 server_base.cc:1034] running on GCE node
I20260927 15:15:36.215063 2128 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260927 15:15:36.215708 2128 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260927 15:15:36.216868 2128 hybrid_clock.cc:648] HybridClock initialized: now 1790522136216851 us; error 29 us; skew 500 ppm
Sep 27 15:15:36 dist-test-slave-5s2t krb5kdc[819](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790522136, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.136.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260927 15:15:36.219403 2128 init.cc:377] Logged in from keytab as kudu/127.17.136.2@KRBTEST.COM (short username kudu)
I20260927 15:15:36.220149 2128 webserver.cc:460] Webserver started at http://127.17.136.2:46249/ using document root <none> and password file <none>
I20260927 15:15:36.220640 2128 fs_manager.cc:359] Metadata directory not provided
I20260927 15:15:36.220695 2128 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260927 15:15:36.224226 2128 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.003s sys 0.000s
I20260927 15:15:36.226135 2145 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260927 15:15:36.227357 2128 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260927 15:15:36.227447 2128 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790521920546562-17952-0/minicluster-data/ts-1/data,/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790521920546562-17952-0/minicluster-data/ts-1/wal
uuid: "437c32e490224ee59166772390280f3f"
format_stamp: "Formatted at 2026-09-27 15:14:53 on dist-test-slave-5s2t"
server_key: "ea4dff3ebf9920264cba02c8f7f3aa73"
server_key_iv: "466d429d2eec40da294248052ddc62b3"
server_key_version: "encryptionkey@0"
I20260927 15:15:36.227984 2128 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790521920546562-17952-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790521920546562-17952-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790521920546562-17952-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260927 15:15:36.253453 2128 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260927 15:15:36.256357 2128 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260927 15:15:36.256505 2128 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260927 15:15:36.257025 2128 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260927 15:15:36.257786 2128 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260927 15:15:36.257829 2128 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260927 15:15:36.257867 2128 ts_tablet_manager.cc:610] Registered 0 tablets
I20260927 15:15:36.257889 2128 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260927 15:15:36.266212 2128 rpc_server.cc:307] RPC server started. Bound to: 127.17.136.2:46571
I20260927 15:15:36.266278 2258 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.136.2:46571 every 8 connection(s)
I20260927 15:15:36.267181 2128 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790521920546562-17952-0/minicluster-data/ts-1/data/info.pb
I20260927 15:15:36.268345 17952 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu as pid 2128
I20260927 15:15:36.268723 17952 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu
/tmp/dist-test-taskiFOyeW/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790521920546562-17952-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790521920546562-17952-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790521920546562-17952-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790521920546562-17952-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.136.3:43107
--local_ip_for_outbound_sockets=127.17.136.3
--tserver_master_addrs=127.17.136.62:37201
--webserver_port=42569
--webserver_interface=127.17.136.3
--keytab_file=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790521920546562-17952-0/krb5kdc/kudu_127.17.136.3.keytab
--principal=kudu/127.17.136.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.136.20:41831
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790521920546562-17952-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790521920546562-17952-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790521920546562-17952-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260927 15:15:36.271199 2261 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:15:36.269368 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.62:37201 (local address 127.17.136.2:38307)
0927 15:15:36.269886 (+ 518us) negotiation.cc:107] Waiting for socket to connect
0927 15:15:36.270011 (+ 125us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.136.62:37201: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":272,"thread_start_us":111,"threads_started":1}
W20260927 15:15:36.271659 2259 heartbeater.cc:644] Failed to heartbeat to 127.17.136.62:37201 (0 consecutive failures): Network error: Failed to ping master at 127.17.136.62:37201: Client connection negotiation failed: client connection to 127.17.136.62:37201: connect: Connection refused (error 111)
I20260927 15:15:36.272248 2261 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:15:36.272011 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.62:37201 (local address 127.17.136.2:60571)
0927 15:15:36.272130 (+ 119us) negotiation.cc:107] Waiting for socket to connect
0927 15:15:36.272184 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.136.62:37201: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":46}
I20260927 15:15:36.272862 2261 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:15:36.272680 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.62:37201 (local address 127.17.136.2:60139)
0927 15:15:36.272772 (+ 92us) negotiation.cc:107] Waiting for socket to connect
0927 15:15:36.272815 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.136.62:37201: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":42}
W20260927 15:15:36.273018 2259 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260927 15:15:36.377686 2262 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260927 15:15:36.377974 2262 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260927 15:15:36.378018 2262 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260927 15:15:36.381995 2262 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260927 15:15:36.382063 2262 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260927 15:15:36.382123 2262 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.136.3
I20260927 15:15:36.387375 2262 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.136.20:41831
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790521920546562-17952-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790521920546562-17952-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790521920546562-17952-0/krb5kdc/kudu_127.17.136.3.keytab
--principal=kudu/127.17.136.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.136.3:43107
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790521920546562-17952-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.17.136.3
--webserver_port=42569
--tserver_master_addrs=127.17.136.62:37201
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2262
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.136.3
--log_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790521920546562-17952-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 27 Sep 2026 14:27:13 UTC on ccycloud.quasar-psqrth.root.comops.site
build id 4676138
I20260927 15:15:36.388449 2262 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260927 15:15:36.389442 2262 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260927 15:15:36.398802 2267 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260927 15:15:36.398823 2270 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260927 15:15:36.398932 2268 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260927 15:15:36.399027 2262 server_base.cc:1034] running on GCE node
I20260927 15:15:36.399544 2262 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260927 15:15:36.400122 2262 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260927 15:15:36.401295 2262 hybrid_clock.cc:648] HybridClock initialized: now 1790522136401257 us; error 47 us; skew 500 ppm
Sep 27 15:15:36 dist-test-slave-5s2t krb5kdc[819](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790522136, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.136.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260927 15:15:36.403875 2262 init.cc:377] Logged in from keytab as kudu/127.17.136.3@KRBTEST.COM (short username kudu)
I20260927 15:15:36.404773 2262 webserver.cc:460] Webserver started at http://127.17.136.3:42569/ using document root <none> and password file <none>
I20260927 15:15:36.405316 2262 fs_manager.cc:359] Metadata directory not provided
I20260927 15:15:36.405375 2262 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260927 15:15:36.409202 2262 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.004s sys 0.000s
I20260927 15:15:36.411306 2277 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260927 15:15:36.412510 2262 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260927 15:15:36.412614 2262 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790521920546562-17952-0/minicluster-data/ts-2/data,/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790521920546562-17952-0/minicluster-data/ts-2/wal
uuid: "1771ad00221b4329844cced239d7ddcf"
format_stamp: "Formatted at 2026-09-27 15:14:54 on dist-test-slave-5s2t"
server_key: "73ae13fc40df686fc099d5135586f7c0"
server_key_iv: "2cb71c111ed52a32a9c6cc9c5db704c9"
server_key_version: "encryptionkey@0"
I20260927 15:15:36.413146 2262 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790521920546562-17952-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790521920546562-17952-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790521920546562-17952-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260927 15:15:36.437121 2262 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260927 15:15:36.440016 2262 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260927 15:15:36.440179 2262 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260927 15:15:36.440770 2262 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260927 15:15:36.441551 2262 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260927 15:15:36.441596 2262 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260927 15:15:36.441656 2262 ts_tablet_manager.cc:610] Registered 0 tablets
I20260927 15:15:36.441685 2262 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260927 15:15:36.449649 2262 rpc_server.cc:307] RPC server started. Bound to: 127.17.136.3:43107
I20260927 15:15:36.449672 2390 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.136.3:43107 every 8 connection(s)
I20260927 15:15:36.450583 2262 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790521920546562-17952-0/minicluster-data/ts-2/data/info.pb
I20260927 15:15:36.454175 2393 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:15:36.452598 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.62:37201 (local address 127.17.136.3:54333)
0927 15:15:36.453007 (+ 409us) negotiation.cc:107] Waiting for socket to connect
0927 15:15:36.453107 (+ 100us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.136.62:37201: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":234,"thread_start_us":92,"threads_started":1}
W20260927 15:15:36.454605 2391 heartbeater.cc:644] Failed to heartbeat to 127.17.136.62:37201 (0 consecutive failures): Network error: Failed to ping master at 127.17.136.62:37201: Client connection negotiation failed: client connection to 127.17.136.62:37201: connect: Connection refused (error 111)
I20260927 15:15:36.455123 2393 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:15:36.454903 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.62:37201 (local address 127.17.136.3:39039)
0927 15:15:36.455013 (+ 110us) negotiation.cc:107] Waiting for socket to connect
0927 15:15:36.455064 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.136.62:37201: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":39}
I20260927 15:15:36.455123 17952 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu as pid 2262
I20260927 15:15:36.455709 2393 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:15:36.455520 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.62:37201 (local address 127.17.136.3:51041)
0927 15:15:36.455618 (+ 98us) negotiation.cc:107] Waiting for socket to connect
0927 15:15:36.455662 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.136.62:37201: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":40}
W20260927 15:15:36.455854 2391 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260927 15:15:37.103091 2395 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:15:37.102551 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.62:37201 (local address 127.17.136.1:43345)
0927 15:15:37.102882 (+ 331us) negotiation.cc:107] Waiting for socket to connect
0927 15:15:37.102960 (+ 78us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.136.62:37201: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":231,"thread_start_us":82,"threads_started":1}
I20260927 15:15:37.273965 2396 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:15:37.273560 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.62:37201 (local address 127.17.136.2:58159)
0927 15:15:37.273811 (+ 251us) negotiation.cc:107] Waiting for socket to connect
0927 15:15:37.273869 (+ 58us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.136.62:37201: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":178,"thread_start_us":66,"threads_started":1}
I20260927 15:15:37.456822 2397 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:15:37.456411 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.62:37201 (local address 127.17.136.3:55921)
0927 15:15:37.456643 (+ 232us) negotiation.cc:107] Waiting for socket to connect
0927 15:15:37.456719 (+ 76us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.136.62:37201: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":160,"thread_start_us":63,"threads_started":1}
I20260927 15:15:37.713524 2398 raft_consensus.cc:482] T 0d23603687b840ab8b8577f0d747caf0 P 0d6699fa47f047bcb6dafd9ef13170de [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:15:37.713727 2398 raft_consensus.cc:504] T 0d23603687b840ab8b8577f0d747caf0 P 0d6699fa47f047bcb6dafd9ef13170de [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1771ad00221b4329844cced239d7ddcf" member_type: VOTER last_known_addr { host: "127.17.136.3" port: 43107 } } peers { permanent_uuid: "437c32e490224ee59166772390280f3f" member_type: VOTER last_known_addr { host: "127.17.136.2" port: 46571 } } peers { permanent_uuid: "0d6699fa47f047bcb6dafd9ef13170de" member_type: VOTER last_known_addr { host: "127.17.136.1" port: 39793 } }
I20260927 15:15:37.714782 2398 leader_election.cc:288] T 0d23603687b840ab8b8577f0d747caf0 P 0d6699fa47f047bcb6dafd9ef13170de [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1771ad00221b4329844cced239d7ddcf (127.17.136.3:43107), 437c32e490224ee59166772390280f3f (127.17.136.2:46571)
Sep 27 15:15:37 dist-test-slave-5s2t krb5kdc[819](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790522136, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.136.1@KRBTEST.COM for kudu/127.17.136.3@KRBTEST.COM
Sep 27 15:15:37 dist-test-slave-5s2t krb5kdc[819](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790522136, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.136.1@KRBTEST.COM for kudu/127.17.136.2@KRBTEST.COM
I20260927 15:15:37.730250 2400 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:15:37.714978 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.3:43107 (local address 127.17.136.1:47459)
0927 15:15:37.715296 (+ 318us) negotiation.cc:107] Waiting for socket to connect
0927 15:15:37.715313 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0927 15:15:37.715432 (+ 119us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0927 15:15:37.717465 (+ 2033us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0927 15:15:37.717468 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0927 15:15:37.718039 (+ 571us) client_negotiation.cc:189] Negotiated authn=SASL
0927 15:15:37.718806 (+ 767us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:15:37.718829 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:15:37.720735 (+ 1906us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:15:37.720738 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:15:37.722339 (+ 1601us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:15:37.722351 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:15:37.723316 (+ 965us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:15:37.723320 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:15:37.723547 (+ 227us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:15:37.724139 (+ 592us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0927 15:15:37.724161 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0927 15:15:37.725833 (+ 1672us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0927 15:15:37.727862 (+ 2029us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0927 15:15:37.727868 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0927 15:15:37.727882 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0927 15:15:37.728189 (+ 307us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0927 15:15:37.728535 (+ 346us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0927 15:15:37.728538 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0927 15:15:37.728540 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0927 15:15:37.728697 (+ 157us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0927 15:15:37.729346 (+ 649us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0927 15:15:37.729353 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0927 15:15:37.729579 (+ 226us) client_negotiation.cc:769] Sending connection context
0927 15:15:37.729729 (+ 150us) client_negotiation.cc:240] Negotiation successful
0927 15:15:37.730058 (+ 329us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":229,"mutex_wait_us":168,"spinlock_wait_cycles":17920,"thread_start_us":60,"threads_started":1}
I20260927 15:15:37.730283 2399 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:15:37.714978 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.2:46571 (local address 127.17.136.1:42423)
0927 15:15:37.715400 (+ 422us) negotiation.cc:107] Waiting for socket to connect
0927 15:15:37.715411 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0927 15:15:37.715469 (+ 58us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0927 15:15:37.717458 (+ 1989us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0927 15:15:37.717465 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0927 15:15:37.718039 (+ 574us) client_negotiation.cc:189] Negotiated authn=SASL
0927 15:15:37.718806 (+ 767us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:15:37.718829 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:15:37.720735 (+ 1906us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:15:37.720738 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:15:37.722339 (+ 1601us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:15:37.722351 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:15:37.723333 (+ 982us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:15:37.723337 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:15:37.723627 (+ 290us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:15:37.724199 (+ 572us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0927 15:15:37.724210 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0927 15:15:37.726182 (+ 1972us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0927 15:15:37.728232 (+ 2050us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0927 15:15:37.728236 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0927 15:15:37.728238 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0927 15:15:37.728467 (+ 229us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0927 15:15:37.728791 (+ 324us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0927 15:15:37.728794 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0927 15:15:37.728796 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0927 15:15:37.728880 (+ 84us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0927 15:15:37.729444 (+ 564us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0927 15:15:37.729447 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0927 15:15:37.729577 (+ 130us) client_negotiation.cc:769] Sending connection context
0927 15:15:37.729730 (+ 153us) client_negotiation.cc:240] Negotiation successful
0927 15:15:37.730126 (+ 396us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":368,"mutex_wait_us":664,"spinlock_wait_cycles":16512,"thread_start_us":61,"threads_started":1}
I20260927 15:15:37.730293 2402 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:15:37.715171 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.136.1:47459 (local address 127.17.136.3:43107)
0927 15:15:37.715596 (+ 425us) server_negotiation.cc:206] Beginning negotiation
0927 15:15:37.715619 (+ 23us) server_negotiation.cc:399] Waiting for connection header
0927 15:15:37.715664 (+ 45us) server_negotiation.cc:407] Connection header received
0927 15:15:37.716568 (+ 904us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:15:37.716575 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:15:37.717004 (+ 429us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:15:37.717335 (+ 331us) server_negotiation.cc:226] Negotiated authn=SASL
0927 15:15:37.718998 (+ 1663us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:15:37.720585 (+ 1587us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:15:37.722460 (+ 1875us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:15:37.723170 (+ 710us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:15:37.723407 (+ 237us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:15:37.726041 (+ 2634us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0927 15:15:37.726048 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0927 15:15:37.726064 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0927 15:15:37.726096 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0927 15:15:37.727748 (+ 1652us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:15:37.728284 (+ 536us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:15:37.728290 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:15:37.728296 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:15:37.728446 (+ 150us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:15:37.728785 (+ 339us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:15:37.728788 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:15:37.728790 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:15:37.729212 (+ 422us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0927 15:15:37.729307 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0927 15:15:37.729862 (+ 555us) server_negotiation.cc:299] Negotiation successful
0927 15:15:37.730105 (+ 243us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":322,"thread_start_us":121,"threads_started":1}
I20260927 15:15:37.730289 2401 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:15:37.715171 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.136.1:42423 (local address 127.17.136.2:46571)
0927 15:15:37.715596 (+ 425us) server_negotiation.cc:206] Beginning negotiation
0927 15:15:37.715620 (+ 24us) server_negotiation.cc:399] Waiting for connection header
0927 15:15:37.715664 (+ 44us) server_negotiation.cc:407] Connection header received
0927 15:15:37.716536 (+ 872us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:15:37.716544 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:15:37.717004 (+ 460us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:15:37.717335 (+ 331us) server_negotiation.cc:226] Negotiated authn=SASL
0927 15:15:37.718998 (+ 1663us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:15:37.720585 (+ 1587us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:15:37.722460 (+ 1875us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:15:37.723192 (+ 732us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:15:37.723495 (+ 303us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:15:37.726347 (+ 2852us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0927 15:15:37.726351 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0927 15:15:37.726361 (+ 10us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0927 15:15:37.726388 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0927 15:15:37.728127 (+ 1739us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:15:37.728559 (+ 432us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:15:37.728564 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:15:37.728570 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:15:37.728697 (+ 127us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:15:37.728959 (+ 262us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:15:37.728961 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:15:37.728962 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:15:37.729338 (+ 376us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0927 15:15:37.729448 (+ 110us) server_negotiation.cc:1035] Waiting for connection context
0927 15:15:37.729881 (+ 433us) server_negotiation.cc:299] Negotiation successful
0927 15:15:37.730141 (+ 260us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":321,"thread_start_us":107,"threads_started":1}
W20260927 15:15:37.732697 2013 leader_election.cc:341] T 0d23603687b840ab8b8577f0d747caf0 P 0d6699fa47f047bcb6dafd9ef13170de [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 1771ad00221b4329844cced239d7ddcf (127.17.136.3:43107): Not found: Tablet not found: 0d23603687b840ab8b8577f0d747caf0
W20260927 15:15:37.733065 2012 leader_election.cc:341] T 0d23603687b840ab8b8577f0d747caf0 P 0d6699fa47f047bcb6dafd9ef13170de [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 437c32e490224ee59166772390280f3f (127.17.136.2:46571): Not found: Tablet not found: 0d23603687b840ab8b8577f0d747caf0
I20260927 15:15:37.733145 2012 leader_election.cc:302] T 0d23603687b840ab8b8577f0d747caf0 P 0d6699fa47f047bcb6dafd9ef13170de [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0d6699fa47f047bcb6dafd9ef13170de; no voters: 1771ad00221b4329844cced239d7ddcf, 437c32e490224ee59166772390280f3f
I20260927 15:15:37.733385 2398 raft_consensus.cc:2726] T 0d23603687b840ab8b8577f0d747caf0 P 0d6699fa47f047bcb6dafd9ef13170de [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260927 15:15:38.104346 2399 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:15:38.103880 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.62:37201 (local address 127.17.136.1:54479)
0927 15:15:38.104068 (+ 188us) negotiation.cc:107] Waiting for socket to connect
0927 15:15:38.104213 (+ 145us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.136.62:37201: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":52}
I20260927 15:15:38.275272 2403 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:15:38.274819 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.62:37201 (local address 127.17.136.2:55637)
0927 15:15:38.275081 (+ 262us) negotiation.cc:107] Waiting for socket to connect
0927 15:15:38.275155 (+ 74us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.136.62:37201: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":182,"thread_start_us":73,"threads_started":1}
I20260927 15:15:38.457942 2404 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:15:38.457519 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.62:37201 (local address 127.17.136.3:44719)
0927 15:15:38.457795 (+ 276us) negotiation.cc:107] Waiting for socket to connect
0927 15:15:38.457853 (+ 58us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.136.62:37201: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":199,"thread_start_us":74,"threads_started":1}
I20260927 15:15:39.105573 2405 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:15:39.105032 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.62:37201 (local address 127.17.136.1:42637)
0927 15:15:39.105403 (+ 371us) negotiation.cc:107] Waiting for socket to connect
0927 15:15:39.105471 (+ 68us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.136.62:37201: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":277,"thread_start_us":68,"threads_started":1}
I20260927 15:15:39.276374 2406 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:15:39.275976 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.62:37201 (local address 127.17.136.2:43189)
0927 15:15:39.276216 (+ 240us) negotiation.cc:107] Waiting for socket to connect
0927 15:15:39.276271 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.136.62:37201: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":170,"thread_start_us":67,"threads_started":1}
I20260927 15:15:39.458959 2407 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:15:39.458581 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.62:37201 (local address 127.17.136.3:47265)
0927 15:15:39.458809 (+ 228us) negotiation.cc:107] Waiting for socket to connect
0927 15:15:39.458868 (+ 59us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.136.62:37201: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":161,"thread_start_us":75,"threads_started":1}
I20260927 15:15:39.844831 2408 raft_consensus.cc:482] T 0d23603687b840ab8b8577f0d747caf0 P 0d6699fa47f047bcb6dafd9ef13170de [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:15:39.844959 2408 raft_consensus.cc:504] T 0d23603687b840ab8b8577f0d747caf0 P 0d6699fa47f047bcb6dafd9ef13170de [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1771ad00221b4329844cced239d7ddcf" member_type: VOTER last_known_addr { host: "127.17.136.3" port: 43107 } } peers { permanent_uuid: "437c32e490224ee59166772390280f3f" member_type: VOTER last_known_addr { host: "127.17.136.2" port: 46571 } } peers { permanent_uuid: "0d6699fa47f047bcb6dafd9ef13170de" member_type: VOTER last_known_addr { host: "127.17.136.1" port: 39793 } }
I20260927 15:15:39.845396 2408 leader_election.cc:288] T 0d23603687b840ab8b8577f0d747caf0 P 0d6699fa47f047bcb6dafd9ef13170de [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1771ad00221b4329844cced239d7ddcf (127.17.136.3:43107), 437c32e490224ee59166772390280f3f (127.17.136.2:46571)
W20260927 15:15:39.846189 2012 leader_election.cc:341] T 0d23603687b840ab8b8577f0d747caf0 P 0d6699fa47f047bcb6dafd9ef13170de [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 437c32e490224ee59166772390280f3f (127.17.136.2:46571): Not found: Tablet not found: 0d23603687b840ab8b8577f0d747caf0
W20260927 15:15:39.846294 2013 leader_election.cc:341] T 0d23603687b840ab8b8577f0d747caf0 P 0d6699fa47f047bcb6dafd9ef13170de [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 1771ad00221b4329844cced239d7ddcf (127.17.136.3:43107): Not found: Tablet not found: 0d23603687b840ab8b8577f0d747caf0
I20260927 15:15:39.846382 2013 leader_election.cc:302] T 0d23603687b840ab8b8577f0d747caf0 P 0d6699fa47f047bcb6dafd9ef13170de [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0d6699fa47f047bcb6dafd9ef13170de; no voters: 1771ad00221b4329844cced239d7ddcf, 437c32e490224ee59166772390280f3f
I20260927 15:15:39.846519 2408 raft_consensus.cc:2726] T 0d23603687b840ab8b8577f0d747caf0 P 0d6699fa47f047bcb6dafd9ef13170de [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260927 15:15:40.106741 2409 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:15:40.106339 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.62:37201 (local address 127.17.136.1:53485)
0927 15:15:40.106580 (+ 241us) negotiation.cc:107] Waiting for socket to connect
0927 15:15:40.106633 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.136.62:37201: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":170,"thread_start_us":74,"threads_started":1}
I20260927 15:15:40.277395 2410 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:15:40.277034 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.62:37201 (local address 127.17.136.2:41691)
0927 15:15:40.277256 (+ 222us) negotiation.cc:107] Waiting for socket to connect
0927 15:15:40.277308 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.136.62:37201: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":160,"thread_start_us":81,"threads_started":1}
I20260927 15:15:40.459990 2411 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:15:40.459623 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.62:37201 (local address 127.17.136.3:57173)
0927 15:15:40.459848 (+ 225us) negotiation.cc:107] Waiting for socket to connect
0927 15:15:40.459901 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.136.62:37201: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":160,"thread_start_us":78,"threads_started":1}
I20260927 15:15:41.107988 2412 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:15:41.107575 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.62:37201 (local address 127.17.136.1:32843)
0927 15:15:41.107832 (+ 257us) negotiation.cc:107] Waiting for socket to connect
0927 15:15:41.107893 (+ 61us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.136.62:37201: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":181,"thread_start_us":77,"threads_started":1}
I20260927 15:15:41.278460 2413 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:15:41.278064 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.62:37201 (local address 127.17.136.2:33195)
0927 15:15:41.278314 (+ 250us) negotiation.cc:107] Waiting for socket to connect
0927 15:15:41.278369 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.136.62:37201: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":174,"thread_start_us":71,"threads_started":1}
I20260927 15:15:41.461182 2414 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:15:41.460702 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.62:37201 (local address 127.17.136.3:43957)
0927 15:15:41.460993 (+ 291us) negotiation.cc:107] Waiting for socket to connect
0927 15:15:41.461049 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.136.62:37201: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":216,"thread_start_us":95,"threads_started":1}
I20260927 15:15:42.109047 2415 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:15:42.108648 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.62:37201 (local address 127.17.136.1:53437)
0927 15:15:42.108892 (+ 244us) negotiation.cc:107] Waiting for socket to connect
0927 15:15:42.108950 (+ 58us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.136.62:37201: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":167,"thread_start_us":66,"threads_started":1}
I20260927 15:15:42.279572 2416 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:15:42.279125 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.62:37201 (local address 127.17.136.2:36057)
0927 15:15:42.279416 (+ 291us) negotiation.cc:107] Waiting for socket to connect
0927 15:15:42.279476 (+ 60us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.136.62:37201: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":219,"thread_start_us":80,"threads_started":1}
I20260927 15:15:42.292544 2417 raft_consensus.cc:482] T 0d23603687b840ab8b8577f0d747caf0 P 0d6699fa47f047bcb6dafd9ef13170de [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:15:42.292672 2417 raft_consensus.cc:504] T 0d23603687b840ab8b8577f0d747caf0 P 0d6699fa47f047bcb6dafd9ef13170de [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1771ad00221b4329844cced239d7ddcf" member_type: VOTER last_known_addr { host: "127.17.136.3" port: 43107 } } peers { permanent_uuid: "437c32e490224ee59166772390280f3f" member_type: VOTER last_known_addr { host: "127.17.136.2" port: 46571 } } peers { permanent_uuid: "0d6699fa47f047bcb6dafd9ef13170de" member_type: VOTER last_known_addr { host: "127.17.136.1" port: 39793 } }
I20260927 15:15:42.293037 2417 leader_election.cc:288] T 0d23603687b840ab8b8577f0d747caf0 P 0d6699fa47f047bcb6dafd9ef13170de [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1771ad00221b4329844cced239d7ddcf (127.17.136.3:43107), 437c32e490224ee59166772390280f3f (127.17.136.2:46571)
W20260927 15:15:42.293810 2013 leader_election.cc:341] T 0d23603687b840ab8b8577f0d747caf0 P 0d6699fa47f047bcb6dafd9ef13170de [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 1771ad00221b4329844cced239d7ddcf (127.17.136.3:43107): Not found: Tablet not found: 0d23603687b840ab8b8577f0d747caf0
W20260927 15:15:42.293943 2012 leader_election.cc:341] T 0d23603687b840ab8b8577f0d747caf0 P 0d6699fa47f047bcb6dafd9ef13170de [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 437c32e490224ee59166772390280f3f (127.17.136.2:46571): Not found: Tablet not found: 0d23603687b840ab8b8577f0d747caf0
I20260927 15:15:42.294004 2012 leader_election.cc:302] T 0d23603687b840ab8b8577f0d747caf0 P 0d6699fa47f047bcb6dafd9ef13170de [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0d6699fa47f047bcb6dafd9ef13170de; no voters: 1771ad00221b4329844cced239d7ddcf, 437c32e490224ee59166772390280f3f
I20260927 15:15:42.294153 2417 raft_consensus.cc:2726] T 0d23603687b840ab8b8577f0d747caf0 P 0d6699fa47f047bcb6dafd9ef13170de [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260927 15:15:42.462164 2418 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:15:42.461806 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.62:37201 (local address 127.17.136.3:45481)
0927 15:15:42.462021 (+ 215us) negotiation.cc:107] Waiting for socket to connect
0927 15:15:42.462071 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.136.62:37201: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":154,"thread_start_us":76,"threads_started":1}
I20260927 15:15:43.110162 2419 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:15:43.109778 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.62:37201 (local address 127.17.136.1:35557)
0927 15:15:43.110007 (+ 229us) negotiation.cc:107] Waiting for socket to connect
0927 15:15:43.110066 (+ 59us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.136.62:37201: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":159,"thread_start_us":74,"threads_started":1}
I20260927 15:15:43.280740 2420 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:15:43.280215 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.62:37201 (local address 127.17.136.2:38305)
0927 15:15:43.280558 (+ 343us) negotiation.cc:107] Waiting for socket to connect
0927 15:15:43.280639 (+ 81us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.136.62:37201: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":262,"thread_start_us":82,"threads_started":1}
I20260927 15:15:43.463224 2421 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:15:43.462772 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.62:37201 (local address 127.17.136.3:42359)
0927 15:15:43.463064 (+ 292us) negotiation.cc:107] Waiting for socket to connect
0927 15:15:43.463118 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.136.62:37201: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":218,"thread_start_us":77,"threads_started":1}
I20260927 15:15:44.111328 2422 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:15:44.110874 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.62:37201 (local address 127.17.136.1:44819)
0927 15:15:44.111136 (+ 262us) negotiation.cc:107] Waiting for socket to connect
0927 15:15:44.111193 (+ 57us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.136.62:37201: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":184,"thread_start_us":80,"threads_started":1}
I20260927 15:15:44.281905 2423 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:15:44.281494 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.62:37201 (local address 127.17.136.2:59877)
0927 15:15:44.281725 (+ 231us) negotiation.cc:107] Waiting for socket to connect
0927 15:15:44.281790 (+ 65us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.136.62:37201: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":161,"thread_start_us":70,"threads_started":1}
I20260927 15:15:44.464315 2424 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:15:44.463922 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.62:37201 (local address 127.17.136.3:42941)
0927 15:15:44.464138 (+ 216us) negotiation.cc:107] Waiting for socket to connect
0927 15:15:44.464195 (+ 57us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.136.62:37201: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":148,"thread_start_us":66,"threads_started":1}
I20260927 15:15:45.112468 2425 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:15:45.112059 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.62:37201 (local address 127.17.136.1:58665)
0927 15:15:45.112308 (+ 249us) negotiation.cc:107] Waiting for socket to connect
0927 15:15:45.112370 (+ 62us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.136.62:37201: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":173,"thread_start_us":72,"threads_started":1}
I20260927 15:15:45.283090 2426 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:15:45.282653 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.62:37201 (local address 127.17.136.2:34453)
0927 15:15:45.282930 (+ 277us) negotiation.cc:107] Waiting for socket to connect
0927 15:15:45.282994 (+ 64us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.136.62:37201: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":193,"thread_start_us":77,"threads_started":1}
I20260927 15:15:45.466887 2427 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:15:45.465022 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.62:37201 (local address 127.17.136.3:39563)
0927 15:15:45.466709 (+ 1687us) negotiation.cc:107] Waiting for socket to connect
0927 15:15:45.466778 (+ 69us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.136.62:37201: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":1603,"thread_start_us":84,"threads_started":1}
I20260927 15:15:46.032553 2428 raft_consensus.cc:482] T 0d23603687b840ab8b8577f0d747caf0 P 0d6699fa47f047bcb6dafd9ef13170de [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:15:46.032677 2428 raft_consensus.cc:504] T 0d23603687b840ab8b8577f0d747caf0 P 0d6699fa47f047bcb6dafd9ef13170de [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1771ad00221b4329844cced239d7ddcf" member_type: VOTER last_known_addr { host: "127.17.136.3" port: 43107 } } peers { permanent_uuid: "437c32e490224ee59166772390280f3f" member_type: VOTER last_known_addr { host: "127.17.136.2" port: 46571 } } peers { permanent_uuid: "0d6699fa47f047bcb6dafd9ef13170de" member_type: VOTER last_known_addr { host: "127.17.136.1" port: 39793 } }
I20260927 15:15:46.033080 2428 leader_election.cc:288] T 0d23603687b840ab8b8577f0d747caf0 P 0d6699fa47f047bcb6dafd9ef13170de [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1771ad00221b4329844cced239d7ddcf (127.17.136.3:43107), 437c32e490224ee59166772390280f3f (127.17.136.2:46571)
W20260927 15:15:46.033797 2012 leader_election.cc:341] T 0d23603687b840ab8b8577f0d747caf0 P 0d6699fa47f047bcb6dafd9ef13170de [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 437c32e490224ee59166772390280f3f (127.17.136.2:46571): Not found: Tablet not found: 0d23603687b840ab8b8577f0d747caf0
W20260927 15:15:46.033931 2013 leader_election.cc:341] T 0d23603687b840ab8b8577f0d747caf0 P 0d6699fa47f047bcb6dafd9ef13170de [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 1771ad00221b4329844cced239d7ddcf (127.17.136.3:43107): Not found: Tablet not found: 0d23603687b840ab8b8577f0d747caf0
I20260927 15:15:46.034029 2013 leader_election.cc:302] T 0d23603687b840ab8b8577f0d747caf0 P 0d6699fa47f047bcb6dafd9ef13170de [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0d6699fa47f047bcb6dafd9ef13170de; no voters: 1771ad00221b4329844cced239d7ddcf, 437c32e490224ee59166772390280f3f
I20260927 15:15:46.034175 2428 raft_consensus.cc:2726] T 0d23603687b840ab8b8577f0d747caf0 P 0d6699fa47f047bcb6dafd9ef13170de [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260927 15:15:46.113933 2429 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:15:46.113431 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.62:37201 (local address 127.17.136.1:37927)
0927 15:15:46.113765 (+ 334us) negotiation.cc:107] Waiting for socket to connect
0927 15:15:46.113830 (+ 65us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.136.62:37201: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":251,"thread_start_us":119,"threads_started":1}
I20260927 15:15:46.284301 2430 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:15:46.283861 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.62:37201 (local address 127.17.136.2:46401)
0927 15:15:46.284109 (+ 248us) negotiation.cc:107] Waiting for socket to connect
0927 15:15:46.284181 (+ 72us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.136.62:37201: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":165,"thread_start_us":70,"threads_started":1}
I20260927 15:15:46.467957 2431 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:15:46.467587 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.62:37201 (local address 127.17.136.3:41165)
0927 15:15:46.467813 (+ 226us) negotiation.cc:107] Waiting for socket to connect
0927 15:15:46.467867 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.136.62:37201: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":160,"thread_start_us":77,"threads_started":1}
I20260927 15:15:47.115072 2432 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:15:47.114691 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.62:37201 (local address 127.17.136.1:40971)
0927 15:15:47.114917 (+ 226us) negotiation.cc:107] Waiting for socket to connect
0927 15:15:47.114975 (+ 58us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.136.62:37201: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":156,"thread_start_us":70,"threads_started":1}
I20260927 15:15:47.285357 2433 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:15:47.284969 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.62:37201 (local address 127.17.136.2:45733)
0927 15:15:47.285201 (+ 232us) negotiation.cc:107] Waiting for socket to connect
0927 15:15:47.285255 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.136.62:37201: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":162,"thread_start_us":71,"threads_started":1}
I20260927 15:15:47.468943 2434 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:15:47.468571 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.62:37201 (local address 127.17.136.3:47119)
0927 15:15:47.468800 (+ 229us) negotiation.cc:107] Waiting for socket to connect
0927 15:15:47.468852 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.136.62:37201: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":165,"thread_start_us":80,"threads_started":1}
I20260927 15:15:48.116195 2435 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:15:48.115771 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.62:37201 (local address 127.17.136.1:55571)
0927 15:15:48.116017 (+ 246us) negotiation.cc:107] Waiting for socket to connect
0927 15:15:48.116074 (+ 57us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.136.62:37201: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":171,"thread_start_us":68,"threads_started":1}
I20260927 15:15:48.286501 2436 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:15:48.286070 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.62:37201 (local address 127.17.136.2:50417)
0927 15:15:48.286350 (+ 280us) negotiation.cc:107] Waiting for socket to connect
0927 15:15:48.286406 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.136.62:37201: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":204,"thread_start_us":97,"threads_started":1}
I20260927 15:15:48.470003 2437 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:15:48.469595 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.62:37201 (local address 127.17.136.3:51687)
0927 15:15:48.469854 (+ 259us) negotiation.cc:107] Waiting for socket to connect
0927 15:15:48.469909 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.136.62:37201: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":188,"thread_start_us":87,"threads_started":1}
I20260927 15:15:49.117350 2438 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:15:49.116922 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.62:37201 (local address 127.17.136.1:47929)
0927 15:15:49.117187 (+ 265us) negotiation.cc:107] Waiting for socket to connect
0927 15:15:49.117253 (+ 66us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.136.62:37201: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":183,"thread_start_us":74,"threads_started":1}
I20260927 15:15:49.287551 2439 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:15:49.287151 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.62:37201 (local address 127.17.136.2:50817)
0927 15:15:49.287405 (+ 254us) negotiation.cc:107] Waiting for socket to connect
0927 15:15:49.287458 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.136.62:37201: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":184,"thread_start_us":93,"threads_started":1}
I20260927 15:15:49.471136 2440 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:15:49.470698 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.62:37201 (local address 127.17.136.3:32847)
0927 15:15:49.470986 (+ 288us) negotiation.cc:107] Waiting for socket to connect
0927 15:15:49.471045 (+ 59us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.136.62:37201: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":207,"thread_start_us":89,"threads_started":1}
I20260927 15:15:49.847980 2441 raft_consensus.cc:482] T 0d23603687b840ab8b8577f0d747caf0 P 0d6699fa47f047bcb6dafd9ef13170de [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:15:49.848111 2441 raft_consensus.cc:504] T 0d23603687b840ab8b8577f0d747caf0 P 0d6699fa47f047bcb6dafd9ef13170de [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1771ad00221b4329844cced239d7ddcf" member_type: VOTER last_known_addr { host: "127.17.136.3" port: 43107 } } peers { permanent_uuid: "437c32e490224ee59166772390280f3f" member_type: VOTER last_known_addr { host: "127.17.136.2" port: 46571 } } peers { permanent_uuid: "0d6699fa47f047bcb6dafd9ef13170de" member_type: VOTER last_known_addr { host: "127.17.136.1" port: 39793 } }
I20260927 15:15:49.848536 2441 leader_election.cc:288] T 0d23603687b840ab8b8577f0d747caf0 P 0d6699fa47f047bcb6dafd9ef13170de [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1771ad00221b4329844cced239d7ddcf (127.17.136.3:43107), 437c32e490224ee59166772390280f3f (127.17.136.2:46571)
W20260927 15:15:49.849277 2013 leader_election.cc:341] T 0d23603687b840ab8b8577f0d747caf0 P 0d6699fa47f047bcb6dafd9ef13170de [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 1771ad00221b4329844cced239d7ddcf (127.17.136.3:43107): Not found: Tablet not found: 0d23603687b840ab8b8577f0d747caf0
W20260927 15:15:49.849390 2012 leader_election.cc:341] T 0d23603687b840ab8b8577f0d747caf0 P 0d6699fa47f047bcb6dafd9ef13170de [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 437c32e490224ee59166772390280f3f (127.17.136.2:46571): Not found: Tablet not found: 0d23603687b840ab8b8577f0d747caf0
I20260927 15:15:49.849464 2012 leader_election.cc:302] T 0d23603687b840ab8b8577f0d747caf0 P 0d6699fa47f047bcb6dafd9ef13170de [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0d6699fa47f047bcb6dafd9ef13170de; no voters: 1771ad00221b4329844cced239d7ddcf, 437c32e490224ee59166772390280f3f
I20260927 15:15:49.849601 2441 raft_consensus.cc:2726] T 0d23603687b840ab8b8577f0d747caf0 P 0d6699fa47f047bcb6dafd9ef13170de [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260927 15:15:50.118481 2442 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:15:50.118052 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.62:37201 (local address 127.17.136.1:57139)
0927 15:15:50.118332 (+ 280us) negotiation.cc:107] Waiting for socket to connect
0927 15:15:50.118385 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.136.62:37201: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":205,"thread_start_us":86,"threads_started":1}
I20260927 15:15:50.288820 2443 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:15:50.288353 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.62:37201 (local address 127.17.136.2:39565)
0927 15:15:50.288636 (+ 283us) negotiation.cc:107] Waiting for socket to connect
0927 15:15:50.288700 (+ 64us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.136.62:37201: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":206,"thread_start_us":94,"threads_started":1}
I20260927 15:15:50.472426 2444 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:15:50.471967 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.62:37201 (local address 127.17.136.3:44289)
0927 15:15:50.472262 (+ 295us) negotiation.cc:107] Waiting for socket to connect
0927 15:15:50.472330 (+ 68us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.136.62:37201: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":211,"thread_start_us":69,"threads_started":1}
I20260927 15:15:51.119926 2445 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:15:51.119446 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.62:37201 (local address 127.17.136.1:58549)
0927 15:15:51.119757 (+ 311us) negotiation.cc:107] Waiting for socket to connect
0927 15:15:51.119827 (+ 70us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.136.62:37201: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":224,"thread_start_us":88,"threads_started":1}
I20260927 15:15:51.290017 2446 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:15:51.289622 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.62:37201 (local address 127.17.136.2:41233)
0927 15:15:51.289865 (+ 243us) negotiation.cc:107] Waiting for socket to connect
0927 15:15:51.289924 (+ 59us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.136.62:37201: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":167,"thread_start_us":82,"threads_started":1}
I20260927 15:15:51.458607 17952 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu with pid 1962
I20260927 15:15:51.463357 17952 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu with pid 2128
I20260927 15:15:51.467784 17952 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu with pid 2262
2026-09-27T15:15:51Z chronyd exiting
[ OK ] SecurityITest.TestEnableAndDisableEncryptedTSK (59157 ms)
[----------] 30 tests from SecurityITest (230914 ms total)
[----------] 6 tests from EncryptionPolicyTest
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/0
Loading random data
Initializing database '/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790521920546562-17952-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 27 15:15:51 dist-test-slave-5s2t krb5kdc[2449](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 27 15:15:51 dist-test-slave-5s2t krb5kdc[2449](info): set up 2 sockets
Sep 27 15:15:51 dist-test-slave-5s2t krb5kdc[2449](info): commencing operation
krb5kdc: starting...
W20260927 15:15:52.410916 17952 mini_kdc.cc:121] Time spent starting KDC: real 0.923s user 0.000s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790521920546562-17952-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790521920546562-17952-0/krb5kdc/test-user.keytab.
Sep 27 15:15:52 dist-test-slave-5s2t krb5kdc[2449](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790522152, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-27T15:15:52Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-27T15:15:52Z Disabled control of system clock
WARNING: no policy specified for kudu/127.17.136.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.136.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.136.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790521920546562-17952-0/krb5kdc/kudu_127.17.136.62.keytab.
Entry for principal kudu/127.17.136.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790521920546562-17952-0/krb5kdc/kudu_127.17.136.62.keytab.
I20260927 15:15:52.528118 17952 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu
/tmp/dist-test-taskiFOyeW/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790521920546562-17952-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790521920546562-17952-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790521920546562-17952-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790521920546562-17952-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.136.62:34823
--webserver_interface=127.17.136.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790521920546562-17952-0/krb5kdc/kudu_127.17.136.62.keytab
--principal=kudu/127.17.136.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.136.20:33211
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.136.62:34823
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790521920546562-17952-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790521920546562-17952-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790521920546562-17952-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260927 15:15:52.634935 2462 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260927 15:15:52.635203 2462 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260927 15:15:52.635281 2462 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260927 15:15:52.639240 2462 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260927 15:15:52.639361 2462 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260927 15:15:52.639389 2462 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260927 15:15:52.639418 2462 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260927 15:15:52.639446 2462 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260927 15:15:52.644773 2462 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.136.20:33211
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790521920546562-17952-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790521920546562-17952-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.17.136.62:34823
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790521920546562-17952-0/krb5kdc/kudu_127.17.136.62.keytab
--principal=kudu/127.17.136.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.136.62:34823
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790521920546562-17952-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.17.136.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2462
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790521920546562-17952-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 27 Sep 2026 14:27:13 UTC on ccycloud.quasar-psqrth.root.comops.site
build id 4676138
I20260927 15:15:52.645833 2462 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260927 15:15:52.646842 2462 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260927 15:15:52.655499 2462 server_base.cc:1034] running on GCE node
W20260927 15:15:52.655455 2468 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260927 15:15:52.655442 2470 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260927 15:15:52.655468 2467 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260927 15:15:52.656211 2462 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260927 15:15:52.657256 2462 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260927 15:15:52.658399 2462 hybrid_clock.cc:648] HybridClock initialized: now 1790522152658387 us; error 32 us; skew 500 ppm
Sep 27 15:15:52 dist-test-slave-5s2t krb5kdc[2449](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790522152, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.136.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260927 15:15:52.660921 2462 init.cc:377] Logged in from keytab as kudu/127.17.136.62@KRBTEST.COM (short username kudu)
I20260927 15:15:52.661737 2462 webserver.cc:460] Webserver started at http://127.17.136.62:39659/ using document root <none> and password file <none>
I20260927 15:15:52.662266 2462 fs_manager.cc:359] Metadata directory not provided
I20260927 15:15:52.662334 2462 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260927 15:15:52.662526 2462 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260927 15:15:52.664645 2462 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790521920546562-17952-0/minicluster-data/master-0/data/instance:
uuid: "07a3fc22057447b0a833424a1f267285"
format_stamp: "Formatted at 2026-09-27 15:15:52 on dist-test-slave-5s2t"
server_key: "83ac09d5ece14414e18f1c1a9fbf338d"
server_key_iv: "27a13ca4fa1f7b3c7a0748eb44c4bbc0"
server_key_version: "encryptionkey@0"
I20260927 15:15:52.665179 2462 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790521920546562-17952-0/minicluster-data/master-0/wal/instance:
uuid: "07a3fc22057447b0a833424a1f267285"
format_stamp: "Formatted at 2026-09-27 15:15:52 on dist-test-slave-5s2t"
server_key: "83ac09d5ece14414e18f1c1a9fbf338d"
server_key_iv: "27a13ca4fa1f7b3c7a0748eb44c4bbc0"
server_key_version: "encryptionkey@0"
I20260927 15:15:52.668743 2462 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.001s sys 0.004s
I20260927 15:15:52.671037 2477 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260927 15:15:52.672237 2462 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260927 15:15:52.672350 2462 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790521920546562-17952-0/minicluster-data/master-0/data,/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790521920546562-17952-0/minicluster-data/master-0/wal
uuid: "07a3fc22057447b0a833424a1f267285"
format_stamp: "Formatted at 2026-09-27 15:15:52 on dist-test-slave-5s2t"
server_key: "83ac09d5ece14414e18f1c1a9fbf338d"
server_key_iv: "27a13ca4fa1f7b3c7a0748eb44c4bbc0"
server_key_version: "encryptionkey@0"
I20260927 15:15:52.672446 2462 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790521920546562-17952-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790521920546562-17952-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790521920546562-17952-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260927 15:15:52.687826 2462 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260927 15:15:52.690644 2462 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260927 15:15:52.690840 2462 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260927 15:15:52.697388 2462 rpc_server.cc:307] RPC server started. Bound to: 127.17.136.62:34823
I20260927 15:15:52.697397 2529 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.136.62:34823 every 8 connection(s)
I20260927 15:15:52.698284 2462 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790521920546562-17952-0/minicluster-data/master-0/data/info.pb
I20260927 15:15:52.700899 2530 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:15:52.703802 17952 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu as pid 2462
I20260927 15:15:52.703926 17952 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790521920546562-17952-0/minicluster-data/master-0/wal/instance
I20260927 15:15:52.704219 17952 external_mini_cluster.cc:1428] Setting key a98623ffc6cb6e3ecba53630b59519a7
I20260927 15:15:52.706589 2530 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 07a3fc22057447b0a833424a1f267285: Bootstrap starting.
I20260927 15:15:52.708688 2530 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 07a3fc22057447b0a833424a1f267285: Neither blocks nor log segments found. Creating new log.
I20260927 15:15:52.709378 2530 log.cc:824] T 00000000000000000000000000000000 P 07a3fc22057447b0a833424a1f267285: Log is configured to *not* fsync() on all Append() calls
I20260927 15:15:52.711125 2530 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 07a3fc22057447b0a833424a1f267285: No bootstrap required, opened a new log
Sep 27 15:15:52 dist-test-slave-5s2t krb5kdc[2449](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790522152, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.136.62@KRBTEST.COM
I20260927 15:15:52.714947 2530 raft_consensus.cc:348] T 00000000000000000000000000000000 P 07a3fc22057447b0a833424a1f267285 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "07a3fc22057447b0a833424a1f267285" member_type: VOTER last_known_addr { host: "127.17.136.62" port: 34823 } }
I20260927 15:15:52.715235 2530 raft_consensus.cc:374] T 00000000000000000000000000000000 P 07a3fc22057447b0a833424a1f267285 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:15:52.715314 2530 raft_consensus.cc:729] T 00000000000000000000000000000000 P 07a3fc22057447b0a833424a1f267285 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 07a3fc22057447b0a833424a1f267285, State: Initialized, Role: FOLLOWER
I20260927 15:15:52.715747 2530 consensus_queue.cc:260] T 00000000000000000000000000000000 P 07a3fc22057447b0a833424a1f267285 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "07a3fc22057447b0a833424a1f267285" member_type: VOTER last_known_addr { host: "127.17.136.62" port: 34823 } }
I20260927 15:15:52.715869 2530 raft_consensus.cc:388] T 00000000000000000000000000000000 P 07a3fc22057447b0a833424a1f267285 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260927 15:15:52.715924 2530 raft_consensus.cc:482] T 00000000000000000000000000000000 P 07a3fc22057447b0a833424a1f267285 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260927 15:15:52.716029 2530 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 07a3fc22057447b0a833424a1f267285 [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:15:52.716843 2530 raft_consensus.cc:504] T 00000000000000000000000000000000 P 07a3fc22057447b0a833424a1f267285 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "07a3fc22057447b0a833424a1f267285" member_type: VOTER last_known_addr { host: "127.17.136.62" port: 34823 } }
I20260927 15:15:52.717159 2530 leader_election.cc:302] T 00000000000000000000000000000000 P 07a3fc22057447b0a833424a1f267285 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 07a3fc22057447b0a833424a1f267285; no voters:
I20260927 15:15:52.717433 2530 leader_election.cc:288] T 00000000000000000000000000000000 P 07a3fc22057447b0a833424a1f267285 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260927 15:15:52.717553 2535 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 07a3fc22057447b0a833424a1f267285 [term 1 FOLLOWER]: Leader election won for term 1
I20260927 15:15:52.717741 2535 raft_consensus.cc:686] T 00000000000000000000000000000000 P 07a3fc22057447b0a833424a1f267285 [term 1 LEADER]: Becoming Leader. State: Replica: 07a3fc22057447b0a833424a1f267285, State: Running, Role: LEADER
I20260927 15:15:52.718124 2533 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:15:52.705592 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33066 (local address 127.17.136.62:34823)
0927 15:15:52.706010 (+ 418us) server_negotiation.cc:206] Beginning negotiation
0927 15:15:52.706024 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0927 15:15:52.706059 (+ 35us) server_negotiation.cc:407] Connection header received
0927 15:15:52.706663 (+ 604us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:15:52.706685 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:15:52.707027 (+ 342us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:15:52.707358 (+ 331us) server_negotiation.cc:226] Negotiated authn=SASL
0927 15:15:52.708114 (+ 756us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:15:52.709131 (+ 1017us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:15:52.710000 (+ 869us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:15:52.710468 (+ 468us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:15:52.710607 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:15:52.713341 (+ 2734us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0927 15:15:52.713346 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0927 15:15:52.713359 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0927 15:15:52.713384 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0927 15:15:52.714918 (+ 1534us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:15:52.715412 (+ 494us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:15:52.715419 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:15:52.715425 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:15:52.715544 (+ 119us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:15:52.715825 (+ 281us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:15:52.715829 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:15:52.715830 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:15:52.716311 (+ 481us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0927 15:15:52.716513 (+ 202us) server_negotiation.cc:1035] Waiting for connection context
0927 15:15:52.716827 (+ 314us) server_negotiation.cc:299] Negotiation successful
0927 15:15:52.717135 (+ 308us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":281,"thread_start_us":117,"threads_started":1}
I20260927 15:15:52.718086 2535 consensus_queue.cc:237] T 00000000000000000000000000000000 P 07a3fc22057447b0a833424a1f267285 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "07a3fc22057447b0a833424a1f267285" member_type: VOTER last_known_addr { host: "127.17.136.62" port: 34823 } }
I20260927 15:15:52.718597 2530 sys_catalog.cc:564] T 00000000000000000000000000000000 P 07a3fc22057447b0a833424a1f267285 [sys.catalog]: configured and running, proceeding with master startup.
I20260927 15:15:52.719447 2535 sys_catalog.cc:455] T 00000000000000000000000000000000 P 07a3fc22057447b0a833424a1f267285 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 07a3fc22057447b0a833424a1f267285. Latest consensus state: current_term: 1 leader_uuid: "07a3fc22057447b0a833424a1f267285" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "07a3fc22057447b0a833424a1f267285" member_type: VOTER last_known_addr { host: "127.17.136.62" port: 34823 } } }
I20260927 15:15:52.720055 2535 sys_catalog.cc:458] T 00000000000000000000000000000000 P 07a3fc22057447b0a833424a1f267285 [sys.catalog]: This master's current role is: LEADER
I20260927 15:15:52.719969 2537 sys_catalog.cc:455] T 00000000000000000000000000000000 P 07a3fc22057447b0a833424a1f267285 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "07a3fc22057447b0a833424a1f267285" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "07a3fc22057447b0a833424a1f267285" member_type: VOTER last_known_addr { host: "127.17.136.62" port: 34823 } } }
I20260927 15:15:52.720340 2537 sys_catalog.cc:458] T 00000000000000000000000000000000 P 07a3fc22057447b0a833424a1f267285 [sys.catalog]: This master's current role is: LEADER
I20260927 15:15:52.720593 2547 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260927 15:15:52.723613 2547 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260927 15:15:52.729020 2547 catalog_manager.cc:1347] Generated new cluster ID: 67d74d26c141434aa3ce781ebe4b1b44
I20260927 15:15:52.729072 2547 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260927 15:15:52.740545 2547 catalog_manager.cc:1370] Generated new certificate authority record
I20260927 15:15:52.741469 2547 catalog_manager.cc:1504] Loading token signing keys...
I20260927 15:15:52.754549 2547 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 07a3fc22057447b0a833424a1f267285: Generated new TSK 0
I20260927 15:15:52.755445 2547 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.17.136.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.136.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.136.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790521920546562-17952-0/krb5kdc/kudu_127.17.136.1.keytab.
Entry for principal kudu/127.17.136.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790521920546562-17952-0/krb5kdc/kudu_127.17.136.1.keytab.
I20260927 15:15:52.786252 17952 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu
/tmp/dist-test-taskiFOyeW/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790521920546562-17952-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790521920546562-17952-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790521920546562-17952-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790521920546562-17952-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.136.1:0
--local_ip_for_outbound_sockets=127.17.136.1
--webserver_interface=127.17.136.1
--webserver_port=0
--tserver_master_addrs=127.17.136.62:34823
--keytab_file=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790521920546562-17952-0/krb5kdc/kudu_127.17.136.1.keytab
--principal=kudu/127.17.136.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.136.20:33211
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790521920546562-17952-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790521920546562-17952-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790521920546562-17952-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260927 15:15:52.895725 2556 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260927 15:15:52.895982 2556 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260927 15:15:52.896049 2556 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260927 15:15:52.899972 2556 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260927 15:15:52.900028 2556 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260927 15:15:52.900107 2556 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.136.1
I20260927 15:15:52.905224 2556 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.136.20:33211
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790521920546562-17952-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790521920546562-17952-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790521920546562-17952-0/krb5kdc/kudu_127.17.136.1.keytab
--principal=kudu/127.17.136.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.136.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790521920546562-17952-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.17.136.1
--webserver_port=0
--tserver_master_addrs=127.17.136.62:34823
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2556
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.136.1
--log_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790521920546562-17952-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 27 Sep 2026 14:27:13 UTC on ccycloud.quasar-psqrth.root.comops.site
build id 4676138
I20260927 15:15:52.906242 2556 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260927 15:15:52.907234 2556 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260927 15:15:52.916638 2564 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260927 15:15:52.916610 2561 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260927 15:15:52.916836 2556 server_base.cc:1034] running on GCE node
W20260927 15:15:52.916630 2562 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260927 15:15:52.917320 2556 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260927 15:15:52.917951 2556 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260927 15:15:52.919139 2556 hybrid_clock.cc:648] HybridClock initialized: now 1790522152919106 us; error 42 us; skew 500 ppm
Sep 27 15:15:52 dist-test-slave-5s2t krb5kdc[2449](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790522152, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.136.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260927 15:15:52.921819 2556 init.cc:377] Logged in from keytab as kudu/127.17.136.1@KRBTEST.COM (short username kudu)
I20260927 15:15:52.922614 2556 webserver.cc:460] Webserver started at http://127.17.136.1:41203/ using document root <none> and password file <none>
I20260927 15:15:52.923121 2556 fs_manager.cc:359] Metadata directory not provided
I20260927 15:15:52.923185 2556 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260927 15:15:52.923390 2556 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260927 15:15:52.925357 2556 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790521920546562-17952-0/minicluster-data/ts-0/data/instance:
uuid: "2907eed990074380b797b788c2e81da1"
format_stamp: "Formatted at 2026-09-27 15:15:52 on dist-test-slave-5s2t"
server_key: "827338000abcbe1d966db38ccab6055f"
server_key_iv: "d0958e19d54a530898bd562e828cda57"
server_key_version: "encryptionkey@0"
I20260927 15:15:52.925863 2556 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790521920546562-17952-0/minicluster-data/ts-0/wal/instance:
uuid: "2907eed990074380b797b788c2e81da1"
format_stamp: "Formatted at 2026-09-27 15:15:52 on dist-test-slave-5s2t"
server_key: "827338000abcbe1d966db38ccab6055f"
server_key_iv: "d0958e19d54a530898bd562e828cda57"
server_key_version: "encryptionkey@0"
I20260927 15:15:52.929353 2556 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260927 15:15:52.931667 2571 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260927 15:15:52.932826 2556 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260927 15:15:52.932917 2556 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790521920546562-17952-0/minicluster-data/ts-0/data,/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790521920546562-17952-0/minicluster-data/ts-0/wal
uuid: "2907eed990074380b797b788c2e81da1"
format_stamp: "Formatted at 2026-09-27 15:15:52 on dist-test-slave-5s2t"
server_key: "827338000abcbe1d966db38ccab6055f"
server_key_iv: "d0958e19d54a530898bd562e828cda57"
server_key_version: "encryptionkey@0"
I20260927 15:15:52.932999 2556 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790521920546562-17952-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790521920546562-17952-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790521920546562-17952-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260927 15:15:52.947309 2556 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260927 15:15:52.950429 2556 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260927 15:15:52.950578 2556 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260927 15:15:52.951115 2556 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260927 15:15:52.951951 2556 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260927 15:15:52.952005 2556 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260927 15:15:52.952050 2556 ts_tablet_manager.cc:610] Registered 0 tablets
I20260927 15:15:52.952085 2556 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260927 15:15:52.960466 2556 rpc_server.cc:307] RPC server started. Bound to: 127.17.136.1:39287
I20260927 15:15:52.960487 2684 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.136.1:39287 every 8 connection(s)
I20260927 15:15:52.961338 2556 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790521920546562-17952-0/minicluster-data/ts-0/data/info.pb
I20260927 15:15:52.962234 17952 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu as pid 2556
I20260927 15:15:52.962344 17952 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790521920546562-17952-0/minicluster-data/ts-0/wal/instance
I20260927 15:15:52.962601 17952 external_mini_cluster.cc:1428] Setting key a859122a20969437bc4799a6e09c2f75
WARNING: no policy specified for kudu/127.17.136.2@KRBTEST.COM; defaulting to no policy
Sep 27 15:15:52 dist-test-slave-5s2t krb5kdc[2449](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790522152, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.136.1@KRBTEST.COM for kudu/127.17.136.62@KRBTEST.COM
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.136.2@KRBTEST.COM" created.
I20260927 15:15:52.974773 2533 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:15:52.963067 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.136.1:44559 (local address 127.17.136.62:34823)
0927 15:15:52.963220 (+ 153us) server_negotiation.cc:206] Beginning negotiation
0927 15:15:52.963223 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0927 15:15:52.964199 (+ 976us) server_negotiation.cc:407] Connection header received
0927 15:15:52.965920 (+ 1721us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:15:52.965923 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:15:52.965976 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:15:52.966053 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0927 15:15:52.967191 (+ 1138us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:15:52.967832 (+ 641us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:15:52.968928 (+ 1096us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:15:52.969163 (+ 235us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:15:52.969257 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:15:52.971543 (+ 2286us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0927 15:15:52.971547 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0927 15:15:52.971550 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0927 15:15:52.971576 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0927 15:15:52.972839 (+ 1263us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:15:52.973321 (+ 482us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:15:52.973324 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:15:52.973325 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:15:52.973396 (+ 71us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:15:52.973702 (+ 306us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:15:52.973704 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:15:52.973706 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:15:52.973901 (+ 195us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0927 15:15:52.973984 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0927 15:15:52.974535 (+ 551us) server_negotiation.cc:299] Negotiation successful
0927 15:15:52.974636 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260927 15:15:52.975802 2687 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:15:52.963544 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.62:34823 (local address 127.17.136.1:44559)
0927 15:15:52.964039 (+ 495us) negotiation.cc:107] Waiting for socket to connect
0927 15:15:52.964096 (+ 57us) client_negotiation.cc:174] Beginning negotiation
0927 15:15:52.965701 (+ 1605us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0927 15:15:52.966227 (+ 526us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0927 15:15:52.966234 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0927 15:15:52.966571 (+ 337us) client_negotiation.cc:189] Negotiated authn=SASL
0927 15:15:52.967045 (+ 474us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:15:52.967059 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:15:52.967954 (+ 895us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:15:52.967956 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:15:52.968819 (+ 863us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:15:52.968829 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:15:52.969303 (+ 474us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:15:52.969307 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:15:52.969469 (+ 162us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:15:52.970003 (+ 534us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0927 15:15:52.970019 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0927 15:15:52.971396 (+ 1377us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0927 15:15:52.972953 (+ 1557us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0927 15:15:52.972959 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0927 15:15:52.972974 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0927 15:15:52.973232 (+ 258us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0927 15:15:52.973473 (+ 241us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0927 15:15:52.973476 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0927 15:15:52.973478 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0927 15:15:52.973606 (+ 128us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0927 15:15:52.974005 (+ 399us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0927 15:15:52.974011 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0927 15:15:52.974308 (+ 297us) client_negotiation.cc:769] Sending connection context
0927 15:15:52.974499 (+ 191us) client_negotiation.cc:240] Negotiation successful
0927 15:15:52.974868 (+ 369us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":277,"thread_start_us":131,"threads_started":1}
I20260927 15:15:52.976986 2685 heartbeater.cc:347] Connected to a master server at 127.17.136.62:34823
I20260927 15:15:52.977253 2685 heartbeater.cc:464] Registering TS with master...
I20260927 15:15:52.977855 2685 heartbeater.cc:511] Master 127.17.136.62:34823 requested a full tablet report, sending...
I20260927 15:15:52.979568 2494 ts_manager.cc:194] Registered new tserver with Master: 2907eed990074380b797b788c2e81da1 (127.17.136.1:39287)
I20260927 15:15:52.981141 2494 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.136.1@KRBTEST.COM'} at 127.17.136.1:44559
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.136.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790521920546562-17952-0/krb5kdc/kudu_127.17.136.2.keytab.
Entry for principal kudu/127.17.136.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790521920546562-17952-0/krb5kdc/kudu_127.17.136.2.keytab.
I20260927 15:15:52.989343 17952 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu
/tmp/dist-test-taskiFOyeW/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790521920546562-17952-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790521920546562-17952-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790521920546562-17952-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790521920546562-17952-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.136.2:0
--local_ip_for_outbound_sockets=127.17.136.2
--webserver_interface=127.17.136.2
--webserver_port=0
--tserver_master_addrs=127.17.136.62:34823
--keytab_file=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790521920546562-17952-0/krb5kdc/kudu_127.17.136.2.keytab
--principal=kudu/127.17.136.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.136.20:33211
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790521920546562-17952-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790521920546562-17952-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790521920546562-17952-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260927 15:15:53.095526 2690 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260927 15:15:53.095845 2690 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260927 15:15:53.095904 2690 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260927 15:15:53.099884 2690 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260927 15:15:53.099936 2690 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260927 15:15:53.100008 2690 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.136.2
I20260927 15:15:53.105083 2690 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.136.20:33211
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790521920546562-17952-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790521920546562-17952-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790521920546562-17952-0/krb5kdc/kudu_127.17.136.2.keytab
--principal=kudu/127.17.136.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.136.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790521920546562-17952-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.17.136.2
--webserver_port=0
--tserver_master_addrs=127.17.136.62:34823
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2690
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.136.2
--log_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790521920546562-17952-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 27 Sep 2026 14:27:13 UTC on ccycloud.quasar-psqrth.root.comops.site
build id 4676138
I20260927 15:15:53.106074 2690 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260927 15:15:53.107046 2690 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260927 15:15:53.116241 2698 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260927 15:15:53.116225 2696 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260927 15:15:53.116286 2695 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260927 15:15:53.116447 2690 server_base.cc:1034] running on GCE node
I20260927 15:15:53.116833 2690 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260927 15:15:53.117411 2690 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260927 15:15:53.118553 2690 hybrid_clock.cc:648] HybridClock initialized: now 1790522153118536 us; error 30 us; skew 500 ppm
Sep 27 15:15:53 dist-test-slave-5s2t krb5kdc[2449](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790522153, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.136.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260927 15:15:53.121191 2690 init.cc:377] Logged in from keytab as kudu/127.17.136.2@KRBTEST.COM (short username kudu)
I20260927 15:15:53.122002 2690 webserver.cc:460] Webserver started at http://127.17.136.2:41291/ using document root <none> and password file <none>
I20260927 15:15:53.122519 2690 fs_manager.cc:359] Metadata directory not provided
I20260927 15:15:53.122577 2690 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260927 15:15:53.122759 2690 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260927 15:15:53.124845 2690 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790521920546562-17952-0/minicluster-data/ts-1/data/instance:
uuid: "19f35042a4024a68b8f7d0d3446523f2"
format_stamp: "Formatted at 2026-09-27 15:15:53 on dist-test-slave-5s2t"
server_key: "ff4d545d1ef1f0b3402069a9443fa23e"
server_key_iv: "be8fb89a0af7ca3849ea3a88081be1e9"
server_key_version: "encryptionkey@0"
I20260927 15:15:53.125365 2690 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790521920546562-17952-0/minicluster-data/ts-1/wal/instance:
uuid: "19f35042a4024a68b8f7d0d3446523f2"
format_stamp: "Formatted at 2026-09-27 15:15:53 on dist-test-slave-5s2t"
server_key: "ff4d545d1ef1f0b3402069a9443fa23e"
server_key_iv: "be8fb89a0af7ca3849ea3a88081be1e9"
server_key_version: "encryptionkey@0"
I20260927 15:15:53.128885 2690 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260927 15:15:53.131116 2705 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260927 15:15:53.132269 2690 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260927 15:15:53.132367 2690 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790521920546562-17952-0/minicluster-data/ts-1/data,/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790521920546562-17952-0/minicluster-data/ts-1/wal
uuid: "19f35042a4024a68b8f7d0d3446523f2"
format_stamp: "Formatted at 2026-09-27 15:15:53 on dist-test-slave-5s2t"
server_key: "ff4d545d1ef1f0b3402069a9443fa23e"
server_key_iv: "be8fb89a0af7ca3849ea3a88081be1e9"
server_key_version: "encryptionkey@0"
I20260927 15:15:53.132462 2690 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790521920546562-17952-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790521920546562-17952-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790521920546562-17952-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260927 15:15:53.156451 2690 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260927 15:15:53.159435 2690 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260927 15:15:53.159601 2690 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260927 15:15:53.160176 2690 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260927 15:15:53.160960 2690 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260927 15:15:53.161005 2690 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260927 15:15:53.161052 2690 ts_tablet_manager.cc:610] Registered 0 tablets
I20260927 15:15:53.161082 2690 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260927 15:15:53.169590 2690 rpc_server.cc:307] RPC server started. Bound to: 127.17.136.2:36885
I20260927 15:15:53.169625 2818 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.136.2:36885 every 8 connection(s)
I20260927 15:15:53.170459 2690 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790521920546562-17952-0/minicluster-data/ts-1/data/info.pb
I20260927 15:15:53.175062 17952 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu as pid 2690
I20260927 15:15:53.175202 17952 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790521920546562-17952-0/minicluster-data/ts-1/wal/instance
I20260927 15:15:53.175532 17952 external_mini_cluster.cc:1428] Setting key d5677e7734dbda996a0a43836e158814
Sep 27 15:15:53 dist-test-slave-5s2t krb5kdc[2449](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790522153, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.136.2@KRBTEST.COM for kudu/127.17.136.62@KRBTEST.COM
WARNING: no policy specified for kudu/127.17.136.3@KRBTEST.COM; defaulting to no policy
I20260927 15:15:53.185402 2533 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:15:53.172317 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.136.2:33927 (local address 127.17.136.62:34823)
0927 15:15:53.172455 (+ 138us) server_negotiation.cc:206] Beginning negotiation
0927 15:15:53.172459 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0927 15:15:53.173318 (+ 859us) server_negotiation.cc:407] Connection header received
0927 15:15:53.174603 (+ 1285us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:15:53.174606 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:15:53.174653 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:15:53.174725 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0927 15:15:53.176350 (+ 1625us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:15:53.177029 (+ 679us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:15:53.178620 (+ 1591us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:15:53.178933 (+ 313us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:15:53.179033 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:15:53.181610 (+ 2577us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0927 15:15:53.181615 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0927 15:15:53.181618 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0927 15:15:53.181648 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0927 15:15:53.183243 (+ 1595us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:15:53.183819 (+ 576us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:15:53.183822 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:15:53.183824 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:15:53.183918 (+ 94us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:15:53.184223 (+ 305us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:15:53.184227 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:15:53.184228 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:15:53.184476 (+ 248us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0927 15:15:53.184581 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0927 15:15:53.185160 (+ 579us) server_negotiation.cc:299] Negotiation successful
0927 15:15:53.185268 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260927 15:15:53.186261 2821 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:15:53.172736 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.62:34823 (local address 127.17.136.2:33927)
0927 15:15:53.173173 (+ 437us) negotiation.cc:107] Waiting for socket to connect
0927 15:15:53.173216 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0927 15:15:53.174417 (+ 1201us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0927 15:15:53.174926 (+ 509us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0927 15:15:53.174936 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0927 15:15:53.175543 (+ 607us) client_negotiation.cc:189] Negotiated authn=SASL
0927 15:15:53.176200 (+ 657us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:15:53.176218 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:15:53.177182 (+ 964us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:15:53.177186 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:15:53.178519 (+ 1333us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:15:53.178530 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:15:53.179151 (+ 621us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:15:53.179155 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:15:53.179367 (+ 212us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:15:53.179968 (+ 601us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0927 15:15:53.179987 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0927 15:15:53.181430 (+ 1443us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0927 15:15:53.183381 (+ 1951us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0927 15:15:53.183387 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0927 15:15:53.183404 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0927 15:15:53.183719 (+ 315us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0927 15:15:53.184002 (+ 283us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0927 15:15:53.184004 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0927 15:15:53.184005 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0927 15:15:53.184143 (+ 138us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0927 15:15:53.184608 (+ 465us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0927 15:15:53.184613 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0927 15:15:53.184882 (+ 269us) client_negotiation.cc:769] Sending connection context
0927 15:15:53.185096 (+ 214us) client_negotiation.cc:240] Negotiation successful
0927 15:15:53.185377 (+ 281us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":247,"thread_start_us":108,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.136.3@KRBTEST.COM" created.
I20260927 15:15:53.187592 2819 heartbeater.cc:347] Connected to a master server at 127.17.136.62:34823
I20260927 15:15:53.187834 2819 heartbeater.cc:464] Registering TS with master...
I20260927 15:15:53.188354 2819 heartbeater.cc:511] Master 127.17.136.62:34823 requested a full tablet report, sending...
I20260927 15:15:53.189536 2494 ts_manager.cc:194] Registered new tserver with Master: 19f35042a4024a68b8f7d0d3446523f2 (127.17.136.2:36885)
I20260927 15:15:53.190253 2494 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.136.2@KRBTEST.COM'} at 127.17.136.2:33927
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.136.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790521920546562-17952-0/krb5kdc/kudu_127.17.136.3.keytab.
Entry for principal kudu/127.17.136.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790521920546562-17952-0/krb5kdc/kudu_127.17.136.3.keytab.
I20260927 15:15:53.202299 17952 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu
/tmp/dist-test-taskiFOyeW/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790521920546562-17952-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790521920546562-17952-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790521920546562-17952-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790521920546562-17952-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.136.3:0
--local_ip_for_outbound_sockets=127.17.136.3
--webserver_interface=127.17.136.3
--webserver_port=0
--tserver_master_addrs=127.17.136.62:34823
--keytab_file=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790521920546562-17952-0/krb5kdc/kudu_127.17.136.3.keytab
--principal=kudu/127.17.136.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.136.20:33211
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790521920546562-17952-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790521920546562-17952-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790521920546562-17952-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260927 15:15:53.313238 2824 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260927 15:15:53.313509 2824 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260927 15:15:53.313552 2824 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260927 15:15:53.317777 2824 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260927 15:15:53.317854 2824 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260927 15:15:53.317926 2824 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.136.3
I20260927 15:15:53.323563 2824 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.136.20:33211
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790521920546562-17952-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790521920546562-17952-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790521920546562-17952-0/krb5kdc/kudu_127.17.136.3.keytab
--principal=kudu/127.17.136.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.136.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790521920546562-17952-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.17.136.3
--webserver_port=0
--tserver_master_addrs=127.17.136.62:34823
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2824
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.136.3
--log_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790521920546562-17952-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 27 Sep 2026 14:27:13 UTC on ccycloud.quasar-psqrth.root.comops.site
build id 4676138
I20260927 15:15:53.324724 2824 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260927 15:15:53.325745 2824 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260927 15:15:53.335009 2832 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260927 15:15:53.335009 2830 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260927 15:15:53.335049 2829 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260927 15:15:53.335103 2824 server_base.cc:1034] running on GCE node
I20260927 15:15:53.335747 2824 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260927 15:15:53.336460 2824 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260927 15:15:53.337617 2824 hybrid_clock.cc:648] HybridClock initialized: now 1790522153337576 us; error 53 us; skew 500 ppm
Sep 27 15:15:53 dist-test-slave-5s2t krb5kdc[2449](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790522153, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.136.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260927 15:15:53.340289 2824 init.cc:377] Logged in from keytab as kudu/127.17.136.3@KRBTEST.COM (short username kudu)
I20260927 15:15:53.341104 2824 webserver.cc:460] Webserver started at http://127.17.136.3:42675/ using document root <none> and password file <none>
I20260927 15:15:53.341629 2824 fs_manager.cc:359] Metadata directory not provided
I20260927 15:15:53.341689 2824 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260927 15:15:53.341884 2824 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260927 15:15:53.343940 2824 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790521920546562-17952-0/minicluster-data/ts-2/data/instance:
uuid: "3d45f365d6f648fd93d5eb201da7cda8"
format_stamp: "Formatted at 2026-09-27 15:15:53 on dist-test-slave-5s2t"
server_key: "a1fc937ed7aebd211ffe1b2cc93ee323"
server_key_iv: "f7801798d7f05e78e567308dc73a203e"
server_key_version: "encryptionkey@0"
I20260927 15:15:53.344448 2824 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790521920546562-17952-0/minicluster-data/ts-2/wal/instance:
uuid: "3d45f365d6f648fd93d5eb201da7cda8"
format_stamp: "Formatted at 2026-09-27 15:15:53 on dist-test-slave-5s2t"
server_key: "a1fc937ed7aebd211ffe1b2cc93ee323"
server_key_iv: "f7801798d7f05e78e567308dc73a203e"
server_key_version: "encryptionkey@0"
I20260927 15:15:53.347992 2824 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260927 15:15:53.350340 2839 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260927 15:15:53.351653 2824 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260927 15:15:53.351758 2824 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790521920546562-17952-0/minicluster-data/ts-2/data,/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790521920546562-17952-0/minicluster-data/ts-2/wal
uuid: "3d45f365d6f648fd93d5eb201da7cda8"
format_stamp: "Formatted at 2026-09-27 15:15:53 on dist-test-slave-5s2t"
server_key: "a1fc937ed7aebd211ffe1b2cc93ee323"
server_key_iv: "f7801798d7f05e78e567308dc73a203e"
server_key_version: "encryptionkey@0"
I20260927 15:15:53.351861 2824 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790521920546562-17952-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790521920546562-17952-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790521920546562-17952-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260927 15:15:53.381201 2824 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260927 15:15:53.384600 2824 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260927 15:15:53.384785 2824 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260927 15:15:53.385372 2824 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260927 15:15:53.386174 2824 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260927 15:15:53.386221 2824 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260927 15:15:53.386273 2824 ts_tablet_manager.cc:610] Registered 0 tablets
I20260927 15:15:53.386312 2824 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260927 15:15:53.394657 2824 rpc_server.cc:307] RPC server started. Bound to: 127.17.136.3:36639
I20260927 15:15:53.394716 2952 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.136.3:36639 every 8 connection(s)
I20260927 15:15:53.395583 2824 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790521920546562-17952-0/minicluster-data/ts-2/data/info.pb
I20260927 15:15:53.398419 17952 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu as pid 2824
I20260927 15:15:53.398536 17952 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790521920546562-17952-0/minicluster-data/ts-2/wal/instance
I20260927 15:15:53.398854 17952 external_mini_cluster.cc:1428] Setting key 8bd6b954fd84970b35d43106e314c909
Sep 27 15:15:53 dist-test-slave-5s2t krb5kdc[2449](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790522153, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.136.3@KRBTEST.COM for kudu/127.17.136.62@KRBTEST.COM
I20260927 15:15:53.408062 2533 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:15:53.397311 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.136.3:51661 (local address 127.17.136.62:34823)
0927 15:15:53.397451 (+ 140us) server_negotiation.cc:206] Beginning negotiation
0927 15:15:53.397454 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0927 15:15:53.398319 (+ 865us) server_negotiation.cc:407] Connection header received
0927 15:15:53.399881 (+ 1562us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:15:53.399883 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:15:53.399933 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:15:53.400014 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0927 15:15:53.401220 (+ 1206us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:15:53.401736 (+ 516us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:15:53.402809 (+ 1073us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:15:53.403009 (+ 200us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:15:53.403082 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:15:53.405356 (+ 2274us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0927 15:15:53.405359 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0927 15:15:53.405361 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0927 15:15:53.405384 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0927 15:15:53.406473 (+ 1089us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:15:53.406887 (+ 414us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:15:53.406889 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:15:53.406890 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:15:53.406956 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:15:53.407193 (+ 237us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:15:53.407195 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:15:53.407196 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:15:53.407380 (+ 184us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0927 15:15:53.407454 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0927 15:15:53.407852 (+ 398us) server_negotiation.cc:299] Negotiation successful
0927 15:15:53.407944 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260927 15:15:53.408839 2955 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:15:53.397702 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.62:34823 (local address 127.17.136.3:51661)
0927 15:15:53.398144 (+ 442us) negotiation.cc:107] Waiting for socket to connect
0927 15:15:53.398203 (+ 59us) client_negotiation.cc:174] Beginning negotiation
0927 15:15:53.399681 (+ 1478us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0927 15:15:53.400187 (+ 506us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0927 15:15:53.400196 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0927 15:15:53.400547 (+ 351us) client_negotiation.cc:189] Negotiated authn=SASL
0927 15:15:53.401103 (+ 556us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:15:53.401117 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:15:53.401831 (+ 714us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:15:53.401833 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:15:53.402717 (+ 884us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:15:53.402725 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:15:53.403113 (+ 388us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:15:53.403115 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:15:53.403301 (+ 186us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:15:53.403842 (+ 541us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0927 15:15:53.403858 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0927 15:15:53.405210 (+ 1352us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0927 15:15:53.406564 (+ 1354us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0927 15:15:53.406568 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0927 15:15:53.406579 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0927 15:15:53.406816 (+ 237us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0927 15:15:53.407015 (+ 199us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0927 15:15:53.407017 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0927 15:15:53.407018 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0927 15:15:53.407133 (+ 115us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0927 15:15:53.407455 (+ 322us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0927 15:15:53.407460 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0927 15:15:53.407674 (+ 214us) client_negotiation.cc:769] Sending connection context
0927 15:15:53.407821 (+ 147us) client_negotiation.cc:240] Negotiation successful
0927 15:15:53.408055 (+ 234us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":262,"thread_start_us":112,"threads_started":1}
I20260927 15:15:53.409811 2953 heartbeater.cc:347] Connected to a master server at 127.17.136.62:34823
I20260927 15:15:53.410020 2953 heartbeater.cc:464] Registering TS with master...
I20260927 15:15:53.410470 2953 heartbeater.cc:511] Master 127.17.136.62:34823 requested a full tablet report, sending...
I20260927 15:15:53.411471 2494 ts_manager.cc:194] Registered new tserver with Master: 3d45f365d6f648fd93d5eb201da7cda8 (127.17.136.3:36639)
I20260927 15:15:53.412149 2494 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.136.3@KRBTEST.COM'} at 127.17.136.3:51661
I20260927 15:15:53.412494 17952 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260927 15:15:53.421335 2533 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:15:53.414335 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33080 (local address 127.17.136.62:34823)
0927 15:15:53.414456 (+ 121us) server_negotiation.cc:206] Beginning negotiation
0927 15:15:53.414461 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0927 15:15:53.414614 (+ 153us) server_negotiation.cc:407] Connection header received
0927 15:15:53.414722 (+ 108us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:15:53.414725 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:15:53.414766 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:15:53.414828 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0927 15:15:53.415522 (+ 694us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:15:53.416023 (+ 501us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:15:53.416838 (+ 815us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:15:53.417056 (+ 218us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:15:53.417138 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:15:53.418429 (+ 1291us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0927 15:15:53.418433 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0927 15:15:53.418435 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0927 15:15:53.418460 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0927 15:15:53.419835 (+ 1375us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:15:53.420214 (+ 379us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:15:53.420218 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:15:53.420220 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:15:53.420297 (+ 77us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:15:53.420525 (+ 228us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:15:53.420528 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:15:53.420530 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:15:53.420753 (+ 223us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0927 15:15:53.420872 (+ 119us) server_negotiation.cc:1035] Waiting for connection context
0927 15:15:53.421086 (+ 214us) server_negotiation.cc:299] Negotiation successful
0927 15:15:53.421187 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260927 15:15:53.423820 2494 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:33080:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:15:53.426692 2494 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:15:53.441094 2964 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:15:53.435197 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.2:36885 (local address 127.0.0.1:60138)
0927 15:15:53.435693 (+ 496us) negotiation.cc:107] Waiting for socket to connect
0927 15:15:53.435708 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0927 15:15:53.435797 (+ 89us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0927 15:15:53.436439 (+ 642us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0927 15:15:53.436446 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0927 15:15:53.436483 (+ 37us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0927 15:15:53.436785 (+ 302us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:15:53.436791 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:15:53.438302 (+ 1511us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:15:53.438305 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:15:53.439745 (+ 1440us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:15:53.439757 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:15:53.440552 (+ 795us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:15:53.440556 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:15:53.440658 (+ 102us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:15:53.440697 (+ 39us) client_negotiation.cc:769] Sending connection context
0927 15:15:53.440818 (+ 121us) client_negotiation.cc:240] Negotiation successful
0927 15:15:53.440941 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":430,"mutex_wait_us":291,"spinlock_wait_cycles":7040,"thread_start_us":125,"threads_started":1}
I20260927 15:15:53.441103 2967 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:15:53.435419 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60138 (local address 127.17.136.2:36885)
0927 15:15:53.435842 (+ 423us) server_negotiation.cc:206] Beginning negotiation
0927 15:15:53.435854 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0927 15:15:53.435877 (+ 23us) server_negotiation.cc:407] Connection header received
0927 15:15:53.435951 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:15:53.435956 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:15:53.436197 (+ 241us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:15:53.436656 (+ 459us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0927 15:15:53.436892 (+ 236us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:15:53.438170 (+ 1278us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:15:53.439884 (+ 1714us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:15:53.440442 (+ 558us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:15:53.440539 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:15:53.440712 (+ 173us) server_negotiation.cc:1035] Waiting for connection context
0927 15:15:53.440855 (+ 143us) server_negotiation.cc:299] Negotiation successful
0927 15:15:53.440945 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":332,"thread_start_us":119,"threads_started":1}
I20260927 15:15:53.441293 2966 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:15:53.434849 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.1:39287 (local address 127.0.0.1:49094)
0927 15:15:53.435574 (+ 725us) negotiation.cc:107] Waiting for socket to connect
0927 15:15:53.435628 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0927 15:15:53.435752 (+ 124us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0927 15:15:53.436439 (+ 687us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0927 15:15:53.436446 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0927 15:15:53.436481 (+ 35us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0927 15:15:53.436659 (+ 178us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:15:53.436668 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:15:53.438382 (+ 1714us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:15:53.438385 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:15:53.439723 (+ 1338us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:15:53.439732 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:15:53.440913 (+ 1181us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:15:53.440916 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:15:53.441005 (+ 89us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:15:53.441027 (+ 22us) client_negotiation.cc:769] Sending connection context
0927 15:15:53.441085 (+ 58us) client_negotiation.cc:240] Negotiation successful
0927 15:15:53.441153 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":548,"mutex_wait_us":95,"spinlock_wait_cycles":7296,"thread_start_us":66,"threads_started":1}
I20260927 15:15:53.441659 2969 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:15:53.435967 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52528 (local address 127.17.136.3:36639)
0927 15:15:53.436299 (+ 332us) server_negotiation.cc:206] Beginning negotiation
0927 15:15:53.436310 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0927 15:15:53.436657 (+ 347us) server_negotiation.cc:407] Connection header received
0927 15:15:53.436753 (+ 96us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:15:53.436759 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:15:53.436956 (+ 197us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:15:53.437088 (+ 132us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0927 15:15:53.437334 (+ 246us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:15:53.438122 (+ 788us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:15:53.439871 (+ 1749us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:15:53.440771 (+ 900us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:15:53.440880 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:15:53.441024 (+ 144us) server_negotiation.cc:1035] Waiting for connection context
0927 15:15:53.441412 (+ 388us) server_negotiation.cc:299] Negotiation successful
0927 15:15:53.441507 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":202,"thread_start_us":107,"threads_started":1}
I20260927 15:15:53.441659 2968 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:15:53.435535 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.3:36639 (local address 127.0.0.1:52528)
0927 15:15:53.436473 (+ 938us) negotiation.cc:107] Waiting for socket to connect
0927 15:15:53.436485 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0927 15:15:53.436565 (+ 80us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0927 15:15:53.437120 (+ 555us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0927 15:15:53.437122 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0927 15:15:53.437139 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0927 15:15:53.437231 (+ 92us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:15:53.437238 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:15:53.438235 (+ 997us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:15:53.438238 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:15:53.439788 (+ 1550us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:15:53.439795 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:15:53.441080 (+ 1285us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:15:53.441083 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:15:53.441190 (+ 107us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:15:53.441211 (+ 21us) client_negotiation.cc:769] Sending connection context
0927 15:15:53.441275 (+ 64us) client_negotiation.cc:240] Negotiation successful
0927 15:15:53.441340 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":882,"mutex_wait_us":80,"thread_start_us":101,"threads_started":1}
I20260927 15:15:53.442446 2965 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:15:53.434962 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49094 (local address 127.17.136.1:39287)
0927 15:15:53.436047 (+ 1085us) server_negotiation.cc:206] Beginning negotiation
0927 15:15:53.436062 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0927 15:15:53.436082 (+ 20us) server_negotiation.cc:407] Connection header received
0927 15:15:53.436147 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:15:53.436151 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:15:53.436306 (+ 155us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:15:53.436977 (+ 671us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0927 15:15:53.437132 (+ 155us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:15:53.438221 (+ 1089us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:15:53.439829 (+ 1608us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:15:53.440771 (+ 942us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:15:53.442003 (+ 1232us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:15:53.442162 (+ 159us) server_negotiation.cc:1035] Waiting for connection context
0927 15:15:53.442212 (+ 50us) server_negotiation.cc:299] Negotiation successful
0927 15:15:53.442301 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":979,"thread_start_us":160,"threads_started":1}
I20260927 15:15:53.444485 2753 tablet_service.cc:1467] Processing CreateTablet for tablet ad5c4bb439594dada918dae330565f65 (DEFAULT_TABLE table=test-table [id=bf000257f3db44a486e8c31cd6a7216e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:15:53.445408 2753 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ad5c4bb439594dada918dae330565f65. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:15:53.445120 2887 tablet_service.cc:1467] Processing CreateTablet for tablet ad5c4bb439594dada918dae330565f65 (DEFAULT_TABLE table=test-table [id=bf000257f3db44a486e8c31cd6a7216e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:15:53.445119 2619 tablet_service.cc:1467] Processing CreateTablet for tablet ad5c4bb439594dada918dae330565f65 (DEFAULT_TABLE table=test-table [id=bf000257f3db44a486e8c31cd6a7216e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:15:53.446125 2887 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ad5c4bb439594dada918dae330565f65. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:15:53.446117 2619 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ad5c4bb439594dada918dae330565f65. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:15:53.451136 2970 tablet_bootstrap.cc:492] T ad5c4bb439594dada918dae330565f65 P 19f35042a4024a68b8f7d0d3446523f2: Bootstrap starting.
I20260927 15:15:53.453336 2970 tablet_bootstrap.cc:654] T ad5c4bb439594dada918dae330565f65 P 19f35042a4024a68b8f7d0d3446523f2: Neither blocks nor log segments found. Creating new log.
I20260927 15:15:53.454061 2971 tablet_bootstrap.cc:492] T ad5c4bb439594dada918dae330565f65 P 3d45f365d6f648fd93d5eb201da7cda8: Bootstrap starting.
I20260927 15:15:53.454571 2970 log.cc:824] T ad5c4bb439594dada918dae330565f65 P 19f35042a4024a68b8f7d0d3446523f2: Log is configured to *not* fsync() on all Append() calls
I20260927 15:15:53.455825 2971 tablet_bootstrap.cc:654] T ad5c4bb439594dada918dae330565f65 P 3d45f365d6f648fd93d5eb201da7cda8: Neither blocks nor log segments found. Creating new log.
I20260927 15:15:53.456377 2970 tablet_bootstrap.cc:492] T ad5c4bb439594dada918dae330565f65 P 19f35042a4024a68b8f7d0d3446523f2: No bootstrap required, opened a new log
I20260927 15:15:53.456559 2970 ts_tablet_manager.cc:1397] T ad5c4bb439594dada918dae330565f65 P 19f35042a4024a68b8f7d0d3446523f2: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260927 15:15:53.456849 2971 log.cc:824] T ad5c4bb439594dada918dae330565f65 P 3d45f365d6f648fd93d5eb201da7cda8: Log is configured to *not* fsync() on all Append() calls
I20260927 15:15:53.457203 2972 tablet_bootstrap.cc:492] T ad5c4bb439594dada918dae330565f65 P 2907eed990074380b797b788c2e81da1: Bootstrap starting.
I20260927 15:15:53.458699 2971 tablet_bootstrap.cc:492] T ad5c4bb439594dada918dae330565f65 P 3d45f365d6f648fd93d5eb201da7cda8: No bootstrap required, opened a new log
I20260927 15:15:53.458918 2971 ts_tablet_manager.cc:1397] T ad5c4bb439594dada918dae330565f65 P 3d45f365d6f648fd93d5eb201da7cda8: Time spent bootstrapping tablet: real 0.005s user 0.005s sys 0.000s
I20260927 15:15:53.459169 2972 tablet_bootstrap.cc:654] T ad5c4bb439594dada918dae330565f65 P 2907eed990074380b797b788c2e81da1: Neither blocks nor log segments found. Creating new log.
I20260927 15:15:53.459816 2970 raft_consensus.cc:348] T ad5c4bb439594dada918dae330565f65 P 19f35042a4024a68b8f7d0d3446523f2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2907eed990074380b797b788c2e81da1" member_type: VOTER last_known_addr { host: "127.17.136.1" port: 39287 } } peers { permanent_uuid: "3d45f365d6f648fd93d5eb201da7cda8" member_type: VOTER last_known_addr { host: "127.17.136.3" port: 36639 } } peers { permanent_uuid: "19f35042a4024a68b8f7d0d3446523f2" member_type: VOTER last_known_addr { host: "127.17.136.2" port: 36885 } }
I20260927 15:15:53.460031 2970 raft_consensus.cc:374] T ad5c4bb439594dada918dae330565f65 P 19f35042a4024a68b8f7d0d3446523f2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:15:53.460104 2970 raft_consensus.cc:729] T ad5c4bb439594dada918dae330565f65 P 19f35042a4024a68b8f7d0d3446523f2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 19f35042a4024a68b8f7d0d3446523f2, State: Initialized, Role: FOLLOWER
I20260927 15:15:53.460368 2972 log.cc:824] T ad5c4bb439594dada918dae330565f65 P 2907eed990074380b797b788c2e81da1: Log is configured to *not* fsync() on all Append() calls
I20260927 15:15:53.460528 2970 consensus_queue.cc:260] T ad5c4bb439594dada918dae330565f65 P 19f35042a4024a68b8f7d0d3446523f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2907eed990074380b797b788c2e81da1" member_type: VOTER last_known_addr { host: "127.17.136.1" port: 39287 } } peers { permanent_uuid: "3d45f365d6f648fd93d5eb201da7cda8" member_type: VOTER last_known_addr { host: "127.17.136.3" port: 36639 } } peers { permanent_uuid: "19f35042a4024a68b8f7d0d3446523f2" member_type: VOTER last_known_addr { host: "127.17.136.2" port: 36885 } }
I20260927 15:15:53.461100 2819 heartbeater.cc:503] Master 127.17.136.62:34823 was elected leader, sending a full tablet report...
I20260927 15:15:53.461460 2970 ts_tablet_manager.cc:1428] T ad5c4bb439594dada918dae330565f65 P 19f35042a4024a68b8f7d0d3446523f2: Time spent starting tablet: real 0.005s user 0.001s sys 0.005s
I20260927 15:15:53.462198 2972 tablet_bootstrap.cc:492] T ad5c4bb439594dada918dae330565f65 P 2907eed990074380b797b788c2e81da1: No bootstrap required, opened a new log
I20260927 15:15:53.462370 2972 ts_tablet_manager.cc:1397] T ad5c4bb439594dada918dae330565f65 P 2907eed990074380b797b788c2e81da1: Time spent bootstrapping tablet: real 0.009s user 0.004s sys 0.000s
I20260927 15:15:53.462591 2971 raft_consensus.cc:348] T ad5c4bb439594dada918dae330565f65 P 3d45f365d6f648fd93d5eb201da7cda8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2907eed990074380b797b788c2e81da1" member_type: VOTER last_known_addr { host: "127.17.136.1" port: 39287 } } peers { permanent_uuid: "3d45f365d6f648fd93d5eb201da7cda8" member_type: VOTER last_known_addr { host: "127.17.136.3" port: 36639 } } peers { permanent_uuid: "19f35042a4024a68b8f7d0d3446523f2" member_type: VOTER last_known_addr { host: "127.17.136.2" port: 36885 } }
I20260927 15:15:53.462847 2971 raft_consensus.cc:374] T ad5c4bb439594dada918dae330565f65 P 3d45f365d6f648fd93d5eb201da7cda8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:15:53.462901 2971 raft_consensus.cc:729] T ad5c4bb439594dada918dae330565f65 P 3d45f365d6f648fd93d5eb201da7cda8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d45f365d6f648fd93d5eb201da7cda8, State: Initialized, Role: FOLLOWER
I20260927 15:15:53.463438 2971 consensus_queue.cc:260] T ad5c4bb439594dada918dae330565f65 P 3d45f365d6f648fd93d5eb201da7cda8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2907eed990074380b797b788c2e81da1" member_type: VOTER last_known_addr { host: "127.17.136.1" port: 39287 } } peers { permanent_uuid: "3d45f365d6f648fd93d5eb201da7cda8" member_type: VOTER last_known_addr { host: "127.17.136.3" port: 36639 } } peers { permanent_uuid: "19f35042a4024a68b8f7d0d3446523f2" member_type: VOTER last_known_addr { host: "127.17.136.2" port: 36885 } }
I20260927 15:15:53.464354 2971 ts_tablet_manager.cc:1428] T ad5c4bb439594dada918dae330565f65 P 3d45f365d6f648fd93d5eb201da7cda8: Time spent starting tablet: real 0.005s user 0.005s sys 0.000s
I20260927 15:15:53.464673 2953 heartbeater.cc:503] Master 127.17.136.62:34823 was elected leader, sending a full tablet report...
I20260927 15:15:53.466667 2972 raft_consensus.cc:348] T ad5c4bb439594dada918dae330565f65 P 2907eed990074380b797b788c2e81da1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2907eed990074380b797b788c2e81da1" member_type: VOTER last_known_addr { host: "127.17.136.1" port: 39287 } } peers { permanent_uuid: "3d45f365d6f648fd93d5eb201da7cda8" member_type: VOTER last_known_addr { host: "127.17.136.3" port: 36639 } } peers { permanent_uuid: "19f35042a4024a68b8f7d0d3446523f2" member_type: VOTER last_known_addr { host: "127.17.136.2" port: 36885 } }
I20260927 15:15:53.466859 2972 raft_consensus.cc:374] T ad5c4bb439594dada918dae330565f65 P 2907eed990074380b797b788c2e81da1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:15:53.466912 2972 raft_consensus.cc:729] T ad5c4bb439594dada918dae330565f65 P 2907eed990074380b797b788c2e81da1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2907eed990074380b797b788c2e81da1, State: Initialized, Role: FOLLOWER
I20260927 15:15:53.467344 2972 consensus_queue.cc:260] T ad5c4bb439594dada918dae330565f65 P 2907eed990074380b797b788c2e81da1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2907eed990074380b797b788c2e81da1" member_type: VOTER last_known_addr { host: "127.17.136.1" port: 39287 } } peers { permanent_uuid: "3d45f365d6f648fd93d5eb201da7cda8" member_type: VOTER last_known_addr { host: "127.17.136.3" port: 36639 } } peers { permanent_uuid: "19f35042a4024a68b8f7d0d3446523f2" member_type: VOTER last_known_addr { host: "127.17.136.2" port: 36885 } }
I20260927 15:15:53.467876 2685 heartbeater.cc:503] Master 127.17.136.62:34823 was elected leader, sending a full tablet report...
I20260927 15:15:53.468044 2972 ts_tablet_manager.cc:1428] T ad5c4bb439594dada918dae330565f65 P 2907eed990074380b797b788c2e81da1: Time spent starting tablet: real 0.006s user 0.005s sys 0.000s
W20260927 15:15:53.646569 2954 tablet.cc:2369] T ad5c4bb439594dada918dae330565f65 P 3d45f365d6f648fd93d5eb201da7cda8: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260927 15:15:53.649434 2976 raft_consensus.cc:482] T ad5c4bb439594dada918dae330565f65 P 19f35042a4024a68b8f7d0d3446523f2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:15:53.649623 2976 raft_consensus.cc:504] T ad5c4bb439594dada918dae330565f65 P 19f35042a4024a68b8f7d0d3446523f2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2907eed990074380b797b788c2e81da1" member_type: VOTER last_known_addr { host: "127.17.136.1" port: 39287 } } peers { permanent_uuid: "3d45f365d6f648fd93d5eb201da7cda8" member_type: VOTER last_known_addr { host: "127.17.136.3" port: 36639 } } peers { permanent_uuid: "19f35042a4024a68b8f7d0d3446523f2" member_type: VOTER last_known_addr { host: "127.17.136.2" port: 36885 } }
I20260927 15:15:53.650702 2976 leader_election.cc:288] T ad5c4bb439594dada918dae330565f65 P 19f35042a4024a68b8f7d0d3446523f2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2907eed990074380b797b788c2e81da1 (127.17.136.1:39287), 3d45f365d6f648fd93d5eb201da7cda8 (127.17.136.3:36639)
I20260927 15:15:53.654356 2821 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:15:53.651097 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.1:39287 (local address 127.17.136.2:49225)
0927 15:15:53.651223 (+ 126us) negotiation.cc:107] Waiting for socket to connect
0927 15:15:53.651235 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0927 15:15:53.651352 (+ 117us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0927 15:15:53.651675 (+ 323us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0927 15:15:53.651678 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0927 15:15:53.651697 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0927 15:15:53.651801 (+ 104us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:15:53.651806 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:15:53.652496 (+ 690us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:15:53.652499 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:15:53.653376 (+ 877us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:15:53.653385 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:15:53.653970 (+ 585us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:15:53.653973 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:15:53.654081 (+ 108us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:15:53.654099 (+ 18us) client_negotiation.cc:769] Sending connection context
0927 15:15:53.654159 (+ 60us) client_negotiation.cc:240] Negotiation successful
0927 15:15:53.654228 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":38}
I20260927 15:15:53.654356 2965 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:15:53.651115 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.136.2:49225 (local address 127.17.136.1:39287)
0927 15:15:53.651303 (+ 188us) server_negotiation.cc:206] Beginning negotiation
0927 15:15:53.651308 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0927 15:15:53.651325 (+ 17us) server_negotiation.cc:407] Connection header received
0927 15:15:53.651468 (+ 143us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:15:53.651471 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:15:53.651522 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:15:53.651622 (+ 100us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0927 15:15:53.651913 (+ 291us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:15:53.652400 (+ 487us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:15:53.653491 (+ 1091us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:15:53.653872 (+ 381us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:15:53.653969 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:15:53.654020 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0927 15:15:53.654181 (+ 161us) server_negotiation.cc:299] Negotiation successful
0927 15:15:53.654251 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260927 15:15:53.654541 2969 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:15:53.651500 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.136.2:48181 (local address 127.17.136.3:36639)
0927 15:15:53.651608 (+ 108us) server_negotiation.cc:206] Beginning negotiation
0927 15:15:53.651613 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0927 15:15:53.651761 (+ 148us) server_negotiation.cc:407] Connection header received
0927 15:15:53.651861 (+ 100us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:15:53.651864 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:15:53.651906 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:15:53.651963 (+ 57us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0927 15:15:53.652189 (+ 226us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:15:53.652691 (+ 502us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:15:53.653665 (+ 974us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:15:53.654068 (+ 403us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:15:53.654165 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:15:53.654212 (+ 47us) server_negotiation.cc:1035] Waiting for connection context
0927 15:15:53.654377 (+ 165us) server_negotiation.cc:299] Negotiation successful
0927 15:15:53.654437 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260927 15:15:53.654552 2979 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:15:53.651383 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.3:36639 (local address 127.17.136.2:48181)
0927 15:15:53.651683 (+ 300us) negotiation.cc:107] Waiting for socket to connect
0927 15:15:53.651693 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0927 15:15:53.651783 (+ 90us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0927 15:15:53.651977 (+ 194us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0927 15:15:53.651980 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0927 15:15:53.651993 (+ 13us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0927 15:15:53.652100 (+ 107us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:15:53.652105 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:15:53.652783 (+ 678us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:15:53.652786 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:15:53.653559 (+ 773us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:15:53.653566 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:15:53.654165 (+ 599us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:15:53.654177 (+ 12us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:15:53.654276 (+ 99us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:15:53.654296 (+ 20us) client_negotiation.cc:769] Sending connection context
0927 15:15:53.654356 (+ 60us) client_negotiation.cc:240] Negotiation successful
0927 15:15:53.654419 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":242,"thread_start_us":106,"threads_started":1}
I20260927 15:15:53.655074 2639 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ad5c4bb439594dada918dae330565f65" candidate_uuid: "19f35042a4024a68b8f7d0d3446523f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2907eed990074380b797b788c2e81da1" is_pre_election: true
I20260927 15:15:53.655077 2907 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ad5c4bb439594dada918dae330565f65" candidate_uuid: "19f35042a4024a68b8f7d0d3446523f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d45f365d6f648fd93d5eb201da7cda8" is_pre_election: true
I20260927 15:15:53.655359 2907 raft_consensus.cc:2454] T ad5c4bb439594dada918dae330565f65 P 3d45f365d6f648fd93d5eb201da7cda8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 19f35042a4024a68b8f7d0d3446523f2 in term 0.
I20260927 15:15:53.655362 2639 raft_consensus.cc:2454] T ad5c4bb439594dada918dae330565f65 P 2907eed990074380b797b788c2e81da1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 19f35042a4024a68b8f7d0d3446523f2 in term 0.
I20260927 15:15:53.655804 2708 leader_election.cc:302] T ad5c4bb439594dada918dae330565f65 P 19f35042a4024a68b8f7d0d3446523f2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 19f35042a4024a68b8f7d0d3446523f2, 2907eed990074380b797b788c2e81da1; no voters:
I20260927 15:15:53.656046 2976 raft_consensus.cc:2781] T ad5c4bb439594dada918dae330565f65 P 19f35042a4024a68b8f7d0d3446523f2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 15:15:53.656136 2976 raft_consensus.cc:482] T ad5c4bb439594dada918dae330565f65 P 19f35042a4024a68b8f7d0d3446523f2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 15:15:53.656196 2976 raft_consensus.cc:3037] T ad5c4bb439594dada918dae330565f65 P 19f35042a4024a68b8f7d0d3446523f2 [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:15:53.657161 2976 raft_consensus.cc:504] T ad5c4bb439594dada918dae330565f65 P 19f35042a4024a68b8f7d0d3446523f2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2907eed990074380b797b788c2e81da1" member_type: VOTER last_known_addr { host: "127.17.136.1" port: 39287 } } peers { permanent_uuid: "3d45f365d6f648fd93d5eb201da7cda8" member_type: VOTER last_known_addr { host: "127.17.136.3" port: 36639 } } peers { permanent_uuid: "19f35042a4024a68b8f7d0d3446523f2" member_type: VOTER last_known_addr { host: "127.17.136.2" port: 36885 } }
I20260927 15:15:53.657456 2976 leader_election.cc:288] T ad5c4bb439594dada918dae330565f65 P 19f35042a4024a68b8f7d0d3446523f2 [CANDIDATE]: Term 1 election: Requested vote from peers 2907eed990074380b797b788c2e81da1 (127.17.136.1:39287), 3d45f365d6f648fd93d5eb201da7cda8 (127.17.136.3:36639)
I20260927 15:15:53.657809 2639 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ad5c4bb439594dada918dae330565f65" candidate_uuid: "19f35042a4024a68b8f7d0d3446523f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2907eed990074380b797b788c2e81da1"
I20260927 15:15:53.657809 2907 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ad5c4bb439594dada918dae330565f65" candidate_uuid: "19f35042a4024a68b8f7d0d3446523f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d45f365d6f648fd93d5eb201da7cda8"
I20260927 15:15:53.657917 2639 raft_consensus.cc:3037] T ad5c4bb439594dada918dae330565f65 P 2907eed990074380b797b788c2e81da1 [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:15:53.657943 2907 raft_consensus.cc:3037] T ad5c4bb439594dada918dae330565f65 P 3d45f365d6f648fd93d5eb201da7cda8 [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:15:53.659055 2639 raft_consensus.cc:2454] T ad5c4bb439594dada918dae330565f65 P 2907eed990074380b797b788c2e81da1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 19f35042a4024a68b8f7d0d3446523f2 in term 1.
I20260927 15:15:53.659122 2907 raft_consensus.cc:2454] T ad5c4bb439594dada918dae330565f65 P 3d45f365d6f648fd93d5eb201da7cda8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 19f35042a4024a68b8f7d0d3446523f2 in term 1.
I20260927 15:15:53.659332 2708 leader_election.cc:302] T ad5c4bb439594dada918dae330565f65 P 19f35042a4024a68b8f7d0d3446523f2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 19f35042a4024a68b8f7d0d3446523f2, 2907eed990074380b797b788c2e81da1; no voters:
I20260927 15:15:53.659503 2976 raft_consensus.cc:2781] T ad5c4bb439594dada918dae330565f65 P 19f35042a4024a68b8f7d0d3446523f2 [term 1 FOLLOWER]: Leader election won for term 1
I20260927 15:15:53.659711 2976 raft_consensus.cc:686] T ad5c4bb439594dada918dae330565f65 P 19f35042a4024a68b8f7d0d3446523f2 [term 1 LEADER]: Becoming Leader. State: Replica: 19f35042a4024a68b8f7d0d3446523f2, State: Running, Role: LEADER
I20260927 15:15:53.660010 2976 consensus_queue.cc:237] T ad5c4bb439594dada918dae330565f65 P 19f35042a4024a68b8f7d0d3446523f2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2907eed990074380b797b788c2e81da1" member_type: VOTER last_known_addr { host: "127.17.136.1" port: 39287 } } peers { permanent_uuid: "3d45f365d6f648fd93d5eb201da7cda8" member_type: VOTER last_known_addr { host: "127.17.136.3" port: 36639 } } peers { permanent_uuid: "19f35042a4024a68b8f7d0d3446523f2" member_type: VOTER last_known_addr { host: "127.17.136.2" port: 36885 } }
I20260927 15:15:53.663123 2494 catalog_manager.cc:5495] T ad5c4bb439594dada918dae330565f65 P 19f35042a4024a68b8f7d0d3446523f2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 19f35042a4024a68b8f7d0d3446523f2 (127.17.136.2). New cstate: current_term: 1 leader_uuid: "19f35042a4024a68b8f7d0d3446523f2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2907eed990074380b797b788c2e81da1" member_type: VOTER last_known_addr { host: "127.17.136.1" port: 39287 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3d45f365d6f648fd93d5eb201da7cda8" member_type: VOTER last_known_addr { host: "127.17.136.3" port: 36639 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "19f35042a4024a68b8f7d0d3446523f2" member_type: VOTER last_known_addr { host: "127.17.136.2" port: 36885 } health_report { overall_health: HEALTHY } } }
W20260927 15:15:53.671526 2820 tablet.cc:2369] T ad5c4bb439594dada918dae330565f65 P 19f35042a4024a68b8f7d0d3446523f2: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260927 15:15:53.680279 2967 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:15:53.676867 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60146 (local address 127.17.136.2:36885)
0927 15:15:53.676975 (+ 108us) server_negotiation.cc:206] Beginning negotiation
0927 15:15:53.676980 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0927 15:15:53.677005 (+ 25us) server_negotiation.cc:407] Connection header received
0927 15:15:53.677140 (+ 135us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:15:53.677142 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:15:53.677197 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:15:53.677283 (+ 86us) server_negotiation.cc:226] Negotiated authn=TOKEN
0927 15:15:53.677529 (+ 246us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:15:53.678021 (+ 492us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:15:53.678854 (+ 833us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:15:53.679072 (+ 218us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:15:53.679154 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:15:53.679484 (+ 330us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0927 15:15:53.679903 (+ 419us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0927 15:15:53.680009 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0927 15:15:53.680075 (+ 66us) server_negotiation.cc:299] Negotiation successful
0927 15:15:53.680130 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260927 15:15:53.685830 2907 raft_consensus.cc:1261] T ad5c4bb439594dada918dae330565f65 P 3d45f365d6f648fd93d5eb201da7cda8 [term 1 FOLLOWER]: Refusing update from remote peer 19f35042a4024a68b8f7d0d3446523f2: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260927 15:15:53.685853 2639 raft_consensus.cc:1261] T ad5c4bb439594dada918dae330565f65 P 2907eed990074380b797b788c2e81da1 [term 1 FOLLOWER]: Refusing update from remote peer 19f35042a4024a68b8f7d0d3446523f2: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260927 15:15:53.686467 2976 consensus_queue.cc:1035] T ad5c4bb439594dada918dae330565f65 P 19f35042a4024a68b8f7d0d3446523f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2907eed990074380b797b788c2e81da1" member_type: VOTER last_known_addr { host: "127.17.136.1" port: 39287 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260927 15:15:53.686676 2980 consensus_queue.cc:1035] T ad5c4bb439594dada918dae330565f65 P 19f35042a4024a68b8f7d0d3446523f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d45f365d6f648fd93d5eb201da7cda8" member_type: VOTER last_known_addr { host: "127.17.136.3" port: 36639 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260927 15:15:53.696508 2983 mvcc.cc:205] Tried to move back new op lower bound from 7333978741490118656 to 7333978741393948672. Current Snapshot: MvccSnapshot[applied={T|T < 7333978741490118656 or (T in {7333978741490118656})}]
I20260927 15:15:53.703575 2493 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:33080:
table { table_name: "test-table" } modify_external_catalogs: true
I20260927 15:15:53.703737 2493 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:33080:
table { table_name: "test-table" } modify_external_catalogs: true
I20260927 15:15:53.705955 2493 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 07a3fc22057447b0a833424a1f267285: Sending DeleteTablet for 3 replicas of tablet ad5c4bb439594dada918dae330565f65
I20260927 15:15:53.706734 2753 tablet_service.cc:1514] Processing DeleteTablet for tablet ad5c4bb439594dada918dae330565f65 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:15:53 UTC) from {username='kudu', principal='kudu/127.17.136.62@KRBTEST.COM'} at 127.0.0.1:60138
I20260927 15:15:53.706795 2887 tablet_service.cc:1514] Processing DeleteTablet for tablet ad5c4bb439594dada918dae330565f65 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:15:53 UTC) from {username='kudu', principal='kudu/127.17.136.62@KRBTEST.COM'} at 127.0.0.1:52528
I20260927 15:15:53.707260 2993 tablet_replica.cc:330] T ad5c4bb439594dada918dae330565f65 P 19f35042a4024a68b8f7d0d3446523f2: stopping tablet replica
I20260927 15:15:53.707417 2619 tablet_service.cc:1514] Processing DeleteTablet for tablet ad5c4bb439594dada918dae330565f65 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:15:53 UTC) from {username='kudu', principal='kudu/127.17.136.62@KRBTEST.COM'} at 127.0.0.1:49094
I20260927 15:15:53.707579 2993 raft_consensus.cc:2229] T ad5c4bb439594dada918dae330565f65 P 19f35042a4024a68b8f7d0d3446523f2 [term 1 LEADER]: Raft consensus shutting down.
I20260927 15:15:53.707906 2993 raft_consensus.cc:2258] T ad5c4bb439594dada918dae330565f65 P 19f35042a4024a68b8f7d0d3446523f2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 15:15:53.708496 17952 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu with pid 2556
I20260927 15:15:53.709261 2993 ts_tablet_manager.cc:1905] T ad5c4bb439594dada918dae330565f65 P 19f35042a4024a68b8f7d0d3446523f2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:15:53.711127 2994 tablet_replica.cc:330] T ad5c4bb439594dada918dae330565f65 P 3d45f365d6f648fd93d5eb201da7cda8: stopping tablet replica
I20260927 15:15:53.711462 2994 raft_consensus.cc:2229] T ad5c4bb439594dada918dae330565f65 P 3d45f365d6f648fd93d5eb201da7cda8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260927 15:15:53.711773 2994 raft_consensus.cc:2258] T ad5c4bb439594dada918dae330565f65 P 3d45f365d6f648fd93d5eb201da7cda8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 15:15:53.711841 2993 ts_tablet_manager.cc:1918] T ad5c4bb439594dada918dae330565f65 P 19f35042a4024a68b8f7d0d3446523f2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260927 15:15:53.712072 2993 log.cc:1196] T ad5c4bb439594dada918dae330565f65 P 19f35042a4024a68b8f7d0d3446523f2: Deleting WAL directory at /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790521920546562-17952-0/minicluster-data/ts-1/wal/wals/ad5c4bb439594dada918dae330565f65
I20260927 15:15:53.712399 2993 ts_tablet_manager.cc:1939] T ad5c4bb439594dada918dae330565f65 P 19f35042a4024a68b8f7d0d3446523f2: Deleting consensus metadata
I20260927 15:15:53.713375 2479 catalog_manager.cc:4841] TS 19f35042a4024a68b8f7d0d3446523f2 (127.17.136.2:36885): tablet ad5c4bb439594dada918dae330565f65 (table test-table [id=bf000257f3db44a486e8c31cd6a7216e]) successfully deleted
I20260927 15:15:53.716295 2994 ts_tablet_manager.cc:1905] T ad5c4bb439594dada918dae330565f65 P 3d45f365d6f648fd93d5eb201da7cda8: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260927 15:15:53.716943 2480 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.17.136.1:39287 (error 108)
I20260927 15:15:53.717945 2968 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:15:53.717659 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.1:39287 (local address 127.0.0.1:49106)
0927 15:15:53.717789 (+ 130us) negotiation.cc:107] Waiting for socket to connect
0927 15:15:53.717861 (+ 72us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.136.1:39287: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":48}
I20260927 15:15:53.718007 17952 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu with pid 2690
W20260927 15:15:53.718221 2480 catalog_manager.cc:4584] TS 2907eed990074380b797b788c2e81da1 (127.17.136.1:39287): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet ad5c4bb439594dada918dae330565f65: Network error: Client connection negotiation failed: client connection to 127.17.136.1:39287: connect: Connection refused (error 111)
I20260927 15:15:53.718834 2994 ts_tablet_manager.cc:1918] T ad5c4bb439594dada918dae330565f65 P 3d45f365d6f648fd93d5eb201da7cda8: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260927 15:15:53.718914 2994 log.cc:1196] T ad5c4bb439594dada918dae330565f65 P 3d45f365d6f648fd93d5eb201da7cda8: Deleting WAL directory at /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790521920546562-17952-0/minicluster-data/ts-2/wal/wals/ad5c4bb439594dada918dae330565f65
I20260927 15:15:53.719208 2994 ts_tablet_manager.cc:1939] T ad5c4bb439594dada918dae330565f65 P 3d45f365d6f648fd93d5eb201da7cda8: Deleting consensus metadata
I20260927 15:15:53.720379 2480 catalog_manager.cc:4841] TS 3d45f365d6f648fd93d5eb201da7cda8 (127.17.136.3:36639): tablet ad5c4bb439594dada918dae330565f65 (table test-table [id=bf000257f3db44a486e8c31cd6a7216e]) successfully deleted
I20260927 15:15:53.723703 17952 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu with pid 2824
I20260927 15:15:53.728894 17952 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu with pid 2462
2026-09-27T15:15:53Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/0 (2261 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/1
2026-09-27T15:15:53Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-27T15:15:53Z Disabled control of system clock
I20260927 15:15:53.755681 17952 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu
/tmp/dist-test-taskiFOyeW/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790521920546562-17952-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790521920546562-17952-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790521920546562-17952-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790521920546562-17952-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.136.62:38899
--webserver_interface=127.17.136.62
--webserver_port=0
--builtin_ntp_servers=127.17.136.20:43911
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.136.62:38899
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260927 15:15:53.860371 3000 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260927 15:15:53.860630 3000 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260927 15:15:53.860664 3000 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260927 15:15:53.864761 3000 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260927 15:15:53.864827 3000 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260927 15:15:53.864842 3000 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260927 15:15:53.864861 3000 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260927 15:15:53.864888 3000 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260927 15:15:53.869681 3000 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.136.20:43911
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790521920546562-17952-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790521920546562-17952-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.17.136.62:38899
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.136.62:38899
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790521920546562-17952-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.17.136.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3000
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790521920546562-17952-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 27 Sep 2026 14:27:13 UTC on ccycloud.quasar-psqrth.root.comops.site
build id 4676138
I20260927 15:15:53.870749 3000 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260927 15:15:53.872162 3000 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260927 15:15:53.880084 3008 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260927 15:15:53.880119 3005 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260927 15:15:53.880154 3000 server_base.cc:1034] running on GCE node
W20260927 15:15:53.880119 3006 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260927 15:15:53.880847 3000 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260927 15:15:53.881927 3000 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260927 15:15:53.883083 3000 hybrid_clock.cc:648] HybridClock initialized: now 1790522153883066 us; error 28 us; skew 500 ppm
I20260927 15:15:53.888286 3000 webserver.cc:460] Webserver started at http://127.17.136.62:36143/ using document root <none> and password file <none>
I20260927 15:15:53.888856 3000 fs_manager.cc:359] Metadata directory not provided
I20260927 15:15:53.888921 3000 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260927 15:15:53.889123 3000 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260927 15:15:53.891242 3000 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790521920546562-17952-0/minicluster-data/master-0/data/instance:
uuid: "49d93dd7b7bb47f09ee5428c54eda52d"
format_stamp: "Formatted at 2026-09-27 15:15:53 on dist-test-slave-5s2t"
server_key: "4428e4c6471c5e50ab8617c71917a023"
server_key_iv: "20f4155e74c26e50c1bed70ceaf08d14"
server_key_version: "encryptionkey@0"
I20260927 15:15:53.891842 3000 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790521920546562-17952-0/minicluster-data/master-0/wal/instance:
uuid: "49d93dd7b7bb47f09ee5428c54eda52d"
format_stamp: "Formatted at 2026-09-27 15:15:53 on dist-test-slave-5s2t"
server_key: "4428e4c6471c5e50ab8617c71917a023"
server_key_iv: "20f4155e74c26e50c1bed70ceaf08d14"
server_key_version: "encryptionkey@0"
I20260927 15:15:53.895391 3000 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260927 15:15:53.897746 3014 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260927 15:15:53.898938 3000 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260927 15:15:53.899048 3000 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790521920546562-17952-0/minicluster-data/master-0/data,/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790521920546562-17952-0/minicluster-data/master-0/wal
uuid: "49d93dd7b7bb47f09ee5428c54eda52d"
format_stamp: "Formatted at 2026-09-27 15:15:53 on dist-test-slave-5s2t"
server_key: "4428e4c6471c5e50ab8617c71917a023"
server_key_iv: "20f4155e74c26e50c1bed70ceaf08d14"
server_key_version: "encryptionkey@0"
I20260927 15:15:53.899137 3000 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790521920546562-17952-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790521920546562-17952-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790521920546562-17952-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260927 15:15:53.928138 3000 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260927 15:15:53.928861 3000 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260927 15:15:53.929036 3000 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260927 15:15:53.935746 3000 rpc_server.cc:307] RPC server started. Bound to: 127.17.136.62:38899
I20260927 15:15:53.935770 3066 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.136.62:38899 every 8 connection(s)
I20260927 15:15:53.936753 3000 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790521920546562-17952-0/minicluster-data/master-0/data/info.pb
I20260927 15:15:53.939878 3067 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:15:53.940929 17952 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu as pid 3000
I20260927 15:15:53.941049 17952 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790521920546562-17952-0/minicluster-data/master-0/wal/instance
I20260927 15:15:53.941309 17952 external_mini_cluster.cc:1428] Setting key 6e02ceec6d36747a81ac3ded333d8a09
I20260927 15:15:53.945698 3067 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 49d93dd7b7bb47f09ee5428c54eda52d: Bootstrap starting.
I20260927 15:15:53.947914 3067 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 49d93dd7b7bb47f09ee5428c54eda52d: Neither blocks nor log segments found. Creating new log.
I20260927 15:15:53.948864 3067 log.cc:824] T 00000000000000000000000000000000 P 49d93dd7b7bb47f09ee5428c54eda52d: Log is configured to *not* fsync() on all Append() calls
I20260927 15:15:53.950939 3067 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 49d93dd7b7bb47f09ee5428c54eda52d: No bootstrap required, opened a new log
I20260927 15:15:53.951145 3070 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:15:53.942642 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39094 (local address 127.17.136.62:38899)
0927 15:15:53.943326 (+ 684us) server_negotiation.cc:206] Beginning negotiation
0927 15:15:53.943350 (+ 24us) server_negotiation.cc:399] Waiting for connection header
0927 15:15:53.943386 (+ 36us) server_negotiation.cc:407] Connection header received
0927 15:15:53.944010 (+ 624us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:15:53.944025 (+ 15us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:15:53.944424 (+ 399us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:15:53.944720 (+ 296us) server_negotiation.cc:226] Negotiated authn=SASL
0927 15:15:53.945121 (+ 401us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:15:53.946079 (+ 958us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:15:53.946936 (+ 857us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:15:53.947438 (+ 502us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:15:53.947587 (+ 149us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:15:53.949373 (+ 1786us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0927 15:15:53.949380 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0927 15:15:53.949396 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0927 15:15:53.949842 (+ 446us) server_negotiation.cc:922] calling sasl_server_start()
0927 15:15:53.949898 (+ 56us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0927 15:15:53.949918 (+ 20us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0927 15:15:53.949990 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0927 15:15:53.950139 (+ 149us) server_negotiation.cc:299] Negotiation successful
0927 15:15:53.950402 (+ 263us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":246,"thread_start_us":96,"threads_started":1}
I20260927 15:15:53.954717 3067 raft_consensus.cc:348] T 00000000000000000000000000000000 P 49d93dd7b7bb47f09ee5428c54eda52d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "49d93dd7b7bb47f09ee5428c54eda52d" member_type: VOTER last_known_addr { host: "127.17.136.62" port: 38899 } }
I20260927 15:15:53.954979 3067 raft_consensus.cc:374] T 00000000000000000000000000000000 P 49d93dd7b7bb47f09ee5428c54eda52d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:15:53.955045 3067 raft_consensus.cc:729] T 00000000000000000000000000000000 P 49d93dd7b7bb47f09ee5428c54eda52d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 49d93dd7b7bb47f09ee5428c54eda52d, State: Initialized, Role: FOLLOWER
I20260927 15:15:53.955480 3067 consensus_queue.cc:260] T 00000000000000000000000000000000 P 49d93dd7b7bb47f09ee5428c54eda52d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "49d93dd7b7bb47f09ee5428c54eda52d" member_type: VOTER last_known_addr { host: "127.17.136.62" port: 38899 } }
I20260927 15:15:53.955601 3067 raft_consensus.cc:388] T 00000000000000000000000000000000 P 49d93dd7b7bb47f09ee5428c54eda52d [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260927 15:15:53.955658 3067 raft_consensus.cc:482] T 00000000000000000000000000000000 P 49d93dd7b7bb47f09ee5428c54eda52d [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260927 15:15:53.955754 3067 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 49d93dd7b7bb47f09ee5428c54eda52d [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:15:53.956602 3067 raft_consensus.cc:504] T 00000000000000000000000000000000 P 49d93dd7b7bb47f09ee5428c54eda52d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "49d93dd7b7bb47f09ee5428c54eda52d" member_type: VOTER last_known_addr { host: "127.17.136.62" port: 38899 } }
I20260927 15:15:53.956931 3067 leader_election.cc:302] T 00000000000000000000000000000000 P 49d93dd7b7bb47f09ee5428c54eda52d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 49d93dd7b7bb47f09ee5428c54eda52d; no voters:
I20260927 15:15:53.957206 3067 leader_election.cc:288] T 00000000000000000000000000000000 P 49d93dd7b7bb47f09ee5428c54eda52d [CANDIDATE]: Term 1 election: Requested vote from peers
I20260927 15:15:53.957310 3072 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 49d93dd7b7bb47f09ee5428c54eda52d [term 1 FOLLOWER]: Leader election won for term 1
I20260927 15:15:53.957504 3072 raft_consensus.cc:686] T 00000000000000000000000000000000 P 49d93dd7b7bb47f09ee5428c54eda52d [term 1 LEADER]: Becoming Leader. State: Replica: 49d93dd7b7bb47f09ee5428c54eda52d, State: Running, Role: LEADER
I20260927 15:15:53.957825 3072 consensus_queue.cc:237] T 00000000000000000000000000000000 P 49d93dd7b7bb47f09ee5428c54eda52d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "49d93dd7b7bb47f09ee5428c54eda52d" member_type: VOTER last_known_addr { host: "127.17.136.62" port: 38899 } }
I20260927 15:15:53.958328 3067 sys_catalog.cc:564] T 00000000000000000000000000000000 P 49d93dd7b7bb47f09ee5428c54eda52d [sys.catalog]: configured and running, proceeding with master startup.
I20260927 15:15:53.959466 3073 sys_catalog.cc:455] T 00000000000000000000000000000000 P 49d93dd7b7bb47f09ee5428c54eda52d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "49d93dd7b7bb47f09ee5428c54eda52d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "49d93dd7b7bb47f09ee5428c54eda52d" member_type: VOTER last_known_addr { host: "127.17.136.62" port: 38899 } } }
I20260927 15:15:53.959482 3074 sys_catalog.cc:455] T 00000000000000000000000000000000 P 49d93dd7b7bb47f09ee5428c54eda52d [sys.catalog]: SysCatalogTable state changed. Reason: New leader 49d93dd7b7bb47f09ee5428c54eda52d. Latest consensus state: current_term: 1 leader_uuid: "49d93dd7b7bb47f09ee5428c54eda52d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "49d93dd7b7bb47f09ee5428c54eda52d" member_type: VOTER last_known_addr { host: "127.17.136.62" port: 38899 } } }
I20260927 15:15:53.959640 3073 sys_catalog.cc:458] T 00000000000000000000000000000000 P 49d93dd7b7bb47f09ee5428c54eda52d [sys.catalog]: This master's current role is: LEADER
I20260927 15:15:53.959702 3074 sys_catalog.cc:458] T 00000000000000000000000000000000 P 49d93dd7b7bb47f09ee5428c54eda52d [sys.catalog]: This master's current role is: LEADER
W20260927 15:15:53.962715 3087 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 49d93dd7b7bb47f09ee5428c54eda52d: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260927 15:15:53.962774 3087 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260927 15:15:53.962844 3082 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260927 15:15:53.963641 3082 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260927 15:15:53.968825 3082 catalog_manager.cc:1347] Generated new cluster ID: ba0c26bbd55a43f5ab2463cb0b248cb5
I20260927 15:15:53.968883 3082 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260927 15:15:53.983378 3082 catalog_manager.cc:1370] Generated new certificate authority record
I20260927 15:15:53.984670 3082 catalog_manager.cc:1504] Loading token signing keys...
I20260927 15:15:53.996423 3082 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 49d93dd7b7bb47f09ee5428c54eda52d: Generated new TSK 0
I20260927 15:15:53.997308 3082 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260927 15:15:54.009675 17952 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu
/tmp/dist-test-taskiFOyeW/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790521920546562-17952-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790521920546562-17952-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790521920546562-17952-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790521920546562-17952-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.136.1:0
--local_ip_for_outbound_sockets=127.17.136.1
--webserver_interface=127.17.136.1
--webserver_port=0
--tserver_master_addrs=127.17.136.62:38899
--builtin_ntp_servers=127.17.136.20:43911
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260927 15:15:54.122040 3091 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260927 15:15:54.122308 3091 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260927 15:15:54.122362 3091 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260927 15:15:54.126362 3091 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260927 15:15:54.126415 3091 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260927 15:15:54.126492 3091 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.136.1
I20260927 15:15:54.131167 3091 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.136.20:43911
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790521920546562-17952-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790521920546562-17952-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.136.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790521920546562-17952-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.17.136.1
--webserver_port=0
--tserver_master_addrs=127.17.136.62:38899
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3091
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.136.1
--log_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790521920546562-17952-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 27 Sep 2026 14:27:13 UTC on ccycloud.quasar-psqrth.root.comops.site
build id 4676138
I20260927 15:15:54.132247 3091 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260927 15:15:54.133574 3091 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260927 15:15:54.142709 3097 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260927 15:15:54.142848 3091 server_base.cc:1034] running on GCE node
W20260927 15:15:54.142714 3096 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260927 15:15:54.143029 3099 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260927 15:15:54.143455 3091 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260927 15:15:54.144053 3091 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260927 15:15:54.145201 3091 hybrid_clock.cc:648] HybridClock initialized: now 1790522154145181 us; error 32 us; skew 500 ppm
I20260927 15:15:54.146976 3091 webserver.cc:460] Webserver started at http://127.17.136.1:45663/ using document root <none> and password file <none>
I20260927 15:15:54.147568 3091 fs_manager.cc:359] Metadata directory not provided
I20260927 15:15:54.147632 3091 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260927 15:15:54.147841 3091 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260927 15:15:54.149863 3091 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790521920546562-17952-0/minicluster-data/ts-0/data/instance:
uuid: "95e58d004e7f4793812714a29247574d"
format_stamp: "Formatted at 2026-09-27 15:15:54 on dist-test-slave-5s2t"
server_key: "4646e6a93e7e8188e41302763202931a"
server_key_iv: "54784f56424fabdda4f947455115db92"
server_key_version: "encryptionkey@0"
I20260927 15:15:54.150398 3091 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790521920546562-17952-0/minicluster-data/ts-0/wal/instance:
uuid: "95e58d004e7f4793812714a29247574d"
format_stamp: "Formatted at 2026-09-27 15:15:54 on dist-test-slave-5s2t"
server_key: "4646e6a93e7e8188e41302763202931a"
server_key_iv: "54784f56424fabdda4f947455115db92"
server_key_version: "encryptionkey@0"
I20260927 15:15:54.154029 3091 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.000s sys 0.006s
I20260927 15:15:54.156453 3105 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260927 15:15:54.157663 3091 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260927 15:15:54.157771 3091 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790521920546562-17952-0/minicluster-data/ts-0/data,/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790521920546562-17952-0/minicluster-data/ts-0/wal
uuid: "95e58d004e7f4793812714a29247574d"
format_stamp: "Formatted at 2026-09-27 15:15:54 on dist-test-slave-5s2t"
server_key: "4646e6a93e7e8188e41302763202931a"
server_key_iv: "54784f56424fabdda4f947455115db92"
server_key_version: "encryptionkey@0"
I20260927 15:15:54.157869 3091 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790521920546562-17952-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790521920546562-17952-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790521920546562-17952-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260927 15:15:54.171001 3091 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260927 15:15:54.171715 3091 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260927 15:15:54.171888 3091 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260927 15:15:54.172453 3091 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260927 15:15:54.173364 3091 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260927 15:15:54.173408 3091 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260927 15:15:54.173460 3091 ts_tablet_manager.cc:610] Registered 0 tablets
I20260927 15:15:54.173491 3091 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260927 15:15:54.181525 3091 rpc_server.cc:307] RPC server started. Bound to: 127.17.136.1:33181
I20260927 15:15:54.181553 3218 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.136.1:33181 every 8 connection(s)
I20260927 15:15:54.182370 3091 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790521920546562-17952-0/minicluster-data/ts-0/data/info.pb
I20260927 15:15:54.185874 17952 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu as pid 3091
I20260927 15:15:54.185977 17952 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790521920546562-17952-0/minicluster-data/ts-0/wal/instance
I20260927 15:15:54.186241 17952 external_mini_cluster.cc:1428] Setting key 6c6ccc831454aba2ce39285c1828b930
I20260927 15:15:54.188016 17952 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu
/tmp/dist-test-taskiFOyeW/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790521920546562-17952-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790521920546562-17952-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790521920546562-17952-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790521920546562-17952-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.136.2:0
--local_ip_for_outbound_sockets=127.17.136.2
--webserver_interface=127.17.136.2
--webserver_port=0
--tserver_master_addrs=127.17.136.62:38899
--builtin_ntp_servers=127.17.136.20:43911
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260927 15:15:54.191568 3070 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:15:54.184117 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.136.1:45949 (local address 127.17.136.62:38899)
0927 15:15:54.184252 (+ 135us) server_negotiation.cc:206] Beginning negotiation
0927 15:15:54.184256 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0927 15:15:54.185304 (+ 1048us) server_negotiation.cc:407] Connection header received
0927 15:15:54.186718 (+ 1414us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:15:54.186721 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:15:54.186778 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:15:54.186853 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0927 15:15:54.187758 (+ 905us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:15:54.188329 (+ 571us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:15:54.189709 (+ 1380us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:15:54.189952 (+ 243us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:15:54.190035 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:15:54.191098 (+ 1063us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0927 15:15:54.191102 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0927 15:15:54.191105 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0927 15:15:54.191117 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0927 15:15:54.191139 (+ 22us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0927 15:15:54.191149 (+ 10us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0927 15:15:54.191214 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0927 15:15:54.191367 (+ 153us) server_negotiation.cc:299] Negotiation successful
0927 15:15:54.191430 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260927 15:15:54.192471 3221 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:15:54.184533 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.62:38899 (local address 127.17.136.1:45949)
0927 15:15:54.185156 (+ 623us) negotiation.cc:107] Waiting for socket to connect
0927 15:15:54.185196 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0927 15:15:54.186519 (+ 1323us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0927 15:15:54.187035 (+ 516us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0927 15:15:54.187042 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0927 15:15:54.187126 (+ 84us) client_negotiation.cc:189] Negotiated authn=SASL
0927 15:15:54.187635 (+ 509us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:15:54.187648 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:15:54.188440 (+ 792us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:15:54.188443 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:15:54.189589 (+ 1146us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:15:54.189600 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:15:54.190095 (+ 495us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:15:54.190099 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:15:54.190241 (+ 142us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:15:54.190834 (+ 593us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0927 15:15:54.190836 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0927 15:15:54.190886 (+ 50us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0927 15:15:54.190951 (+ 65us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0927 15:15:54.191224 (+ 273us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0927 15:15:54.191228 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0927 15:15:54.191232 (+ 4us) client_negotiation.cc:769] Sending connection context
0927 15:15:54.191359 (+ 127us) client_negotiation.cc:240] Negotiation successful
0927 15:15:54.191588 (+ 229us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":246,"thread_start_us":104,"threads_started":1}
I20260927 15:15:54.193619 3219 heartbeater.cc:347] Connected to a master server at 127.17.136.62:38899
I20260927 15:15:54.193840 3219 heartbeater.cc:464] Registering TS with master...
I20260927 15:15:54.194327 3219 heartbeater.cc:511] Master 127.17.136.62:38899 requested a full tablet report, sending...
I20260927 15:15:54.195937 3031 ts_manager.cc:194] Registered new tserver with Master: 95e58d004e7f4793812714a29247574d (127.17.136.1:33181)
I20260927 15:15:54.197537 3031 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.17.136.1:45949
W20260927 15:15:54.295035 3222 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260927 15:15:54.295307 3222 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260927 15:15:54.295346 3222 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260927 15:15:54.299211 3222 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260927 15:15:54.299274 3222 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260927 15:15:54.299347 3222 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.136.2
I20260927 15:15:54.304070 3222 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.136.20:43911
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790521920546562-17952-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790521920546562-17952-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.136.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790521920546562-17952-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.17.136.2
--webserver_port=0
--tserver_master_addrs=127.17.136.62:38899
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3222
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.136.2
--log_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790521920546562-17952-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 27 Sep 2026 14:27:13 UTC on ccycloud.quasar-psqrth.root.comops.site
build id 4676138
I20260927 15:15:54.305083 3222 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260927 15:15:54.306394 3222 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260927 15:15:54.315536 3227 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260927 15:15:54.315557 3228 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260927 15:15:54.315563 3230 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260927 15:15:54.316002 3222 server_base.cc:1034] running on GCE node
I20260927 15:15:54.316479 3222 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260927 15:15:54.317266 3222 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260927 15:15:54.318457 3222 hybrid_clock.cc:648] HybridClock initialized: now 1790522154318430 us; error 38 us; skew 500 ppm
I20260927 15:15:54.320652 3222 webserver.cc:460] Webserver started at http://127.17.136.2:38151/ using document root <none> and password file <none>
I20260927 15:15:54.321175 3222 fs_manager.cc:359] Metadata directory not provided
I20260927 15:15:54.321250 3222 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260927 15:15:54.321491 3222 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260927 15:15:54.323588 3222 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790521920546562-17952-0/minicluster-data/ts-1/data/instance:
uuid: "91fb947b77d947c6be839adc443087a0"
format_stamp: "Formatted at 2026-09-27 15:15:54 on dist-test-slave-5s2t"
server_key: "2de62351c133f68c27492fe09949b950"
server_key_iv: "c5462440e3005c3bf27c993ca0604663"
server_key_version: "encryptionkey@0"
I20260927 15:15:54.324113 3222 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790521920546562-17952-0/minicluster-data/ts-1/wal/instance:
uuid: "91fb947b77d947c6be839adc443087a0"
format_stamp: "Formatted at 2026-09-27 15:15:54 on dist-test-slave-5s2t"
server_key: "2de62351c133f68c27492fe09949b950"
server_key_iv: "c5462440e3005c3bf27c993ca0604663"
server_key_version: "encryptionkey@0"
I20260927 15:15:54.327636 3222 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260927 15:15:54.329964 3236 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260927 15:15:54.331130 3222 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260927 15:15:54.331234 3222 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790521920546562-17952-0/minicluster-data/ts-1/data,/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790521920546562-17952-0/minicluster-data/ts-1/wal
uuid: "91fb947b77d947c6be839adc443087a0"
format_stamp: "Formatted at 2026-09-27 15:15:54 on dist-test-slave-5s2t"
server_key: "2de62351c133f68c27492fe09949b950"
server_key_iv: "c5462440e3005c3bf27c993ca0604663"
server_key_version: "encryptionkey@0"
I20260927 15:15:54.331367 3222 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790521920546562-17952-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790521920546562-17952-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790521920546562-17952-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260927 15:15:54.357851 3222 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260927 15:15:54.358634 3222 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260927 15:15:54.358817 3222 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260927 15:15:54.359519 3222 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260927 15:15:54.360546 3222 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260927 15:15:54.360592 3222 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260927 15:15:54.360647 3222 ts_tablet_manager.cc:610] Registered 0 tablets
I20260927 15:15:54.360673 3222 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260927 15:15:54.369274 3222 rpc_server.cc:307] RPC server started. Bound to: 127.17.136.2:38321
I20260927 15:15:54.369316 3349 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.136.2:38321 every 8 connection(s)
I20260927 15:15:54.370150 3222 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790521920546562-17952-0/minicluster-data/ts-1/data/info.pb
I20260927 15:15:54.374733 17952 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu as pid 3222
I20260927 15:15:54.374866 17952 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790521920546562-17952-0/minicluster-data/ts-1/wal/instance
I20260927 15:15:54.375224 17952 external_mini_cluster.cc:1428] Setting key 07cc097beb19dca60d6305cab363937a
I20260927 15:15:54.377437 17952 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu
/tmp/dist-test-taskiFOyeW/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790521920546562-17952-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790521920546562-17952-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790521920546562-17952-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790521920546562-17952-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.136.3:0
--local_ip_for_outbound_sockets=127.17.136.3
--webserver_interface=127.17.136.3
--webserver_port=0
--tserver_master_addrs=127.17.136.62:38899
--builtin_ntp_servers=127.17.136.20:43911
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260927 15:15:54.380249 3070 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:15:54.372137 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.136.2:55535 (local address 127.17.136.62:38899)
0927 15:15:54.372292 (+ 155us) server_negotiation.cc:206] Beginning negotiation
0927 15:15:54.372296 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0927 15:15:54.373349 (+ 1053us) server_negotiation.cc:407] Connection header received
0927 15:15:54.374731 (+ 1382us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:15:54.374736 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:15:54.374800 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:15:54.374908 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0927 15:15:54.376117 (+ 1209us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:15:54.376783 (+ 666us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:15:54.378084 (+ 1301us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:15:54.378399 (+ 315us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:15:54.378508 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:15:54.379820 (+ 1312us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0927 15:15:54.379823 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0927 15:15:54.379825 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0927 15:15:54.379838 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0927 15:15:54.379858 (+ 20us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0927 15:15:54.379865 (+ 7us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0927 15:15:54.379930 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0927 15:15:54.380077 (+ 147us) server_negotiation.cc:299] Negotiation successful
0927 15:15:54.380130 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260927 15:15:54.381382 3352 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:15:54.372532 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.62:38899 (local address 127.17.136.2:55535)
0927 15:15:54.373190 (+ 658us) negotiation.cc:107] Waiting for socket to connect
0927 15:15:54.373231 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0927 15:15:54.374487 (+ 1256us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0927 15:15:54.375134 (+ 647us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0927 15:15:54.375141 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0927 15:15:54.375232 (+ 91us) client_negotiation.cc:189] Negotiated authn=SASL
0927 15:15:54.375966 (+ 734us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:15:54.375986 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:15:54.376909 (+ 923us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:15:54.376912 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:15:54.377954 (+ 1042us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:15:54.377963 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:15:54.378590 (+ 627us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:15:54.378596 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:15:54.378802 (+ 206us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:15:54.379483 (+ 681us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0927 15:15:54.379485 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0927 15:15:54.379541 (+ 56us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0927 15:15:54.379640 (+ 99us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0927 15:15:54.379945 (+ 305us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0927 15:15:54.379953 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0927 15:15:54.379959 (+ 6us) client_negotiation.cc:769] Sending connection context
0927 15:15:54.380080 (+ 121us) client_negotiation.cc:240] Negotiation successful
0927 15:15:54.380378 (+ 298us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":259,"thread_start_us":111,"threads_started":1}
I20260927 15:15:54.382524 3350 heartbeater.cc:347] Connected to a master server at 127.17.136.62:38899
I20260927 15:15:54.382788 3350 heartbeater.cc:464] Registering TS with master...
I20260927 15:15:54.383478 3350 heartbeater.cc:511] Master 127.17.136.62:38899 requested a full tablet report, sending...
I20260927 15:15:54.384591 3031 ts_manager.cc:194] Registered new tserver with Master: 91fb947b77d947c6be839adc443087a0 (127.17.136.2:38321)
I20260927 15:15:54.385139 3031 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.17.136.2:55535
W20260927 15:15:54.486043 3353 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260927 15:15:54.486306 3353 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260927 15:15:54.486361 3353 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260927 15:15:54.490368 3353 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260927 15:15:54.490428 3353 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260927 15:15:54.490504 3353 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.136.3
I20260927 15:15:54.495221 3353 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.136.20:43911
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790521920546562-17952-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790521920546562-17952-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.136.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790521920546562-17952-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.17.136.3
--webserver_port=0
--tserver_master_addrs=127.17.136.62:38899
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3353
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.136.3
--log_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790521920546562-17952-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 27 Sep 2026 14:27:13 UTC on ccycloud.quasar-psqrth.root.comops.site
build id 4676138
I20260927 15:15:54.496332 3353 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260927 15:15:54.497684 3353 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260927 15:15:54.507032 3358 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260927 15:15:54.507007 3359 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260927 15:15:54.507102 3353 server_base.cc:1034] running on GCE node
W20260927 15:15:54.507000 3361 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260927 15:15:54.507660 3353 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260927 15:15:54.508229 3353 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260927 15:15:54.509402 3353 hybrid_clock.cc:648] HybridClock initialized: now 1790522154509372 us; error 39 us; skew 500 ppm
I20260927 15:15:54.511188 3353 webserver.cc:460] Webserver started at http://127.17.136.3:32793/ using document root <none> and password file <none>
I20260927 15:15:54.511818 3353 fs_manager.cc:359] Metadata directory not provided
I20260927 15:15:54.511902 3353 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260927 15:15:54.512117 3353 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260927 15:15:54.514062 3353 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790521920546562-17952-0/minicluster-data/ts-2/data/instance:
uuid: "47fe6c51065b48a7aa94b491a76e7149"
format_stamp: "Formatted at 2026-09-27 15:15:54 on dist-test-slave-5s2t"
server_key: "f0a7aae0f8c2c20e3221c1bf1f21f41b"
server_key_iv: "b32677b835545aabc25910eb330fc227"
server_key_version: "encryptionkey@0"
I20260927 15:15:54.514541 3353 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790521920546562-17952-0/minicluster-data/ts-2/wal/instance:
uuid: "47fe6c51065b48a7aa94b491a76e7149"
format_stamp: "Formatted at 2026-09-27 15:15:54 on dist-test-slave-5s2t"
server_key: "f0a7aae0f8c2c20e3221c1bf1f21f41b"
server_key_iv: "b32677b835545aabc25910eb330fc227"
server_key_version: "encryptionkey@0"
I20260927 15:15:54.518101 3353 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.006s sys 0.000s
I20260927 15:15:54.520404 3367 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260927 15:15:54.521540 3353 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260927 15:15:54.521639 3353 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790521920546562-17952-0/minicluster-data/ts-2/data,/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790521920546562-17952-0/minicluster-data/ts-2/wal
uuid: "47fe6c51065b48a7aa94b491a76e7149"
format_stamp: "Formatted at 2026-09-27 15:15:54 on dist-test-slave-5s2t"
server_key: "f0a7aae0f8c2c20e3221c1bf1f21f41b"
server_key_iv: "b32677b835545aabc25910eb330fc227"
server_key_version: "encryptionkey@0"
I20260927 15:15:54.521725 3353 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790521920546562-17952-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790521920546562-17952-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790521920546562-17952-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260927 15:15:54.546845 3353 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260927 15:15:54.547602 3353 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260927 15:15:54.547756 3353 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260927 15:15:54.548321 3353 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260927 15:15:54.549252 3353 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260927 15:15:54.549296 3353 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260927 15:15:54.549335 3353 ts_tablet_manager.cc:610] Registered 0 tablets
I20260927 15:15:54.549352 3353 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260927 15:15:54.557415 3353 rpc_server.cc:307] RPC server started. Bound to: 127.17.136.3:46367
I20260927 15:15:54.557447 3480 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.136.3:46367 every 8 connection(s)
I20260927 15:15:54.558279 3353 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790521920546562-17952-0/minicluster-data/ts-2/data/info.pb
I20260927 15:15:54.563936 17952 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu as pid 3353
I20260927 15:15:54.564025 17952 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790521920546562-17952-0/minicluster-data/ts-2/wal/instance
I20260927 15:15:54.564299 17952 external_mini_cluster.cc:1428] Setting key da8d80cad2e8e824180beb95350bde31
I20260927 15:15:54.567373 3070 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:15:54.559993 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.136.3:49711 (local address 127.17.136.62:38899)
0927 15:15:54.560126 (+ 133us) server_negotiation.cc:206] Beginning negotiation
0927 15:15:54.560132 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0927 15:15:54.561279 (+ 1147us) server_negotiation.cc:407] Connection header received
0927 15:15:54.562600 (+ 1321us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:15:54.562602 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:15:54.562648 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:15:54.562719 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0927 15:15:54.563577 (+ 858us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:15:54.564142 (+ 565us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:15:54.565573 (+ 1431us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:15:54.565890 (+ 317us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:15:54.565990 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:15:54.566978 (+ 988us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0927 15:15:54.566981 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0927 15:15:54.566983 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0927 15:15:54.566995 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0927 15:15:54.567012 (+ 17us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0927 15:15:54.567020 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0927 15:15:54.567072 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0927 15:15:54.567169 (+ 97us) server_negotiation.cc:299] Negotiation successful
0927 15:15:54.567215 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260927 15:15:54.568138 3483 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:15:54.560480 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.62:38899 (local address 127.17.136.3:49711)
0927 15:15:54.561118 (+ 638us) negotiation.cc:107] Waiting for socket to connect
0927 15:15:54.561155 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0927 15:15:54.562427 (+ 1272us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0927 15:15:54.562862 (+ 435us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0927 15:15:54.562868 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0927 15:15:54.562947 (+ 79us) client_negotiation.cc:189] Negotiated authn=SASL
0927 15:15:54.563475 (+ 528us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:15:54.563488 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:15:54.564263 (+ 775us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:15:54.564266 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:15:54.565469 (+ 1203us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:15:54.565478 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:15:54.566015 (+ 537us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:15:54.566017 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:15:54.566204 (+ 187us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:15:54.566762 (+ 558us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0927 15:15:54.566763 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0927 15:15:54.566802 (+ 39us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0927 15:15:54.566859 (+ 57us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0927 15:15:54.567079 (+ 220us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0927 15:15:54.567083 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0927 15:15:54.567086 (+ 3us) client_negotiation.cc:769] Sending connection context
0927 15:15:54.567189 (+ 103us) client_negotiation.cc:240] Negotiation successful
0927 15:15:54.567434 (+ 245us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":231,"thread_start_us":103,"threads_started":1}
I20260927 15:15:54.569056 3481 heartbeater.cc:347] Connected to a master server at 127.17.136.62:38899
I20260927 15:15:54.569244 3481 heartbeater.cc:464] Registering TS with master...
I20260927 15:15:54.569650 3481 heartbeater.cc:511] Master 127.17.136.62:38899 requested a full tablet report, sending...
I20260927 15:15:54.570616 3031 ts_manager.cc:194] Registered new tserver with Master: 47fe6c51065b48a7aa94b491a76e7149 (127.17.136.3:46367)
I20260927 15:15:54.571146 3031 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.17.136.3:49711
I20260927 15:15:54.577741 17952 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260927 15:15:54.582924 3070 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:15:54.579485 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39098 (local address 127.17.136.62:38899)
0927 15:15:54.579599 (+ 114us) server_negotiation.cc:206] Beginning negotiation
0927 15:15:54.579603 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0927 15:15:54.579762 (+ 159us) server_negotiation.cc:407] Connection header received
0927 15:15:54.579868 (+ 106us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:15:54.579871 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:15:54.579911 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:15:54.579970 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0927 15:15:54.580244 (+ 274us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:15:54.580736 (+ 492us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:15:54.581539 (+ 803us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:15:54.581749 (+ 210us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:15:54.581830 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:15:54.582555 (+ 725us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0927 15:15:54.582559 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0927 15:15:54.582561 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0927 15:15:54.582573 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0927 15:15:54.582590 (+ 17us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0927 15:15:54.582598 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0927 15:15:54.582653 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0927 15:15:54.582746 (+ 93us) server_negotiation.cc:299] Negotiation successful
0927 15:15:54.582796 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260927 15:15:54.585325 3031 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39098:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:15:54.588135 3031 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:15:54.602226 3495 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:15:54.597031 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57550 (local address 127.17.136.3:46367)
0927 15:15:54.597653 (+ 622us) server_negotiation.cc:206] Beginning negotiation
0927 15:15:54.597662 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0927 15:15:54.597680 (+ 18us) server_negotiation.cc:407] Connection header received
0927 15:15:54.597741 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:15:54.597745 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:15:54.597877 (+ 132us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:15:54.598001 (+ 124us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0927 15:15:54.598205 (+ 204us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:15:54.599018 (+ 813us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:15:54.600903 (+ 1885us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:15:54.601583 (+ 680us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:15:54.601721 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:15:54.601853 (+ 132us) server_negotiation.cc:1035] Waiting for connection context
0927 15:15:54.601966 (+ 113us) server_negotiation.cc:299] Negotiation successful
0927 15:15:54.602057 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":530,"thread_start_us":153,"threads_started":1}
I20260927 15:15:54.602224 3494 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:15:54.596853 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.3:46367 (local address 127.0.0.1:57550)
0927 15:15:54.597386 (+ 533us) negotiation.cc:107] Waiting for socket to connect
0927 15:15:54.597399 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0927 15:15:54.597485 (+ 86us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0927 15:15:54.597997 (+ 512us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0927 15:15:54.598000 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0927 15:15:54.598016 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0927 15:15:54.598102 (+ 86us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:15:54.598108 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:15:54.599120 (+ 1012us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:15:54.599123 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:15:54.600789 (+ 1666us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:15:54.600800 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:15:54.601689 (+ 889us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:15:54.601692 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:15:54.601808 (+ 116us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:15:54.601826 (+ 18us) client_negotiation.cc:769] Sending connection context
0927 15:15:54.601907 (+ 81us) client_negotiation.cc:240] Negotiation successful
0927 15:15:54.602068 (+ 161us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":471,"mutex_wait_us":138,"thread_start_us":86,"threads_started":1}
I20260927 15:15:54.603099 3492 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:15:54.596139 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.2:38321 (local address 127.0.0.1:41814)
0927 15:15:54.596461 (+ 322us) negotiation.cc:107] Waiting for socket to connect
0927 15:15:54.596504 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0927 15:15:54.596619 (+ 115us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0927 15:15:54.597373 (+ 754us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0927 15:15:54.597379 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0927 15:15:54.597403 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0927 15:15:54.597913 (+ 510us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:15:54.597921 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:15:54.599299 (+ 1378us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:15:54.599302 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:15:54.600793 (+ 1491us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:15:54.600800 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:15:54.602738 (+ 1938us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:15:54.602742 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:15:54.602835 (+ 93us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:15:54.602858 (+ 23us) client_negotiation.cc:769] Sending connection context
0927 15:15:54.602914 (+ 56us) client_negotiation.cc:240] Negotiation successful
0927 15:15:54.602978 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":164,"mutex_wait_us":140,"thread_start_us":73,"threads_started":1}
I20260927 15:15:54.603174 3493 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:15:54.596303 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41814 (local address 127.17.136.2:38321)
0927 15:15:54.596595 (+ 292us) server_negotiation.cc:206] Beginning negotiation
0927 15:15:54.596607 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0927 15:15:54.596634 (+ 27us) server_negotiation.cc:407] Connection header received
0927 15:15:54.596819 (+ 185us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:15:54.596825 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:15:54.597046 (+ 221us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:15:54.597192 (+ 146us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0927 15:15:54.598033 (+ 841us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:15:54.599186 (+ 1153us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:15:54.601879 (+ 2693us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:15:54.602629 (+ 750us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:15:54.602730 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:15:54.602891 (+ 161us) server_negotiation.cc:1035] Waiting for connection context
0927 15:15:54.602935 (+ 44us) server_negotiation.cc:299] Negotiation successful
0927 15:15:54.603016 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":195,"thread_start_us":100,"threads_started":1}
I20260927 15:15:54.602224 3496 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:15:54.597139 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.1:33181 (local address 127.0.0.1:41584)
0927 15:15:54.597462 (+ 323us) negotiation.cc:107] Waiting for socket to connect
0927 15:15:54.597474 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0927 15:15:54.597551 (+ 77us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0927 15:15:54.598297 (+ 746us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0927 15:15:54.598300 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0927 15:15:54.598318 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0927 15:15:54.598398 (+ 80us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:15:54.598403 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:15:54.599652 (+ 1249us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:15:54.599655 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:15:54.600639 (+ 984us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:15:54.600648 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:15:54.601614 (+ 966us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:15:54.601616 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:15:54.601748 (+ 132us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:15:54.601811 (+ 63us) client_negotiation.cc:769] Sending connection context
0927 15:15:54.601913 (+ 102us) client_negotiation.cc:240] Negotiation successful
0927 15:15:54.602068 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":269,"mutex_wait_us":141,"thread_start_us":114,"threads_started":1}
I20260927 15:15:54.604378 3497 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:15:54.597557 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41584 (local address 127.17.136.1:33181)
0927 15:15:54.597865 (+ 308us) server_negotiation.cc:206] Beginning negotiation
0927 15:15:54.597880 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0927 15:15:54.597901 (+ 21us) server_negotiation.cc:407] Connection header received
0927 15:15:54.597974 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:15:54.597979 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:15:54.598157 (+ 178us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:15:54.598307 (+ 150us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0927 15:15:54.598500 (+ 193us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:15:54.599548 (+ 1048us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:15:54.600748 (+ 1200us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:15:54.601511 (+ 763us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:15:54.601619 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:15:54.601812 (+ 193us) server_negotiation.cc:1035] Waiting for connection context
0927 15:15:54.604121 (+ 2309us) server_negotiation.cc:299] Negotiation successful
0927 15:15:54.604229 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":218,"thread_start_us":117,"threads_started":1}
I20260927 15:15:54.605209 3415 tablet_service.cc:1467] Processing CreateTablet for tablet 17f2cd91e71f49ac97314cc757f3c91b (DEFAULT_TABLE table=test-table [id=d1eb57039ef74283a59140e62488e285]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:15:54.605612 3284 tablet_service.cc:1467] Processing CreateTablet for tablet 17f2cd91e71f49ac97314cc757f3c91b (DEFAULT_TABLE table=test-table [id=d1eb57039ef74283a59140e62488e285]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:15:54.606148 3415 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 17f2cd91e71f49ac97314cc757f3c91b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:15:54.606581 3284 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 17f2cd91e71f49ac97314cc757f3c91b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:15:54.607031 3153 tablet_service.cc:1467] Processing CreateTablet for tablet 17f2cd91e71f49ac97314cc757f3c91b (DEFAULT_TABLE table=test-table [id=d1eb57039ef74283a59140e62488e285]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:15:54.607965 3153 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 17f2cd91e71f49ac97314cc757f3c91b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:15:54.612176 3498 tablet_bootstrap.cc:492] T 17f2cd91e71f49ac97314cc757f3c91b P 47fe6c51065b48a7aa94b491a76e7149: Bootstrap starting.
I20260927 15:15:54.613554 3499 tablet_bootstrap.cc:492] T 17f2cd91e71f49ac97314cc757f3c91b P 91fb947b77d947c6be839adc443087a0: Bootstrap starting.
I20260927 15:15:54.614331 3498 tablet_bootstrap.cc:654] T 17f2cd91e71f49ac97314cc757f3c91b P 47fe6c51065b48a7aa94b491a76e7149: Neither blocks nor log segments found. Creating new log.
I20260927 15:15:54.614394 3500 tablet_bootstrap.cc:492] T 17f2cd91e71f49ac97314cc757f3c91b P 95e58d004e7f4793812714a29247574d: Bootstrap starting.
I20260927 15:15:54.615289 3498 log.cc:824] T 17f2cd91e71f49ac97314cc757f3c91b P 47fe6c51065b48a7aa94b491a76e7149: Log is configured to *not* fsync() on all Append() calls
I20260927 15:15:54.615617 3499 tablet_bootstrap.cc:654] T 17f2cd91e71f49ac97314cc757f3c91b P 91fb947b77d947c6be839adc443087a0: Neither blocks nor log segments found. Creating new log.
I20260927 15:15:54.616298 3500 tablet_bootstrap.cc:654] T 17f2cd91e71f49ac97314cc757f3c91b P 95e58d004e7f4793812714a29247574d: Neither blocks nor log segments found. Creating new log.
I20260927 15:15:54.616410 3499 log.cc:824] T 17f2cd91e71f49ac97314cc757f3c91b P 91fb947b77d947c6be839adc443087a0: Log is configured to *not* fsync() on all Append() calls
I20260927 15:15:54.617044 3500 log.cc:824] T 17f2cd91e71f49ac97314cc757f3c91b P 95e58d004e7f4793812714a29247574d: Log is configured to *not* fsync() on all Append() calls
I20260927 15:15:54.617421 3498 tablet_bootstrap.cc:492] T 17f2cd91e71f49ac97314cc757f3c91b P 47fe6c51065b48a7aa94b491a76e7149: No bootstrap required, opened a new log
I20260927 15:15:54.617599 3498 ts_tablet_manager.cc:1397] T 17f2cd91e71f49ac97314cc757f3c91b P 47fe6c51065b48a7aa94b491a76e7149: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260927 15:15:54.618136 3499 tablet_bootstrap.cc:492] T 17f2cd91e71f49ac97314cc757f3c91b P 91fb947b77d947c6be839adc443087a0: No bootstrap required, opened a new log
I20260927 15:15:54.618326 3499 ts_tablet_manager.cc:1397] T 17f2cd91e71f49ac97314cc757f3c91b P 91fb947b77d947c6be839adc443087a0: Time spent bootstrapping tablet: real 0.005s user 0.003s sys 0.000s
I20260927 15:15:54.618820 3500 tablet_bootstrap.cc:492] T 17f2cd91e71f49ac97314cc757f3c91b P 95e58d004e7f4793812714a29247574d: No bootstrap required, opened a new log
I20260927 15:15:54.618979 3500 ts_tablet_manager.cc:1397] T 17f2cd91e71f49ac97314cc757f3c91b P 95e58d004e7f4793812714a29247574d: Time spent bootstrapping tablet: real 0.005s user 0.003s sys 0.000s
I20260927 15:15:54.620715 3498 raft_consensus.cc:348] T 17f2cd91e71f49ac97314cc757f3c91b P 47fe6c51065b48a7aa94b491a76e7149 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91fb947b77d947c6be839adc443087a0" member_type: VOTER last_known_addr { host: "127.17.136.2" port: 38321 } } peers { permanent_uuid: "47fe6c51065b48a7aa94b491a76e7149" member_type: VOTER last_known_addr { host: "127.17.136.3" port: 46367 } } peers { permanent_uuid: "95e58d004e7f4793812714a29247574d" member_type: VOTER last_known_addr { host: "127.17.136.1" port: 33181 } }
I20260927 15:15:54.620910 3498 raft_consensus.cc:374] T 17f2cd91e71f49ac97314cc757f3c91b P 47fe6c51065b48a7aa94b491a76e7149 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:15:54.620959 3498 raft_consensus.cc:729] T 17f2cd91e71f49ac97314cc757f3c91b P 47fe6c51065b48a7aa94b491a76e7149 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 47fe6c51065b48a7aa94b491a76e7149, State: Initialized, Role: FOLLOWER
I20260927 15:15:54.621352 3498 consensus_queue.cc:260] T 17f2cd91e71f49ac97314cc757f3c91b P 47fe6c51065b48a7aa94b491a76e7149 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91fb947b77d947c6be839adc443087a0" member_type: VOTER last_known_addr { host: "127.17.136.2" port: 38321 } } peers { permanent_uuid: "47fe6c51065b48a7aa94b491a76e7149" member_type: VOTER last_known_addr { host: "127.17.136.3" port: 46367 } } peers { permanent_uuid: "95e58d004e7f4793812714a29247574d" member_type: VOTER last_known_addr { host: "127.17.136.1" port: 33181 } }
I20260927 15:15:54.622290 3498 ts_tablet_manager.cc:1428] T 17f2cd91e71f49ac97314cc757f3c91b P 47fe6c51065b48a7aa94b491a76e7149: Time spent starting tablet: real 0.005s user 0.005s sys 0.000s
I20260927 15:15:54.622488 3481 heartbeater.cc:503] Master 127.17.136.62:38899 was elected leader, sending a full tablet report...
I20260927 15:15:54.622421 3499 raft_consensus.cc:348] T 17f2cd91e71f49ac97314cc757f3c91b P 91fb947b77d947c6be839adc443087a0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91fb947b77d947c6be839adc443087a0" member_type: VOTER last_known_addr { host: "127.17.136.2" port: 38321 } } peers { permanent_uuid: "47fe6c51065b48a7aa94b491a76e7149" member_type: VOTER last_known_addr { host: "127.17.136.3" port: 46367 } } peers { permanent_uuid: "95e58d004e7f4793812714a29247574d" member_type: VOTER last_known_addr { host: "127.17.136.1" port: 33181 } }
I20260927 15:15:54.622665 3499 raft_consensus.cc:374] T 17f2cd91e71f49ac97314cc757f3c91b P 91fb947b77d947c6be839adc443087a0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:15:54.622726 3499 raft_consensus.cc:729] T 17f2cd91e71f49ac97314cc757f3c91b P 91fb947b77d947c6be839adc443087a0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 91fb947b77d947c6be839adc443087a0, State: Initialized, Role: FOLLOWER
I20260927 15:15:54.622885 3500 raft_consensus.cc:348] T 17f2cd91e71f49ac97314cc757f3c91b P 95e58d004e7f4793812714a29247574d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91fb947b77d947c6be839adc443087a0" member_type: VOTER last_known_addr { host: "127.17.136.2" port: 38321 } } peers { permanent_uuid: "47fe6c51065b48a7aa94b491a76e7149" member_type: VOTER last_known_addr { host: "127.17.136.3" port: 46367 } } peers { permanent_uuid: "95e58d004e7f4793812714a29247574d" member_type: VOTER last_known_addr { host: "127.17.136.1" port: 33181 } }
I20260927 15:15:54.623108 3500 raft_consensus.cc:374] T 17f2cd91e71f49ac97314cc757f3c91b P 95e58d004e7f4793812714a29247574d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:15:54.623158 3500 raft_consensus.cc:729] T 17f2cd91e71f49ac97314cc757f3c91b P 95e58d004e7f4793812714a29247574d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95e58d004e7f4793812714a29247574d, State: Initialized, Role: FOLLOWER
I20260927 15:15:54.623121 3499 consensus_queue.cc:260] T 17f2cd91e71f49ac97314cc757f3c91b P 91fb947b77d947c6be839adc443087a0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91fb947b77d947c6be839adc443087a0" member_type: VOTER last_known_addr { host: "127.17.136.2" port: 38321 } } peers { permanent_uuid: "47fe6c51065b48a7aa94b491a76e7149" member_type: VOTER last_known_addr { host: "127.17.136.3" port: 46367 } } peers { permanent_uuid: "95e58d004e7f4793812714a29247574d" member_type: VOTER last_known_addr { host: "127.17.136.1" port: 33181 } }
I20260927 15:15:54.623565 3500 consensus_queue.cc:260] T 17f2cd91e71f49ac97314cc757f3c91b P 95e58d004e7f4793812714a29247574d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91fb947b77d947c6be839adc443087a0" member_type: VOTER last_known_addr { host: "127.17.136.2" port: 38321 } } peers { permanent_uuid: "47fe6c51065b48a7aa94b491a76e7149" member_type: VOTER last_known_addr { host: "127.17.136.3" port: 46367 } } peers { permanent_uuid: "95e58d004e7f4793812714a29247574d" member_type: VOTER last_known_addr { host: "127.17.136.1" port: 33181 } }
I20260927 15:15:54.624153 3219 heartbeater.cc:503] Master 127.17.136.62:38899 was elected leader, sending a full tablet report...
I20260927 15:15:54.624399 3500 ts_tablet_manager.cc:1428] T 17f2cd91e71f49ac97314cc757f3c91b P 95e58d004e7f4793812714a29247574d: Time spent starting tablet: real 0.005s user 0.003s sys 0.003s
I20260927 15:15:54.624030 3499 ts_tablet_manager.cc:1428] T 17f2cd91e71f49ac97314cc757f3c91b P 91fb947b77d947c6be839adc443087a0: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20260927 15:15:54.625264 3350 heartbeater.cc:503] Master 127.17.136.62:38899 was elected leader, sending a full tablet report...
I20260927 15:15:54.662693 3504 raft_consensus.cc:482] T 17f2cd91e71f49ac97314cc757f3c91b P 47fe6c51065b48a7aa94b491a76e7149 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:15:54.662900 3504 raft_consensus.cc:504] T 17f2cd91e71f49ac97314cc757f3c91b P 47fe6c51065b48a7aa94b491a76e7149 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91fb947b77d947c6be839adc443087a0" member_type: VOTER last_known_addr { host: "127.17.136.2" port: 38321 } } peers { permanent_uuid: "47fe6c51065b48a7aa94b491a76e7149" member_type: VOTER last_known_addr { host: "127.17.136.3" port: 46367 } } peers { permanent_uuid: "95e58d004e7f4793812714a29247574d" member_type: VOTER last_known_addr { host: "127.17.136.1" port: 33181 } }
I20260927 15:15:54.664050 3504 leader_election.cc:288] T 17f2cd91e71f49ac97314cc757f3c91b P 47fe6c51065b48a7aa94b491a76e7149 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 91fb947b77d947c6be839adc443087a0 (127.17.136.2:38321), 95e58d004e7f4793812714a29247574d (127.17.136.1:33181)
I20260927 15:15:54.667692 3483 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:15:54.664268 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.2:38321 (local address 127.17.136.3:42327)
0927 15:15:54.664377 (+ 109us) negotiation.cc:107] Waiting for socket to connect
0927 15:15:54.664392 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0927 15:15:54.664489 (+ 97us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0927 15:15:54.664820 (+ 331us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0927 15:15:54.664822 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0927 15:15:54.664838 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0927 15:15:54.664940 (+ 102us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:15:54.664947 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:15:54.665789 (+ 842us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:15:54.665793 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:15:54.666649 (+ 856us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:15:54.666659 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:15:54.667298 (+ 639us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:15:54.667302 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:15:54.667399 (+ 97us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:15:54.667424 (+ 25us) client_negotiation.cc:769] Sending connection context
0927 15:15:54.667494 (+ 70us) client_negotiation.cc:240] Negotiation successful
0927 15:15:54.667562 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":30}
I20260927 15:15:54.667734 3493 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:15:54.664355 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.136.3:42327 (local address 127.17.136.2:38321)
0927 15:15:54.664478 (+ 123us) server_negotiation.cc:206] Beginning negotiation
0927 15:15:54.664482 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0927 15:15:54.664496 (+ 14us) server_negotiation.cc:407] Connection header received
0927 15:15:54.664573 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:15:54.664576 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:15:54.664620 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:15:54.664679 (+ 59us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0927 15:15:54.665057 (+ 378us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:15:54.665682 (+ 625us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:15:54.666764 (+ 1082us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:15:54.667175 (+ 411us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:15:54.667300 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:15:54.667341 (+ 41us) server_negotiation.cc:1035] Waiting for connection context
0927 15:15:54.667515 (+ 174us) server_negotiation.cc:299] Negotiation successful
0927 15:15:54.667588 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260927 15:15:54.667798 3497 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:15:54.664629 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.136.3:45951 (local address 127.17.136.1:33181)
0927 15:15:54.664759 (+ 130us) server_negotiation.cc:206] Beginning negotiation
0927 15:15:54.664764 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0927 15:15:54.664925 (+ 161us) server_negotiation.cc:407] Connection header received
0927 15:15:54.665011 (+ 86us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:15:54.665015 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:15:54.665064 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:15:54.665123 (+ 59us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0927 15:15:54.665379 (+ 256us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:15:54.665900 (+ 521us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:15:54.666889 (+ 989us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:15:54.667315 (+ 426us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:15:54.667420 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:15:54.667460 (+ 40us) server_negotiation.cc:1035] Waiting for connection context
0927 15:15:54.667630 (+ 170us) server_negotiation.cc:299] Negotiation successful
0927 15:15:54.667695 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260927 15:15:54.668001 3507 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:15:54.664525 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.1:33181 (local address 127.17.136.3:45951)
0927 15:15:54.664842 (+ 317us) negotiation.cc:107] Waiting for socket to connect
0927 15:15:54.664853 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0927 15:15:54.664940 (+ 87us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0927 15:15:54.665146 (+ 206us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0927 15:15:54.665148 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0927 15:15:54.665173 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0927 15:15:54.665291 (+ 118us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:15:54.665297 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:15:54.666003 (+ 706us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:15:54.666006 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:15:54.666777 (+ 771us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:15:54.666787 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:15:54.667432 (+ 645us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:15:54.667435 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:15:54.667515 (+ 80us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:15:54.667536 (+ 21us) client_negotiation.cc:769] Sending connection context
0927 15:15:54.667606 (+ 70us) client_negotiation.cc:240] Negotiation successful
0927 15:15:54.667668 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":261,"thread_start_us":129,"threads_started":1}
I20260927 15:15:54.668444 3304 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "17f2cd91e71f49ac97314cc757f3c91b" candidate_uuid: "47fe6c51065b48a7aa94b491a76e7149" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91fb947b77d947c6be839adc443087a0" is_pre_election: true
I20260927 15:15:54.668499 3173 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "17f2cd91e71f49ac97314cc757f3c91b" candidate_uuid: "47fe6c51065b48a7aa94b491a76e7149" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95e58d004e7f4793812714a29247574d" is_pre_election: true
I20260927 15:15:54.668766 3173 raft_consensus.cc:2454] T 17f2cd91e71f49ac97314cc757f3c91b P 95e58d004e7f4793812714a29247574d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47fe6c51065b48a7aa94b491a76e7149 in term 0.
I20260927 15:15:54.668766 3304 raft_consensus.cc:2454] T 17f2cd91e71f49ac97314cc757f3c91b P 91fb947b77d947c6be839adc443087a0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47fe6c51065b48a7aa94b491a76e7149 in term 0.
I20260927 15:15:54.669219 3371 leader_election.cc:302] T 17f2cd91e71f49ac97314cc757f3c91b P 47fe6c51065b48a7aa94b491a76e7149 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47fe6c51065b48a7aa94b491a76e7149, 91fb947b77d947c6be839adc443087a0; no voters:
I20260927 15:15:54.669471 3504 raft_consensus.cc:2781] T 17f2cd91e71f49ac97314cc757f3c91b P 47fe6c51065b48a7aa94b491a76e7149 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 15:15:54.669546 3504 raft_consensus.cc:482] T 17f2cd91e71f49ac97314cc757f3c91b P 47fe6c51065b48a7aa94b491a76e7149 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 15:15:54.669575 3504 raft_consensus.cc:3037] T 17f2cd91e71f49ac97314cc757f3c91b P 47fe6c51065b48a7aa94b491a76e7149 [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:15:54.670558 3504 raft_consensus.cc:504] T 17f2cd91e71f49ac97314cc757f3c91b P 47fe6c51065b48a7aa94b491a76e7149 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91fb947b77d947c6be839adc443087a0" member_type: VOTER last_known_addr { host: "127.17.136.2" port: 38321 } } peers { permanent_uuid: "47fe6c51065b48a7aa94b491a76e7149" member_type: VOTER last_known_addr { host: "127.17.136.3" port: 46367 } } peers { permanent_uuid: "95e58d004e7f4793812714a29247574d" member_type: VOTER last_known_addr { host: "127.17.136.1" port: 33181 } }
I20260927 15:15:54.670877 3504 leader_election.cc:288] T 17f2cd91e71f49ac97314cc757f3c91b P 47fe6c51065b48a7aa94b491a76e7149 [CANDIDATE]: Term 1 election: Requested vote from peers 91fb947b77d947c6be839adc443087a0 (127.17.136.2:38321), 95e58d004e7f4793812714a29247574d (127.17.136.1:33181)
I20260927 15:15:54.671175 3304 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "17f2cd91e71f49ac97314cc757f3c91b" candidate_uuid: "47fe6c51065b48a7aa94b491a76e7149" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91fb947b77d947c6be839adc443087a0"
I20260927 15:15:54.671231 3173 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "17f2cd91e71f49ac97314cc757f3c91b" candidate_uuid: "47fe6c51065b48a7aa94b491a76e7149" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95e58d004e7f4793812714a29247574d"
I20260927 15:15:54.671317 3304 raft_consensus.cc:3037] T 17f2cd91e71f49ac97314cc757f3c91b P 91fb947b77d947c6be839adc443087a0 [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:15:54.671365 3173 raft_consensus.cc:3037] T 17f2cd91e71f49ac97314cc757f3c91b P 95e58d004e7f4793812714a29247574d [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:15:54.672510 3304 raft_consensus.cc:2454] T 17f2cd91e71f49ac97314cc757f3c91b P 91fb947b77d947c6be839adc443087a0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47fe6c51065b48a7aa94b491a76e7149 in term 1.
I20260927 15:15:54.672510 3173 raft_consensus.cc:2454] T 17f2cd91e71f49ac97314cc757f3c91b P 95e58d004e7f4793812714a29247574d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47fe6c51065b48a7aa94b491a76e7149 in term 1.
I20260927 15:15:54.672787 3371 leader_election.cc:302] T 17f2cd91e71f49ac97314cc757f3c91b P 47fe6c51065b48a7aa94b491a76e7149 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47fe6c51065b48a7aa94b491a76e7149, 95e58d004e7f4793812714a29247574d; no voters:
I20260927 15:15:54.672928 3504 raft_consensus.cc:2781] T 17f2cd91e71f49ac97314cc757f3c91b P 47fe6c51065b48a7aa94b491a76e7149 [term 1 FOLLOWER]: Leader election won for term 1
I20260927 15:15:54.673151 3504 raft_consensus.cc:686] T 17f2cd91e71f49ac97314cc757f3c91b P 47fe6c51065b48a7aa94b491a76e7149 [term 1 LEADER]: Becoming Leader. State: Replica: 47fe6c51065b48a7aa94b491a76e7149, State: Running, Role: LEADER
I20260927 15:15:54.673519 3504 consensus_queue.cc:237] T 17f2cd91e71f49ac97314cc757f3c91b P 47fe6c51065b48a7aa94b491a76e7149 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91fb947b77d947c6be839adc443087a0" member_type: VOTER last_known_addr { host: "127.17.136.2" port: 38321 } } peers { permanent_uuid: "47fe6c51065b48a7aa94b491a76e7149" member_type: VOTER last_known_addr { host: "127.17.136.3" port: 46367 } } peers { permanent_uuid: "95e58d004e7f4793812714a29247574d" member_type: VOTER last_known_addr { host: "127.17.136.1" port: 33181 } }
I20260927 15:15:54.676662 3031 catalog_manager.cc:5495] T 17f2cd91e71f49ac97314cc757f3c91b P 47fe6c51065b48a7aa94b491a76e7149 reported cstate change: term changed from 0 to 1, leader changed from <none> to 47fe6c51065b48a7aa94b491a76e7149 (127.17.136.3). New cstate: current_term: 1 leader_uuid: "47fe6c51065b48a7aa94b491a76e7149" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91fb947b77d947c6be839adc443087a0" member_type: VOTER last_known_addr { host: "127.17.136.2" port: 38321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "47fe6c51065b48a7aa94b491a76e7149" member_type: VOTER last_known_addr { host: "127.17.136.3" port: 46367 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "95e58d004e7f4793812714a29247574d" member_type: VOTER last_known_addr { host: "127.17.136.1" port: 33181 } health_report { overall_health: UNKNOWN } } }
W20260927 15:15:54.683409 3220 tablet.cc:2369] T 17f2cd91e71f49ac97314cc757f3c91b P 95e58d004e7f4793812714a29247574d: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260927 15:15:54.701658 3495 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:15:54.698690 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57564 (local address 127.17.136.3:46367)
0927 15:15:54.698799 (+ 109us) server_negotiation.cc:206] Beginning negotiation
0927 15:15:54.698802 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0927 15:15:54.698816 (+ 14us) server_negotiation.cc:407] Connection header received
0927 15:15:54.698905 (+ 89us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:15:54.698907 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:15:54.698961 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:15:54.699043 (+ 82us) server_negotiation.cc:226] Negotiated authn=TOKEN
0927 15:15:54.699217 (+ 174us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:15:54.699748 (+ 531us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:15:54.700504 (+ 756us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:15:54.700712 (+ 208us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:15:54.700775 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:15:54.700983 (+ 208us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0927 15:15:54.701379 (+ 396us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0927 15:15:54.701466 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0927 15:15:54.701493 (+ 27us) server_negotiation.cc:299] Negotiation successful
0927 15:15:54.701535 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260927 15:15:54.707082 3173 raft_consensus.cc:1261] T 17f2cd91e71f49ac97314cc757f3c91b P 95e58d004e7f4793812714a29247574d [term 1 FOLLOWER]: Refusing update from remote peer 47fe6c51065b48a7aa94b491a76e7149: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260927 15:15:54.707118 3304 raft_consensus.cc:1261] T 17f2cd91e71f49ac97314cc757f3c91b P 91fb947b77d947c6be839adc443087a0 [term 1 FOLLOWER]: Refusing update from remote peer 47fe6c51065b48a7aa94b491a76e7149: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260927 15:15:54.707758 3504 consensus_queue.cc:1035] T 17f2cd91e71f49ac97314cc757f3c91b P 47fe6c51065b48a7aa94b491a76e7149 [LEADER]: Connected to new peer: Peer: permanent_uuid: "91fb947b77d947c6be839adc443087a0" member_type: VOTER last_known_addr { host: "127.17.136.2" port: 38321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260927 15:15:54.707959 3508 consensus_queue.cc:1035] T 17f2cd91e71f49ac97314cc757f3c91b P 47fe6c51065b48a7aa94b491a76e7149 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95e58d004e7f4793812714a29247574d" member_type: VOTER last_known_addr { host: "127.17.136.1" port: 33181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260927 15:15:54.715932 3512 mvcc.cc:205] Tried to move back new op lower bound from 7333978745673879552 to 7333978745545150464. Current Snapshot: MvccSnapshot[applied={T|T < 7333978745673879552}]
I20260927 15:15:54.717015 3513 mvcc.cc:205] Tried to move back new op lower bound from 7333978745673879552 to 7333978745545150464. Current Snapshot: MvccSnapshot[applied={T|T < 7333978745673879552}]
I20260927 15:15:54.722043 3031 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:39098:
table { table_name: "test-table" } modify_external_catalogs: true
I20260927 15:15:54.722215 3031 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:39098:
table { table_name: "test-table" } modify_external_catalogs: true
I20260927 15:15:54.726277 3031 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 49d93dd7b7bb47f09ee5428c54eda52d: Sending DeleteTablet for 3 replicas of tablet 17f2cd91e71f49ac97314cc757f3c91b
I20260927 15:15:54.727368 3284 tablet_service.cc:1514] Processing DeleteTablet for tablet 17f2cd91e71f49ac97314cc757f3c91b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:15:54 UTC) from {username='slave'} at 127.0.0.1:41814
I20260927 15:15:54.727563 3415 tablet_service.cc:1514] Processing DeleteTablet for tablet 17f2cd91e71f49ac97314cc757f3c91b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:15:54 UTC) from {username='slave'} at 127.0.0.1:57550
I20260927 15:15:54.727885 3153 tablet_service.cc:1514] Processing DeleteTablet for tablet 17f2cd91e71f49ac97314cc757f3c91b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:15:54 UTC) from {username='slave'} at 127.0.0.1:41584
I20260927 15:15:54.728549 3521 tablet_replica.cc:330] T 17f2cd91e71f49ac97314cc757f3c91b P 95e58d004e7f4793812714a29247574d: stopping tablet replica
I20260927 15:15:54.729068 17952 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu with pid 3091
I20260927 15:15:54.729074 3521 raft_consensus.cc:2229] T 17f2cd91e71f49ac97314cc757f3c91b P 95e58d004e7f4793812714a29247574d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260927 15:15:54.731828 3522 tablet_replica.cc:330] T 17f2cd91e71f49ac97314cc757f3c91b P 91fb947b77d947c6be839adc443087a0: stopping tablet replica
I20260927 15:15:54.732129 3522 raft_consensus.cc:2229] T 17f2cd91e71f49ac97314cc757f3c91b P 91fb947b77d947c6be839adc443087a0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260927 15:15:54.732441 3522 raft_consensus.cc:2258] T 17f2cd91e71f49ac97314cc757f3c91b P 91fb947b77d947c6be839adc443087a0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 15:15:54.732789 3520 tablet_replica.cc:330] T 17f2cd91e71f49ac97314cc757f3c91b P 47fe6c51065b48a7aa94b491a76e7149: stopping tablet replica
I20260927 15:15:54.733044 3520 raft_consensus.cc:2229] T 17f2cd91e71f49ac97314cc757f3c91b P 47fe6c51065b48a7aa94b491a76e7149 [term 1 LEADER]: Raft consensus shutting down.
I20260927 15:15:54.733398 3520 raft_consensus.cc:2258] T 17f2cd91e71f49ac97314cc757f3c91b P 47fe6c51065b48a7aa94b491a76e7149 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 15:15:54.734212 3522 ts_tablet_manager.cc:1905] T 17f2cd91e71f49ac97314cc757f3c91b P 91fb947b77d947c6be839adc443087a0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:15:54.734755 3520 ts_tablet_manager.cc:1905] T 17f2cd91e71f49ac97314cc757f3c91b P 47fe6c51065b48a7aa94b491a76e7149: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260927 15:15:54.736411 3018 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.17.136.1:33181 (error 108)
I20260927 15:15:54.737140 3522 ts_tablet_manager.cc:1918] T 17f2cd91e71f49ac97314cc757f3c91b P 91fb947b77d947c6be839adc443087a0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260927 15:15:54.737183 17952 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu with pid 3222
I20260927 15:15:54.737330 3522 log.cc:1196] T 17f2cd91e71f49ac97314cc757f3c91b P 91fb947b77d947c6be839adc443087a0: Deleting WAL directory at /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790521920546562-17952-0/minicluster-data/ts-1/wal/wals/17f2cd91e71f49ac97314cc757f3c91b
I20260927 15:15:54.737802 3520 ts_tablet_manager.cc:1918] T 17f2cd91e71f49ac97314cc757f3c91b P 47fe6c51065b48a7aa94b491a76e7149: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260927 15:15:54.737888 3520 log.cc:1196] T 17f2cd91e71f49ac97314cc757f3c91b P 47fe6c51065b48a7aa94b491a76e7149: Deleting WAL directory at /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790521920546562-17952-0/minicluster-data/ts-2/wal/wals/17f2cd91e71f49ac97314cc757f3c91b
I20260927 15:15:54.738152 3520 ts_tablet_manager.cc:1939] T 17f2cd91e71f49ac97314cc757f3c91b P 47fe6c51065b48a7aa94b491a76e7149: Deleting consensus metadata
I20260927 15:15:54.739324 3018 catalog_manager.cc:4841] TS 47fe6c51065b48a7aa94b491a76e7149 (127.17.136.3:46367): tablet 17f2cd91e71f49ac97314cc757f3c91b (table test-table [id=d1eb57039ef74283a59140e62488e285]) successfully deleted
I20260927 15:15:54.743603 17952 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu with pid 3353
I20260927 15:15:54.744365 3496 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:15:54.743815 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.1:33181 (local address 127.0.0.1:41586)
0927 15:15:54.744189 (+ 374us) negotiation.cc:107] Waiting for socket to connect
0927 15:15:54.744263 (+ 74us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.136.1:33181: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":290}
W20260927 15:15:54.744691 3018 catalog_manager.cc:4584] TS 95e58d004e7f4793812714a29247574d (127.17.136.1:33181): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 17f2cd91e71f49ac97314cc757f3c91b: Network error: Client connection negotiation failed: client connection to 127.17.136.1:33181: connect: Connection refused (error 111)
I20260927 15:15:54.745348 3496 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:15:54.745092 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.2:38321 (local address 127.0.0.1:41830)
0927 15:15:54.745234 (+ 142us) negotiation.cc:107] Waiting for socket to connect
0927 15:15:54.745289 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.136.2:38321: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":80}
I20260927 15:15:54.748456 17952 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu with pid 3000
2026-09-27T15:15:54Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/1 (1019 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/2
Loading random data
Initializing database '/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790521920546562-17952-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 27 15:15:54 dist-test-slave-5s2t krb5kdc[3526](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 27 15:15:54 dist-test-slave-5s2t krb5kdc[3526](info): set up 2 sockets
Sep 27 15:15:54 dist-test-slave-5s2t krb5kdc[3526](info): commencing operation
krb5kdc: starting...
W20260927 15:15:55.690881 17952 mini_kdc.cc:121] Time spent starting KDC: real 0.923s user 0.003s sys 0.002s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790521920546562-17952-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790521920546562-17952-0/krb5kdc/test-user.keytab.
Sep 27 15:15:55 dist-test-slave-5s2t krb5kdc[3526](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790522155, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-27T15:15:55Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-27T15:15:55Z Disabled control of system clock
WARNING: no policy specified for kudu/127.17.136.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.136.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.136.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790521920546562-17952-0/krb5kdc/kudu_127.17.136.62.keytab.
Entry for principal kudu/127.17.136.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790521920546562-17952-0/krb5kdc/kudu_127.17.136.62.keytab.
I20260927 15:15:55.804519 17952 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu
/tmp/dist-test-taskiFOyeW/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790521920546562-17952-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790521920546562-17952-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790521920546562-17952-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790521920546562-17952-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.136.62:34223
--webserver_interface=127.17.136.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790521920546562-17952-0/krb5kdc/kudu_127.17.136.62.keytab
--principal=kudu/127.17.136.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.136.20:40725
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.136.62:34223
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790521920546562-17952-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790521920546562-17952-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790521920546562-17952-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260927 15:15:55.910199 3539 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260927 15:15:55.910445 3539 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260927 15:15:55.910483 3539 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260927 15:15:55.914373 3539 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260927 15:15:55.914427 3539 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260927 15:15:55.914445 3539 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260927 15:15:55.914461 3539 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260927 15:15:55.914494 3539 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260927 15:15:55.919718 3539 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.136.20:40725
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790521920546562-17952-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790521920546562-17952-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.17.136.62:34223
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790521920546562-17952-0/krb5kdc/kudu_127.17.136.62.keytab
--principal=kudu/127.17.136.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.136.62:34223
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790521920546562-17952-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.17.136.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3539
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790521920546562-17952-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 27 Sep 2026 14:27:13 UTC on ccycloud.quasar-psqrth.root.comops.site
build id 4676138
I20260927 15:15:55.920704 3539 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260927 15:15:55.921684 3539 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260927 15:15:55.929587 3544 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260927 15:15:55.929618 3547 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260927 15:15:55.929699 3545 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260927 15:15:55.929919 3539 server_base.cc:1034] running on GCE node
I20260927 15:15:55.930449 3539 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260927 15:15:55.931555 3539 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260927 15:15:55.932734 3539 hybrid_clock.cc:648] HybridClock initialized: now 1790522155932706 us; error 37 us; skew 500 ppm
Sep 27 15:15:55 dist-test-slave-5s2t krb5kdc[3526](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790522155, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.136.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260927 15:15:55.935292 3539 init.cc:377] Logged in from keytab as kudu/127.17.136.62@KRBTEST.COM (short username kudu)
I20260927 15:15:55.936137 3539 webserver.cc:460] Webserver started at http://127.17.136.62:38519/ using document root <none> and password file <none>
I20260927 15:15:55.936647 3539 fs_manager.cc:359] Metadata directory not provided
I20260927 15:15:55.936705 3539 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260927 15:15:55.936910 3539 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260927 15:15:55.938800 3539 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790521920546562-17952-0/minicluster-data/master-0/data/instance:
uuid: "d0ce69b79b75446d8935d17385ef1396"
format_stamp: "Formatted at 2026-09-27 15:15:55 on dist-test-slave-5s2t"
server_key: "9d053f8aa05794983908751775ffc189"
server_key_iv: "06fb9db862c414800cc22173d2452219"
server_key_version: "encryptionkey@0"
I20260927 15:15:55.939355 3539 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790521920546562-17952-0/minicluster-data/master-0/wal/instance:
uuid: "d0ce69b79b75446d8935d17385ef1396"
format_stamp: "Formatted at 2026-09-27 15:15:55 on dist-test-slave-5s2t"
server_key: "9d053f8aa05794983908751775ffc189"
server_key_iv: "06fb9db862c414800cc22173d2452219"
server_key_version: "encryptionkey@0"
I20260927 15:15:55.942880 3539 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.001s
I20260927 15:15:55.945188 3554 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260927 15:15:55.946329 3539 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260927 15:15:55.946439 3539 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790521920546562-17952-0/minicluster-data/master-0/data,/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790521920546562-17952-0/minicluster-data/master-0/wal
uuid: "d0ce69b79b75446d8935d17385ef1396"
format_stamp: "Formatted at 2026-09-27 15:15:55 on dist-test-slave-5s2t"
server_key: "9d053f8aa05794983908751775ffc189"
server_key_iv: "06fb9db862c414800cc22173d2452219"
server_key_version: "encryptionkey@0"
I20260927 15:15:55.946530 3539 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790521920546562-17952-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790521920546562-17952-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790521920546562-17952-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260927 15:15:55.983495 3539 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260927 15:15:55.986302 3539 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260927 15:15:55.986476 3539 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260927 15:15:55.993074 3539 rpc_server.cc:307] RPC server started. Bound to: 127.17.136.62:34223
I20260927 15:15:55.993100 3606 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.136.62:34223 every 8 connection(s)
I20260927 15:15:55.993988 3539 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790521920546562-17952-0/minicluster-data/master-0/data/info.pb
I20260927 15:15:55.996767 3607 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:15:56.000514 17952 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu as pid 3539
I20260927 15:15:56.000643 17952 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790521920546562-17952-0/minicluster-data/master-0/wal/instance
I20260927 15:15:56.000895 17952 external_mini_cluster.cc:1428] Setting key b72f15a08a7dbeb213225f3d5fd5eba3
I20260927 15:15:56.002360 3607 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d0ce69b79b75446d8935d17385ef1396: Bootstrap starting.
I20260927 15:15:56.004710 3607 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d0ce69b79b75446d8935d17385ef1396: Neither blocks nor log segments found. Creating new log.
I20260927 15:15:56.005455 3607 log.cc:824] T 00000000000000000000000000000000 P d0ce69b79b75446d8935d17385ef1396: Log is configured to *not* fsync() on all Append() calls
I20260927 15:15:56.007158 3607 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d0ce69b79b75446d8935d17385ef1396: No bootstrap required, opened a new log
Sep 27 15:15:56 dist-test-slave-5s2t krb5kdc[3526](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790522155, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.136.62@KRBTEST.COM
I20260927 15:15:56.011444 3607 raft_consensus.cc:348] T 00000000000000000000000000000000 P d0ce69b79b75446d8935d17385ef1396 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d0ce69b79b75446d8935d17385ef1396" member_type: VOTER last_known_addr { host: "127.17.136.62" port: 34223 } }
I20260927 15:15:56.011722 3607 raft_consensus.cc:374] T 00000000000000000000000000000000 P d0ce69b79b75446d8935d17385ef1396 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:15:56.011776 3607 raft_consensus.cc:729] T 00000000000000000000000000000000 P d0ce69b79b75446d8935d17385ef1396 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d0ce69b79b75446d8935d17385ef1396, State: Initialized, Role: FOLLOWER
I20260927 15:15:56.012257 3607 consensus_queue.cc:260] T 00000000000000000000000000000000 P d0ce69b79b75446d8935d17385ef1396 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d0ce69b79b75446d8935d17385ef1396" member_type: VOTER last_known_addr { host: "127.17.136.62" port: 34223 } }
I20260927 15:15:56.012382 3607 raft_consensus.cc:388] T 00000000000000000000000000000000 P d0ce69b79b75446d8935d17385ef1396 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260927 15:15:56.012444 3607 raft_consensus.cc:482] T 00000000000000000000000000000000 P d0ce69b79b75446d8935d17385ef1396 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260927 15:15:56.012543 3607 raft_consensus.cc:3037] T 00000000000000000000000000000000 P d0ce69b79b75446d8935d17385ef1396 [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:15:56.013602 3607 raft_consensus.cc:504] T 00000000000000000000000000000000 P d0ce69b79b75446d8935d17385ef1396 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d0ce69b79b75446d8935d17385ef1396" member_type: VOTER last_known_addr { host: "127.17.136.62" port: 34223 } }
I20260927 15:15:56.013947 3607 leader_election.cc:302] T 00000000000000000000000000000000 P d0ce69b79b75446d8935d17385ef1396 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: d0ce69b79b75446d8935d17385ef1396; no voters:
I20260927 15:15:56.014274 3607 leader_election.cc:288] T 00000000000000000000000000000000 P d0ce69b79b75446d8935d17385ef1396 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260927 15:15:56.014402 3612 raft_consensus.cc:2781] T 00000000000000000000000000000000 P d0ce69b79b75446d8935d17385ef1396 [term 1 FOLLOWER]: Leader election won for term 1
I20260927 15:15:56.014593 3612 raft_consensus.cc:686] T 00000000000000000000000000000000 P d0ce69b79b75446d8935d17385ef1396 [term 1 LEADER]: Becoming Leader. State: Replica: d0ce69b79b75446d8935d17385ef1396, State: Running, Role: LEADER
I20260927 15:15:56.014896 3612 consensus_queue.cc:237] T 00000000000000000000000000000000 P d0ce69b79b75446d8935d17385ef1396 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d0ce69b79b75446d8935d17385ef1396" member_type: VOTER last_known_addr { host: "127.17.136.62" port: 34223 } }
I20260927 15:15:56.015120 3610 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:15:56.002261 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42290 (local address 127.17.136.62:34223)
0927 15:15:56.002662 (+ 401us) server_negotiation.cc:206] Beginning negotiation
0927 15:15:56.002678 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0927 15:15:56.002724 (+ 46us) server_negotiation.cc:407] Connection header received
0927 15:15:56.003397 (+ 673us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:15:56.003417 (+ 20us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:15:56.003747 (+ 330us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:15:56.004034 (+ 287us) server_negotiation.cc:226] Negotiated authn=SASL
0927 15:15:56.004908 (+ 874us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:15:56.005913 (+ 1005us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:15:56.006747 (+ 834us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:15:56.007237 (+ 490us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:15:56.007394 (+ 157us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:15:56.010057 (+ 2663us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0927 15:15:56.010064 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0927 15:15:56.010082 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0927 15:15:56.010117 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0927 15:15:56.012029 (+ 1912us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:15:56.012439 (+ 410us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:15:56.012445 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:15:56.012451 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:15:56.012601 (+ 150us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:15:56.012861 (+ 260us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:15:56.012864 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:15:56.012866 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:15:56.013388 (+ 522us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0927 15:15:56.013583 (+ 195us) server_negotiation.cc:1035] Waiting for connection context
0927 15:15:56.013813 (+ 230us) server_negotiation.cc:299] Negotiation successful
0927 15:15:56.014111 (+ 298us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":254,"thread_start_us":120,"threads_started":1}
I20260927 15:15:56.015544 3607 sys_catalog.cc:564] T 00000000000000000000000000000000 P d0ce69b79b75446d8935d17385ef1396 [sys.catalog]: configured and running, proceeding with master startup.
I20260927 15:15:56.017405 3614 sys_catalog.cc:455] T 00000000000000000000000000000000 P d0ce69b79b75446d8935d17385ef1396 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "d0ce69b79b75446d8935d17385ef1396" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d0ce69b79b75446d8935d17385ef1396" member_type: VOTER last_known_addr { host: "127.17.136.62" port: 34223 } } }
I20260927 15:15:56.017558 3613 sys_catalog.cc:455] T 00000000000000000000000000000000 P d0ce69b79b75446d8935d17385ef1396 [sys.catalog]: SysCatalogTable state changed. Reason: New leader d0ce69b79b75446d8935d17385ef1396. Latest consensus state: current_term: 1 leader_uuid: "d0ce69b79b75446d8935d17385ef1396" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d0ce69b79b75446d8935d17385ef1396" member_type: VOTER last_known_addr { host: "127.17.136.62" port: 34223 } } }
I20260927 15:15:56.017910 3614 sys_catalog.cc:458] T 00000000000000000000000000000000 P d0ce69b79b75446d8935d17385ef1396 [sys.catalog]: This master's current role is: LEADER
I20260927 15:15:56.017918 3613 sys_catalog.cc:458] T 00000000000000000000000000000000 P d0ce69b79b75446d8935d17385ef1396 [sys.catalog]: This master's current role is: LEADER
W20260927 15:15:56.020222 3626 catalog_manager.cc:1558] T 00000000000000000000000000000000 P d0ce69b79b75446d8935d17385ef1396: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260927 15:15:56.020295 3626 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260927 15:15:56.020350 3627 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260927 15:15:56.020984 3627 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260927 15:15:56.026379 3627 catalog_manager.cc:1347] Generated new cluster ID: 2242ceae8d7545c196370da9d62d938b
I20260927 15:15:56.026448 3627 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260927 15:15:56.037058 3627 catalog_manager.cc:1370] Generated new certificate authority record
I20260927 15:15:56.038359 3627 catalog_manager.cc:1504] Loading token signing keys...
I20260927 15:15:56.045827 3627 catalog_manager.cc:5868] T 00000000000000000000000000000000 P d0ce69b79b75446d8935d17385ef1396: Generated new TSK 0
I20260927 15:15:56.046553 3627 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.17.136.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.136.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.136.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790521920546562-17952-0/krb5kdc/kudu_127.17.136.1.keytab.
Entry for principal kudu/127.17.136.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790521920546562-17952-0/krb5kdc/kudu_127.17.136.1.keytab.
I20260927 15:15:56.078289 17952 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu
/tmp/dist-test-taskiFOyeW/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790521920546562-17952-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790521920546562-17952-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790521920546562-17952-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790521920546562-17952-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.136.1:0
--local_ip_for_outbound_sockets=127.17.136.1
--webserver_interface=127.17.136.1
--webserver_port=0
--tserver_master_addrs=127.17.136.62:34223
--keytab_file=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790521920546562-17952-0/krb5kdc/kudu_127.17.136.1.keytab
--principal=kudu/127.17.136.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.136.20:40725
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790521920546562-17952-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790521920546562-17952-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790521920546562-17952-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260927 15:15:56.187220 3633 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260927 15:15:56.187537 3633 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260927 15:15:56.187582 3633 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260927 15:15:56.191634 3633 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260927 15:15:56.191694 3633 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260927 15:15:56.191762 3633 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.136.1
I20260927 15:15:56.197419 3633 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.136.20:40725
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790521920546562-17952-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790521920546562-17952-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790521920546562-17952-0/krb5kdc/kudu_127.17.136.1.keytab
--principal=kudu/127.17.136.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.136.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790521920546562-17952-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.17.136.1
--webserver_port=0
--tserver_master_addrs=127.17.136.62:34223
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3633
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.136.1
--log_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790521920546562-17952-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 27 Sep 2026 14:27:13 UTC on ccycloud.quasar-psqrth.root.comops.site
build id 4676138
I20260927 15:15:56.198514 3633 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260927 15:15:56.199604 3633 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260927 15:15:56.209107 3639 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260927 15:15:56.209100 3641 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260927 15:15:56.209100 3638 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260927 15:15:56.209640 3633 server_base.cc:1034] running on GCE node
I20260927 15:15:56.210031 3633 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260927 15:15:56.210646 3633 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260927 15:15:56.211795 3633 hybrid_clock.cc:648] HybridClock initialized: now 1790522156211767 us; error 40 us; skew 500 ppm
Sep 27 15:15:56 dist-test-slave-5s2t krb5kdc[3526](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790522156, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.136.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260927 15:15:56.214437 3633 init.cc:377] Logged in from keytab as kudu/127.17.136.1@KRBTEST.COM (short username kudu)
I20260927 15:15:56.215238 3633 webserver.cc:460] Webserver started at http://127.17.136.1:33473/ using document root <none> and password file <none>
I20260927 15:15:56.215842 3633 fs_manager.cc:359] Metadata directory not provided
I20260927 15:15:56.215909 3633 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260927 15:15:56.216070 3633 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260927 15:15:56.218093 3633 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790521920546562-17952-0/minicluster-data/ts-0/data/instance:
uuid: "5d847d71426a409881bae41cd14e2a57"
format_stamp: "Formatted at 2026-09-27 15:15:56 on dist-test-slave-5s2t"
server_key: "3aa3d73b84b8229cd09f3598474f368d"
server_key_iv: "fc8564e033210b3bbb8b4edf889fd8e1"
server_key_version: "encryptionkey@0"
I20260927 15:15:56.218582 3633 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790521920546562-17952-0/minicluster-data/ts-0/wal/instance:
uuid: "5d847d71426a409881bae41cd14e2a57"
format_stamp: "Formatted at 2026-09-27 15:15:56 on dist-test-slave-5s2t"
server_key: "3aa3d73b84b8229cd09f3598474f368d"
server_key_iv: "fc8564e033210b3bbb8b4edf889fd8e1"
server_key_version: "encryptionkey@0"
I20260927 15:15:56.222127 3633 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.003s
I20260927 15:15:56.224455 3648 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260927 15:15:56.225642 3633 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260927 15:15:56.225747 3633 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790521920546562-17952-0/minicluster-data/ts-0/data,/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790521920546562-17952-0/minicluster-data/ts-0/wal
uuid: "5d847d71426a409881bae41cd14e2a57"
format_stamp: "Formatted at 2026-09-27 15:15:56 on dist-test-slave-5s2t"
server_key: "3aa3d73b84b8229cd09f3598474f368d"
server_key_iv: "fc8564e033210b3bbb8b4edf889fd8e1"
server_key_version: "encryptionkey@0"
I20260927 15:15:56.225852 3633 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790521920546562-17952-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790521920546562-17952-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790521920546562-17952-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260927 15:15:56.239840 3633 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260927 15:15:56.242604 3633 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260927 15:15:56.242774 3633 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260927 15:15:56.243367 3633 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260927 15:15:56.244174 3633 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260927 15:15:56.244233 3633 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260927 15:15:56.244287 3633 ts_tablet_manager.cc:610] Registered 0 tablets
I20260927 15:15:56.244315 3633 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260927 15:15:56.252653 3633 rpc_server.cc:307] RPC server started. Bound to: 127.17.136.1:46381
I20260927 15:15:56.252693 3761 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.136.1:46381 every 8 connection(s)
I20260927 15:15:56.253523 3633 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790521920546562-17952-0/minicluster-data/ts-0/data/info.pb
I20260927 15:15:56.253909 17952 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu as pid 3633
I20260927 15:15:56.254040 17952 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790521920546562-17952-0/minicluster-data/ts-0/wal/instance
I20260927 15:15:56.254367 17952 external_mini_cluster.cc:1428] Setting key 1089fd11ae9208b6fab51fb26d651ca7
WARNING: no policy specified for kudu/127.17.136.2@KRBTEST.COM; defaulting to no policy
Sep 27 15:15:56 dist-test-slave-5s2t krb5kdc[3526](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790522156, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.136.1@KRBTEST.COM for kudu/127.17.136.62@KRBTEST.COM
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.136.2@KRBTEST.COM" created.
I20260927 15:15:56.267968 3610 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:15:56.255374 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.136.1:36619 (local address 127.17.136.62:34223)
0927 15:15:56.255500 (+ 126us) server_negotiation.cc:206] Beginning negotiation
0927 15:15:56.255504 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0927 15:15:56.256532 (+ 1028us) server_negotiation.cc:407] Connection header received
0927 15:15:56.257993 (+ 1461us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:15:56.257996 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:15:56.258039 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:15:56.258109 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0927 15:15:56.259560 (+ 1451us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:15:56.260183 (+ 623us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:15:56.261788 (+ 1605us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:15:56.262008 (+ 220us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:15:56.262093 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:15:56.264629 (+ 2536us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0927 15:15:56.264632 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0927 15:15:56.264634 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0927 15:15:56.264657 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0927 15:15:56.265919 (+ 1262us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:15:56.266442 (+ 523us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:15:56.266445 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:15:56.266447 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:15:56.266532 (+ 85us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:15:56.266892 (+ 360us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:15:56.266895 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:15:56.266896 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:15:56.267063 (+ 167us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0927 15:15:56.267143 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0927 15:15:56.267679 (+ 536us) server_negotiation.cc:299] Negotiation successful
0927 15:15:56.267803 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260927 15:15:56.268805 3764 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:15:56.255854 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.62:34223 (local address 127.17.136.1:36619)
0927 15:15:56.256395 (+ 541us) negotiation.cc:107] Waiting for socket to connect
0927 15:15:56.256438 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0927 15:15:56.257755 (+ 1317us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0927 15:15:56.258314 (+ 559us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0927 15:15:56.258323 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0927 15:15:56.258761 (+ 438us) client_negotiation.cc:189] Negotiated authn=SASL
0927 15:15:56.259418 (+ 657us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:15:56.259436 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:15:56.260307 (+ 871us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:15:56.260310 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:15:56.261667 (+ 1357us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:15:56.261677 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:15:56.262170 (+ 493us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:15:56.262174 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:15:56.262370 (+ 196us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:15:56.262942 (+ 572us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0927 15:15:56.262964 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0927 15:15:56.264486 (+ 1522us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0927 15:15:56.266031 (+ 1545us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0927 15:15:56.266035 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0927 15:15:56.266046 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0927 15:15:56.266336 (+ 290us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0927 15:15:56.266627 (+ 291us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0927 15:15:56.266631 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0927 15:15:56.266633 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0927 15:15:56.266804 (+ 171us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0927 15:15:56.267169 (+ 365us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0927 15:15:56.267175 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0927 15:15:56.267444 (+ 269us) client_negotiation.cc:769] Sending connection context
0927 15:15:56.267604 (+ 160us) client_negotiation.cc:240] Negotiation successful
0927 15:15:56.267933 (+ 329us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":351,"thread_start_us":186,"threads_started":1}
I20260927 15:15:56.270009 3762 heartbeater.cc:347] Connected to a master server at 127.17.136.62:34223
I20260927 15:15:56.270267 3762 heartbeater.cc:464] Registering TS with master...
I20260927 15:15:56.270864 3762 heartbeater.cc:511] Master 127.17.136.62:34223 requested a full tablet report, sending...
I20260927 15:15:56.272567 3571 ts_manager.cc:194] Registered new tserver with Master: 5d847d71426a409881bae41cd14e2a57 (127.17.136.1:46381)
I20260927 15:15:56.274117 3571 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.136.1@KRBTEST.COM'} at 127.17.136.1:36619
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.136.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790521920546562-17952-0/krb5kdc/kudu_127.17.136.2.keytab.
Entry for principal kudu/127.17.136.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790521920546562-17952-0/krb5kdc/kudu_127.17.136.2.keytab.
I20260927 15:15:56.282069 17952 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu
/tmp/dist-test-taskiFOyeW/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790521920546562-17952-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790521920546562-17952-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790521920546562-17952-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790521920546562-17952-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.136.2:0
--local_ip_for_outbound_sockets=127.17.136.2
--webserver_interface=127.17.136.2
--webserver_port=0
--tserver_master_addrs=127.17.136.62:34223
--keytab_file=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790521920546562-17952-0/krb5kdc/kudu_127.17.136.2.keytab
--principal=kudu/127.17.136.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.136.20:40725
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790521920546562-17952-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790521920546562-17952-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790521920546562-17952-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260927 15:15:56.390440 3767 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260927 15:15:56.390694 3767 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260927 15:15:56.390735 3767 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260927 15:15:56.394745 3767 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260927 15:15:56.394810 3767 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260927 15:15:56.394869 3767 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.136.2
I20260927 15:15:56.400070 3767 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.136.20:40725
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790521920546562-17952-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790521920546562-17952-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790521920546562-17952-0/krb5kdc/kudu_127.17.136.2.keytab
--principal=kudu/127.17.136.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.136.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790521920546562-17952-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.17.136.2
--webserver_port=0
--tserver_master_addrs=127.17.136.62:34223
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3767
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.136.2
--log_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790521920546562-17952-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 27 Sep 2026 14:27:13 UTC on ccycloud.quasar-psqrth.root.comops.site
build id 4676138
I20260927 15:15:56.401080 3767 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260927 15:15:56.402048 3767 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260927 15:15:56.411418 3772 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260927 15:15:56.411418 3773 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260927 15:15:56.411406 3775 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260927 15:15:56.411592 3767 server_base.cc:1034] running on GCE node
I20260927 15:15:56.412020 3767 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260927 15:15:56.412585 3767 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260927 15:15:56.413748 3767 hybrid_clock.cc:648] HybridClock initialized: now 1790522156413728 us; error 33 us; skew 500 ppm
Sep 27 15:15:56 dist-test-slave-5s2t krb5kdc[3526](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790522156, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.136.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260927 15:15:56.416538 3767 init.cc:377] Logged in from keytab as kudu/127.17.136.2@KRBTEST.COM (short username kudu)
I20260927 15:15:56.417387 3767 webserver.cc:460] Webserver started at http://127.17.136.2:44839/ using document root <none> and password file <none>
I20260927 15:15:56.417887 3767 fs_manager.cc:359] Metadata directory not provided
I20260927 15:15:56.417941 3767 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260927 15:15:56.418115 3767 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260927 15:15:56.420126 3767 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790521920546562-17952-0/minicluster-data/ts-1/data/instance:
uuid: "d044f97cc15b4adc86667b19988b3745"
format_stamp: "Formatted at 2026-09-27 15:15:56 on dist-test-slave-5s2t"
server_key: "ef7463cf761d3b0b140e4887c24d1fea"
server_key_iv: "7b552bae8548173b506c13336521a820"
server_key_version: "encryptionkey@0"
I20260927 15:15:56.420614 3767 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790521920546562-17952-0/minicluster-data/ts-1/wal/instance:
uuid: "d044f97cc15b4adc86667b19988b3745"
format_stamp: "Formatted at 2026-09-27 15:15:56 on dist-test-slave-5s2t"
server_key: "ef7463cf761d3b0b140e4887c24d1fea"
server_key_iv: "7b552bae8548173b506c13336521a820"
server_key_version: "encryptionkey@0"
I20260927 15:15:56.424075 3767 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.001s
I20260927 15:15:56.426395 3782 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260927 15:15:56.427603 3767 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260927 15:15:56.427697 3767 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790521920546562-17952-0/minicluster-data/ts-1/data,/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790521920546562-17952-0/minicluster-data/ts-1/wal
uuid: "d044f97cc15b4adc86667b19988b3745"
format_stamp: "Formatted at 2026-09-27 15:15:56 on dist-test-slave-5s2t"
server_key: "ef7463cf761d3b0b140e4887c24d1fea"
server_key_iv: "7b552bae8548173b506c13336521a820"
server_key_version: "encryptionkey@0"
I20260927 15:15:56.427798 3767 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790521920546562-17952-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790521920546562-17952-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790521920546562-17952-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260927 15:15:56.445470 3767 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260927 15:15:56.448560 3767 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260927 15:15:56.448733 3767 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260927 15:15:56.449338 3767 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260927 15:15:56.450150 3767 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260927 15:15:56.450198 3767 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260927 15:15:56.450239 3767 ts_tablet_manager.cc:610] Registered 0 tablets
I20260927 15:15:56.450258 3767 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260927 15:15:56.458521 3767 rpc_server.cc:307] RPC server started. Bound to: 127.17.136.2:46809
I20260927 15:15:56.458549 3895 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.136.2:46809 every 8 connection(s)
I20260927 15:15:56.459499 3767 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790521920546562-17952-0/minicluster-data/ts-1/data/info.pb
Sep 27 15:15:56 dist-test-slave-5s2t krb5kdc[3526](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790522156, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.136.2@KRBTEST.COM for kudu/127.17.136.62@KRBTEST.COM
I20260927 15:15:56.469262 17952 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu as pid 3767
I20260927 15:15:56.469391 17952 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790521920546562-17952-0/minicluster-data/ts-1/wal/instance
I20260927 15:15:56.469672 17952 external_mini_cluster.cc:1428] Setting key c55e49e55c3711213e2462ade86735c0
I20260927 15:15:56.472730 3610 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:15:56.461220 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.136.2:41721 (local address 127.17.136.62:34223)
0927 15:15:56.461362 (+ 142us) server_negotiation.cc:206] Beginning negotiation
0927 15:15:56.461366 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0927 15:15:56.462309 (+ 943us) server_negotiation.cc:407] Connection header received
0927 15:15:56.463712 (+ 1403us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:15:56.463714 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:15:56.463764 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:15:56.463837 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0927 15:15:56.465006 (+ 1169us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:15:56.465541 (+ 535us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:15:56.466656 (+ 1115us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:15:56.466877 (+ 221us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:15:56.466959 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:15:56.469406 (+ 2447us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0927 15:15:56.469409 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0927 15:15:56.469411 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0927 15:15:56.469435 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0927 15:15:56.470796 (+ 1361us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:15:56.471300 (+ 504us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:15:56.471303 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:15:56.471304 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:15:56.471377 (+ 73us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:15:56.471683 (+ 306us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:15:56.471687 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:15:56.471688 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:15:56.471863 (+ 175us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0927 15:15:56.471946 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0927 15:15:56.472438 (+ 492us) server_negotiation.cc:299] Negotiation successful
0927 15:15:56.472559 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260927 15:15:56.473508 3898 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:15:56.461622 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.62:34223 (local address 127.17.136.2:41721)
0927 15:15:56.462159 (+ 537us) negotiation.cc:107] Waiting for socket to connect
0927 15:15:56.462205 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0927 15:15:56.463503 (+ 1298us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0927 15:15:56.464004 (+ 501us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0927 15:15:56.464010 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0927 15:15:56.464408 (+ 398us) client_negotiation.cc:189] Negotiated authn=SASL
0927 15:15:56.464894 (+ 486us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:15:56.464908 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:15:56.465656 (+ 748us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:15:56.465659 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:15:56.466537 (+ 878us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:15:56.466546 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:15:56.467020 (+ 474us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:15:56.467023 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:15:56.467206 (+ 183us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:15:56.467753 (+ 547us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0927 15:15:56.467769 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0927 15:15:56.469245 (+ 1476us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0927 15:15:56.470904 (+ 1659us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0927 15:15:56.470910 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0927 15:15:56.470925 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0927 15:15:56.471185 (+ 260us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0927 15:15:56.471460 (+ 275us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0927 15:15:56.471462 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0927 15:15:56.471464 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0927 15:15:56.471598 (+ 134us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0927 15:15:56.471958 (+ 360us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0927 15:15:56.471965 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0927 15:15:56.472212 (+ 247us) client_negotiation.cc:769] Sending connection context
0927 15:15:56.472378 (+ 166us) client_negotiation.cc:240] Negotiation successful
0927 15:15:56.472694 (+ 316us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":297,"thread_start_us":118,"threads_started":1}
I20260927 15:15:56.474655 3896 heartbeater.cc:347] Connected to a master server at 127.17.136.62:34223
I20260927 15:15:56.474881 3896 heartbeater.cc:464] Registering TS with master...
I20260927 15:15:56.475384 3896 heartbeater.cc:511] Master 127.17.136.62:34223 requested a full tablet report, sending...
I20260927 15:15:56.476418 3571 ts_manager.cc:194] Registered new tserver with Master: d044f97cc15b4adc86667b19988b3745 (127.17.136.2:46809)
I20260927 15:15:56.476955 3571 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.136.2@KRBTEST.COM'} at 127.17.136.2:41721
WARNING: no policy specified for kudu/127.17.136.3@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.136.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.136.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790521920546562-17952-0/krb5kdc/kudu_127.17.136.3.keytab.
Entry for principal kudu/127.17.136.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790521920546562-17952-0/krb5kdc/kudu_127.17.136.3.keytab.
I20260927 15:15:56.494690 17952 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu
/tmp/dist-test-taskiFOyeW/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790521920546562-17952-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790521920546562-17952-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790521920546562-17952-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790521920546562-17952-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.136.3:0
--local_ip_for_outbound_sockets=127.17.136.3
--webserver_interface=127.17.136.3
--webserver_port=0
--tserver_master_addrs=127.17.136.62:34223
--keytab_file=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790521920546562-17952-0/krb5kdc/kudu_127.17.136.3.keytab
--principal=kudu/127.17.136.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.136.20:40725
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790521920546562-17952-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790521920546562-17952-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790521920546562-17952-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260927 15:15:56.603080 3901 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260927 15:15:56.603380 3901 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260927 15:15:56.603444 3901 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260927 15:15:56.607554 3901 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260927 15:15:56.607609 3901 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260927 15:15:56.607686 3901 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.136.3
I20260927 15:15:56.612846 3901 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.136.20:40725
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790521920546562-17952-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790521920546562-17952-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790521920546562-17952-0/krb5kdc/kudu_127.17.136.3.keytab
--principal=kudu/127.17.136.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.136.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790521920546562-17952-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.17.136.3
--webserver_port=0
--tserver_master_addrs=127.17.136.62:34223
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3901
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.136.3
--log_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790521920546562-17952-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 27 Sep 2026 14:27:13 UTC on ccycloud.quasar-psqrth.root.comops.site
build id 4676138
I20260927 15:15:56.613824 3901 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260927 15:15:56.614789 3901 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260927 15:15:56.624028 3909 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260927 15:15:56.624040 3906 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260927 15:15:56.624045 3907 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260927 15:15:56.624209 3901 server_base.cc:1034] running on GCE node
I20260927 15:15:56.624681 3901 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260927 15:15:56.625284 3901 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260927 15:15:56.626436 3901 hybrid_clock.cc:648] HybridClock initialized: now 1790522156626418 us; error 30 us; skew 500 ppm
Sep 27 15:15:56 dist-test-slave-5s2t krb5kdc[3526](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790522156, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.136.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260927 15:15:56.629127 3901 init.cc:377] Logged in from keytab as kudu/127.17.136.3@KRBTEST.COM (short username kudu)
I20260927 15:15:56.630028 3901 webserver.cc:460] Webserver started at http://127.17.136.3:42401/ using document root <none> and password file <none>
I20260927 15:15:56.630553 3901 fs_manager.cc:359] Metadata directory not provided
I20260927 15:15:56.630610 3901 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260927 15:15:56.630821 3901 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260927 15:15:56.632930 3901 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790521920546562-17952-0/minicluster-data/ts-2/data/instance:
uuid: "7b9fa4372ae447b9b4592803474655ec"
format_stamp: "Formatted at 2026-09-27 15:15:56 on dist-test-slave-5s2t"
server_key: "a3493b43d0f818647d284f1be63418bb"
server_key_iv: "75c09c6d8293e064768085815110c9b2"
server_key_version: "encryptionkey@0"
I20260927 15:15:56.633450 3901 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790521920546562-17952-0/minicluster-data/ts-2/wal/instance:
uuid: "7b9fa4372ae447b9b4592803474655ec"
format_stamp: "Formatted at 2026-09-27 15:15:56 on dist-test-slave-5s2t"
server_key: "a3493b43d0f818647d284f1be63418bb"
server_key_iv: "75c09c6d8293e064768085815110c9b2"
server_key_version: "encryptionkey@0"
I20260927 15:15:56.637055 3901 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260927 15:15:56.639536 3916 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260927 15:15:56.640751 3901 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260927 15:15:56.640861 3901 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790521920546562-17952-0/minicluster-data/ts-2/data,/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790521920546562-17952-0/minicluster-data/ts-2/wal
uuid: "7b9fa4372ae447b9b4592803474655ec"
format_stamp: "Formatted at 2026-09-27 15:15:56 on dist-test-slave-5s2t"
server_key: "a3493b43d0f818647d284f1be63418bb"
server_key_iv: "75c09c6d8293e064768085815110c9b2"
server_key_version: "encryptionkey@0"
I20260927 15:15:56.640977 3901 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790521920546562-17952-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790521920546562-17952-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790521920546562-17952-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260927 15:15:56.653956 3901 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260927 15:15:56.656574 3901 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260927 15:15:56.656728 3901 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260927 15:15:56.657262 3901 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260927 15:15:56.657996 3901 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260927 15:15:56.658041 3901 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260927 15:15:56.658106 3901 ts_tablet_manager.cc:610] Registered 0 tablets
I20260927 15:15:56.658131 3901 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260927 15:15:56.666328 3901 rpc_server.cc:307] RPC server started. Bound to: 127.17.136.3:39151
I20260927 15:15:56.666358 4029 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.136.3:39151 every 8 connection(s)
I20260927 15:15:56.667169 3901 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790521920546562-17952-0/minicluster-data/ts-2/data/info.pb
I20260927 15:15:56.670063 17952 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu as pid 3901
I20260927 15:15:56.670204 17952 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790521920546562-17952-0/minicluster-data/ts-2/wal/instance
I20260927 15:15:56.670518 17952 external_mini_cluster.cc:1428] Setting key 89631169fad2324e57026531cc1e3291
Sep 27 15:15:56 dist-test-slave-5s2t krb5kdc[3526](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790522156, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.136.3@KRBTEST.COM for kudu/127.17.136.62@KRBTEST.COM
I20260927 15:15:56.679836 3610 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:15:56.668875 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.136.3:33221 (local address 127.17.136.62:34223)
0927 15:15:56.669036 (+ 161us) server_negotiation.cc:206] Beginning negotiation
0927 15:15:56.669041 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0927 15:15:56.669795 (+ 754us) server_negotiation.cc:407] Connection header received
0927 15:15:56.671401 (+ 1606us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:15:56.671404 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:15:56.671467 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:15:56.671545 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0927 15:15:56.672789 (+ 1244us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:15:56.673325 (+ 536us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:15:56.674385 (+ 1060us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:15:56.674601 (+ 216us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:15:56.674678 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:15:56.676877 (+ 2199us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0927 15:15:56.676880 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0927 15:15:56.676882 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0927 15:15:56.676907 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0927 15:15:56.678069 (+ 1162us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:15:56.678504 (+ 435us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:15:56.678506 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:15:56.678508 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:15:56.678578 (+ 70us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:15:56.678897 (+ 319us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:15:56.678899 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:15:56.678900 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:15:56.679061 (+ 161us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0927 15:15:56.679127 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0927 15:15:56.679619 (+ 492us) server_negotiation.cc:299] Negotiation successful
0927 15:15:56.679718 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260927 15:15:56.680647 4032 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:15:56.669227 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.62:34223 (local address 127.17.136.3:33221)
0927 15:15:56.669641 (+ 414us) negotiation.cc:107] Waiting for socket to connect
0927 15:15:56.669697 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0927 15:15:56.671156 (+ 1459us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0927 15:15:56.671721 (+ 565us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0927 15:15:56.671730 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0927 15:15:56.672130 (+ 400us) client_negotiation.cc:189] Negotiated authn=SASL
0927 15:15:56.672669 (+ 539us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:15:56.672686 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:15:56.673416 (+ 730us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:15:56.673418 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:15:56.674284 (+ 866us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:15:56.674292 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:15:56.674712 (+ 420us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:15:56.674714 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:15:56.674846 (+ 132us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:15:56.675371 (+ 525us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0927 15:15:56.675387 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0927 15:15:56.676730 (+ 1343us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0927 15:15:56.678173 (+ 1443us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0927 15:15:56.678177 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0927 15:15:56.678188 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0927 15:15:56.678424 (+ 236us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0927 15:15:56.678679 (+ 255us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0927 15:15:56.678682 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0927 15:15:56.678683 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0927 15:15:56.678821 (+ 138us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0927 15:15:56.679129 (+ 308us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0927 15:15:56.679134 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0927 15:15:56.679415 (+ 281us) client_negotiation.cc:769] Sending connection context
0927 15:15:56.679566 (+ 151us) client_negotiation.cc:240] Negotiation successful
0927 15:15:56.679817 (+ 251us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":235,"thread_start_us":111,"threads_started":1}
I20260927 15:15:56.681706 4030 heartbeater.cc:347] Connected to a master server at 127.17.136.62:34223
I20260927 15:15:56.681931 4030 heartbeater.cc:464] Registering TS with master...
I20260927 15:15:56.682381 4030 heartbeater.cc:511] Master 127.17.136.62:34223 requested a full tablet report, sending...
I20260927 15:15:56.683362 3571 ts_manager.cc:194] Registered new tserver with Master: 7b9fa4372ae447b9b4592803474655ec (127.17.136.3:39151)
I20260927 15:15:56.683929 3571 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.136.3@KRBTEST.COM'} at 127.17.136.3:33221
I20260927 15:15:56.684190 17952 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260927 15:15:56.692903 3610 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:15:56.686017 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42296 (local address 127.17.136.62:34223)
0927 15:15:56.686129 (+ 112us) server_negotiation.cc:206] Beginning negotiation
0927 15:15:56.686133 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0927 15:15:56.686315 (+ 182us) server_negotiation.cc:407] Connection header received
0927 15:15:56.686422 (+ 107us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:15:56.686425 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:15:56.686465 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:15:56.686525 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0927 15:15:56.687154 (+ 629us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:15:56.687689 (+ 535us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:15:56.688491 (+ 802us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:15:56.688706 (+ 215us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:15:56.688796 (+ 90us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:15:56.690160 (+ 1364us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0927 15:15:56.690163 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0927 15:15:56.690166 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0927 15:15:56.690191 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0927 15:15:56.691183 (+ 992us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:15:56.691712 (+ 529us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:15:56.691716 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:15:56.691718 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:15:56.691797 (+ 79us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:15:56.692094 (+ 297us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:15:56.692098 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:15:56.692100 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:15:56.692291 (+ 191us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0927 15:15:56.692418 (+ 127us) server_negotiation.cc:1035] Waiting for connection context
0927 15:15:56.692671 (+ 253us) server_negotiation.cc:299] Negotiation successful
0927 15:15:56.692754 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260927 15:15:56.695621 3571 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:42296:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:15:56.698618 3571 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:15:56.712387 4041 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:15:56.706421 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.2:46809 (local address 127.0.0.1:33850)
0927 15:15:56.706782 (+ 361us) negotiation.cc:107] Waiting for socket to connect
0927 15:15:56.706834 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0927 15:15:56.706965 (+ 131us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0927 15:15:56.708035 (+ 1070us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0927 15:15:56.708041 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0927 15:15:56.708064 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0927 15:15:56.708198 (+ 134us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:15:56.708205 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:15:56.709396 (+ 1191us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:15:56.709399 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:15:56.710873 (+ 1474us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:15:56.710884 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:15:56.711849 (+ 965us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:15:56.711852 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:15:56.711960 (+ 108us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:15:56.711997 (+ 37us) client_negotiation.cc:769] Sending connection context
0927 15:15:56.712104 (+ 107us) client_negotiation.cc:240] Negotiation successful
0927 15:15:56.712232 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":173,"mutex_wait_us":113,"thread_start_us":83,"threads_started":1}
I20260927 15:15:56.712596 4046 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:15:56.707550 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47352 (local address 127.17.136.1:46381)
0927 15:15:56.708109 (+ 559us) server_negotiation.cc:206] Beginning negotiation
0927 15:15:56.708121 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0927 15:15:56.708144 (+ 23us) server_negotiation.cc:407] Connection header received
0927 15:15:56.708229 (+ 85us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:15:56.708234 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:15:56.708401 (+ 167us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:15:56.708546 (+ 145us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0927 15:15:56.708719 (+ 173us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:15:56.709759 (+ 1040us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:15:56.711225 (+ 1466us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:15:56.712027 (+ 802us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:15:56.712124 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:15:56.712233 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0927 15:15:56.712339 (+ 106us) server_negotiation.cc:299] Negotiation successful
0927 15:15:56.712440 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":462,"thread_start_us":166,"threads_started":1}
I20260927 15:15:56.712826 4044 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:15:56.707150 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.1:46381 (local address 127.0.0.1:47352)
0927 15:15:56.707597 (+ 447us) negotiation.cc:107] Waiting for socket to connect
0927 15:15:56.707609 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0927 15:15:56.707694 (+ 85us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0927 15:15:56.708536 (+ 842us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0927 15:15:56.708539 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0927 15:15:56.708556 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0927 15:15:56.708631 (+ 75us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:15:56.708637 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:15:56.709870 (+ 1233us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:15:56.709874 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:15:56.711103 (+ 1229us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:15:56.711114 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:15:56.712131 (+ 1017us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:15:56.712134 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:15:56.712220 (+ 86us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:15:56.712239 (+ 19us) client_negotiation.cc:769] Sending connection context
0927 15:15:56.712306 (+ 67us) client_negotiation.cc:240] Negotiation successful
0927 15:15:56.712360 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":383,"mutex_wait_us":4,"thread_start_us":253,"threads_started":1}
I20260927 15:15:56.712926 4042 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:15:56.706561 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33850 (local address 127.17.136.2:46809)
0927 15:15:56.707549 (+ 988us) server_negotiation.cc:206] Beginning negotiation
0927 15:15:56.707561 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0927 15:15:56.707582 (+ 21us) server_negotiation.cc:407] Connection header received
0927 15:15:56.707654 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:15:56.707659 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:15:56.707867 (+ 208us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:15:56.708345 (+ 478us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0927 15:15:56.708480 (+ 135us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:15:56.709279 (+ 799us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:15:56.711043 (+ 1764us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:15:56.711727 (+ 684us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:15:56.711827 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:15:56.711983 (+ 156us) server_negotiation.cc:1035] Waiting for connection context
0927 15:15:56.712459 (+ 476us) server_negotiation.cc:299] Negotiation successful
0927 15:15:56.712787 (+ 328us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":882,"thread_start_us":153,"threads_started":1}
I20260927 15:15:56.713021 4045 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:15:56.707103 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58226 (local address 127.17.136.3:39151)
0927 15:15:56.707552 (+ 449us) server_negotiation.cc:206] Beginning negotiation
0927 15:15:56.707562 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0927 15:15:56.707582 (+ 20us) server_negotiation.cc:407] Connection header received
0927 15:15:56.707654 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:15:56.707659 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:15:56.707866 (+ 207us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:15:56.708014 (+ 148us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0927 15:15:56.708372 (+ 358us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:15:56.709528 (+ 1156us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:15:56.711097 (+ 1569us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:15:56.711923 (+ 826us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:15:56.712026 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:15:56.712168 (+ 142us) server_negotiation.cc:1035] Waiting for connection context
0927 15:15:56.712783 (+ 615us) server_negotiation.cc:299] Negotiation successful
0927 15:15:56.712876 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":375,"thread_start_us":173,"threads_started":1}
I20260927 15:15:56.713234 4043 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:15:56.706641 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.3:39151 (local address 127.0.0.1:58226)
0927 15:15:56.707179 (+ 538us) negotiation.cc:107] Waiting for socket to connect
0927 15:15:56.707191 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0927 15:15:56.707306 (+ 115us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0927 15:15:56.708164 (+ 858us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0927 15:15:56.708167 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0927 15:15:56.708180 (+ 13us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0927 15:15:56.708255 (+ 75us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:15:56.708272 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:15:56.709651 (+ 1379us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:15:56.709655 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:15:56.710995 (+ 1340us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:15:56.711002 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:15:56.712233 (+ 1231us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:15:56.712236 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:15:56.712352 (+ 116us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:15:56.712375 (+ 23us) client_negotiation.cc:769] Sending connection context
0927 15:15:56.712441 (+ 66us) client_negotiation.cc:240] Negotiation successful
0927 15:15:56.712615 (+ 174us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":481,"mutex_wait_us":151,"thread_start_us":103,"threads_started":1}
I20260927 15:15:56.715736 3696 tablet_service.cc:1467] Processing CreateTablet for tablet a555a0134b1c4883b1cd1c919d48df17 (DEFAULT_TABLE table=test-table [id=c3e922e20d844d389ffe124f6ab69285]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:15:56.715781 3964 tablet_service.cc:1467] Processing CreateTablet for tablet a555a0134b1c4883b1cd1c919d48df17 (DEFAULT_TABLE table=test-table [id=c3e922e20d844d389ffe124f6ab69285]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:15:56.715781 3830 tablet_service.cc:1467] Processing CreateTablet for tablet a555a0134b1c4883b1cd1c919d48df17 (DEFAULT_TABLE table=test-table [id=c3e922e20d844d389ffe124f6ab69285]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:15:56.716801 3696 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a555a0134b1c4883b1cd1c919d48df17. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:15:56.716813 3964 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a555a0134b1c4883b1cd1c919d48df17. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:15:56.716807 3830 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a555a0134b1c4883b1cd1c919d48df17. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:15:56.724365 4047 tablet_bootstrap.cc:492] T a555a0134b1c4883b1cd1c919d48df17 P 5d847d71426a409881bae41cd14e2a57: Bootstrap starting.
I20260927 15:15:56.726282 4047 tablet_bootstrap.cc:654] T a555a0134b1c4883b1cd1c919d48df17 P 5d847d71426a409881bae41cd14e2a57: Neither blocks nor log segments found. Creating new log.
I20260927 15:15:56.726636 4048 tablet_bootstrap.cc:492] T a555a0134b1c4883b1cd1c919d48df17 P 7b9fa4372ae447b9b4592803474655ec: Bootstrap starting.
I20260927 15:15:56.727411 4047 log.cc:824] T a555a0134b1c4883b1cd1c919d48df17 P 5d847d71426a409881bae41cd14e2a57: Log is configured to *not* fsync() on all Append() calls
I20260927 15:15:56.727903 4049 tablet_bootstrap.cc:492] T a555a0134b1c4883b1cd1c919d48df17 P d044f97cc15b4adc86667b19988b3745: Bootstrap starting.
I20260927 15:15:56.728879 4048 tablet_bootstrap.cc:654] T a555a0134b1c4883b1cd1c919d48df17 P 7b9fa4372ae447b9b4592803474655ec: Neither blocks nor log segments found. Creating new log.
I20260927 15:15:56.729687 4047 tablet_bootstrap.cc:492] T a555a0134b1c4883b1cd1c919d48df17 P 5d847d71426a409881bae41cd14e2a57: No bootstrap required, opened a new log
I20260927 15:15:56.729938 4047 ts_tablet_manager.cc:1397] T a555a0134b1c4883b1cd1c919d48df17 P 5d847d71426a409881bae41cd14e2a57: Time spent bootstrapping tablet: real 0.006s user 0.000s sys 0.005s
I20260927 15:15:56.730270 4048 log.cc:824] T a555a0134b1c4883b1cd1c919d48df17 P 7b9fa4372ae447b9b4592803474655ec: Log is configured to *not* fsync() on all Append() calls
I20260927 15:15:56.730443 4049 tablet_bootstrap.cc:654] T a555a0134b1c4883b1cd1c919d48df17 P d044f97cc15b4adc86667b19988b3745: Neither blocks nor log segments found. Creating new log.
I20260927 15:15:56.731230 4049 log.cc:824] T a555a0134b1c4883b1cd1c919d48df17 P d044f97cc15b4adc86667b19988b3745: Log is configured to *not* fsync() on all Append() calls
I20260927 15:15:56.732544 4048 tablet_bootstrap.cc:492] T a555a0134b1c4883b1cd1c919d48df17 P 7b9fa4372ae447b9b4592803474655ec: No bootstrap required, opened a new log
I20260927 15:15:56.732738 4048 ts_tablet_manager.cc:1397] T a555a0134b1c4883b1cd1c919d48df17 P 7b9fa4372ae447b9b4592803474655ec: Time spent bootstrapping tablet: real 0.006s user 0.000s sys 0.004s
I20260927 15:15:56.733206 4049 tablet_bootstrap.cc:492] T a555a0134b1c4883b1cd1c919d48df17 P d044f97cc15b4adc86667b19988b3745: No bootstrap required, opened a new log
I20260927 15:15:56.733386 4049 ts_tablet_manager.cc:1397] T a555a0134b1c4883b1cd1c919d48df17 P d044f97cc15b4adc86667b19988b3745: Time spent bootstrapping tablet: real 0.006s user 0.000s sys 0.004s
I20260927 15:15:56.733685 4047 raft_consensus.cc:348] T a555a0134b1c4883b1cd1c919d48df17 P 5d847d71426a409881bae41cd14e2a57 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d044f97cc15b4adc86667b19988b3745" member_type: VOTER last_known_addr { host: "127.17.136.2" port: 46809 } } peers { permanent_uuid: "5d847d71426a409881bae41cd14e2a57" member_type: VOTER last_known_addr { host: "127.17.136.1" port: 46381 } } peers { permanent_uuid: "7b9fa4372ae447b9b4592803474655ec" member_type: VOTER last_known_addr { host: "127.17.136.3" port: 39151 } }
I20260927 15:15:56.733933 4047 raft_consensus.cc:374] T a555a0134b1c4883b1cd1c919d48df17 P 5d847d71426a409881bae41cd14e2a57 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:15:56.733986 4047 raft_consensus.cc:729] T a555a0134b1c4883b1cd1c919d48df17 P 5d847d71426a409881bae41cd14e2a57 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d847d71426a409881bae41cd14e2a57, State: Initialized, Role: FOLLOWER
I20260927 15:15:56.734414 4047 consensus_queue.cc:260] T a555a0134b1c4883b1cd1c919d48df17 P 5d847d71426a409881bae41cd14e2a57 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d044f97cc15b4adc86667b19988b3745" member_type: VOTER last_known_addr { host: "127.17.136.2" port: 46809 } } peers { permanent_uuid: "5d847d71426a409881bae41cd14e2a57" member_type: VOTER last_known_addr { host: "127.17.136.1" port: 46381 } } peers { permanent_uuid: "7b9fa4372ae447b9b4592803474655ec" member_type: VOTER last_known_addr { host: "127.17.136.3" port: 39151 } }
I20260927 15:15:56.735062 3762 heartbeater.cc:503] Master 127.17.136.62:34223 was elected leader, sending a full tablet report...
I20260927 15:15:56.735489 4047 ts_tablet_manager.cc:1428] T a555a0134b1c4883b1cd1c919d48df17 P 5d847d71426a409881bae41cd14e2a57: Time spent starting tablet: real 0.005s user 0.005s sys 0.000s
I20260927 15:15:56.736646 4048 raft_consensus.cc:348] T a555a0134b1c4883b1cd1c919d48df17 P 7b9fa4372ae447b9b4592803474655ec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d044f97cc15b4adc86667b19988b3745" member_type: VOTER last_known_addr { host: "127.17.136.2" port: 46809 } } peers { permanent_uuid: "5d847d71426a409881bae41cd14e2a57" member_type: VOTER last_known_addr { host: "127.17.136.1" port: 46381 } } peers { permanent_uuid: "7b9fa4372ae447b9b4592803474655ec" member_type: VOTER last_known_addr { host: "127.17.136.3" port: 39151 } }
I20260927 15:15:56.736919 4048 raft_consensus.cc:374] T a555a0134b1c4883b1cd1c919d48df17 P 7b9fa4372ae447b9b4592803474655ec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:15:56.736963 4048 raft_consensus.cc:729] T a555a0134b1c4883b1cd1c919d48df17 P 7b9fa4372ae447b9b4592803474655ec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7b9fa4372ae447b9b4592803474655ec, State: Initialized, Role: FOLLOWER
I20260927 15:15:56.737413 4048 consensus_queue.cc:260] T a555a0134b1c4883b1cd1c919d48df17 P 7b9fa4372ae447b9b4592803474655ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d044f97cc15b4adc86667b19988b3745" member_type: VOTER last_known_addr { host: "127.17.136.2" port: 46809 } } peers { permanent_uuid: "5d847d71426a409881bae41cd14e2a57" member_type: VOTER last_known_addr { host: "127.17.136.1" port: 46381 } } peers { permanent_uuid: "7b9fa4372ae447b9b4592803474655ec" member_type: VOTER last_known_addr { host: "127.17.136.3" port: 39151 } }
I20260927 15:15:56.737409 4049 raft_consensus.cc:348] T a555a0134b1c4883b1cd1c919d48df17 P d044f97cc15b4adc86667b19988b3745 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d044f97cc15b4adc86667b19988b3745" member_type: VOTER last_known_addr { host: "127.17.136.2" port: 46809 } } peers { permanent_uuid: "5d847d71426a409881bae41cd14e2a57" member_type: VOTER last_known_addr { host: "127.17.136.1" port: 46381 } } peers { permanent_uuid: "7b9fa4372ae447b9b4592803474655ec" member_type: VOTER last_known_addr { host: "127.17.136.3" port: 39151 } }
I20260927 15:15:56.737653 4049 raft_consensus.cc:374] T a555a0134b1c4883b1cd1c919d48df17 P d044f97cc15b4adc86667b19988b3745 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:15:56.737715 4049 raft_consensus.cc:729] T a555a0134b1c4883b1cd1c919d48df17 P d044f97cc15b4adc86667b19988b3745 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d044f97cc15b4adc86667b19988b3745, State: Initialized, Role: FOLLOWER
I20260927 15:15:56.738103 4030 heartbeater.cc:503] Master 127.17.136.62:34223 was elected leader, sending a full tablet report...
I20260927 15:15:56.738152 4049 consensus_queue.cc:260] T a555a0134b1c4883b1cd1c919d48df17 P d044f97cc15b4adc86667b19988b3745 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d044f97cc15b4adc86667b19988b3745" member_type: VOTER last_known_addr { host: "127.17.136.2" port: 46809 } } peers { permanent_uuid: "5d847d71426a409881bae41cd14e2a57" member_type: VOTER last_known_addr { host: "127.17.136.1" port: 46381 } } peers { permanent_uuid: "7b9fa4372ae447b9b4592803474655ec" member_type: VOTER last_known_addr { host: "127.17.136.3" port: 39151 } }
I20260927 15:15:56.738459 4048 ts_tablet_manager.cc:1428] T a555a0134b1c4883b1cd1c919d48df17 P 7b9fa4372ae447b9b4592803474655ec: Time spent starting tablet: real 0.006s user 0.007s sys 0.000s
I20260927 15:15:56.739001 3896 heartbeater.cc:503] Master 127.17.136.62:34223 was elected leader, sending a full tablet report...
I20260927 15:15:56.739306 4049 ts_tablet_manager.cc:1428] T a555a0134b1c4883b1cd1c919d48df17 P d044f97cc15b4adc86667b19988b3745: Time spent starting tablet: real 0.006s user 0.006s sys 0.001s
I20260927 15:15:56.750617 4053 raft_consensus.cc:482] T a555a0134b1c4883b1cd1c919d48df17 P 5d847d71426a409881bae41cd14e2a57 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:15:56.750823 4053 raft_consensus.cc:504] T a555a0134b1c4883b1cd1c919d48df17 P 5d847d71426a409881bae41cd14e2a57 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d044f97cc15b4adc86667b19988b3745" member_type: VOTER last_known_addr { host: "127.17.136.2" port: 46809 } } peers { permanent_uuid: "5d847d71426a409881bae41cd14e2a57" member_type: VOTER last_known_addr { host: "127.17.136.1" port: 46381 } } peers { permanent_uuid: "7b9fa4372ae447b9b4592803474655ec" member_type: VOTER last_known_addr { host: "127.17.136.3" port: 39151 } }
I20260927 15:15:56.751999 4053 leader_election.cc:288] T a555a0134b1c4883b1cd1c919d48df17 P 5d847d71426a409881bae41cd14e2a57 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d044f97cc15b4adc86667b19988b3745 (127.17.136.2:46809), 7b9fa4372ae447b9b4592803474655ec (127.17.136.3:39151)
W20260927 15:15:56.754694 3763 tablet.cc:2369] T a555a0134b1c4883b1cd1c919d48df17 P 5d847d71426a409881bae41cd14e2a57: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260927 15:15:56.756656 4042 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:15:56.752298 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.136.1:51267 (local address 127.17.136.2:46809)
0927 15:15:56.752404 (+ 106us) server_negotiation.cc:206] Beginning negotiation
0927 15:15:56.752409 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0927 15:15:56.752453 (+ 44us) server_negotiation.cc:407] Connection header received
0927 15:15:56.752626 (+ 173us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:15:56.752629 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:15:56.752679 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:15:56.752759 (+ 80us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0927 15:15:56.753019 (+ 260us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:15:56.753795 (+ 776us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:15:56.755454 (+ 1659us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:15:56.756055 (+ 601us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:15:56.756149 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:15:56.756201 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0927 15:15:56.756452 (+ 251us) server_negotiation.cc:299] Negotiation successful
0927 15:15:56.756523 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260927 15:15:56.756656 4045 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:15:56.752360 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.136.1:40433 (local address 127.17.136.3:39151)
0927 15:15:56.752489 (+ 129us) server_negotiation.cc:206] Beginning negotiation
0927 15:15:56.752494 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0927 15:15:56.752722 (+ 228us) server_negotiation.cc:407] Connection header received
0927 15:15:56.752801 (+ 79us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:15:56.752804 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:15:56.752848 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:15:56.752906 (+ 58us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0927 15:15:56.753123 (+ 217us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:15:56.753839 (+ 716us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:15:56.755391 (+ 1552us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:15:56.756027 (+ 636us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:15:56.756149 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:15:56.756201 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0927 15:15:56.756452 (+ 251us) server_negotiation.cc:299] Negotiation successful
0927 15:15:56.756523 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260927 15:15:56.756695 3764 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:15:56.752201 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.2:46809 (local address 127.17.136.1:51267)
0927 15:15:56.752386 (+ 185us) negotiation.cc:107] Waiting for socket to connect
0927 15:15:56.752402 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0927 15:15:56.752509 (+ 107us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0927 15:15:56.752788 (+ 279us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0927 15:15:56.752791 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0927 15:15:56.752806 (+ 15us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0927 15:15:56.752916 (+ 110us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:15:56.752923 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:15:56.753900 (+ 977us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:15:56.753904 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:15:56.755343 (+ 1439us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:15:56.755356 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:15:56.756158 (+ 802us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:15:56.756161 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:15:56.756318 (+ 157us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:15:56.756352 (+ 34us) client_negotiation.cc:769] Sending connection context
0927 15:15:56.756428 (+ 76us) client_negotiation.cc:240] Negotiation successful
0927 15:15:56.756544 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":110,"mutex_wait_us":176}
I20260927 15:15:56.756703 4056 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:15:56.752257 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.3:39151 (local address 127.17.136.1:40433)
0927 15:15:56.752635 (+ 378us) negotiation.cc:107] Waiting for socket to connect
0927 15:15:56.752646 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0927 15:15:56.752726 (+ 80us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0927 15:15:56.752923 (+ 197us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0927 15:15:56.752926 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0927 15:15:56.752938 (+ 12us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0927 15:15:56.753039 (+ 101us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:15:56.753044 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:15:56.753916 (+ 872us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:15:56.753919 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:15:56.755296 (+ 1377us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:15:56.755308 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:15:56.756152 (+ 844us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:15:56.756173 (+ 21us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:15:56.756313 (+ 140us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:15:56.756360 (+ 47us) client_negotiation.cc:769] Sending connection context
0927 15:15:56.756428 (+ 68us) client_negotiation.cc:240] Negotiation successful
0927 15:15:56.756544 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":320,"mutex_wait_us":86,"thread_start_us":139,"threads_started":1}
I20260927 15:15:56.757308 3850 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a555a0134b1c4883b1cd1c919d48df17" candidate_uuid: "5d847d71426a409881bae41cd14e2a57" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d044f97cc15b4adc86667b19988b3745" is_pre_election: true
I20260927 15:15:56.757304 3984 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a555a0134b1c4883b1cd1c919d48df17" candidate_uuid: "5d847d71426a409881bae41cd14e2a57" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7b9fa4372ae447b9b4592803474655ec" is_pre_election: true
I20260927 15:15:56.757579 3984 raft_consensus.cc:2454] T a555a0134b1c4883b1cd1c919d48df17 P 7b9fa4372ae447b9b4592803474655ec [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d847d71426a409881bae41cd14e2a57 in term 0.
I20260927 15:15:56.757587 3850 raft_consensus.cc:2454] T a555a0134b1c4883b1cd1c919d48df17 P d044f97cc15b4adc86667b19988b3745 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d847d71426a409881bae41cd14e2a57 in term 0.
I20260927 15:15:56.758015 3650 leader_election.cc:302] T a555a0134b1c4883b1cd1c919d48df17 P 5d847d71426a409881bae41cd14e2a57 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d847d71426a409881bae41cd14e2a57, 7b9fa4372ae447b9b4592803474655ec; no voters:
I20260927 15:15:56.758282 4053 raft_consensus.cc:2781] T a555a0134b1c4883b1cd1c919d48df17 P 5d847d71426a409881bae41cd14e2a57 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 15:15:56.758368 4053 raft_consensus.cc:482] T a555a0134b1c4883b1cd1c919d48df17 P 5d847d71426a409881bae41cd14e2a57 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 15:15:56.758417 4053 raft_consensus.cc:3037] T a555a0134b1c4883b1cd1c919d48df17 P 5d847d71426a409881bae41cd14e2a57 [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:15:56.759465 4053 raft_consensus.cc:504] T a555a0134b1c4883b1cd1c919d48df17 P 5d847d71426a409881bae41cd14e2a57 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d044f97cc15b4adc86667b19988b3745" member_type: VOTER last_known_addr { host: "127.17.136.2" port: 46809 } } peers { permanent_uuid: "5d847d71426a409881bae41cd14e2a57" member_type: VOTER last_known_addr { host: "127.17.136.1" port: 46381 } } peers { permanent_uuid: "7b9fa4372ae447b9b4592803474655ec" member_type: VOTER last_known_addr { host: "127.17.136.3" port: 39151 } }
I20260927 15:15:56.759805 4053 leader_election.cc:288] T a555a0134b1c4883b1cd1c919d48df17 P 5d847d71426a409881bae41cd14e2a57 [CANDIDATE]: Term 1 election: Requested vote from peers d044f97cc15b4adc86667b19988b3745 (127.17.136.2:46809), 7b9fa4372ae447b9b4592803474655ec (127.17.136.3:39151)
I20260927 15:15:56.760136 3984 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a555a0134b1c4883b1cd1c919d48df17" candidate_uuid: "5d847d71426a409881bae41cd14e2a57" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7b9fa4372ae447b9b4592803474655ec"
I20260927 15:15:56.760135 3850 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a555a0134b1c4883b1cd1c919d48df17" candidate_uuid: "5d847d71426a409881bae41cd14e2a57" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d044f97cc15b4adc86667b19988b3745"
I20260927 15:15:56.760243 3984 raft_consensus.cc:3037] T a555a0134b1c4883b1cd1c919d48df17 P 7b9fa4372ae447b9b4592803474655ec [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:15:56.760270 3850 raft_consensus.cc:3037] T a555a0134b1c4883b1cd1c919d48df17 P d044f97cc15b4adc86667b19988b3745 [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:15:56.761190 3984 raft_consensus.cc:2454] T a555a0134b1c4883b1cd1c919d48df17 P 7b9fa4372ae447b9b4592803474655ec [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d847d71426a409881bae41cd14e2a57 in term 1.
I20260927 15:15:56.761276 3850 raft_consensus.cc:2454] T a555a0134b1c4883b1cd1c919d48df17 P d044f97cc15b4adc86667b19988b3745 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d847d71426a409881bae41cd14e2a57 in term 1.
I20260927 15:15:56.761451 3650 leader_election.cc:302] T a555a0134b1c4883b1cd1c919d48df17 P 5d847d71426a409881bae41cd14e2a57 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d847d71426a409881bae41cd14e2a57, 7b9fa4372ae447b9b4592803474655ec; no voters:
I20260927 15:15:56.761602 4053 raft_consensus.cc:2781] T a555a0134b1c4883b1cd1c919d48df17 P 5d847d71426a409881bae41cd14e2a57 [term 1 FOLLOWER]: Leader election won for term 1
I20260927 15:15:56.761798 4053 raft_consensus.cc:686] T a555a0134b1c4883b1cd1c919d48df17 P 5d847d71426a409881bae41cd14e2a57 [term 1 LEADER]: Becoming Leader. State: Replica: 5d847d71426a409881bae41cd14e2a57, State: Running, Role: LEADER
I20260927 15:15:56.762125 4053 consensus_queue.cc:237] T a555a0134b1c4883b1cd1c919d48df17 P 5d847d71426a409881bae41cd14e2a57 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d044f97cc15b4adc86667b19988b3745" member_type: VOTER last_known_addr { host: "127.17.136.2" port: 46809 } } peers { permanent_uuid: "5d847d71426a409881bae41cd14e2a57" member_type: VOTER last_known_addr { host: "127.17.136.1" port: 46381 } } peers { permanent_uuid: "7b9fa4372ae447b9b4592803474655ec" member_type: VOTER last_known_addr { host: "127.17.136.3" port: 39151 } }
I20260927 15:15:56.765071 3570 catalog_manager.cc:5495] T a555a0134b1c4883b1cd1c919d48df17 P 5d847d71426a409881bae41cd14e2a57 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5d847d71426a409881bae41cd14e2a57 (127.17.136.1). New cstate: current_term: 1 leader_uuid: "5d847d71426a409881bae41cd14e2a57" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d044f97cc15b4adc86667b19988b3745" member_type: VOTER last_known_addr { host: "127.17.136.2" port: 46809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d847d71426a409881bae41cd14e2a57" member_type: VOTER last_known_addr { host: "127.17.136.1" port: 46381 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7b9fa4372ae447b9b4592803474655ec" member_type: VOTER last_known_addr { host: "127.17.136.3" port: 39151 } health_report { overall_health: UNKNOWN } } }
I20260927 15:15:56.776170 4046 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:15:56.772708 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47354 (local address 127.17.136.1:46381)
0927 15:15:56.772846 (+ 138us) server_negotiation.cc:206] Beginning negotiation
0927 15:15:56.772850 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0927 15:15:56.772865 (+ 15us) server_negotiation.cc:407] Connection header received
0927 15:15:56.772972 (+ 107us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:15:56.772974 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:15:56.773029 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:15:56.773138 (+ 109us) server_negotiation.cc:226] Negotiated authn=TOKEN
0927 15:15:56.773362 (+ 224us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:15:56.773887 (+ 525us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:15:56.774704 (+ 817us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:15:56.774911 (+ 207us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:15:56.774994 (+ 83us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:15:56.775329 (+ 335us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0927 15:15:56.775738 (+ 409us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0927 15:15:56.775869 (+ 131us) server_negotiation.cc:1035] Waiting for connection context
0927 15:15:56.775987 (+ 118us) server_negotiation.cc:299] Negotiation successful
0927 15:15:56.776025 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260927 15:15:56.781629 3850 raft_consensus.cc:1261] T a555a0134b1c4883b1cd1c919d48df17 P d044f97cc15b4adc86667b19988b3745 [term 1 FOLLOWER]: Refusing update from remote peer 5d847d71426a409881bae41cd14e2a57: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260927 15:15:56.781629 3984 raft_consensus.cc:1261] T a555a0134b1c4883b1cd1c919d48df17 P 7b9fa4372ae447b9b4592803474655ec [term 1 FOLLOWER]: Refusing update from remote peer 5d847d71426a409881bae41cd14e2a57: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260927 15:15:56.782281 4057 consensus_queue.cc:1035] T a555a0134b1c4883b1cd1c919d48df17 P 5d847d71426a409881bae41cd14e2a57 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7b9fa4372ae447b9b4592803474655ec" member_type: VOTER last_known_addr { host: "127.17.136.3" port: 39151 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260927 15:15:56.782460 4053 consensus_queue.cc:1035] T a555a0134b1c4883b1cd1c919d48df17 P 5d847d71426a409881bae41cd14e2a57 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d044f97cc15b4adc86667b19988b3745" member_type: VOTER last_known_addr { host: "127.17.136.2" port: 46809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260927 15:15:56.790823 4062 mvcc.cc:205] Tried to move back new op lower bound from 7333978754171117568 to 7333978754100154368. Current Snapshot: MvccSnapshot[applied={T|T < 7333978754171117568}]
I20260927 15:15:56.797942 3569 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:42296:
table { table_name: "test-table" } modify_external_catalogs: true
I20260927 15:15:56.798107 3569 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:42296:
table { table_name: "test-table" } modify_external_catalogs: true
I20260927 15:15:56.800462 3569 catalog_manager.cc:5782] T 00000000000000000000000000000000 P d0ce69b79b75446d8935d17385ef1396: Sending DeleteTablet for 3 replicas of tablet a555a0134b1c4883b1cd1c919d48df17
I20260927 15:15:56.801308 3830 tablet_service.cc:1514] Processing DeleteTablet for tablet a555a0134b1c4883b1cd1c919d48df17 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:15:56 UTC) from {username='kudu', principal='kudu/127.17.136.62@KRBTEST.COM'} at 127.0.0.1:33850
I20260927 15:15:56.801306 3964 tablet_service.cc:1514] Processing DeleteTablet for tablet a555a0134b1c4883b1cd1c919d48df17 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:15:56 UTC) from {username='kudu', principal='kudu/127.17.136.62@KRBTEST.COM'} at 127.0.0.1:58226
I20260927 15:15:56.801432 3696 tablet_service.cc:1514] Processing DeleteTablet for tablet a555a0134b1c4883b1cd1c919d48df17 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:15:56 UTC) from {username='kudu', principal='kudu/127.17.136.62@KRBTEST.COM'} at 127.0.0.1:47352
I20260927 15:15:56.801923 4072 tablet_replica.cc:330] T a555a0134b1c4883b1cd1c919d48df17 P 5d847d71426a409881bae41cd14e2a57: stopping tablet replica
I20260927 15:15:56.802065 4070 tablet_replica.cc:330] T a555a0134b1c4883b1cd1c919d48df17 P 7b9fa4372ae447b9b4592803474655ec: stopping tablet replica
I20260927 15:15:56.802248 4072 raft_consensus.cc:2229] T a555a0134b1c4883b1cd1c919d48df17 P 5d847d71426a409881bae41cd14e2a57 [term 1 LEADER]: Raft consensus shutting down.
I20260927 15:15:56.802346 4070 raft_consensus.cc:2229] T a555a0134b1c4883b1cd1c919d48df17 P 7b9fa4372ae447b9b4592803474655ec [term 1 FOLLOWER]: Raft consensus shutting down.
I20260927 15:15:56.802589 17952 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu with pid 3633
I20260927 15:15:56.802665 4070 raft_consensus.cc:2258] T a555a0134b1c4883b1cd1c919d48df17 P 7b9fa4372ae447b9b4592803474655ec [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 15:15:56.803014 4071 tablet_replica.cc:330] T a555a0134b1c4883b1cd1c919d48df17 P d044f97cc15b4adc86667b19988b3745: stopping tablet replica
I20260927 15:15:56.803294 4071 raft_consensus.cc:2229] T a555a0134b1c4883b1cd1c919d48df17 P d044f97cc15b4adc86667b19988b3745 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260927 15:15:56.803576 4071 raft_consensus.cc:2258] T a555a0134b1c4883b1cd1c919d48df17 P d044f97cc15b4adc86667b19988b3745 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 15:15:56.805192 4071 ts_tablet_manager.cc:1905] T a555a0134b1c4883b1cd1c919d48df17 P d044f97cc15b4adc86667b19988b3745: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:15:56.805862 4070 ts_tablet_manager.cc:1905] T a555a0134b1c4883b1cd1c919d48df17 P 7b9fa4372ae447b9b4592803474655ec: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:15:56.807940 4071 ts_tablet_manager.cc:1918] T a555a0134b1c4883b1cd1c919d48df17 P d044f97cc15b4adc86667b19988b3745: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260927 15:15:56.808039 4071 log.cc:1196] T a555a0134b1c4883b1cd1c919d48df17 P d044f97cc15b4adc86667b19988b3745: Deleting WAL directory at /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790521920546562-17952-0/minicluster-data/ts-1/wal/wals/a555a0134b1c4883b1cd1c919d48df17
I20260927 15:15:56.808348 4071 ts_tablet_manager.cc:1939] T a555a0134b1c4883b1cd1c919d48df17 P d044f97cc15b4adc86667b19988b3745: Deleting consensus metadata
I20260927 15:15:56.808753 4070 ts_tablet_manager.cc:1918] T a555a0134b1c4883b1cd1c919d48df17 P 7b9fa4372ae447b9b4592803474655ec: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260927 15:15:56.808840 4070 log.cc:1196] T a555a0134b1c4883b1cd1c919d48df17 P 7b9fa4372ae447b9b4592803474655ec: Deleting WAL directory at /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790521920546562-17952-0/minicluster-data/ts-2/wal/wals/a555a0134b1c4883b1cd1c919d48df17
W20260927 15:15:56.808900 3558 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.17.136.1:46381 (error 108)
I20260927 15:15:56.809108 4070 ts_tablet_manager.cc:1939] T a555a0134b1c4883b1cd1c919d48df17 P 7b9fa4372ae447b9b4592803474655ec: Deleting consensus metadata
I20260927 15:15:56.809669 17952 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu with pid 3767
I20260927 15:15:56.809928 4043 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:15:56.809605 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.1:46381 (local address 127.0.0.1:47364)
0927 15:15:56.809781 (+ 176us) negotiation.cc:107] Waiting for socket to connect
0927 15:15:56.809846 (+ 65us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.136.1:46381: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":103}
I20260927 15:15:56.810209 3556 catalog_manager.cc:4841] TS 7b9fa4372ae447b9b4592803474655ec (127.17.136.3:39151): tablet a555a0134b1c4883b1cd1c919d48df17 (table test-table [id=c3e922e20d844d389ffe124f6ab69285]) successfully deleted
W20260927 15:15:56.810860 3558 catalog_manager.cc:4584] TS 5d847d71426a409881bae41cd14e2a57 (127.17.136.1:46381): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet a555a0134b1c4883b1cd1c919d48df17: Network error: Client connection negotiation failed: client connection to 127.17.136.1:46381: connect: Connection refused (error 111)
I20260927 15:15:56.814497 17952 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu with pid 3901
I20260927 15:15:56.814879 4043 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:15:56.814602 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.2:46809 (local address 127.0.0.1:33862)
0927 15:15:56.814765 (+ 163us) negotiation.cc:107] Waiting for socket to connect
0927 15:15:56.814809 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.136.2:46809: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":99}
I20260927 15:15:56.819094 17952 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu with pid 3539
2026-09-27T15:15:56Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/2 (2070 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/3
2026-09-27T15:15:56Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-27T15:15:56Z Disabled control of system clock
I20260927 15:15:56.846611 17952 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu
/tmp/dist-test-taskiFOyeW/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790521920546562-17952-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790521920546562-17952-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790521920546562-17952-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790521920546562-17952-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.136.62:35275
--webserver_interface=127.17.136.62
--webserver_port=0
--builtin_ntp_servers=127.17.136.20:33667
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.136.62:35275
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260927 15:15:56.954481 4077 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260927 15:15:56.954798 4077 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260927 15:15:56.954887 4077 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260927 15:15:56.958930 4077 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260927 15:15:56.958997 4077 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260927 15:15:56.959010 4077 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260927 15:15:56.959025 4077 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260927 15:15:56.959039 4077 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260927 15:15:56.963933 4077 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.136.20:33667
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790521920546562-17952-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790521920546562-17952-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.17.136.62:35275
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.136.62:35275
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790521920546562-17952-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.17.136.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4077
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790521920546562-17952-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 27 Sep 2026 14:27:13 UTC on ccycloud.quasar-psqrth.root.comops.site
build id 4676138
I20260927 15:15:56.964994 4077 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260927 15:15:56.966327 4077 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260927 15:15:56.974184 4082 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260927 15:15:56.974218 4083 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260927 15:15:56.974229 4085 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260927 15:15:56.974323 4077 server_base.cc:1034] running on GCE node
I20260927 15:15:56.974978 4077 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260927 15:15:56.976073 4077 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260927 15:15:56.977229 4077 hybrid_clock.cc:648] HybridClock initialized: now 1790522156977218 us; error 29 us; skew 500 ppm
I20260927 15:15:56.978982 4077 webserver.cc:460] Webserver started at http://127.17.136.62:40559/ using document root <none> and password file <none>
I20260927 15:15:56.979568 4077 fs_manager.cc:359] Metadata directory not provided
I20260927 15:15:56.979637 4077 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260927 15:15:56.979842 4077 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260927 15:15:56.981834 4077 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790521920546562-17952-0/minicluster-data/master-0/data/instance:
uuid: "122836d0380b4dd2b71217df9640e050"
format_stamp: "Formatted at 2026-09-27 15:15:56 on dist-test-slave-5s2t"
server_key: "e2b3c89bff782997faba6303b0c5329d"
server_key_iv: "cadda12c40ea648ffb348bfc44cc07b2"
server_key_version: "encryptionkey@0"
I20260927 15:15:56.982369 4077 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790521920546562-17952-0/minicluster-data/master-0/wal/instance:
uuid: "122836d0380b4dd2b71217df9640e050"
format_stamp: "Formatted at 2026-09-27 15:15:56 on dist-test-slave-5s2t"
server_key: "e2b3c89bff782997faba6303b0c5329d"
server_key_iv: "cadda12c40ea648ffb348bfc44cc07b2"
server_key_version: "encryptionkey@0"
I20260927 15:15:56.985934 4077 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.003s
I20260927 15:15:56.988286 4091 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260927 15:15:56.989437 4077 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260927 15:15:56.989549 4077 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790521920546562-17952-0/minicluster-data/master-0/data,/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790521920546562-17952-0/minicluster-data/master-0/wal
uuid: "122836d0380b4dd2b71217df9640e050"
format_stamp: "Formatted at 2026-09-27 15:15:56 on dist-test-slave-5s2t"
server_key: "e2b3c89bff782997faba6303b0c5329d"
server_key_iv: "cadda12c40ea648ffb348bfc44cc07b2"
server_key_version: "encryptionkey@0"
I20260927 15:15:56.989640 4077 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790521920546562-17952-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790521920546562-17952-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790521920546562-17952-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260927 15:15:57.008982 4077 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260927 15:15:57.009721 4077 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260927 15:15:57.009899 4077 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260927 15:15:57.016479 4077 rpc_server.cc:307] RPC server started. Bound to: 127.17.136.62:35275
I20260927 15:15:57.016495 4143 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.136.62:35275 every 8 connection(s)
I20260927 15:15:57.017423 4077 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790521920546562-17952-0/minicluster-data/master-0/data/info.pb
I20260927 15:15:57.020499 4144 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:15:57.022181 17952 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu as pid 4077
I20260927 15:15:57.022317 17952 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790521920546562-17952-0/minicluster-data/master-0/wal/instance
I20260927 15:15:57.022598 17952 external_mini_cluster.cc:1428] Setting key c899e2b1d55203bdd09049299aef18b7
I20260927 15:15:57.026942 4144 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 122836d0380b4dd2b71217df9640e050: Bootstrap starting.
I20260927 15:15:57.029124 4144 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 122836d0380b4dd2b71217df9640e050: Neither blocks nor log segments found. Creating new log.
I20260927 15:15:57.029814 4144 log.cc:824] T 00000000000000000000000000000000 P 122836d0380b4dd2b71217df9640e050: Log is configured to *not* fsync() on all Append() calls
I20260927 15:15:57.031642 4147 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:15:57.024071 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52056 (local address 127.17.136.62:35275)
0927 15:15:57.024727 (+ 656us) server_negotiation.cc:206] Beginning negotiation
0927 15:15:57.024742 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0927 15:15:57.024793 (+ 51us) server_negotiation.cc:407] Connection header received
0927 15:15:57.025445 (+ 652us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:15:57.025463 (+ 18us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:15:57.025876 (+ 413us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:15:57.026184 (+ 308us) server_negotiation.cc:226] Negotiated authn=SASL
0927 15:15:57.026616 (+ 432us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:15:57.027636 (+ 1020us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:15:57.028482 (+ 846us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:15:57.028951 (+ 469us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:15:57.029107 (+ 156us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:15:57.029877 (+ 770us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0927 15:15:57.029882 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0927 15:15:57.029895 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0927 15:15:57.030299 (+ 404us) server_negotiation.cc:922] calling sasl_server_start()
0927 15:15:57.030355 (+ 56us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0927 15:15:57.030382 (+ 27us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0927 15:15:57.030465 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0927 15:15:57.030604 (+ 139us) server_negotiation.cc:299] Negotiation successful
0927 15:15:57.030880 (+ 276us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":304,"thread_start_us":129,"threads_started":1}
I20260927 15:15:57.031765 4144 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 122836d0380b4dd2b71217df9640e050: No bootstrap required, opened a new log
I20260927 15:15:57.035507 4144 raft_consensus.cc:348] T 00000000000000000000000000000000 P 122836d0380b4dd2b71217df9640e050 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "122836d0380b4dd2b71217df9640e050" member_type: VOTER last_known_addr { host: "127.17.136.62" port: 35275 } }
I20260927 15:15:57.035764 4144 raft_consensus.cc:374] T 00000000000000000000000000000000 P 122836d0380b4dd2b71217df9640e050 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:15:57.035822 4144 raft_consensus.cc:729] T 00000000000000000000000000000000 P 122836d0380b4dd2b71217df9640e050 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 122836d0380b4dd2b71217df9640e050, State: Initialized, Role: FOLLOWER
I20260927 15:15:57.036262 4144 consensus_queue.cc:260] T 00000000000000000000000000000000 P 122836d0380b4dd2b71217df9640e050 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "122836d0380b4dd2b71217df9640e050" member_type: VOTER last_known_addr { host: "127.17.136.62" port: 35275 } }
I20260927 15:15:57.036398 4144 raft_consensus.cc:388] T 00000000000000000000000000000000 P 122836d0380b4dd2b71217df9640e050 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260927 15:15:57.036465 4144 raft_consensus.cc:482] T 00000000000000000000000000000000 P 122836d0380b4dd2b71217df9640e050 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260927 15:15:57.036561 4144 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 122836d0380b4dd2b71217df9640e050 [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:15:57.037480 4144 raft_consensus.cc:504] T 00000000000000000000000000000000 P 122836d0380b4dd2b71217df9640e050 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "122836d0380b4dd2b71217df9640e050" member_type: VOTER last_known_addr { host: "127.17.136.62" port: 35275 } }
I20260927 15:15:57.037818 4144 leader_election.cc:302] T 00000000000000000000000000000000 P 122836d0380b4dd2b71217df9640e050 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 122836d0380b4dd2b71217df9640e050; no voters:
I20260927 15:15:57.038118 4144 leader_election.cc:288] T 00000000000000000000000000000000 P 122836d0380b4dd2b71217df9640e050 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260927 15:15:57.038271 4149 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 122836d0380b4dd2b71217df9640e050 [term 1 FOLLOWER]: Leader election won for term 1
I20260927 15:15:57.038496 4149 raft_consensus.cc:686] T 00000000000000000000000000000000 P 122836d0380b4dd2b71217df9640e050 [term 1 LEADER]: Becoming Leader. State: Replica: 122836d0380b4dd2b71217df9640e050, State: Running, Role: LEADER
I20260927 15:15:57.038838 4149 consensus_queue.cc:237] T 00000000000000000000000000000000 P 122836d0380b4dd2b71217df9640e050 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "122836d0380b4dd2b71217df9640e050" member_type: VOTER last_known_addr { host: "127.17.136.62" port: 35275 } }
I20260927 15:15:57.039458 4144 sys_catalog.cc:564] T 00000000000000000000000000000000 P 122836d0380b4dd2b71217df9640e050 [sys.catalog]: configured and running, proceeding with master startup.
I20260927 15:15:57.040522 4151 sys_catalog.cc:455] T 00000000000000000000000000000000 P 122836d0380b4dd2b71217df9640e050 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 122836d0380b4dd2b71217df9640e050. Latest consensus state: current_term: 1 leader_uuid: "122836d0380b4dd2b71217df9640e050" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "122836d0380b4dd2b71217df9640e050" member_type: VOTER last_known_addr { host: "127.17.136.62" port: 35275 } } }
I20260927 15:15:57.040522 4150 sys_catalog.cc:455] T 00000000000000000000000000000000 P 122836d0380b4dd2b71217df9640e050 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "122836d0380b4dd2b71217df9640e050" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "122836d0380b4dd2b71217df9640e050" member_type: VOTER last_known_addr { host: "127.17.136.62" port: 35275 } } }
I20260927 15:15:57.040685 4150 sys_catalog.cc:458] T 00000000000000000000000000000000 P 122836d0380b4dd2b71217df9640e050 [sys.catalog]: This master's current role is: LEADER
I20260927 15:15:57.040685 4151 sys_catalog.cc:458] T 00000000000000000000000000000000 P 122836d0380b4dd2b71217df9640e050 [sys.catalog]: This master's current role is: LEADER
I20260927 15:15:57.041113 4158 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260927 15:15:57.044296 4158 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260927 15:15:57.049897 4158 catalog_manager.cc:1347] Generated new cluster ID: ef610ed2ef5d474da8e2e419e2368356
I20260927 15:15:57.049973 4158 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260927 15:15:57.061638 4158 catalog_manager.cc:1370] Generated new certificate authority record
I20260927 15:15:57.062531 4158 catalog_manager.cc:1504] Loading token signing keys...
I20260927 15:15:57.068436 4158 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 122836d0380b4dd2b71217df9640e050: Generated new TSK 0
I20260927 15:15:57.069238 4158 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260927 15:15:57.080051 17952 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu
/tmp/dist-test-taskiFOyeW/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790521920546562-17952-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790521920546562-17952-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790521920546562-17952-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790521920546562-17952-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.136.1:0
--local_ip_for_outbound_sockets=127.17.136.1
--webserver_interface=127.17.136.1
--webserver_port=0
--tserver_master_addrs=127.17.136.62:35275
--builtin_ntp_servers=127.17.136.20:33667
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260927 15:15:57.188510 4168 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260927 15:15:57.188763 4168 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260927 15:15:57.188802 4168 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260927 15:15:57.192791 4168 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260927 15:15:57.192852 4168 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260927 15:15:57.192919 4168 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.136.1
I20260927 15:15:57.197742 4168 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.136.20:33667
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790521920546562-17952-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790521920546562-17952-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.136.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790521920546562-17952-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.17.136.1
--webserver_port=0
--tserver_master_addrs=127.17.136.62:35275
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4168
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.136.1
--log_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790521920546562-17952-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 27 Sep 2026 14:27:13 UTC on ccycloud.quasar-psqrth.root.comops.site
build id 4676138
I20260927 15:15:57.198853 4168 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260927 15:15:57.200299 4168 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260927 15:15:57.209362 4176 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260927 15:15:57.209362 4174 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260927 15:15:57.209429 4168 server_base.cc:1034] running on GCE node
W20260927 15:15:57.209358 4173 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260927 15:15:57.209944 4168 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260927 15:15:57.210569 4168 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260927 15:15:57.211714 4168 hybrid_clock.cc:648] HybridClock initialized: now 1790522157211690 us; error 37 us; skew 500 ppm
I20260927 15:15:57.213451 4168 webserver.cc:460] Webserver started at http://127.17.136.1:43595/ using document root <none> and password file <none>
I20260927 15:15:57.213995 4168 fs_manager.cc:359] Metadata directory not provided
I20260927 15:15:57.214061 4168 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260927 15:15:57.214255 4168 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260927 15:15:57.216308 4168 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790521920546562-17952-0/minicluster-data/ts-0/data/instance:
uuid: "c3ab57a5a08d474d8730b206897c798f"
format_stamp: "Formatted at 2026-09-27 15:15:57 on dist-test-slave-5s2t"
server_key: "9df1d5e39bedf063113de42855d18988"
server_key_iv: "671e49f8d1e312c68c5679c03d3f955f"
server_key_version: "encryptionkey@0"
I20260927 15:15:57.216830 4168 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790521920546562-17952-0/minicluster-data/ts-0/wal/instance:
uuid: "c3ab57a5a08d474d8730b206897c798f"
format_stamp: "Formatted at 2026-09-27 15:15:57 on dist-test-slave-5s2t"
server_key: "9df1d5e39bedf063113de42855d18988"
server_key_iv: "671e49f8d1e312c68c5679c03d3f955f"
server_key_version: "encryptionkey@0"
I20260927 15:15:57.220348 4168 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.000s sys 0.004s
I20260927 15:15:57.222692 4182 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260927 15:15:57.223881 4168 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260927 15:15:57.223984 4168 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790521920546562-17952-0/minicluster-data/ts-0/data,/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790521920546562-17952-0/minicluster-data/ts-0/wal
uuid: "c3ab57a5a08d474d8730b206897c798f"
format_stamp: "Formatted at 2026-09-27 15:15:57 on dist-test-slave-5s2t"
server_key: "9df1d5e39bedf063113de42855d18988"
server_key_iv: "671e49f8d1e312c68c5679c03d3f955f"
server_key_version: "encryptionkey@0"
I20260927 15:15:57.224076 4168 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790521920546562-17952-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790521920546562-17952-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790521920546562-17952-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260927 15:15:57.241339 4168 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260927 15:15:57.242074 4168 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260927 15:15:57.242259 4168 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260927 15:15:57.242820 4168 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260927 15:15:57.243824 4168 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260927 15:15:57.243870 4168 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260927 15:15:57.243924 4168 ts_tablet_manager.cc:610] Registered 0 tablets
I20260927 15:15:57.243953 4168 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260927 15:15:57.251897 4168 rpc_server.cc:307] RPC server started. Bound to: 127.17.136.1:39207
I20260927 15:15:57.251950 4295 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.136.1:39207 every 8 connection(s)
I20260927 15:15:57.252753 4168 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790521920546562-17952-0/minicluster-data/ts-0/data/info.pb
I20260927 15:15:57.256050 17952 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu as pid 4168
I20260927 15:15:57.256181 17952 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790521920546562-17952-0/minicluster-data/ts-0/wal/instance
I20260927 15:15:57.256443 17952 external_mini_cluster.cc:1428] Setting key b7dbffc9b1c7da493b17ce027ffba3a2
I20260927 15:15:57.258349 17952 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu
/tmp/dist-test-taskiFOyeW/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790521920546562-17952-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790521920546562-17952-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790521920546562-17952-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790521920546562-17952-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.136.2:0
--local_ip_for_outbound_sockets=127.17.136.2
--webserver_interface=127.17.136.2
--webserver_port=0
--tserver_master_addrs=127.17.136.62:35275
--builtin_ntp_servers=127.17.136.20:33667
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260927 15:15:57.262296 4147 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:15:57.254479 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.136.1:58185 (local address 127.17.136.62:35275)
0927 15:15:57.254615 (+ 136us) server_negotiation.cc:206] Beginning negotiation
0927 15:15:57.254618 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0927 15:15:57.255693 (+ 1075us) server_negotiation.cc:407] Connection header received
0927 15:15:57.257180 (+ 1487us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:15:57.257184 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:15:57.257246 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:15:57.257318 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0927 15:15:57.258282 (+ 964us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:15:57.258878 (+ 596us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:15:57.260431 (+ 1553us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:15:57.260680 (+ 249us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:15:57.260770 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:15:57.261848 (+ 1078us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0927 15:15:57.261851 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0927 15:15:57.261853 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0927 15:15:57.261865 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0927 15:15:57.261885 (+ 20us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0927 15:15:57.261892 (+ 7us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0927 15:15:57.261948 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0927 15:15:57.262094 (+ 146us) server_negotiation.cc:299] Negotiation successful
0927 15:15:57.262155 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260927 15:15:57.263131 4298 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:15:57.254868 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.62:35275 (local address 127.17.136.1:58185)
0927 15:15:57.255551 (+ 683us) negotiation.cc:107] Waiting for socket to connect
0927 15:15:57.255594 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0927 15:15:57.256972 (+ 1378us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0927 15:15:57.257507 (+ 535us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0927 15:15:57.257514 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0927 15:15:57.257603 (+ 89us) client_negotiation.cc:189] Negotiated authn=SASL
0927 15:15:57.258110 (+ 507us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:15:57.258124 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:15:57.259006 (+ 882us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:15:57.259009 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:15:57.260298 (+ 1289us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:15:57.260311 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:15:57.260826 (+ 515us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:15:57.260829 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:15:57.261005 (+ 176us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:15:57.261592 (+ 587us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0927 15:15:57.261594 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0927 15:15:57.261635 (+ 41us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0927 15:15:57.261701 (+ 66us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0927 15:15:57.261960 (+ 259us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0927 15:15:57.261969 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0927 15:15:57.261975 (+ 6us) client_negotiation.cc:769] Sending connection context
0927 15:15:57.262079 (+ 104us) client_negotiation.cc:240] Negotiation successful
0927 15:15:57.262363 (+ 284us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":254,"thread_start_us":117,"threads_started":1}
I20260927 15:15:57.264341 4296 heartbeater.cc:347] Connected to a master server at 127.17.136.62:35275
I20260927 15:15:57.264556 4296 heartbeater.cc:464] Registering TS with master...
I20260927 15:15:57.265045 4296 heartbeater.cc:511] Master 127.17.136.62:35275 requested a full tablet report, sending...
I20260927 15:15:57.266659 4108 ts_manager.cc:194] Registered new tserver with Master: c3ab57a5a08d474d8730b206897c798f (127.17.136.1:39207)
I20260927 15:15:57.268325 4108 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.17.136.1:58185
W20260927 15:15:57.368435 4299 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260927 15:15:57.368710 4299 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260927 15:15:57.368748 4299 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260927 15:15:57.372836 4299 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260927 15:15:57.372892 4299 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260927 15:15:57.372946 4299 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.136.2
I20260927 15:15:57.377718 4299 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.136.20:33667
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790521920546562-17952-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790521920546562-17952-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.136.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790521920546562-17952-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.17.136.2
--webserver_port=0
--tserver_master_addrs=127.17.136.62:35275
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4299
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.136.2
--log_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790521920546562-17952-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 27 Sep 2026 14:27:13 UTC on ccycloud.quasar-psqrth.root.comops.site
build id 4676138
I20260927 15:15:57.378722 4299 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260927 15:15:57.380108 4299 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260927 15:15:57.389508 4299 server_base.cc:1034] running on GCE node
W20260927 15:15:57.389474 4304 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260927 15:15:57.389469 4305 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260927 15:15:57.389474 4307 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260927 15:15:57.390072 4299 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260927 15:15:57.390692 4299 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260927 15:15:57.391849 4299 hybrid_clock.cc:648] HybridClock initialized: now 1790522157391830 us; error 36 us; skew 500 ppm
I20260927 15:15:57.393631 4299 webserver.cc:460] Webserver started at http://127.17.136.2:42771/ using document root <none> and password file <none>
I20260927 15:15:57.394272 4299 fs_manager.cc:359] Metadata directory not provided
I20260927 15:15:57.394341 4299 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260927 15:15:57.394541 4299 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260927 15:15:57.396651 4299 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790521920546562-17952-0/minicluster-data/ts-1/data/instance:
uuid: "2e5d85674fcf4cefacdd7978941243ec"
format_stamp: "Formatted at 2026-09-27 15:15:57 on dist-test-slave-5s2t"
server_key: "08ffeec6b779f0c034a779b777df36da"
server_key_iv: "cfd1670008f0a0a0299bf4de61f1cbc6"
server_key_version: "encryptionkey@0"
I20260927 15:15:57.397223 4299 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790521920546562-17952-0/minicluster-data/ts-1/wal/instance:
uuid: "2e5d85674fcf4cefacdd7978941243ec"
format_stamp: "Formatted at 2026-09-27 15:15:57 on dist-test-slave-5s2t"
server_key: "08ffeec6b779f0c034a779b777df36da"
server_key_iv: "cfd1670008f0a0a0299bf4de61f1cbc6"
server_key_version: "encryptionkey@0"
I20260927 15:15:57.400908 4299 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.001s sys 0.004s
I20260927 15:15:57.403264 4313 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260927 15:15:57.404500 4299 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260927 15:15:57.404609 4299 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790521920546562-17952-0/minicluster-data/ts-1/data,/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790521920546562-17952-0/minicluster-data/ts-1/wal
uuid: "2e5d85674fcf4cefacdd7978941243ec"
format_stamp: "Formatted at 2026-09-27 15:15:57 on dist-test-slave-5s2t"
server_key: "08ffeec6b779f0c034a779b777df36da"
server_key_iv: "cfd1670008f0a0a0299bf4de61f1cbc6"
server_key_version: "encryptionkey@0"
I20260927 15:15:57.404723 4299 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790521920546562-17952-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790521920546562-17952-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790521920546562-17952-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260927 15:15:57.418138 4299 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260927 15:15:57.418797 4299 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260927 15:15:57.418974 4299 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260927 15:15:57.419605 4299 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260927 15:15:57.420501 4299 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260927 15:15:57.420550 4299 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260927 15:15:57.420601 4299 ts_tablet_manager.cc:610] Registered 0 tablets
I20260927 15:15:57.420627 4299 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260927 15:15:57.428557 4299 rpc_server.cc:307] RPC server started. Bound to: 127.17.136.2:34851
I20260927 15:15:57.428606 4426 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.136.2:34851 every 8 connection(s)
I20260927 15:15:57.429400 4299 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790521920546562-17952-0/minicluster-data/ts-1/data/info.pb
I20260927 15:15:57.435189 17952 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu as pid 4299
I20260927 15:15:57.435317 17952 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790521920546562-17952-0/minicluster-data/ts-1/wal/instance
I20260927 15:15:57.435644 17952 external_mini_cluster.cc:1428] Setting key 22d5c4ec9d53daea1e8d539d5df51cf0
I20260927 15:15:57.437647 17952 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu
/tmp/dist-test-taskiFOyeW/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790521920546562-17952-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790521920546562-17952-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790521920546562-17952-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790521920546562-17952-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.136.3:0
--local_ip_for_outbound_sockets=127.17.136.3
--webserver_interface=127.17.136.3
--webserver_port=0
--tserver_master_addrs=127.17.136.62:35275
--builtin_ntp_servers=127.17.136.20:33667
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260927 15:15:57.438570 4147 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:15:57.431121 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.136.2:53973 (local address 127.17.136.62:35275)
0927 15:15:57.431280 (+ 159us) server_negotiation.cc:206] Beginning negotiation
0927 15:15:57.431285 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0927 15:15:57.432317 (+ 1032us) server_negotiation.cc:407] Connection header received
0927 15:15:57.433649 (+ 1332us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:15:57.433651 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:15:57.433700 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:15:57.433776 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0927 15:15:57.434680 (+ 904us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:15:57.435237 (+ 557us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:15:57.436639 (+ 1402us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:15:57.436887 (+ 248us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:15:57.436981 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:15:57.438075 (+ 1094us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0927 15:15:57.438079 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0927 15:15:57.438082 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0927 15:15:57.438097 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0927 15:15:57.438119 (+ 22us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0927 15:15:57.438130 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0927 15:15:57.438207 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0927 15:15:57.438355 (+ 148us) server_negotiation.cc:299] Negotiation successful
0927 15:15:57.438418 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260927 15:15:57.439558 4429 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:15:57.431549 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.62:35275 (local address 127.17.136.2:53973)
0927 15:15:57.432173 (+ 624us) negotiation.cc:107] Waiting for socket to connect
0927 15:15:57.432213 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0927 15:15:57.433437 (+ 1224us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0927 15:15:57.433930 (+ 493us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0927 15:15:57.433936 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0927 15:15:57.434018 (+ 82us) client_negotiation.cc:189] Negotiated authn=SASL
0927 15:15:57.434522 (+ 504us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:15:57.434533 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:15:57.435380 (+ 847us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:15:57.435383 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:15:57.436533 (+ 1150us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:15:57.436543 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:15:57.437035 (+ 492us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:15:57.437039 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:15:57.437210 (+ 171us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:15:57.437786 (+ 576us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0927 15:15:57.437788 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0927 15:15:57.437844 (+ 56us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0927 15:15:57.437920 (+ 76us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0927 15:15:57.438215 (+ 295us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0927 15:15:57.438223 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0927 15:15:57.438228 (+ 5us) client_negotiation.cc:769] Sending connection context
0927 15:15:57.438350 (+ 122us) client_negotiation.cc:240] Negotiation successful
0927 15:15:57.438626 (+ 276us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":245,"thread_start_us":110,"threads_started":1}
I20260927 15:15:57.440640 4427 heartbeater.cc:347] Connected to a master server at 127.17.136.62:35275
I20260927 15:15:57.440896 4427 heartbeater.cc:464] Registering TS with master...
I20260927 15:15:57.441468 4427 heartbeater.cc:511] Master 127.17.136.62:35275 requested a full tablet report, sending...
I20260927 15:15:57.442615 4108 ts_manager.cc:194] Registered new tserver with Master: 2e5d85674fcf4cefacdd7978941243ec (127.17.136.2:34851)
I20260927 15:15:57.443390 4108 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.17.136.2:53973
W20260927 15:15:57.546123 4430 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260927 15:15:57.546363 4430 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260927 15:15:57.546398 4430 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260927 15:15:57.550292 4430 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260927 15:15:57.550341 4430 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260927 15:15:57.550400 4430 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.136.3
I20260927 15:15:57.554977 4430 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.136.20:33667
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790521920546562-17952-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790521920546562-17952-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.136.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790521920546562-17952-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.17.136.3
--webserver_port=0
--tserver_master_addrs=127.17.136.62:35275
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4430
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.136.3
--log_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790521920546562-17952-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 27 Sep 2026 14:27:13 UTC on ccycloud.quasar-psqrth.root.comops.site
build id 4676138
I20260927 15:15:57.555949 4430 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260927 15:15:57.557225 4430 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260927 15:15:57.566365 4436 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260927 15:15:57.566377 4435 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260927 15:15:57.566457 4430 server_base.cc:1034] running on GCE node
W20260927 15:15:57.566373 4438 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260927 15:15:57.566946 4430 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260927 15:15:57.567577 4430 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260927 15:15:57.568732 4430 hybrid_clock.cc:648] HybridClock initialized: now 1790522157568695 us; error 47 us; skew 500 ppm
I20260927 15:15:57.570365 4430 webserver.cc:460] Webserver started at http://127.17.136.3:45615/ using document root <none> and password file <none>
I20260927 15:15:57.570914 4430 fs_manager.cc:359] Metadata directory not provided
I20260927 15:15:57.570982 4430 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260927 15:15:57.571179 4430 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260927 15:15:57.573210 4430 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790521920546562-17952-0/minicluster-data/ts-2/data/instance:
uuid: "c5ac1d7b83ba4c0c88b4691fcb19ce3f"
format_stamp: "Formatted at 2026-09-27 15:15:57 on dist-test-slave-5s2t"
server_key: "0bb1613d154dc993adf57878959f2ba9"
server_key_iv: "fc8291162126c9416305d1e58d896b1f"
server_key_version: "encryptionkey@0"
I20260927 15:15:57.573733 4430 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790521920546562-17952-0/minicluster-data/ts-2/wal/instance:
uuid: "c5ac1d7b83ba4c0c88b4691fcb19ce3f"
format_stamp: "Formatted at 2026-09-27 15:15:57 on dist-test-slave-5s2t"
server_key: "0bb1613d154dc993adf57878959f2ba9"
server_key_iv: "fc8291162126c9416305d1e58d896b1f"
server_key_version: "encryptionkey@0"
I20260927 15:15:57.577126 4430 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260927 15:15:57.579584 4444 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260927 15:15:57.580736 4430 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260927 15:15:57.580839 4430 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790521920546562-17952-0/minicluster-data/ts-2/data,/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790521920546562-17952-0/minicluster-data/ts-2/wal
uuid: "c5ac1d7b83ba4c0c88b4691fcb19ce3f"
format_stamp: "Formatted at 2026-09-27 15:15:57 on dist-test-slave-5s2t"
server_key: "0bb1613d154dc993adf57878959f2ba9"
server_key_iv: "fc8291162126c9416305d1e58d896b1f"
server_key_version: "encryptionkey@0"
I20260927 15:15:57.580933 4430 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790521920546562-17952-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790521920546562-17952-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790521920546562-17952-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260927 15:15:57.607403 4430 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260927 15:15:57.608071 4430 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260927 15:15:57.608263 4430 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260927 15:15:57.608860 4430 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260927 15:15:57.609782 4430 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260927 15:15:57.609827 4430 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260927 15:15:57.609879 4430 ts_tablet_manager.cc:610] Registered 0 tablets
I20260927 15:15:57.609907 4430 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260927 15:15:57.617630 4430 rpc_server.cc:307] RPC server started. Bound to: 127.17.136.3:36565
I20260927 15:15:57.617686 4557 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.136.3:36565 every 8 connection(s)
I20260927 15:15:57.618467 4430 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790521920546562-17952-0/minicluster-data/ts-2/data/info.pb
I20260927 15:15:57.624514 17952 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu as pid 4430
I20260927 15:15:57.624606 17952 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790521920546562-17952-0/minicluster-data/ts-2/wal/instance
I20260927 15:15:57.624853 17952 external_mini_cluster.cc:1428] Setting key 219b4b173f67e3b987df5252bfb50183
I20260927 15:15:57.627144 4147 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:15:57.620137 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.136.3:38359 (local address 127.17.136.62:35275)
0927 15:15:57.620301 (+ 164us) server_negotiation.cc:206] Beginning negotiation
0927 15:15:57.620306 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0927 15:15:57.621301 (+ 995us) server_negotiation.cc:407] Connection header received
0927 15:15:57.622621 (+ 1320us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:15:57.622623 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:15:57.622669 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:15:57.622738 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0927 15:15:57.623584 (+ 846us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:15:57.624088 (+ 504us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:15:57.625232 (+ 1144us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:15:57.625486 (+ 254us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:15:57.625578 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:15:57.626675 (+ 1097us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0927 15:15:57.626679 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0927 15:15:57.626681 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0927 15:15:57.626695 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0927 15:15:57.626718 (+ 23us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0927 15:15:57.626728 (+ 10us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0927 15:15:57.626798 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0927 15:15:57.626937 (+ 139us) server_negotiation.cc:299] Negotiation successful
0927 15:15:57.626987 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260927 15:15:57.627991 4560 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:15:57.620547 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.62:35275 (local address 127.17.136.3:38359)
0927 15:15:57.621167 (+ 620us) negotiation.cc:107] Waiting for socket to connect
0927 15:15:57.621206 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0927 15:15:57.622448 (+ 1242us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0927 15:15:57.622891 (+ 443us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0927 15:15:57.622897 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0927 15:15:57.622979 (+ 82us) client_negotiation.cc:189] Negotiated authn=SASL
0927 15:15:57.623484 (+ 505us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:15:57.623497 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:15:57.624169 (+ 672us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:15:57.624171 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:15:57.625118 (+ 947us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:15:57.625128 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:15:57.625643 (+ 515us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:15:57.625647 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:15:57.625834 (+ 187us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:15:57.626396 (+ 562us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0927 15:15:57.626398 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0927 15:15:57.626456 (+ 58us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0927 15:15:57.626531 (+ 75us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0927 15:15:57.626805 (+ 274us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0927 15:15:57.626812 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0927 15:15:57.626817 (+ 5us) client_negotiation.cc:769] Sending connection context
0927 15:15:57.626933 (+ 116us) client_negotiation.cc:240] Negotiation successful
0927 15:15:57.627210 (+ 277us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":244,"thread_start_us":111,"threads_started":1}
I20260927 15:15:57.629005 4558 heartbeater.cc:347] Connected to a master server at 127.17.136.62:35275
I20260927 15:15:57.629199 4558 heartbeater.cc:464] Registering TS with master...
I20260927 15:15:57.629630 4558 heartbeater.cc:511] Master 127.17.136.62:35275 requested a full tablet report, sending...
I20260927 15:15:57.630505 4108 ts_manager.cc:194] Registered new tserver with Master: c5ac1d7b83ba4c0c88b4691fcb19ce3f (127.17.136.3:36565)
I20260927 15:15:57.631045 4108 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.17.136.3:38359
I20260927 15:15:57.638381 17952 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260927 15:15:57.644028 4147 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:15:57.640423 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52072 (local address 127.17.136.62:35275)
0927 15:15:57.640541 (+ 118us) server_negotiation.cc:206] Beginning negotiation
0927 15:15:57.640546 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0927 15:15:57.640728 (+ 182us) server_negotiation.cc:407] Connection header received
0927 15:15:57.640817 (+ 89us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:15:57.640819 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:15:57.640857 (+ 38us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:15:57.640918 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0927 15:15:57.641121 (+ 203us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:15:57.641679 (+ 558us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:15:57.642431 (+ 752us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:15:57.642630 (+ 199us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:15:57.642726 (+ 96us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:15:57.643546 (+ 820us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0927 15:15:57.643550 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0927 15:15:57.643553 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0927 15:15:57.643566 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0927 15:15:57.643585 (+ 19us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0927 15:15:57.643592 (+ 7us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0927 15:15:57.643702 (+ 110us) server_negotiation.cc:1035] Waiting for connection context
0927 15:15:57.643853 (+ 151us) server_negotiation.cc:299] Negotiation successful
0927 15:15:57.643892 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260927 15:15:57.646608 4108 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:52072:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:15:57.650105 4108 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:15:57.663746 4573 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:15:57.658657 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.3:36565 (local address 127.0.0.1:53560)
0927 15:15:57.659063 (+ 406us) negotiation.cc:107] Waiting for socket to connect
0927 15:15:57.659075 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0927 15:15:57.659165 (+ 90us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0927 15:15:57.659829 (+ 664us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0927 15:15:57.659832 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0927 15:15:57.659845 (+ 13us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0927 15:15:57.659924 (+ 79us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:15:57.659930 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:15:57.661427 (+ 1497us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:15:57.661430 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:15:57.662309 (+ 879us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:15:57.662319 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:15:57.663182 (+ 863us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:15:57.663186 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:15:57.663326 (+ 140us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:15:57.663365 (+ 39us) client_negotiation.cc:769] Sending connection context
0927 15:15:57.663468 (+ 103us) client_negotiation.cc:240] Negotiation successful
0927 15:15:57.663588 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":348,"mutex_wait_us":25,"thread_start_us":101,"threads_started":1}
I20260927 15:15:57.663750 4574 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:15:57.659055 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53560 (local address 127.17.136.3:36565)
0927 15:15:57.659392 (+ 337us) server_negotiation.cc:206] Beginning negotiation
0927 15:15:57.659405 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0927 15:15:57.659427 (+ 22us) server_negotiation.cc:407] Connection header received
0927 15:15:57.659496 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:15:57.659501 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:15:57.659685 (+ 184us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:15:57.660110 (+ 425us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0927 15:15:57.660236 (+ 126us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:15:57.661294 (+ 1058us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:15:57.662432 (+ 1138us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:15:57.663073 (+ 641us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:15:57.663175 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:15:57.663390 (+ 215us) server_negotiation.cc:1035] Waiting for connection context
0927 15:15:57.663507 (+ 117us) server_negotiation.cc:299] Negotiation successful
0927 15:15:57.663597 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":241,"thread_start_us":122,"threads_started":1}
I20260927 15:15:57.664319 4569 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:15:57.658047 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.2:34851 (local address 127.0.0.1:53086)
0927 15:15:57.658801 (+ 754us) negotiation.cc:107] Waiting for socket to connect
0927 15:15:57.658852 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0927 15:15:57.658980 (+ 128us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0927 15:15:57.660058 (+ 1078us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0927 15:15:57.660061 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0927 15:15:57.660076 (+ 15us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0927 15:15:57.660160 (+ 84us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:15:57.660165 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:15:57.661172 (+ 1007us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:15:57.661175 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:15:57.662498 (+ 1323us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:15:57.662509 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:15:57.663787 (+ 1278us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:15:57.663791 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:15:57.663922 (+ 131us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:15:57.663997 (+ 75us) client_negotiation.cc:769] Sending connection context
0927 15:15:57.664071 (+ 74us) client_negotiation.cc:240] Negotiation successful
0927 15:15:57.664163 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":595,"mutex_wait_us":49,"spinlock_wait_cycles":3200,"thread_start_us":66,"threads_started":1}
I20260927 15:15:57.664326 4571 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:15:57.658283 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.1:39207 (local address 127.0.0.1:44360)
0927 15:15:57.658801 (+ 518us) negotiation.cc:107] Waiting for socket to connect
0927 15:15:57.658852 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0927 15:15:57.658980 (+ 128us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0927 15:15:57.659755 (+ 775us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0927 15:15:57.659761 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0927 15:15:57.659785 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0927 15:15:57.659917 (+ 132us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:15:57.659924 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:15:57.661360 (+ 1436us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:15:57.661363 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:15:57.662507 (+ 1144us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:15:57.662513 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:15:57.663787 (+ 1274us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:15:57.663791 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:15:57.663943 (+ 152us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:15:57.664002 (+ 59us) client_negotiation.cc:769] Sending connection context
0927 15:15:57.664071 (+ 69us) client_negotiation.cc:240] Negotiation successful
0927 15:15:57.664169 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":443,"mutex_wait_us":113,"spinlock_wait_cycles":6528,"thread_start_us":97,"threads_started":1}
I20260927 15:15:57.664990 4572 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:15:57.658474 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44360 (local address 127.17.136.1:39207)
0927 15:15:57.658897 (+ 423us) server_negotiation.cc:206] Beginning negotiation
0927 15:15:57.658908 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0927 15:15:57.658934 (+ 26us) server_negotiation.cc:407] Connection header received
0927 15:15:57.659194 (+ 260us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:15:57.659200 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:15:57.659442 (+ 242us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:15:57.659589 (+ 147us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0927 15:15:57.660039 (+ 450us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:15:57.661250 (+ 1211us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:15:57.662636 (+ 1386us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:15:57.663458 (+ 822us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:15:57.663557 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:15:57.663725 (+ 168us) server_negotiation.cc:1035] Waiting for connection context
0927 15:15:57.664122 (+ 397us) server_negotiation.cc:299] Negotiation successful
0927 15:15:57.664872 (+ 750us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":326,"thread_start_us":125,"threads_started":1}
I20260927 15:15:57.665445 4570 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:15:57.658200 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53086 (local address 127.17.136.2:34851)
0927 15:15:57.659570 (+ 1370us) server_negotiation.cc:206] Beginning negotiation
0927 15:15:57.659582 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0927 15:15:57.659604 (+ 22us) server_negotiation.cc:407] Connection header received
0927 15:15:57.659678 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:15:57.659683 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:15:57.659877 (+ 194us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:15:57.660278 (+ 401us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0927 15:15:57.660387 (+ 109us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:15:57.661067 (+ 680us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:15:57.662636 (+ 1569us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:15:57.663458 (+ 822us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:15:57.663557 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:15:57.663725 (+ 168us) server_negotiation.cc:1035] Waiting for connection context
0927 15:15:57.665199 (+ 1474us) server_negotiation.cc:299] Negotiation successful
0927 15:15:57.665291 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1266,"thread_start_us":117,"threads_started":1}
I20260927 15:15:57.666903 4492 tablet_service.cc:1467] Processing CreateTablet for tablet 6782b2efb81e407fa2290639faaf37c3 (DEFAULT_TABLE table=test-table [id=8badf69f881e419dbb149520a5fa5053]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:15:57.667857 4492 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6782b2efb81e407fa2290639faaf37c3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:15:57.668835 4361 tablet_service.cc:1467] Processing CreateTablet for tablet 6782b2efb81e407fa2290639faaf37c3 (DEFAULT_TABLE table=test-table [id=8badf69f881e419dbb149520a5fa5053]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:15:57.669732 4361 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6782b2efb81e407fa2290639faaf37c3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:15:57.673784 4575 tablet_bootstrap.cc:492] T 6782b2efb81e407fa2290639faaf37c3 P c5ac1d7b83ba4c0c88b4691fcb19ce3f: Bootstrap starting.
I20260927 15:15:57.675580 4576 tablet_bootstrap.cc:492] T 6782b2efb81e407fa2290639faaf37c3 P 2e5d85674fcf4cefacdd7978941243ec: Bootstrap starting.
I20260927 15:15:57.676498 4575 tablet_bootstrap.cc:654] T 6782b2efb81e407fa2290639faaf37c3 P c5ac1d7b83ba4c0c88b4691fcb19ce3f: Neither blocks nor log segments found. Creating new log.
I20260927 15:15:57.676119 4230 tablet_service.cc:1467] Processing CreateTablet for tablet 6782b2efb81e407fa2290639faaf37c3 (DEFAULT_TABLE table=test-table [id=8badf69f881e419dbb149520a5fa5053]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:15:57.677202 4230 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6782b2efb81e407fa2290639faaf37c3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:15:57.677205 4575 log.cc:824] T 6782b2efb81e407fa2290639faaf37c3 P c5ac1d7b83ba4c0c88b4691fcb19ce3f: Log is configured to *not* fsync() on all Append() calls
I20260927 15:15:57.677636 4576 tablet_bootstrap.cc:654] T 6782b2efb81e407fa2290639faaf37c3 P 2e5d85674fcf4cefacdd7978941243ec: Neither blocks nor log segments found. Creating new log.
I20260927 15:15:57.678467 4576 log.cc:824] T 6782b2efb81e407fa2290639faaf37c3 P 2e5d85674fcf4cefacdd7978941243ec: Log is configured to *not* fsync() on all Append() calls
I20260927 15:15:57.678932 4575 tablet_bootstrap.cc:492] T 6782b2efb81e407fa2290639faaf37c3 P c5ac1d7b83ba4c0c88b4691fcb19ce3f: No bootstrap required, opened a new log
I20260927 15:15:57.679136 4575 ts_tablet_manager.cc:1397] T 6782b2efb81e407fa2290639faaf37c3 P c5ac1d7b83ba4c0c88b4691fcb19ce3f: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260927 15:15:57.680712 4576 tablet_bootstrap.cc:492] T 6782b2efb81e407fa2290639faaf37c3 P 2e5d85674fcf4cefacdd7978941243ec: No bootstrap required, opened a new log
I20260927 15:15:57.680968 4576 ts_tablet_manager.cc:1397] T 6782b2efb81e407fa2290639faaf37c3 P 2e5d85674fcf4cefacdd7978941243ec: Time spent bootstrapping tablet: real 0.006s user 0.005s sys 0.000s
I20260927 15:15:57.682507 4575 raft_consensus.cc:348] T 6782b2efb81e407fa2290639faaf37c3 P c5ac1d7b83ba4c0c88b4691fcb19ce3f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e5d85674fcf4cefacdd7978941243ec" member_type: VOTER last_known_addr { host: "127.17.136.2" port: 34851 } } peers { permanent_uuid: "c3ab57a5a08d474d8730b206897c798f" member_type: VOTER last_known_addr { host: "127.17.136.1" port: 39207 } } peers { permanent_uuid: "c5ac1d7b83ba4c0c88b4691fcb19ce3f" member_type: VOTER last_known_addr { host: "127.17.136.3" port: 36565 } }
I20260927 15:15:57.682718 4575 raft_consensus.cc:374] T 6782b2efb81e407fa2290639faaf37c3 P c5ac1d7b83ba4c0c88b4691fcb19ce3f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:15:57.682770 4575 raft_consensus.cc:729] T 6782b2efb81e407fa2290639faaf37c3 P c5ac1d7b83ba4c0c88b4691fcb19ce3f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c5ac1d7b83ba4c0c88b4691fcb19ce3f, State: Initialized, Role: FOLLOWER
I20260927 15:15:57.683208 4575 consensus_queue.cc:260] T 6782b2efb81e407fa2290639faaf37c3 P c5ac1d7b83ba4c0c88b4691fcb19ce3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e5d85674fcf4cefacdd7978941243ec" member_type: VOTER last_known_addr { host: "127.17.136.2" port: 34851 } } peers { permanent_uuid: "c3ab57a5a08d474d8730b206897c798f" member_type: VOTER last_known_addr { host: "127.17.136.1" port: 39207 } } peers { permanent_uuid: "c5ac1d7b83ba4c0c88b4691fcb19ce3f" member_type: VOTER last_known_addr { host: "127.17.136.3" port: 36565 } }
I20260927 15:15:57.683869 4558 heartbeater.cc:503] Master 127.17.136.62:35275 was elected leader, sending a full tablet report...
I20260927 15:15:57.684173 4575 ts_tablet_manager.cc:1428] T 6782b2efb81e407fa2290639faaf37c3 P c5ac1d7b83ba4c0c88b4691fcb19ce3f: Time spent starting tablet: real 0.005s user 0.006s sys 0.000s
I20260927 15:15:57.684942 4580 tablet_bootstrap.cc:492] T 6782b2efb81e407fa2290639faaf37c3 P c3ab57a5a08d474d8730b206897c798f: Bootstrap starting.
I20260927 15:15:57.685352 4576 raft_consensus.cc:348] T 6782b2efb81e407fa2290639faaf37c3 P 2e5d85674fcf4cefacdd7978941243ec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e5d85674fcf4cefacdd7978941243ec" member_type: VOTER last_known_addr { host: "127.17.136.2" port: 34851 } } peers { permanent_uuid: "c3ab57a5a08d474d8730b206897c798f" member_type: VOTER last_known_addr { host: "127.17.136.1" port: 39207 } } peers { permanent_uuid: "c5ac1d7b83ba4c0c88b4691fcb19ce3f" member_type: VOTER last_known_addr { host: "127.17.136.3" port: 36565 } }
I20260927 15:15:57.685611 4576 raft_consensus.cc:374] T 6782b2efb81e407fa2290639faaf37c3 P 2e5d85674fcf4cefacdd7978941243ec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:15:57.685670 4576 raft_consensus.cc:729] T 6782b2efb81e407fa2290639faaf37c3 P 2e5d85674fcf4cefacdd7978941243ec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2e5d85674fcf4cefacdd7978941243ec, State: Initialized, Role: FOLLOWER
I20260927 15:15:57.686084 4576 consensus_queue.cc:260] T 6782b2efb81e407fa2290639faaf37c3 P 2e5d85674fcf4cefacdd7978941243ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e5d85674fcf4cefacdd7978941243ec" member_type: VOTER last_known_addr { host: "127.17.136.2" port: 34851 } } peers { permanent_uuid: "c3ab57a5a08d474d8730b206897c798f" member_type: VOTER last_known_addr { host: "127.17.136.1" port: 39207 } } peers { permanent_uuid: "c5ac1d7b83ba4c0c88b4691fcb19ce3f" member_type: VOTER last_known_addr { host: "127.17.136.3" port: 36565 } }
I20260927 15:15:57.686731 4427 heartbeater.cc:503] Master 127.17.136.62:35275 was elected leader, sending a full tablet report...
I20260927 15:15:57.687067 4576 ts_tablet_manager.cc:1428] T 6782b2efb81e407fa2290639faaf37c3 P 2e5d85674fcf4cefacdd7978941243ec: Time spent starting tablet: real 0.006s user 0.005s sys 0.000s
I20260927 15:15:57.687502 4580 tablet_bootstrap.cc:654] T 6782b2efb81e407fa2290639faaf37c3 P c3ab57a5a08d474d8730b206897c798f: Neither blocks nor log segments found. Creating new log.
I20260927 15:15:57.688361 4580 log.cc:824] T 6782b2efb81e407fa2290639faaf37c3 P c3ab57a5a08d474d8730b206897c798f: Log is configured to *not* fsync() on all Append() calls
I20260927 15:15:57.690186 4580 tablet_bootstrap.cc:492] T 6782b2efb81e407fa2290639faaf37c3 P c3ab57a5a08d474d8730b206897c798f: No bootstrap required, opened a new log
I20260927 15:15:57.690353 4580 ts_tablet_manager.cc:1397] T 6782b2efb81e407fa2290639faaf37c3 P c3ab57a5a08d474d8730b206897c798f: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260927 15:15:57.693357 4580 raft_consensus.cc:348] T 6782b2efb81e407fa2290639faaf37c3 P c3ab57a5a08d474d8730b206897c798f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e5d85674fcf4cefacdd7978941243ec" member_type: VOTER last_known_addr { host: "127.17.136.2" port: 34851 } } peers { permanent_uuid: "c3ab57a5a08d474d8730b206897c798f" member_type: VOTER last_known_addr { host: "127.17.136.1" port: 39207 } } peers { permanent_uuid: "c5ac1d7b83ba4c0c88b4691fcb19ce3f" member_type: VOTER last_known_addr { host: "127.17.136.3" port: 36565 } }
I20260927 15:15:57.693583 4580 raft_consensus.cc:374] T 6782b2efb81e407fa2290639faaf37c3 P c3ab57a5a08d474d8730b206897c798f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:15:57.693648 4580 raft_consensus.cc:729] T 6782b2efb81e407fa2290639faaf37c3 P c3ab57a5a08d474d8730b206897c798f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c3ab57a5a08d474d8730b206897c798f, State: Initialized, Role: FOLLOWER
I20260927 15:15:57.694036 4580 consensus_queue.cc:260] T 6782b2efb81e407fa2290639faaf37c3 P c3ab57a5a08d474d8730b206897c798f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e5d85674fcf4cefacdd7978941243ec" member_type: VOTER last_known_addr { host: "127.17.136.2" port: 34851 } } peers { permanent_uuid: "c3ab57a5a08d474d8730b206897c798f" member_type: VOTER last_known_addr { host: "127.17.136.1" port: 39207 } } peers { permanent_uuid: "c5ac1d7b83ba4c0c88b4691fcb19ce3f" member_type: VOTER last_known_addr { host: "127.17.136.3" port: 36565 } }
I20260927 15:15:57.694607 4296 heartbeater.cc:503] Master 127.17.136.62:35275 was elected leader, sending a full tablet report...
I20260927 15:15:57.694820 4580 ts_tablet_manager.cc:1428] T 6782b2efb81e407fa2290639faaf37c3 P c3ab57a5a08d474d8730b206897c798f: Time spent starting tablet: real 0.004s user 0.005s sys 0.000s
I20260927 15:15:57.699182 4583 raft_consensus.cc:482] T 6782b2efb81e407fa2290639faaf37c3 P c3ab57a5a08d474d8730b206897c798f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:15:57.699357 4583 raft_consensus.cc:504] T 6782b2efb81e407fa2290639faaf37c3 P c3ab57a5a08d474d8730b206897c798f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e5d85674fcf4cefacdd7978941243ec" member_type: VOTER last_known_addr { host: "127.17.136.2" port: 34851 } } peers { permanent_uuid: "c3ab57a5a08d474d8730b206897c798f" member_type: VOTER last_known_addr { host: "127.17.136.1" port: 39207 } } peers { permanent_uuid: "c5ac1d7b83ba4c0c88b4691fcb19ce3f" member_type: VOTER last_known_addr { host: "127.17.136.3" port: 36565 } }
I20260927 15:15:57.700232 4583 leader_election.cc:288] T 6782b2efb81e407fa2290639faaf37c3 P c3ab57a5a08d474d8730b206897c798f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2e5d85674fcf4cefacdd7978941243ec (127.17.136.2:34851), c5ac1d7b83ba4c0c88b4691fcb19ce3f (127.17.136.3:36565)
I20260927 15:15:57.703569 4570 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:15:57.700476 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.136.1:56821 (local address 127.17.136.2:34851)
0927 15:15:57.700596 (+ 120us) server_negotiation.cc:206] Beginning negotiation
0927 15:15:57.700600 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0927 15:15:57.700777 (+ 177us) server_negotiation.cc:407] Connection header received
0927 15:15:57.700818 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:15:57.700820 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:15:57.700858 (+ 38us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:15:57.700913 (+ 55us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0927 15:15:57.701149 (+ 236us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:15:57.701634 (+ 485us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:15:57.702678 (+ 1044us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:15:57.703055 (+ 377us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:15:57.703156 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:15:57.703205 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0927 15:15:57.703394 (+ 189us) server_negotiation.cc:299] Negotiation successful
0927 15:15:57.703465 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260927 15:15:57.703569 4298 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:15:57.700411 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.2:34851 (local address 127.17.136.1:56821)
0927 15:15:57.700605 (+ 194us) negotiation.cc:107] Waiting for socket to connect
0927 15:15:57.700620 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0927 15:15:57.700703 (+ 83us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0927 15:15:57.700946 (+ 243us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0927 15:15:57.700949 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0927 15:15:57.700964 (+ 15us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0927 15:15:57.701058 (+ 94us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:15:57.701063 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:15:57.701735 (+ 672us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:15:57.701739 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:15:57.702566 (+ 827us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:15:57.702575 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:15:57.703159 (+ 584us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:15:57.703163 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:15:57.703287 (+ 124us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:15:57.703310 (+ 23us) client_negotiation.cc:769] Sending connection context
0927 15:15:57.703374 (+ 64us) client_negotiation.cc:240] Negotiation successful
0927 15:15:57.703444 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":120,"mutex_wait_us":45}
I20260927 15:15:57.703636 4574 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:15:57.700538 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.136.1:43423 (local address 127.17.136.3:36565)
0927 15:15:57.700640 (+ 102us) server_negotiation.cc:206] Beginning negotiation
0927 15:15:57.700645 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0927 15:15:57.700858 (+ 213us) server_negotiation.cc:407] Connection header received
0927 15:15:57.700952 (+ 94us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:15:57.700955 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:15:57.700998 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:15:57.701057 (+ 59us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0927 15:15:57.701295 (+ 238us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:15:57.701765 (+ 470us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:15:57.702755 (+ 990us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:15:57.703120 (+ 365us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:15:57.703223 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:15:57.703292 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0927 15:15:57.703460 (+ 168us) server_negotiation.cc:299] Negotiation successful
0927 15:15:57.703522 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260927 15:15:57.703692 4584 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:15:57.700457 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.3:36565 (local address 127.17.136.1:43423)
0927 15:15:57.700773 (+ 316us) negotiation.cc:107] Waiting for socket to connect
0927 15:15:57.700783 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0927 15:15:57.700872 (+ 89us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0927 15:15:57.701071 (+ 199us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0927 15:15:57.701074 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0927 15:15:57.701088 (+ 14us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0927 15:15:57.701203 (+ 115us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:15:57.701208 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:15:57.701857 (+ 649us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:15:57.701860 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:15:57.702633 (+ 773us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:15:57.702641 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:15:57.703232 (+ 591us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:15:57.703235 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:15:57.703356 (+ 121us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:15:57.703378 (+ 22us) client_negotiation.cc:769] Sending connection context
0927 15:15:57.703439 (+ 61us) client_negotiation.cc:240] Negotiation successful
0927 15:15:57.703504 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":265,"thread_start_us":97,"threads_started":1}
I20260927 15:15:57.704104 4381 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6782b2efb81e407fa2290639faaf37c3" candidate_uuid: "c3ab57a5a08d474d8730b206897c798f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e5d85674fcf4cefacdd7978941243ec" is_pre_election: true
I20260927 15:15:57.704368 4381 raft_consensus.cc:2454] T 6782b2efb81e407fa2290639faaf37c3 P 2e5d85674fcf4cefacdd7978941243ec [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c3ab57a5a08d474d8730b206897c798f in term 0.
I20260927 15:15:57.704490 4512 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6782b2efb81e407fa2290639faaf37c3" candidate_uuid: "c3ab57a5a08d474d8730b206897c798f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5ac1d7b83ba4c0c88b4691fcb19ce3f" is_pre_election: true
I20260927 15:15:57.704761 4512 raft_consensus.cc:2454] T 6782b2efb81e407fa2290639faaf37c3 P c5ac1d7b83ba4c0c88b4691fcb19ce3f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c3ab57a5a08d474d8730b206897c798f in term 0.
I20260927 15:15:57.704825 4185 leader_election.cc:302] T 6782b2efb81e407fa2290639faaf37c3 P c3ab57a5a08d474d8730b206897c798f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e5d85674fcf4cefacdd7978941243ec, c3ab57a5a08d474d8730b206897c798f; no voters:
I20260927 15:15:57.705075 4583 raft_consensus.cc:2781] T 6782b2efb81e407fa2290639faaf37c3 P c3ab57a5a08d474d8730b206897c798f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 15:15:57.705155 4583 raft_consensus.cc:482] T 6782b2efb81e407fa2290639faaf37c3 P c3ab57a5a08d474d8730b206897c798f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 15:15:57.705197 4583 raft_consensus.cc:3037] T 6782b2efb81e407fa2290639faaf37c3 P c3ab57a5a08d474d8730b206897c798f [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:15:57.706247 4583 raft_consensus.cc:504] T 6782b2efb81e407fa2290639faaf37c3 P c3ab57a5a08d474d8730b206897c798f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e5d85674fcf4cefacdd7978941243ec" member_type: VOTER last_known_addr { host: "127.17.136.2" port: 34851 } } peers { permanent_uuid: "c3ab57a5a08d474d8730b206897c798f" member_type: VOTER last_known_addr { host: "127.17.136.1" port: 39207 } } peers { permanent_uuid: "c5ac1d7b83ba4c0c88b4691fcb19ce3f" member_type: VOTER last_known_addr { host: "127.17.136.3" port: 36565 } }
I20260927 15:15:57.706597 4583 leader_election.cc:288] T 6782b2efb81e407fa2290639faaf37c3 P c3ab57a5a08d474d8730b206897c798f [CANDIDATE]: Term 1 election: Requested vote from peers 2e5d85674fcf4cefacdd7978941243ec (127.17.136.2:34851), c5ac1d7b83ba4c0c88b4691fcb19ce3f (127.17.136.3:36565)
I20260927 15:15:57.706894 4512 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6782b2efb81e407fa2290639faaf37c3" candidate_uuid: "c3ab57a5a08d474d8730b206897c798f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5ac1d7b83ba4c0c88b4691fcb19ce3f"
I20260927 15:15:57.706902 4381 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6782b2efb81e407fa2290639faaf37c3" candidate_uuid: "c3ab57a5a08d474d8730b206897c798f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e5d85674fcf4cefacdd7978941243ec"
I20260927 15:15:57.707013 4381 raft_consensus.cc:3037] T 6782b2efb81e407fa2290639faaf37c3 P 2e5d85674fcf4cefacdd7978941243ec [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:15:57.707013 4512 raft_consensus.cc:3037] T 6782b2efb81e407fa2290639faaf37c3 P c5ac1d7b83ba4c0c88b4691fcb19ce3f [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:15:57.708278 4381 raft_consensus.cc:2454] T 6782b2efb81e407fa2290639faaf37c3 P 2e5d85674fcf4cefacdd7978941243ec [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c3ab57a5a08d474d8730b206897c798f in term 1.
I20260927 15:15:57.708278 4512 raft_consensus.cc:2454] T 6782b2efb81e407fa2290639faaf37c3 P c5ac1d7b83ba4c0c88b4691fcb19ce3f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c3ab57a5a08d474d8730b206897c798f in term 1.
I20260927 15:15:57.708564 4185 leader_election.cc:302] T 6782b2efb81e407fa2290639faaf37c3 P c3ab57a5a08d474d8730b206897c798f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e5d85674fcf4cefacdd7978941243ec, c3ab57a5a08d474d8730b206897c798f; no voters:
I20260927 15:15:57.708719 4583 raft_consensus.cc:2781] T 6782b2efb81e407fa2290639faaf37c3 P c3ab57a5a08d474d8730b206897c798f [term 1 FOLLOWER]: Leader election won for term 1
I20260927 15:15:57.708911 4583 raft_consensus.cc:686] T 6782b2efb81e407fa2290639faaf37c3 P c3ab57a5a08d474d8730b206897c798f [term 1 LEADER]: Becoming Leader. State: Replica: c3ab57a5a08d474d8730b206897c798f, State: Running, Role: LEADER
I20260927 15:15:57.709242 4583 consensus_queue.cc:237] T 6782b2efb81e407fa2290639faaf37c3 P c3ab57a5a08d474d8730b206897c798f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e5d85674fcf4cefacdd7978941243ec" member_type: VOTER last_known_addr { host: "127.17.136.2" port: 34851 } } peers { permanent_uuid: "c3ab57a5a08d474d8730b206897c798f" member_type: VOTER last_known_addr { host: "127.17.136.1" port: 39207 } } peers { permanent_uuid: "c5ac1d7b83ba4c0c88b4691fcb19ce3f" member_type: VOTER last_known_addr { host: "127.17.136.3" port: 36565 } }
I20260927 15:15:57.712216 4108 catalog_manager.cc:5495] T 6782b2efb81e407fa2290639faaf37c3 P c3ab57a5a08d474d8730b206897c798f reported cstate change: term changed from 0 to 1, leader changed from <none> to c3ab57a5a08d474d8730b206897c798f (127.17.136.1). New cstate: current_term: 1 leader_uuid: "c3ab57a5a08d474d8730b206897c798f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e5d85674fcf4cefacdd7978941243ec" member_type: VOTER last_known_addr { host: "127.17.136.2" port: 34851 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c3ab57a5a08d474d8730b206897c798f" member_type: VOTER last_known_addr { host: "127.17.136.1" port: 39207 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c5ac1d7b83ba4c0c88b4691fcb19ce3f" member_type: VOTER last_known_addr { host: "127.17.136.3" port: 36565 } health_report { overall_health: UNKNOWN } } }
I20260927 15:15:57.727582 4572 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:15:57.723966 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44372 (local address 127.17.136.1:39207)
0927 15:15:57.724084 (+ 118us) server_negotiation.cc:206] Beginning negotiation
0927 15:15:57.724087 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0927 15:15:57.724136 (+ 49us) server_negotiation.cc:407] Connection header received
0927 15:15:57.724306 (+ 170us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:15:57.724308 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:15:57.724368 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:15:57.724458 (+ 90us) server_negotiation.cc:226] Negotiated authn=TOKEN
0927 15:15:57.724675 (+ 217us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:15:57.725162 (+ 487us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:15:57.726012 (+ 850us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:15:57.726210 (+ 198us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:15:57.726283 (+ 73us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:15:57.726541 (+ 258us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0927 15:15:57.726987 (+ 446us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0927 15:15:57.727100 (+ 113us) server_negotiation.cc:1035] Waiting for connection context
0927 15:15:57.727402 (+ 302us) server_negotiation.cc:299] Negotiation successful
0927 15:15:57.727438 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260927 15:15:57.733352 4381 raft_consensus.cc:1261] T 6782b2efb81e407fa2290639faaf37c3 P 2e5d85674fcf4cefacdd7978941243ec [term 1 FOLLOWER]: Refusing update from remote peer c3ab57a5a08d474d8730b206897c798f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260927 15:15:57.733352 4512 raft_consensus.cc:1261] T 6782b2efb81e407fa2290639faaf37c3 P c5ac1d7b83ba4c0c88b4691fcb19ce3f [term 1 FOLLOWER]: Refusing update from remote peer c3ab57a5a08d474d8730b206897c798f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260927 15:15:57.733995 4583 consensus_queue.cc:1035] T 6782b2efb81e407fa2290639faaf37c3 P c3ab57a5a08d474d8730b206897c798f [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5ac1d7b83ba4c0c88b4691fcb19ce3f" member_type: VOTER last_known_addr { host: "127.17.136.3" port: 36565 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260927 15:15:57.734175 4585 consensus_queue.cc:1035] T 6782b2efb81e407fa2290639faaf37c3 P c3ab57a5a08d474d8730b206897c798f [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e5d85674fcf4cefacdd7978941243ec" member_type: VOTER last_known_addr { host: "127.17.136.2" port: 34851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260927 15:15:57.742709 4589 mvcc.cc:205] Tried to move back new op lower bound from 7333978758069047296 to 7333978757979328512. Current Snapshot: MvccSnapshot[applied={T|T < 7333978758069047296}]
I20260927 15:15:57.749590 4107 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:52072:
table { table_name: "test-table" } modify_external_catalogs: true
I20260927 15:15:57.749737 4107 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:52072:
table { table_name: "test-table" } modify_external_catalogs: true
I20260927 15:15:57.752089 4107 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 122836d0380b4dd2b71217df9640e050: Sending DeleteTablet for 3 replicas of tablet 6782b2efb81e407fa2290639faaf37c3
I20260927 15:15:57.752768 4361 tablet_service.cc:1514] Processing DeleteTablet for tablet 6782b2efb81e407fa2290639faaf37c3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:15:57 UTC) from {username='slave'} at 127.0.0.1:53086
I20260927 15:15:57.752823 4230 tablet_service.cc:1514] Processing DeleteTablet for tablet 6782b2efb81e407fa2290639faaf37c3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:15:57 UTC) from {username='slave'} at 127.0.0.1:44360
I20260927 15:15:57.753038 4492 tablet_service.cc:1514] Processing DeleteTablet for tablet 6782b2efb81e407fa2290639faaf37c3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:15:57 UTC) from {username='slave'} at 127.0.0.1:53560
I20260927 15:15:57.753329 4598 tablet_replica.cc:330] T 6782b2efb81e407fa2290639faaf37c3 P 2e5d85674fcf4cefacdd7978941243ec: stopping tablet replica
I20260927 15:15:57.753500 4600 tablet_replica.cc:330] T 6782b2efb81e407fa2290639faaf37c3 P c5ac1d7b83ba4c0c88b4691fcb19ce3f: stopping tablet replica
I20260927 15:15:57.753849 17952 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu with pid 4168
I20260927 15:15:57.754510 4598 raft_consensus.cc:2229] T 6782b2efb81e407fa2290639faaf37c3 P 2e5d85674fcf4cefacdd7978941243ec [term 1 FOLLOWER]: Raft consensus shutting down.
I20260927 15:15:57.754807 4598 raft_consensus.cc:2258] T 6782b2efb81e407fa2290639faaf37c3 P 2e5d85674fcf4cefacdd7978941243ec [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 15:15:57.756145 4600 raft_consensus.cc:2229] T 6782b2efb81e407fa2290639faaf37c3 P c5ac1d7b83ba4c0c88b4691fcb19ce3f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260927 15:15:57.756417 4600 raft_consensus.cc:2258] T 6782b2efb81e407fa2290639faaf37c3 P c5ac1d7b83ba4c0c88b4691fcb19ce3f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 15:15:57.756429 4598 ts_tablet_manager.cc:1905] T 6782b2efb81e407fa2290639faaf37c3 P 2e5d85674fcf4cefacdd7978941243ec: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:15:57.757606 4600 ts_tablet_manager.cc:1905] T 6782b2efb81e407fa2290639faaf37c3 P c5ac1d7b83ba4c0c88b4691fcb19ce3f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:15:57.759065 4598 ts_tablet_manager.cc:1918] T 6782b2efb81e407fa2290639faaf37c3 P 2e5d85674fcf4cefacdd7978941243ec: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260927 15:15:57.759166 4598 log.cc:1196] T 6782b2efb81e407fa2290639faaf37c3 P 2e5d85674fcf4cefacdd7978941243ec: Deleting WAL directory at /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790521920546562-17952-0/minicluster-data/ts-1/wal/wals/6782b2efb81e407fa2290639faaf37c3
I20260927 15:15:57.759470 4598 ts_tablet_manager.cc:1939] T 6782b2efb81e407fa2290639faaf37c3 P 2e5d85674fcf4cefacdd7978941243ec: Deleting consensus metadata
I20260927 15:15:57.759791 4600 ts_tablet_manager.cc:1918] T 6782b2efb81e407fa2290639faaf37c3 P c5ac1d7b83ba4c0c88b4691fcb19ce3f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260927 15:15:57.759869 4600 log.cc:1196] T 6782b2efb81e407fa2290639faaf37c3 P c5ac1d7b83ba4c0c88b4691fcb19ce3f: Deleting WAL directory at /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790521920546562-17952-0/minicluster-data/ts-2/wal/wals/6782b2efb81e407fa2290639faaf37c3
I20260927 15:15:57.760154 4600 ts_tablet_manager.cc:1939] T 6782b2efb81e407fa2290639faaf37c3 P c5ac1d7b83ba4c0c88b4691fcb19ce3f: Deleting consensus metadata
I20260927 15:15:57.760649 4094 catalog_manager.cc:4841] TS 2e5d85674fcf4cefacdd7978941243ec (127.17.136.2:34851): tablet 6782b2efb81e407fa2290639faaf37c3 (table test-table [id=8badf69f881e419dbb149520a5fa5053]) successfully deleted
W20260927 15:15:57.761063 4092 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.17.136.1:39207 (error 108)
I20260927 15:15:57.761168 4095 catalog_manager.cc:4841] TS c5ac1d7b83ba4c0c88b4691fcb19ce3f (127.17.136.3:36565): tablet 6782b2efb81e407fa2290639faaf37c3 (table test-table [id=8badf69f881e419dbb149520a5fa5053]) successfully deleted
I20260927 15:15:57.761416 17952 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu with pid 4299
I20260927 15:15:57.762444 4571 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:15:57.762148 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.1:39207 (local address 127.0.0.1:44374)
0927 15:15:57.762290 (+ 142us) negotiation.cc:107] Waiting for socket to connect
0927 15:15:57.762362 (+ 72us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.136.1:39207: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":43}
W20260927 15:15:57.762631 4092 catalog_manager.cc:4584] TS c3ab57a5a08d474d8730b206897c798f (127.17.136.1:39207): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 6782b2efb81e407fa2290639faaf37c3: Network error: Client connection negotiation failed: client connection to 127.17.136.1:39207: connect: Connection refused (error 111)
I20260927 15:15:57.766346 17952 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu with pid 4430
I20260927 15:15:57.771014 17952 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu with pid 4077
2026-09-27T15:15:57Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/3 (951 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/4
Loading random data
Initializing database '/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790521920546562-17952-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 27 15:15:57 dist-test-slave-5s2t krb5kdc[4604](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 27 15:15:57 dist-test-slave-5s2t krb5kdc[4604](info): set up 2 sockets
Sep 27 15:15:57 dist-test-slave-5s2t krb5kdc[4604](info): commencing operation
krb5kdc: starting...
W20260927 15:15:58.726990 17952 mini_kdc.cc:121] Time spent starting KDC: real 0.937s user 0.000s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790521920546562-17952-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790521920546562-17952-0/krb5kdc/test-user.keytab.
Sep 27 15:15:58 dist-test-slave-5s2t krb5kdc[4604](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790522158, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-27T15:15:58Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-27T15:15:58Z Disabled control of system clock
WARNING: no policy specified for kudu/127.17.136.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.136.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.136.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790521920546562-17952-0/krb5kdc/kudu_127.17.136.62.keytab.
Entry for principal kudu/127.17.136.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790521920546562-17952-0/krb5kdc/kudu_127.17.136.62.keytab.
I20260927 15:15:58.839291 17952 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu
/tmp/dist-test-taskiFOyeW/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790521920546562-17952-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790521920546562-17952-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790521920546562-17952-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790521920546562-17952-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.136.62:45619
--webserver_interface=127.17.136.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790521920546562-17952-0/krb5kdc/kudu_127.17.136.62.keytab
--principal=kudu/127.17.136.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.136.20:37589
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.136.62:45619
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790521920546562-17952-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790521920546562-17952-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790521920546562-17952-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260927 15:15:58.959601 4617 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260927 15:15:58.959877 4617 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260927 15:15:58.959932 4617 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260927 15:15:58.963877 4617 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260927 15:15:58.963935 4617 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260927 15:15:58.963960 4617 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260927 15:15:58.963992 4617 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260927 15:15:58.964022 4617 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260927 15:15:58.969316 4617 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.136.20:37589
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790521920546562-17952-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790521920546562-17952-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.17.136.62:45619
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790521920546562-17952-0/krb5kdc/kudu_127.17.136.62.keytab
--principal=kudu/127.17.136.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.136.62:45619
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790521920546562-17952-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.17.136.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4617
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790521920546562-17952-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 27 Sep 2026 14:27:13 UTC on ccycloud.quasar-psqrth.root.comops.site
build id 4676138
I20260927 15:15:58.970361 4617 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260927 15:15:58.971386 4617 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260927 15:15:58.979378 4617 server_base.cc:1034] running on GCE node
W20260927 15:15:58.979241 4623 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260927 15:15:58.979279 4622 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260927 15:15:58.979300 4625 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260927 15:15:58.979985 4617 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260927 15:15:58.981006 4617 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260927 15:15:58.982165 4617 hybrid_clock.cc:648] HybridClock initialized: now 1790522158982150 us; error 28 us; skew 500 ppm
Sep 27 15:15:58 dist-test-slave-5s2t krb5kdc[4604](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790522158, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.136.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260927 15:15:58.988024 4617 init.cc:377] Logged in from keytab as kudu/127.17.136.62@KRBTEST.COM (short username kudu)
I20260927 15:15:58.988924 4617 webserver.cc:460] Webserver started at http://127.17.136.62:43389/ using document root <none> and password file <none>
I20260927 15:15:58.989452 4617 fs_manager.cc:359] Metadata directory not provided
I20260927 15:15:58.989514 4617 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260927 15:15:58.989707 4617 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260927 15:15:58.991715 4617 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790521920546562-17952-0/minicluster-data/master-0/data/instance:
uuid: "571a1f28677843db8290f45b29660701"
format_stamp: "Formatted at 2026-09-27 15:15:58 on dist-test-slave-5s2t"
server_key: "44a096ddcd37822acb9e6981bc73fe43"
server_key_iv: "f9e62537ddb41cfeb6bce9faddfdf6f8"
server_key_version: "encryptionkey@0"
I20260927 15:15:58.992233 4617 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790521920546562-17952-0/minicluster-data/master-0/wal/instance:
uuid: "571a1f28677843db8290f45b29660701"
format_stamp: "Formatted at 2026-09-27 15:15:58 on dist-test-slave-5s2t"
server_key: "44a096ddcd37822acb9e6981bc73fe43"
server_key_iv: "f9e62537ddb41cfeb6bce9faddfdf6f8"
server_key_version: "encryptionkey@0"
I20260927 15:15:58.995705 4617 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.001s
I20260927 15:15:58.998008 4632 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260927 15:15:58.999286 4617 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260927 15:15:58.999414 4617 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790521920546562-17952-0/minicluster-data/master-0/data,/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790521920546562-17952-0/minicluster-data/master-0/wal
uuid: "571a1f28677843db8290f45b29660701"
format_stamp: "Formatted at 2026-09-27 15:15:58 on dist-test-slave-5s2t"
server_key: "44a096ddcd37822acb9e6981bc73fe43"
server_key_iv: "f9e62537ddb41cfeb6bce9faddfdf6f8"
server_key_version: "encryptionkey@0"
I20260927 15:15:58.999519 4617 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790521920546562-17952-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790521920546562-17952-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790521920546562-17952-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260927 15:15:59.012856 4617 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260927 15:15:59.015789 4617 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260927 15:15:59.015950 4617 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260927 15:15:59.022465 4617 rpc_server.cc:307] RPC server started. Bound to: 127.17.136.62:45619
I20260927 15:15:59.022482 4684 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.136.62:45619 every 8 connection(s)
I20260927 15:15:59.023375 4617 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790521920546562-17952-0/minicluster-data/master-0/data/info.pb
I20260927 15:15:59.024636 17952 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu as pid 4617
I20260927 15:15:59.024794 17952 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790521920546562-17952-0/minicluster-data/master-0/wal/instance
I20260927 15:15:59.025110 17952 external_mini_cluster.cc:1428] Setting key 6e8abcf7e71da800e1b443ab9659d469
I20260927 15:15:59.026512 4685 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:15:59.032634 4685 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 571a1f28677843db8290f45b29660701: Bootstrap starting.
Sep 27 15:15:59 dist-test-slave-5s2t krb5kdc[4604](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790522158, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.136.62@KRBTEST.COM
I20260927 15:15:59.034912 4685 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 571a1f28677843db8290f45b29660701: Neither blocks nor log segments found. Creating new log.
I20260927 15:15:59.035797 4685 log.cc:824] T 00000000000000000000000000000000 P 571a1f28677843db8290f45b29660701: Log is configured to *not* fsync() on all Append() calls
I20260927 15:15:59.038034 4685 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 571a1f28677843db8290f45b29660701: No bootstrap required, opened a new log
I20260927 15:15:59.039203 4688 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:15:59.026391 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37098 (local address 127.17.136.62:45619)
0927 15:15:59.026779 (+ 388us) server_negotiation.cc:206] Beginning negotiation
0927 15:15:59.026794 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0927 15:15:59.026830 (+ 36us) server_negotiation.cc:407] Connection header received
0927 15:15:59.027486 (+ 656us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:15:59.027503 (+ 17us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:15:59.027841 (+ 338us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:15:59.028110 (+ 269us) server_negotiation.cc:226] Negotiated authn=SASL
0927 15:15:59.028955 (+ 845us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:15:59.029922 (+ 967us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:15:59.031035 (+ 1113us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:15:59.031534 (+ 499us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:15:59.031673 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:15:59.034233 (+ 2560us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0927 15:15:59.034239 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0927 15:15:59.034251 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0927 15:15:59.034287 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0927 15:15:59.036114 (+ 1827us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:15:59.036571 (+ 457us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:15:59.036576 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:15:59.036582 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:15:59.036719 (+ 137us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:15:59.036977 (+ 258us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:15:59.036980 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:15:59.036982 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:15:59.037465 (+ 483us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0927 15:15:59.037639 (+ 174us) server_negotiation.cc:1035] Waiting for connection context
0927 15:15:59.037923 (+ 284us) server_negotiation.cc:299] Negotiation successful
0927 15:15:59.038222 (+ 299us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":258,"thread_start_us":106,"threads_started":1}
I20260927 15:15:59.041810 4685 raft_consensus.cc:348] T 00000000000000000000000000000000 P 571a1f28677843db8290f45b29660701 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "571a1f28677843db8290f45b29660701" member_type: VOTER last_known_addr { host: "127.17.136.62" port: 45619 } }
I20260927 15:15:59.042089 4685 raft_consensus.cc:374] T 00000000000000000000000000000000 P 571a1f28677843db8290f45b29660701 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:15:59.042145 4685 raft_consensus.cc:729] T 00000000000000000000000000000000 P 571a1f28677843db8290f45b29660701 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 571a1f28677843db8290f45b29660701, State: Initialized, Role: FOLLOWER
I20260927 15:15:59.042534 4685 consensus_queue.cc:260] T 00000000000000000000000000000000 P 571a1f28677843db8290f45b29660701 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "571a1f28677843db8290f45b29660701" member_type: VOTER last_known_addr { host: "127.17.136.62" port: 45619 } }
I20260927 15:15:59.042656 4685 raft_consensus.cc:388] T 00000000000000000000000000000000 P 571a1f28677843db8290f45b29660701 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260927 15:15:59.042699 4685 raft_consensus.cc:482] T 00000000000000000000000000000000 P 571a1f28677843db8290f45b29660701 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260927 15:15:59.042771 4685 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 571a1f28677843db8290f45b29660701 [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:15:59.043681 4685 raft_consensus.cc:504] T 00000000000000000000000000000000 P 571a1f28677843db8290f45b29660701 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "571a1f28677843db8290f45b29660701" member_type: VOTER last_known_addr { host: "127.17.136.62" port: 45619 } }
I20260927 15:15:59.043980 4685 leader_election.cc:302] T 00000000000000000000000000000000 P 571a1f28677843db8290f45b29660701 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 571a1f28677843db8290f45b29660701; no voters:
I20260927 15:15:59.044232 4685 leader_election.cc:288] T 00000000000000000000000000000000 P 571a1f28677843db8290f45b29660701 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260927 15:15:59.044332 4690 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 571a1f28677843db8290f45b29660701 [term 1 FOLLOWER]: Leader election won for term 1
I20260927 15:15:59.044533 4690 raft_consensus.cc:686] T 00000000000000000000000000000000 P 571a1f28677843db8290f45b29660701 [term 1 LEADER]: Becoming Leader. State: Replica: 571a1f28677843db8290f45b29660701, State: Running, Role: LEADER
I20260927 15:15:59.044849 4690 consensus_queue.cc:237] T 00000000000000000000000000000000 P 571a1f28677843db8290f45b29660701 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "571a1f28677843db8290f45b29660701" member_type: VOTER last_known_addr { host: "127.17.136.62" port: 45619 } }
I20260927 15:15:59.045372 4685 sys_catalog.cc:564] T 00000000000000000000000000000000 P 571a1f28677843db8290f45b29660701 [sys.catalog]: configured and running, proceeding with master startup.
I20260927 15:15:59.046531 4692 sys_catalog.cc:455] T 00000000000000000000000000000000 P 571a1f28677843db8290f45b29660701 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 571a1f28677843db8290f45b29660701. Latest consensus state: current_term: 1 leader_uuid: "571a1f28677843db8290f45b29660701" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "571a1f28677843db8290f45b29660701" member_type: VOTER last_known_addr { host: "127.17.136.62" port: 45619 } } }
I20260927 15:15:59.046569 4691 sys_catalog.cc:455] T 00000000000000000000000000000000 P 571a1f28677843db8290f45b29660701 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "571a1f28677843db8290f45b29660701" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "571a1f28677843db8290f45b29660701" member_type: VOTER last_known_addr { host: "127.17.136.62" port: 45619 } } }
I20260927 15:15:59.046677 4692 sys_catalog.cc:458] T 00000000000000000000000000000000 P 571a1f28677843db8290f45b29660701 [sys.catalog]: This master's current role is: LEADER
I20260927 15:15:59.046676 4691 sys_catalog.cc:458] T 00000000000000000000000000000000 P 571a1f28677843db8290f45b29660701 [sys.catalog]: This master's current role is: LEADER
I20260927 15:15:59.047073 4699 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260927 15:15:59.050263 4699 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260927 15:15:59.056109 4699 catalog_manager.cc:1347] Generated new cluster ID: f42c24358ae845fbbb4233fbd65ff339
I20260927 15:15:59.056193 4699 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260927 15:15:59.064831 4699 catalog_manager.cc:1370] Generated new certificate authority record
I20260927 15:15:59.065914 4699 catalog_manager.cc:1504] Loading token signing keys...
I20260927 15:15:59.074064 4699 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 571a1f28677843db8290f45b29660701: Generated new TSK 0
I20260927 15:15:59.074729 4699 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.17.136.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.136.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.136.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790521920546562-17952-0/krb5kdc/kudu_127.17.136.1.keytab.
Entry for principal kudu/127.17.136.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790521920546562-17952-0/krb5kdc/kudu_127.17.136.1.keytab.
I20260927 15:15:59.106326 17952 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu
/tmp/dist-test-taskiFOyeW/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790521920546562-17952-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790521920546562-17952-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790521920546562-17952-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790521920546562-17952-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.136.1:0
--local_ip_for_outbound_sockets=127.17.136.1
--webserver_interface=127.17.136.1
--webserver_port=0
--tserver_master_addrs=127.17.136.62:45619
--keytab_file=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790521920546562-17952-0/krb5kdc/kudu_127.17.136.1.keytab
--principal=kudu/127.17.136.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.136.20:37589
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790521920546562-17952-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790521920546562-17952-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790521920546562-17952-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260927 15:15:59.213442 4711 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260927 15:15:59.213718 4711 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260927 15:15:59.213762 4711 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260927 15:15:59.217814 4711 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260927 15:15:59.217867 4711 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260927 15:15:59.217937 4711 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.136.1
I20260927 15:15:59.223142 4711 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.136.20:37589
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790521920546562-17952-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790521920546562-17952-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790521920546562-17952-0/krb5kdc/kudu_127.17.136.1.keytab
--principal=kudu/127.17.136.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.136.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790521920546562-17952-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.17.136.1
--webserver_port=0
--tserver_master_addrs=127.17.136.62:45619
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4711
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.136.1
--log_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790521920546562-17952-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 27 Sep 2026 14:27:13 UTC on ccycloud.quasar-psqrth.root.comops.site
build id 4676138
I20260927 15:15:59.224159 4711 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260927 15:15:59.225119 4711 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260927 15:15:59.234022 4717 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260927 15:15:59.234063 4719 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260927 15:15:59.234107 4711 server_base.cc:1034] running on GCE node
W20260927 15:15:59.234063 4716 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260927 15:15:59.234660 4711 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260927 15:15:59.235241 4711 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260927 15:15:59.236428 4711 hybrid_clock.cc:648] HybridClock initialized: now 1790522159236412 us; error 34 us; skew 500 ppm
Sep 27 15:15:59 dist-test-slave-5s2t krb5kdc[4604](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790522159, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.136.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260927 15:15:59.238966 4711 init.cc:377] Logged in from keytab as kudu/127.17.136.1@KRBTEST.COM (short username kudu)
I20260927 15:15:59.239838 4711 webserver.cc:460] Webserver started at http://127.17.136.1:43241/ using document root <none> and password file <none>
I20260927 15:15:59.240358 4711 fs_manager.cc:359] Metadata directory not provided
I20260927 15:15:59.240422 4711 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260927 15:15:59.240621 4711 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260927 15:15:59.242573 4711 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790521920546562-17952-0/minicluster-data/ts-0/data/instance:
uuid: "53d92b179ccd4fedb7d20fd0f7a40673"
format_stamp: "Formatted at 2026-09-27 15:15:59 on dist-test-slave-5s2t"
server_key: "7ee460728633f35ef4d598e3805ff6fb"
server_key_iv: "246a20fe215884ba4d973e29be79b1da"
server_key_version: "encryptionkey@0"
I20260927 15:15:59.243099 4711 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790521920546562-17952-0/minicluster-data/ts-0/wal/instance:
uuid: "53d92b179ccd4fedb7d20fd0f7a40673"
format_stamp: "Formatted at 2026-09-27 15:15:59 on dist-test-slave-5s2t"
server_key: "7ee460728633f35ef4d598e3805ff6fb"
server_key_iv: "246a20fe215884ba4d973e29be79b1da"
server_key_version: "encryptionkey@0"
I20260927 15:15:59.246737 4711 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.000s
I20260927 15:15:59.249095 4726 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260927 15:15:59.250221 4711 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260927 15:15:59.250322 4711 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790521920546562-17952-0/minicluster-data/ts-0/data,/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790521920546562-17952-0/minicluster-data/ts-0/wal
uuid: "53d92b179ccd4fedb7d20fd0f7a40673"
format_stamp: "Formatted at 2026-09-27 15:15:59 on dist-test-slave-5s2t"
server_key: "7ee460728633f35ef4d598e3805ff6fb"
server_key_iv: "246a20fe215884ba4d973e29be79b1da"
server_key_version: "encryptionkey@0"
I20260927 15:15:59.250413 4711 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790521920546562-17952-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790521920546562-17952-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790521920546562-17952-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260927 15:15:59.269369 4711 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260927 15:15:59.272447 4711 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260927 15:15:59.272608 4711 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260927 15:15:59.273159 4711 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260927 15:15:59.273929 4711 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260927 15:15:59.273972 4711 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260927 15:15:59.274015 4711 ts_tablet_manager.cc:610] Registered 0 tablets
I20260927 15:15:59.274044 4711 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260927 15:15:59.282308 4711 rpc_server.cc:307] RPC server started. Bound to: 127.17.136.1:35295
I20260927 15:15:59.282341 4839 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.136.1:35295 every 8 connection(s)
I20260927 15:15:59.283195 4711 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790521920546562-17952-0/minicluster-data/ts-0/data/info.pb
I20260927 15:15:59.292322 17952 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu as pid 4711
Sep 27 15:15:59 dist-test-slave-5s2t krb5kdc[4604](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790522159, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.136.1@KRBTEST.COM for kudu/127.17.136.62@KRBTEST.COM
I20260927 15:15:59.292444 17952 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790521920546562-17952-0/minicluster-data/ts-0/wal/instance
I20260927 15:15:59.292711 17952 external_mini_cluster.cc:1428] Setting key 54ce4a58ac19d974deffb2c9aa75dcd1
I20260927 15:15:59.296235 4688 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:15:59.284959 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.136.1:40887 (local address 127.17.136.62:45619)
0927 15:15:59.285098 (+ 139us) server_negotiation.cc:206] Beginning negotiation
0927 15:15:59.285102 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0927 15:15:59.285953 (+ 851us) server_negotiation.cc:407] Connection header received
0927 15:15:59.287299 (+ 1346us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:15:59.287302 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:15:59.287361 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:15:59.287437 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0927 15:15:59.288619 (+ 1182us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:15:59.289161 (+ 542us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:15:59.290281 (+ 1120us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:15:59.290514 (+ 233us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:15:59.290605 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:15:59.292940 (+ 2335us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0927 15:15:59.292943 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0927 15:15:59.292945 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0927 15:15:59.292968 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0927 15:15:59.294365 (+ 1397us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:15:59.294816 (+ 451us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:15:59.294819 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:15:59.294821 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:15:59.294894 (+ 73us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:15:59.295189 (+ 295us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:15:59.295192 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:15:59.295194 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:15:59.295412 (+ 218us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0927 15:15:59.295495 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0927 15:15:59.295958 (+ 463us) server_negotiation.cc:299] Negotiation successful
0927 15:15:59.296079 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260927 15:15:59.297021 4842 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:15:59.285343 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.62:45619 (local address 127.17.136.1:40887)
0927 15:15:59.285809 (+ 466us) negotiation.cc:107] Waiting for socket to connect
0927 15:15:59.285853 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0927 15:15:59.287067 (+ 1214us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0927 15:15:59.287623 (+ 556us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0927 15:15:59.287638 (+ 15us) client_negotiation.cc:394] Received NEGOTIATE response from server
0927 15:15:59.287989 (+ 351us) client_negotiation.cc:189] Negotiated authn=SASL
0927 15:15:59.288476 (+ 487us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:15:59.288490 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:15:59.289279 (+ 789us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:15:59.289282 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:15:59.290166 (+ 884us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:15:59.290176 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:15:59.290663 (+ 487us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:15:59.290668 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:15:59.290830 (+ 162us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:15:59.291363 (+ 533us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0927 15:15:59.291379 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0927 15:15:59.292784 (+ 1405us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0927 15:15:59.294466 (+ 1682us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0927 15:15:59.294471 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0927 15:15:59.294486 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0927 15:15:59.294728 (+ 242us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0927 15:15:59.294970 (+ 242us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0927 15:15:59.294973 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0927 15:15:59.294975 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0927 15:15:59.295105 (+ 130us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0927 15:15:59.295507 (+ 402us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0927 15:15:59.295513 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0927 15:15:59.295744 (+ 231us) client_negotiation.cc:769] Sending connection context
0927 15:15:59.295901 (+ 157us) client_negotiation.cc:240] Negotiation successful
0927 15:15:59.296223 (+ 322us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":272,"thread_start_us":112,"threads_started":1}
I20260927 15:15:59.298224 4840 heartbeater.cc:347] Connected to a master server at 127.17.136.62:45619
I20260927 15:15:59.298436 4840 heartbeater.cc:464] Registering TS with master...
I20260927 15:15:59.298884 4840 heartbeater.cc:511] Master 127.17.136.62:45619 requested a full tablet report, sending...
I20260927 15:15:59.300312 4649 ts_manager.cc:194] Registered new tserver with Master: 53d92b179ccd4fedb7d20fd0f7a40673 (127.17.136.1:35295)
WARNING: no policy specified for kudu/127.17.136.2@KRBTEST.COM; defaulting to no policy
I20260927 15:15:59.301409 4649 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.136.1@KRBTEST.COM'} at 127.17.136.1:40887
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.136.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.136.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790521920546562-17952-0/krb5kdc/kudu_127.17.136.2.keytab.
Entry for principal kudu/127.17.136.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790521920546562-17952-0/krb5kdc/kudu_127.17.136.2.keytab.
I20260927 15:15:59.316231 17952 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu
/tmp/dist-test-taskiFOyeW/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790521920546562-17952-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790521920546562-17952-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790521920546562-17952-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790521920546562-17952-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.136.2:0
--local_ip_for_outbound_sockets=127.17.136.2
--webserver_interface=127.17.136.2
--webserver_port=0
--tserver_master_addrs=127.17.136.62:45619
--keytab_file=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790521920546562-17952-0/krb5kdc/kudu_127.17.136.2.keytab
--principal=kudu/127.17.136.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.136.20:37589
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790521920546562-17952-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790521920546562-17952-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790521920546562-17952-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260927 15:15:59.424823 4845 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260927 15:15:59.425086 4845 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260927 15:15:59.425127 4845 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260927 15:15:59.429045 4845 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260927 15:15:59.429098 4845 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260927 15:15:59.429153 4845 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.136.2
I20260927 15:15:59.434437 4845 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.136.20:37589
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790521920546562-17952-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790521920546562-17952-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790521920546562-17952-0/krb5kdc/kudu_127.17.136.2.keytab
--principal=kudu/127.17.136.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.136.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790521920546562-17952-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.17.136.2
--webserver_port=0
--tserver_master_addrs=127.17.136.62:45619
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4845
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.136.2
--log_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790521920546562-17952-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 27 Sep 2026 14:27:13 UTC on ccycloud.quasar-psqrth.root.comops.site
build id 4676138
I20260927 15:15:59.435648 4845 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260927 15:15:59.436702 4845 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260927 15:15:59.446398 4851 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260927 15:15:59.446471 4845 server_base.cc:1034] running on GCE node
W20260927 15:15:59.446415 4853 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260927 15:15:59.446398 4850 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260927 15:15:59.447072 4845 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260927 15:15:59.447765 4845 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260927 15:15:59.448921 4845 hybrid_clock.cc:648] HybridClock initialized: now 1790522159448897 us; error 37 us; skew 500 ppm
Sep 27 15:15:59 dist-test-slave-5s2t krb5kdc[4604](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790522159, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.136.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260927 15:15:59.451447 4845 init.cc:377] Logged in from keytab as kudu/127.17.136.2@KRBTEST.COM (short username kudu)
I20260927 15:15:59.452250 4845 webserver.cc:460] Webserver started at http://127.17.136.2:35925/ using document root <none> and password file <none>
I20260927 15:15:59.452764 4845 fs_manager.cc:359] Metadata directory not provided
I20260927 15:15:59.452829 4845 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260927 15:15:59.453018 4845 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260927 15:15:59.454996 4845 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790521920546562-17952-0/minicluster-data/ts-1/data/instance:
uuid: "d1a92b3db3c64a4cb1580b6ae5d00435"
format_stamp: "Formatted at 2026-09-27 15:15:59 on dist-test-slave-5s2t"
server_key: "52ca0a3fb07e9009924448b42ffaa31c"
server_key_iv: "bd0d5d3717d1ac2d0f5b1e5f86c5d2a4"
server_key_version: "encryptionkey@0"
I20260927 15:15:59.455549 4845 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790521920546562-17952-0/minicluster-data/ts-1/wal/instance:
uuid: "d1a92b3db3c64a4cb1580b6ae5d00435"
format_stamp: "Formatted at 2026-09-27 15:15:59 on dist-test-slave-5s2t"
server_key: "52ca0a3fb07e9009924448b42ffaa31c"
server_key_iv: "bd0d5d3717d1ac2d0f5b1e5f86c5d2a4"
server_key_version: "encryptionkey@0"
I20260927 15:15:59.458981 4845 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.000s
I20260927 15:15:59.461350 4860 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260927 15:15:59.462525 4845 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260927 15:15:59.462627 4845 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790521920546562-17952-0/minicluster-data/ts-1/data,/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790521920546562-17952-0/minicluster-data/ts-1/wal
uuid: "d1a92b3db3c64a4cb1580b6ae5d00435"
format_stamp: "Formatted at 2026-09-27 15:15:59 on dist-test-slave-5s2t"
server_key: "52ca0a3fb07e9009924448b42ffaa31c"
server_key_iv: "bd0d5d3717d1ac2d0f5b1e5f86c5d2a4"
server_key_version: "encryptionkey@0"
I20260927 15:15:59.462718 4845 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790521920546562-17952-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790521920546562-17952-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790521920546562-17952-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260927 15:15:59.482434 4845 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260927 15:15:59.485267 4845 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260927 15:15:59.485443 4845 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260927 15:15:59.486035 4845 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260927 15:15:59.486842 4845 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260927 15:15:59.486888 4845 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260927 15:15:59.486941 4845 ts_tablet_manager.cc:610] Registered 0 tablets
I20260927 15:15:59.486969 4845 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260927 15:15:59.495208 4845 rpc_server.cc:307] RPC server started. Bound to: 127.17.136.2:44211
I20260927 15:15:59.495231 4973 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.136.2:44211 every 8 connection(s)
I20260927 15:15:59.496060 4845 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790521920546562-17952-0/minicluster-data/ts-1/data/info.pb
I20260927 15:15:59.502166 17952 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu as pid 4845
I20260927 15:15:59.502285 17952 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790521920546562-17952-0/minicluster-data/ts-1/wal/instance
I20260927 15:15:59.502564 17952 external_mini_cluster.cc:1428] Setting key 78e020159a54ba23b86e629e05d08936
Sep 27 15:15:59 dist-test-slave-5s2t krb5kdc[4604](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790522159, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.136.2@KRBTEST.COM for kudu/127.17.136.62@KRBTEST.COM
I20260927 15:15:59.509815 4688 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:15:59.497780 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.136.2:35403 (local address 127.17.136.62:45619)
0927 15:15:59.497913 (+ 133us) server_negotiation.cc:206] Beginning negotiation
0927 15:15:59.497916 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0927 15:15:59.498784 (+ 868us) server_negotiation.cc:407] Connection header received
0927 15:15:59.500159 (+ 1375us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:15:59.500163 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:15:59.500220 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:15:59.500289 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0927 15:15:59.501447 (+ 1158us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:15:59.502000 (+ 553us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:15:59.503432 (+ 1432us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:15:59.503777 (+ 345us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:15:59.503877 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:15:59.506293 (+ 2416us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0927 15:15:59.506297 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0927 15:15:59.506300 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0927 15:15:59.506327 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0927 15:15:59.507735 (+ 1408us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:15:59.508312 (+ 577us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:15:59.508316 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:15:59.508318 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:15:59.508410 (+ 92us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:15:59.508751 (+ 341us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:15:59.508755 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:15:59.508757 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:15:59.508987 (+ 230us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0927 15:15:59.509090 (+ 103us) server_negotiation.cc:1035] Waiting for connection context
0927 15:15:59.509525 (+ 435us) server_negotiation.cc:299] Negotiation successful
0927 15:15:59.509649 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260927 15:15:59.510541 4976 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:15:59.498183 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.62:45619 (local address 127.17.136.2:35403)
0927 15:15:59.498631 (+ 448us) negotiation.cc:107] Waiting for socket to connect
0927 15:15:59.498683 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0927 15:15:59.499941 (+ 1258us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0927 15:15:59.500465 (+ 524us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0927 15:15:59.500483 (+ 18us) client_negotiation.cc:394] Received NEGOTIATE response from server
0927 15:15:59.500835 (+ 352us) client_negotiation.cc:189] Negotiated authn=SASL
0927 15:15:59.501312 (+ 477us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:15:59.501325 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:15:59.502127 (+ 802us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:15:59.502130 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:15:59.503270 (+ 1140us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:15:59.503327 (+ 57us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:15:59.503925 (+ 598us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:15:59.503930 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:15:59.504092 (+ 162us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:15:59.504657 (+ 565us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0927 15:15:59.504672 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0927 15:15:59.506135 (+ 1463us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0927 15:15:59.507872 (+ 1737us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0927 15:15:59.507877 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0927 15:15:59.507887 (+ 10us) client_negotiation.cc:760] calling sasl_client_step()
0927 15:15:59.508217 (+ 330us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0927 15:15:59.508513 (+ 296us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0927 15:15:59.508516 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0927 15:15:59.508517 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0927 15:15:59.508657 (+ 140us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0927 15:15:59.509074 (+ 417us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0927 15:15:59.509078 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0927 15:15:59.509307 (+ 229us) client_negotiation.cc:769] Sending connection context
0927 15:15:59.509458 (+ 151us) client_negotiation.cc:240] Negotiation successful
0927 15:15:59.509702 (+ 244us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":267,"thread_start_us":110,"threads_started":1}
I20260927 15:15:59.511636 4974 heartbeater.cc:347] Connected to a master server at 127.17.136.62:45619
WARNING: no policy specified for kudu/127.17.136.3@KRBTEST.COM; defaulting to no policy
I20260927 15:15:59.511860 4974 heartbeater.cc:464] Registering TS with master...
I20260927 15:15:59.512313 4974 heartbeater.cc:511] Master 127.17.136.62:45619 requested a full tablet report, sending...
I20260927 15:15:59.513278 4649 ts_manager.cc:194] Registered new tserver with Master: d1a92b3db3c64a4cb1580b6ae5d00435 (127.17.136.2:44211)
I20260927 15:15:59.513875 4649 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.136.2@KRBTEST.COM'} at 127.17.136.2:35403
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.136.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.136.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790521920546562-17952-0/krb5kdc/kudu_127.17.136.3.keytab.
Entry for principal kudu/127.17.136.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790521920546562-17952-0/krb5kdc/kudu_127.17.136.3.keytab.
I20260927 15:15:59.529951 17952 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu
/tmp/dist-test-taskiFOyeW/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790521920546562-17952-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790521920546562-17952-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790521920546562-17952-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790521920546562-17952-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.136.3:0
--local_ip_for_outbound_sockets=127.17.136.3
--webserver_interface=127.17.136.3
--webserver_port=0
--tserver_master_addrs=127.17.136.62:45619
--keytab_file=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790521920546562-17952-0/krb5kdc/kudu_127.17.136.3.keytab
--principal=kudu/127.17.136.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.136.20:37589
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790521920546562-17952-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790521920546562-17952-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790521920546562-17952-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260927 15:15:59.637583 4979 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260927 15:15:59.637849 4979 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260927 15:15:59.637919 4979 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260927 15:15:59.641953 4979 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260927 15:15:59.642021 4979 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260927 15:15:59.642102 4979 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.136.3
I20260927 15:15:59.647644 4979 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.136.20:37589
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790521920546562-17952-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790521920546562-17952-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790521920546562-17952-0/krb5kdc/kudu_127.17.136.3.keytab
--principal=kudu/127.17.136.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.136.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790521920546562-17952-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.17.136.3
--webserver_port=0
--tserver_master_addrs=127.17.136.62:45619
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4979
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.136.3
--log_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790521920546562-17952-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 27 Sep 2026 14:27:13 UTC on ccycloud.quasar-psqrth.root.comops.site
build id 4676138
I20260927 15:15:59.648690 4979 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260927 15:15:59.649672 4979 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260927 15:15:59.660703 4984 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260927 15:15:59.661280 4985 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260927 15:15:59.662523 4987 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260927 15:15:59.663293 4979 server_base.cc:1034] running on GCE node
I20260927 15:15:59.663710 4979 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260927 15:15:59.664352 4979 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260927 15:15:59.665522 4979 hybrid_clock.cc:648] HybridClock initialized: now 1790522159665496 us; error 37 us; skew 500 ppm
Sep 27 15:15:59 dist-test-slave-5s2t krb5kdc[4604](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790522159, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.136.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260927 15:15:59.668190 4979 init.cc:377] Logged in from keytab as kudu/127.17.136.3@KRBTEST.COM (short username kudu)
I20260927 15:15:59.669054 4979 webserver.cc:460] Webserver started at http://127.17.136.3:38433/ using document root <none> and password file <none>
I20260927 15:15:59.669580 4979 fs_manager.cc:359] Metadata directory not provided
I20260927 15:15:59.669643 4979 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260927 15:15:59.669827 4979 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260927 15:15:59.671881 4979 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790521920546562-17952-0/minicluster-data/ts-2/data/instance:
uuid: "dd8104eb3e144e27bcd87dddedb249a5"
format_stamp: "Formatted at 2026-09-27 15:15:59 on dist-test-slave-5s2t"
server_key: "e4f1cf7a162cfe891f21b03ad2b466eb"
server_key_iv: "301a567d0352a2f40665e826bf0e6d0d"
server_key_version: "encryptionkey@0"
I20260927 15:15:59.672410 4979 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790521920546562-17952-0/minicluster-data/ts-2/wal/instance:
uuid: "dd8104eb3e144e27bcd87dddedb249a5"
format_stamp: "Formatted at 2026-09-27 15:15:59 on dist-test-slave-5s2t"
server_key: "e4f1cf7a162cfe891f21b03ad2b466eb"
server_key_iv: "301a567d0352a2f40665e826bf0e6d0d"
server_key_version: "encryptionkey@0"
I20260927 15:15:59.675990 4979 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.000s
I20260927 15:15:59.678719 4994 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260927 15:15:59.680043 4979 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260927 15:15:59.680162 4979 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790521920546562-17952-0/minicluster-data/ts-2/data,/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790521920546562-17952-0/minicluster-data/ts-2/wal
uuid: "dd8104eb3e144e27bcd87dddedb249a5"
format_stamp: "Formatted at 2026-09-27 15:15:59 on dist-test-slave-5s2t"
server_key: "e4f1cf7a162cfe891f21b03ad2b466eb"
server_key_iv: "301a567d0352a2f40665e826bf0e6d0d"
server_key_version: "encryptionkey@0"
I20260927 15:15:59.680262 4979 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790521920546562-17952-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790521920546562-17952-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790521920546562-17952-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260927 15:15:59.702579 4979 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260927 15:15:59.705551 4979 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260927 15:15:59.705720 4979 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260927 15:15:59.706308 4979 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260927 15:15:59.707116 4979 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260927 15:15:59.707170 4979 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260927 15:15:59.707213 4979 ts_tablet_manager.cc:610] Registered 0 tablets
I20260927 15:15:59.707242 4979 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260927 15:15:59.715521 4979 rpc_server.cc:307] RPC server started. Bound to: 127.17.136.3:33977
I20260927 15:15:59.715544 5107 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.136.3:33977 every 8 connection(s)
I20260927 15:15:59.716378 4979 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790521920546562-17952-0/minicluster-data/ts-2/data/info.pb
Sep 27 15:15:59 dist-test-slave-5s2t krb5kdc[4604](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790522159, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.136.3@KRBTEST.COM for kudu/127.17.136.62@KRBTEST.COM
I20260927 15:15:59.725517 17952 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu as pid 4979
I20260927 15:15:59.725616 17952 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790521920546562-17952-0/minicluster-data/ts-2/wal/instance
I20260927 15:15:59.725925 17952 external_mini_cluster.cc:1428] Setting key cedbe5503c06d4a3350b9a10f89e4cc1
I20260927 15:15:59.729333 4688 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:15:59.718077 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.136.3:34819 (local address 127.17.136.62:45619)
0927 15:15:59.718200 (+ 123us) server_negotiation.cc:206] Beginning negotiation
0927 15:15:59.718203 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0927 15:15:59.719008 (+ 805us) server_negotiation.cc:407] Connection header received
0927 15:15:59.720308 (+ 1300us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:15:59.720311 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:15:59.720363 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:15:59.720435 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0927 15:15:59.721576 (+ 1141us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:15:59.722084 (+ 508us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:15:59.723155 (+ 1071us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:15:59.723383 (+ 228us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:15:59.723455 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:15:59.725804 (+ 2349us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0927 15:15:59.725808 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0927 15:15:59.725812 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0927 15:15:59.725843 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0927 15:15:59.727295 (+ 1452us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:15:59.727798 (+ 503us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:15:59.727801 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:15:59.727803 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:15:59.727898 (+ 95us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:15:59.728271 (+ 373us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:15:59.728274 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:15:59.728276 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:15:59.728466 (+ 190us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0927 15:15:59.728549 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0927 15:15:59.729052 (+ 503us) server_negotiation.cc:299] Negotiation successful
0927 15:15:59.729173 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260927 15:15:59.730252 5110 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:15:59.718426 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.62:45619 (local address 127.17.136.3:34819)
0927 15:15:59.718853 (+ 427us) negotiation.cc:107] Waiting for socket to connect
0927 15:15:59.718896 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0927 15:15:59.720108 (+ 1212us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0927 15:15:59.720594 (+ 486us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0927 15:15:59.720602 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0927 15:15:59.720957 (+ 355us) client_negotiation.cc:189] Negotiated authn=SASL
0927 15:15:59.721462 (+ 505us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:15:59.721475 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:15:59.722171 (+ 696us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:15:59.722173 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:15:59.723056 (+ 883us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:15:59.723065 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:15:59.723505 (+ 440us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:15:59.723507 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:15:59.723657 (+ 150us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:15:59.724175 (+ 518us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0927 15:15:59.724191 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0927 15:15:59.725620 (+ 1429us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0927 15:15:59.727413 (+ 1793us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0927 15:15:59.727419 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0927 15:15:59.727437 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0927 15:15:59.727698 (+ 261us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0927 15:15:59.727981 (+ 283us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0927 15:15:59.727984 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0927 15:15:59.727986 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0927 15:15:59.728180 (+ 194us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0927 15:15:59.728562 (+ 382us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0927 15:15:59.728570 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0927 15:15:59.728824 (+ 254us) client_negotiation.cc:769] Sending connection context
0927 15:15:59.728995 (+ 171us) client_negotiation.cc:240] Negotiation successful
0927 15:15:59.729355 (+ 360us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":243,"thread_start_us":106,"threads_started":1}
I20260927 15:15:59.733117 5108 heartbeater.cc:347] Connected to a master server at 127.17.136.62:45619
I20260927 15:15:59.733357 5108 heartbeater.cc:464] Registering TS with master...
I20260927 15:15:59.733918 5108 heartbeater.cc:511] Master 127.17.136.62:45619 requested a full tablet report, sending...
I20260927 15:15:59.735103 4649 ts_manager.cc:194] Registered new tserver with Master: dd8104eb3e144e27bcd87dddedb249a5 (127.17.136.3:33977)
I20260927 15:15:59.735882 4649 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.136.3@KRBTEST.COM'} at 127.17.136.3:34819
I20260927 15:15:59.739574 17952 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260927 15:15:59.748119 4688 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:15:59.741382 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41572 (local address 127.17.136.62:45619)
0927 15:15:59.741502 (+ 120us) server_negotiation.cc:206] Beginning negotiation
0927 15:15:59.741507 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0927 15:15:59.741651 (+ 144us) server_negotiation.cc:407] Connection header received
0927 15:15:59.741772 (+ 121us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:15:59.741775 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:15:59.741819 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:15:59.741883 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0927 15:15:59.742518 (+ 635us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:15:59.743023 (+ 505us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:15:59.743859 (+ 836us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:15:59.744085 (+ 226us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:15:59.744169 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:15:59.745358 (+ 1189us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0927 15:15:59.745362 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0927 15:15:59.745365 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0927 15:15:59.745392 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0927 15:15:59.746512 (+ 1120us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:15:59.746984 (+ 472us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:15:59.746993 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:15:59.746994 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:15:59.747075 (+ 81us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:15:59.747336 (+ 261us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:15:59.747339 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:15:59.747340 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:15:59.747620 (+ 280us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0927 15:15:59.747724 (+ 104us) server_negotiation.cc:1035] Waiting for connection context
0927 15:15:59.747909 (+ 185us) server_negotiation.cc:299] Negotiation successful
0927 15:15:59.748002 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260927 15:15:59.750730 4649 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:41572:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:15:59.753895 4649 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:15:59.768026 5119 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:15:59.762119 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.2:44211 (local address 127.0.0.1:50548)
0927 15:15:59.762870 (+ 751us) negotiation.cc:107] Waiting for socket to connect
0927 15:15:59.762921 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0927 15:15:59.763046 (+ 125us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0927 15:15:59.763693 (+ 647us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0927 15:15:59.763699 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0927 15:15:59.763722 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0927 15:15:59.763860 (+ 138us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:15:59.763867 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:15:59.764996 (+ 1129us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:15:59.764999 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:15:59.766440 (+ 1441us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:15:59.766450 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:15:59.767500 (+ 1050us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:15:59.767504 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:15:59.767607 (+ 103us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:15:59.767641 (+ 34us) client_negotiation.cc:769] Sending connection context
0927 15:15:59.767744 (+ 103us) client_negotiation.cc:240] Negotiation successful
0927 15:15:59.767874 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":589,"mutex_wait_us":31,"thread_start_us":81,"threads_started":1}
I20260927 15:15:59.768031 5120 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:15:59.762295 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50548 (local address 127.17.136.2:44211)
0927 15:15:59.762625 (+ 330us) server_negotiation.cc:206] Beginning negotiation
0927 15:15:59.762637 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0927 15:15:59.763214 (+ 577us) server_negotiation.cc:407] Connection header received
0927 15:15:59.763322 (+ 108us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:15:59.763328 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:15:59.763535 (+ 207us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:15:59.763678 (+ 143us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0927 15:15:59.763964 (+ 286us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:15:59.764868 (+ 904us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:15:59.766571 (+ 1703us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:15:59.767392 (+ 821us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:15:59.767487 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:15:59.767637 (+ 150us) server_negotiation.cc:1035] Waiting for connection context
0927 15:15:59.767783 (+ 146us) server_negotiation.cc:299] Negotiation successful
0927 15:15:59.767874 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":225,"thread_start_us":115,"threads_started":1}
I20260927 15:15:59.768594 5121 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:15:59.762819 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.1:35295 (local address 127.0.0.1:47594)
0927 15:15:59.763603 (+ 784us) negotiation.cc:107] Waiting for socket to connect
0927 15:15:59.763614 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0927 15:15:59.763685 (+ 71us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0927 15:15:59.764513 (+ 828us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0927 15:15:59.764517 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0927 15:15:59.764534 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0927 15:15:59.764638 (+ 104us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:15:59.764645 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:15:59.765936 (+ 1291us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:15:59.765938 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:15:59.766843 (+ 905us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:15:59.766853 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:15:59.768091 (+ 1238us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:15:59.768095 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:15:59.768236 (+ 141us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:15:59.768273 (+ 37us) client_negotiation.cc:769] Sending connection context
0927 15:15:59.768340 (+ 67us) client_negotiation.cc:240] Negotiation successful
0927 15:15:59.768438 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":727,"mutex_wait_us":28,"thread_start_us":94,"threads_started":1}
I20260927 15:15:59.768687 5124 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:15:59.763200 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46032 (local address 127.17.136.3:33977)
0927 15:15:59.763928 (+ 728us) server_negotiation.cc:206] Beginning negotiation
0927 15:15:59.763938 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0927 15:15:59.763958 (+ 20us) server_negotiation.cc:407] Connection header received
0927 15:15:59.764024 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:15:59.764028 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:15:59.764210 (+ 182us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:15:59.764359 (+ 149us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0927 15:15:59.764556 (+ 197us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:15:59.765613 (+ 1057us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:15:59.767020 (+ 1407us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:15:59.767806 (+ 786us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:15:59.767905 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:15:59.768030 (+ 125us) server_negotiation.cc:1035] Waiting for connection context
0927 15:15:59.768465 (+ 435us) server_negotiation.cc:299] Negotiation successful
0927 15:15:59.768552 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":631,"thread_start_us":137,"threads_started":1}
I20260927 15:15:59.768958 5122 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:15:59.762376 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.3:33977 (local address 127.0.0.1:46032)
0927 15:15:59.763321 (+ 945us) negotiation.cc:107] Waiting for socket to connect
0927 15:15:59.763335 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0927 15:15:59.763424 (+ 89us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0927 15:15:59.764350 (+ 926us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0927 15:15:59.764353 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0927 15:15:59.764370 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0927 15:15:59.764451 (+ 81us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:15:59.764456 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:15:59.765768 (+ 1312us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:15:59.765772 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:15:59.766924 (+ 1152us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:15:59.766933 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:15:59.768091 (+ 1158us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:15:59.768095 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:15:59.768233 (+ 138us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:15:59.768280 (+ 47us) client_negotiation.cc:769] Sending connection context
0927 15:15:59.768340 (+ 60us) client_negotiation.cc:240] Negotiation successful
0927 15:15:59.768835 (+ 495us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":852,"mutex_wait_us":466,"thread_start_us":100,"threads_started":1}
I20260927 15:15:59.768993 5123 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:15:59.762975 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47594 (local address 127.17.136.1:35295)
0927 15:15:59.763652 (+ 677us) server_negotiation.cc:206] Beginning negotiation
0927 15:15:59.763666 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0927 15:15:59.763687 (+ 21us) server_negotiation.cc:407] Connection header received
0927 15:15:59.763787 (+ 100us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:15:59.764026 (+ 239us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:15:59.764213 (+ 187us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:15:59.764359 (+ 146us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0927 15:15:59.764763 (+ 404us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:15:59.765793 (+ 1030us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:15:59.766955 (+ 1162us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:15:59.767805 (+ 850us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:15:59.767905 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:15:59.768030 (+ 125us) server_negotiation.cc:1035] Waiting for connection context
0927 15:15:59.768760 (+ 730us) server_negotiation.cc:299] Negotiation successful
0927 15:15:59.768859 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":572,"thread_start_us":58,"threads_started":1}
I20260927 15:15:59.771387 4908 tablet_service.cc:1467] Processing CreateTablet for tablet 3f1cd1c8afe040f1804c34abaadbe8c3 (DEFAULT_TABLE table=test-table [id=1a2e18825bc840b39345edf56e457509]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:15:59.771387 5042 tablet_service.cc:1467] Processing CreateTablet for tablet 3f1cd1c8afe040f1804c34abaadbe8c3 (DEFAULT_TABLE table=test-table [id=1a2e18825bc840b39345edf56e457509]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:15:59.772253 4908 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3f1cd1c8afe040f1804c34abaadbe8c3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:15:59.772262 5042 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3f1cd1c8afe040f1804c34abaadbe8c3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:15:59.775477 4774 tablet_service.cc:1467] Processing CreateTablet for tablet 3f1cd1c8afe040f1804c34abaadbe8c3 (DEFAULT_TABLE table=test-table [id=1a2e18825bc840b39345edf56e457509]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:15:59.776453 4774 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3f1cd1c8afe040f1804c34abaadbe8c3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:15:59.779219 5126 tablet_bootstrap.cc:492] T 3f1cd1c8afe040f1804c34abaadbe8c3 P d1a92b3db3c64a4cb1580b6ae5d00435: Bootstrap starting.
I20260927 15:15:59.779219 5125 tablet_bootstrap.cc:492] T 3f1cd1c8afe040f1804c34abaadbe8c3 P dd8104eb3e144e27bcd87dddedb249a5: Bootstrap starting.
I20260927 15:15:59.780984 5125 tablet_bootstrap.cc:654] T 3f1cd1c8afe040f1804c34abaadbe8c3 P dd8104eb3e144e27bcd87dddedb249a5: Neither blocks nor log segments found. Creating new log.
I20260927 15:15:59.781662 5126 tablet_bootstrap.cc:654] T 3f1cd1c8afe040f1804c34abaadbe8c3 P d1a92b3db3c64a4cb1580b6ae5d00435: Neither blocks nor log segments found. Creating new log.
I20260927 15:15:59.782058 5125 log.cc:824] T 3f1cd1c8afe040f1804c34abaadbe8c3 P dd8104eb3e144e27bcd87dddedb249a5: Log is configured to *not* fsync() on all Append() calls
I20260927 15:15:59.782464 5126 log.cc:824] T 3f1cd1c8afe040f1804c34abaadbe8c3 P d1a92b3db3c64a4cb1580b6ae5d00435: Log is configured to *not* fsync() on all Append() calls
I20260927 15:15:59.783654 5129 tablet_bootstrap.cc:492] T 3f1cd1c8afe040f1804c34abaadbe8c3 P 53d92b179ccd4fedb7d20fd0f7a40673: Bootstrap starting.
I20260927 15:15:59.784107 5125 tablet_bootstrap.cc:492] T 3f1cd1c8afe040f1804c34abaadbe8c3 P dd8104eb3e144e27bcd87dddedb249a5: No bootstrap required, opened a new log
I20260927 15:15:59.784356 5126 tablet_bootstrap.cc:492] T 3f1cd1c8afe040f1804c34abaadbe8c3 P d1a92b3db3c64a4cb1580b6ae5d00435: No bootstrap required, opened a new log
I20260927 15:15:59.784507 5125 ts_tablet_manager.cc:1397] T 3f1cd1c8afe040f1804c34abaadbe8c3 P dd8104eb3e144e27bcd87dddedb249a5: Time spent bootstrapping tablet: real 0.005s user 0.005s sys 0.000s
I20260927 15:15:59.784559 5126 ts_tablet_manager.cc:1397] T 3f1cd1c8afe040f1804c34abaadbe8c3 P d1a92b3db3c64a4cb1580b6ae5d00435: Time spent bootstrapping tablet: real 0.006s user 0.000s sys 0.005s
I20260927 15:15:59.785971 5129 tablet_bootstrap.cc:654] T 3f1cd1c8afe040f1804c34abaadbe8c3 P 53d92b179ccd4fedb7d20fd0f7a40673: Neither blocks nor log segments found. Creating new log.
I20260927 15:15:59.787150 5129 log.cc:824] T 3f1cd1c8afe040f1804c34abaadbe8c3 P 53d92b179ccd4fedb7d20fd0f7a40673: Log is configured to *not* fsync() on all Append() calls
I20260927 15:15:59.787412 5125 raft_consensus.cc:348] T 3f1cd1c8afe040f1804c34abaadbe8c3 P dd8104eb3e144e27bcd87dddedb249a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1a92b3db3c64a4cb1580b6ae5d00435" member_type: VOTER last_known_addr { host: "127.17.136.2" port: 44211 } } peers { permanent_uuid: "dd8104eb3e144e27bcd87dddedb249a5" member_type: VOTER last_known_addr { host: "127.17.136.3" port: 33977 } } peers { permanent_uuid: "53d92b179ccd4fedb7d20fd0f7a40673" member_type: VOTER last_known_addr { host: "127.17.136.1" port: 35295 } }
I20260927 15:15:59.787673 5125 raft_consensus.cc:374] T 3f1cd1c8afe040f1804c34abaadbe8c3 P dd8104eb3e144e27bcd87dddedb249a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:15:59.787757 5125 raft_consensus.cc:729] T 3f1cd1c8afe040f1804c34abaadbe8c3 P dd8104eb3e144e27bcd87dddedb249a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dd8104eb3e144e27bcd87dddedb249a5, State: Initialized, Role: FOLLOWER
I20260927 15:15:59.788184 5125 consensus_queue.cc:260] T 3f1cd1c8afe040f1804c34abaadbe8c3 P dd8104eb3e144e27bcd87dddedb249a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1a92b3db3c64a4cb1580b6ae5d00435" member_type: VOTER last_known_addr { host: "127.17.136.2" port: 44211 } } peers { permanent_uuid: "dd8104eb3e144e27bcd87dddedb249a5" member_type: VOTER last_known_addr { host: "127.17.136.3" port: 33977 } } peers { permanent_uuid: "53d92b179ccd4fedb7d20fd0f7a40673" member_type: VOTER last_known_addr { host: "127.17.136.1" port: 35295 } }
I20260927 15:15:59.788130 5126 raft_consensus.cc:348] T 3f1cd1c8afe040f1804c34abaadbe8c3 P d1a92b3db3c64a4cb1580b6ae5d00435 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1a92b3db3c64a4cb1580b6ae5d00435" member_type: VOTER last_known_addr { host: "127.17.136.2" port: 44211 } } peers { permanent_uuid: "dd8104eb3e144e27bcd87dddedb249a5" member_type: VOTER last_known_addr { host: "127.17.136.3" port: 33977 } } peers { permanent_uuid: "53d92b179ccd4fedb7d20fd0f7a40673" member_type: VOTER last_known_addr { host: "127.17.136.1" port: 35295 } }
I20260927 15:15:59.788422 5126 raft_consensus.cc:374] T 3f1cd1c8afe040f1804c34abaadbe8c3 P d1a92b3db3c64a4cb1580b6ae5d00435 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:15:59.788517 5126 raft_consensus.cc:729] T 3f1cd1c8afe040f1804c34abaadbe8c3 P d1a92b3db3c64a4cb1580b6ae5d00435 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d1a92b3db3c64a4cb1580b6ae5d00435, State: Initialized, Role: FOLLOWER
I20260927 15:15:59.788784 5108 heartbeater.cc:503] Master 127.17.136.62:45619 was elected leader, sending a full tablet report...
I20260927 15:15:59.789084 5125 ts_tablet_manager.cc:1428] T 3f1cd1c8afe040f1804c34abaadbe8c3 P dd8104eb3e144e27bcd87dddedb249a5: Time spent starting tablet: real 0.004s user 0.004s sys 0.000s
I20260927 15:15:59.789088 5129 tablet_bootstrap.cc:492] T 3f1cd1c8afe040f1804c34abaadbe8c3 P 53d92b179ccd4fedb7d20fd0f7a40673: No bootstrap required, opened a new log
I20260927 15:15:59.789261 5129 ts_tablet_manager.cc:1397] T 3f1cd1c8afe040f1804c34abaadbe8c3 P 53d92b179ccd4fedb7d20fd0f7a40673: Time spent bootstrapping tablet: real 0.006s user 0.001s sys 0.003s
I20260927 15:15:59.789530 5126 consensus_queue.cc:260] T 3f1cd1c8afe040f1804c34abaadbe8c3 P d1a92b3db3c64a4cb1580b6ae5d00435 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1a92b3db3c64a4cb1580b6ae5d00435" member_type: VOTER last_known_addr { host: "127.17.136.2" port: 44211 } } peers { permanent_uuid: "dd8104eb3e144e27bcd87dddedb249a5" member_type: VOTER last_known_addr { host: "127.17.136.3" port: 33977 } } peers { permanent_uuid: "53d92b179ccd4fedb7d20fd0f7a40673" member_type: VOTER last_known_addr { host: "127.17.136.1" port: 35295 } }
I20260927 15:15:59.790445 5126 ts_tablet_manager.cc:1428] T 3f1cd1c8afe040f1804c34abaadbe8c3 P d1a92b3db3c64a4cb1580b6ae5d00435: Time spent starting tablet: real 0.006s user 0.003s sys 0.002s
I20260927 15:15:59.791504 4974 heartbeater.cc:503] Master 127.17.136.62:45619 was elected leader, sending a full tablet report...
I20260927 15:15:59.792856 5129 raft_consensus.cc:348] T 3f1cd1c8afe040f1804c34abaadbe8c3 P 53d92b179ccd4fedb7d20fd0f7a40673 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1a92b3db3c64a4cb1580b6ae5d00435" member_type: VOTER last_known_addr { host: "127.17.136.2" port: 44211 } } peers { permanent_uuid: "dd8104eb3e144e27bcd87dddedb249a5" member_type: VOTER last_known_addr { host: "127.17.136.3" port: 33977 } } peers { permanent_uuid: "53d92b179ccd4fedb7d20fd0f7a40673" member_type: VOTER last_known_addr { host: "127.17.136.1" port: 35295 } }
I20260927 15:15:59.793151 5129 raft_consensus.cc:374] T 3f1cd1c8afe040f1804c34abaadbe8c3 P 53d92b179ccd4fedb7d20fd0f7a40673 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:15:59.793217 5129 raft_consensus.cc:729] T 3f1cd1c8afe040f1804c34abaadbe8c3 P 53d92b179ccd4fedb7d20fd0f7a40673 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 53d92b179ccd4fedb7d20fd0f7a40673, State: Initialized, Role: FOLLOWER
I20260927 15:15:59.793596 5129 consensus_queue.cc:260] T 3f1cd1c8afe040f1804c34abaadbe8c3 P 53d92b179ccd4fedb7d20fd0f7a40673 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1a92b3db3c64a4cb1580b6ae5d00435" member_type: VOTER last_known_addr { host: "127.17.136.2" port: 44211 } } peers { permanent_uuid: "dd8104eb3e144e27bcd87dddedb249a5" member_type: VOTER last_known_addr { host: "127.17.136.3" port: 33977 } } peers { permanent_uuid: "53d92b179ccd4fedb7d20fd0f7a40673" member_type: VOTER last_known_addr { host: "127.17.136.1" port: 35295 } }
I20260927 15:15:59.794193 4840 heartbeater.cc:503] Master 127.17.136.62:45619 was elected leader, sending a full tablet report...
I20260927 15:15:59.794425 5129 ts_tablet_manager.cc:1428] T 3f1cd1c8afe040f1804c34abaadbe8c3 P 53d92b179ccd4fedb7d20fd0f7a40673: Time spent starting tablet: real 0.005s user 0.004s sys 0.001s
W20260927 15:15:59.967343 5109 tablet.cc:2369] T 3f1cd1c8afe040f1804c34abaadbe8c3 P dd8104eb3e144e27bcd87dddedb249a5: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260927 15:15:59.997241 4975 tablet.cc:2369] T 3f1cd1c8afe040f1804c34abaadbe8c3 P d1a92b3db3c64a4cb1580b6ae5d00435: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260927 15:16:00.034461 4841 tablet.cc:2369] T 3f1cd1c8afe040f1804c34abaadbe8c3 P 53d92b179ccd4fedb7d20fd0f7a40673: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260927 15:16:00.146013 5131 raft_consensus.cc:482] T 3f1cd1c8afe040f1804c34abaadbe8c3 P dd8104eb3e144e27bcd87dddedb249a5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:16:00.146238 5131 raft_consensus.cc:504] T 3f1cd1c8afe040f1804c34abaadbe8c3 P dd8104eb3e144e27bcd87dddedb249a5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1a92b3db3c64a4cb1580b6ae5d00435" member_type: VOTER last_known_addr { host: "127.17.136.2" port: 44211 } } peers { permanent_uuid: "dd8104eb3e144e27bcd87dddedb249a5" member_type: VOTER last_known_addr { host: "127.17.136.3" port: 33977 } } peers { permanent_uuid: "53d92b179ccd4fedb7d20fd0f7a40673" member_type: VOTER last_known_addr { host: "127.17.136.1" port: 35295 } }
I20260927 15:16:00.147621 5131 leader_election.cc:288] T 3f1cd1c8afe040f1804c34abaadbe8c3 P dd8104eb3e144e27bcd87dddedb249a5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d1a92b3db3c64a4cb1580b6ae5d00435 (127.17.136.2:44211), 53d92b179ccd4fedb7d20fd0f7a40673 (127.17.136.1:35295)
I20260927 15:16:00.151405 5120 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:16:00.147933 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.136.3:58545 (local address 127.17.136.2:44211)
0927 15:16:00.148250 (+ 317us) server_negotiation.cc:206] Beginning negotiation
0927 15:16:00.148255 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0927 15:16:00.148272 (+ 17us) server_negotiation.cc:407] Connection header received
0927 15:16:00.148329 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:16:00.148332 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:16:00.148379 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:16:00.148448 (+ 69us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0927 15:16:00.148782 (+ 334us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:16:00.149316 (+ 534us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:16:00.150419 (+ 1103us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:16:00.150823 (+ 404us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:16:00.150928 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:16:00.150979 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0927 15:16:00.151190 (+ 211us) server_negotiation.cc:299] Negotiation successful
0927 15:16:00.151286 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":231}
I20260927 15:16:00.151405 5123 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:16:00.148052 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.136.3:48193 (local address 127.17.136.1:35295)
0927 15:16:00.148172 (+ 120us) server_negotiation.cc:206] Beginning negotiation
0927 15:16:00.148176 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0927 15:16:00.148371 (+ 195us) server_negotiation.cc:407] Connection header received
0927 15:16:00.148442 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:16:00.148445 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:16:00.148497 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:16:00.148581 (+ 84us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0927 15:16:00.148853 (+ 272us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:16:00.149333 (+ 480us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:16:00.150423 (+ 1090us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:16:00.150821 (+ 398us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:16:00.150923 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:16:00.150977 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0927 15:16:00.151197 (+ 220us) server_negotiation.cc:299] Negotiation successful
0927 15:16:00.151287 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260927 15:16:00.151405 5110 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:16:00.147877 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.2:44211 (local address 127.17.136.3:58545)
0927 15:16:00.148069 (+ 192us) negotiation.cc:107] Waiting for socket to connect
0927 15:16:00.148083 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0927 15:16:00.148177 (+ 94us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0927 15:16:00.148488 (+ 311us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0927 15:16:00.148491 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0927 15:16:00.148508 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0927 15:16:00.148657 (+ 149us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:16:00.148665 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:16:00.149425 (+ 760us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:16:00.149429 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:16:00.150299 (+ 870us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:16:00.150308 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:16:00.150929 (+ 621us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:16:00.150932 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:16:00.151078 (+ 146us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:16:00.151095 (+ 17us) client_negotiation.cc:769] Sending connection context
0927 15:16:00.151159 (+ 64us) client_negotiation.cc:240] Negotiation successful
0927 15:16:00.151235 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":114,"mutex_wait_us":64}
I20260927 15:16:00.151417 5134 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:16:00.147885 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.1:35295 (local address 127.17.136.3:48193)
0927 15:16:00.148245 (+ 360us) negotiation.cc:107] Waiting for socket to connect
0927 15:16:00.148258 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0927 15:16:00.148364 (+ 106us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0927 15:16:00.148614 (+ 250us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0927 15:16:00.148616 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0927 15:16:00.148629 (+ 13us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0927 15:16:00.148738 (+ 109us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:16:00.148744 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:16:00.149435 (+ 691us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:16:00.149438 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:16:00.150304 (+ 866us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:16:00.150312 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:16:00.150929 (+ 617us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:16:00.150932 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:16:00.151075 (+ 143us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:16:00.151101 (+ 26us) client_negotiation.cc:769] Sending connection context
0927 15:16:00.151166 (+ 65us) client_negotiation.cc:240] Negotiation successful
0927 15:16:00.151239 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":304,"mutex_wait_us":81,"thread_start_us":122,"threads_started":1}
I20260927 15:16:00.152272 4928 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3f1cd1c8afe040f1804c34abaadbe8c3" candidate_uuid: "dd8104eb3e144e27bcd87dddedb249a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d1a92b3db3c64a4cb1580b6ae5d00435" is_pre_election: true
I20260927 15:16:00.152498 4794 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3f1cd1c8afe040f1804c34abaadbe8c3" candidate_uuid: "dd8104eb3e144e27bcd87dddedb249a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "53d92b179ccd4fedb7d20fd0f7a40673" is_pre_election: true
I20260927 15:16:00.152643 4928 raft_consensus.cc:2454] T 3f1cd1c8afe040f1804c34abaadbe8c3 P d1a92b3db3c64a4cb1580b6ae5d00435 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd8104eb3e144e27bcd87dddedb249a5 in term 0.
I20260927 15:16:00.152752 4794 raft_consensus.cc:2454] T 3f1cd1c8afe040f1804c34abaadbe8c3 P 53d92b179ccd4fedb7d20fd0f7a40673 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd8104eb3e144e27bcd87dddedb249a5 in term 0.
I20260927 15:16:00.153221 4995 leader_election.cc:302] T 3f1cd1c8afe040f1804c34abaadbe8c3 P dd8104eb3e144e27bcd87dddedb249a5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 53d92b179ccd4fedb7d20fd0f7a40673, dd8104eb3e144e27bcd87dddedb249a5; no voters:
I20260927 15:16:00.153465 5131 raft_consensus.cc:2781] T 3f1cd1c8afe040f1804c34abaadbe8c3 P dd8104eb3e144e27bcd87dddedb249a5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 15:16:00.153548 5131 raft_consensus.cc:482] T 3f1cd1c8afe040f1804c34abaadbe8c3 P dd8104eb3e144e27bcd87dddedb249a5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 15:16:00.153594 5131 raft_consensus.cc:3037] T 3f1cd1c8afe040f1804c34abaadbe8c3 P dd8104eb3e144e27bcd87dddedb249a5 [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:16:00.154680 5131 raft_consensus.cc:504] T 3f1cd1c8afe040f1804c34abaadbe8c3 P dd8104eb3e144e27bcd87dddedb249a5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1a92b3db3c64a4cb1580b6ae5d00435" member_type: VOTER last_known_addr { host: "127.17.136.2" port: 44211 } } peers { permanent_uuid: "dd8104eb3e144e27bcd87dddedb249a5" member_type: VOTER last_known_addr { host: "127.17.136.3" port: 33977 } } peers { permanent_uuid: "53d92b179ccd4fedb7d20fd0f7a40673" member_type: VOTER last_known_addr { host: "127.17.136.1" port: 35295 } }
I20260927 15:16:00.155019 5131 leader_election.cc:288] T 3f1cd1c8afe040f1804c34abaadbe8c3 P dd8104eb3e144e27bcd87dddedb249a5 [CANDIDATE]: Term 1 election: Requested vote from peers d1a92b3db3c64a4cb1580b6ae5d00435 (127.17.136.2:44211), 53d92b179ccd4fedb7d20fd0f7a40673 (127.17.136.1:35295)
I20260927 15:16:00.155404 4928 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3f1cd1c8afe040f1804c34abaadbe8c3" candidate_uuid: "dd8104eb3e144e27bcd87dddedb249a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d1a92b3db3c64a4cb1580b6ae5d00435"
I20260927 15:16:00.155404 4794 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3f1cd1c8afe040f1804c34abaadbe8c3" candidate_uuid: "dd8104eb3e144e27bcd87dddedb249a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "53d92b179ccd4fedb7d20fd0f7a40673"
I20260927 15:16:00.155536 4794 raft_consensus.cc:3037] T 3f1cd1c8afe040f1804c34abaadbe8c3 P 53d92b179ccd4fedb7d20fd0f7a40673 [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:16:00.155536 4928 raft_consensus.cc:3037] T 3f1cd1c8afe040f1804c34abaadbe8c3 P d1a92b3db3c64a4cb1580b6ae5d00435 [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:16:00.156818 4794 raft_consensus.cc:2454] T 3f1cd1c8afe040f1804c34abaadbe8c3 P 53d92b179ccd4fedb7d20fd0f7a40673 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dd8104eb3e144e27bcd87dddedb249a5 in term 1.
I20260927 15:16:00.156818 4928 raft_consensus.cc:2454] T 3f1cd1c8afe040f1804c34abaadbe8c3 P d1a92b3db3c64a4cb1580b6ae5d00435 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dd8104eb3e144e27bcd87dddedb249a5 in term 1.
I20260927 15:16:00.157140 4997 leader_election.cc:302] T 3f1cd1c8afe040f1804c34abaadbe8c3 P dd8104eb3e144e27bcd87dddedb249a5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d1a92b3db3c64a4cb1580b6ae5d00435, dd8104eb3e144e27bcd87dddedb249a5; no voters:
I20260927 15:16:00.157306 5131 raft_consensus.cc:2781] T 3f1cd1c8afe040f1804c34abaadbe8c3 P dd8104eb3e144e27bcd87dddedb249a5 [term 1 FOLLOWER]: Leader election won for term 1
I20260927 15:16:00.157509 5131 raft_consensus.cc:686] T 3f1cd1c8afe040f1804c34abaadbe8c3 P dd8104eb3e144e27bcd87dddedb249a5 [term 1 LEADER]: Becoming Leader. State: Replica: dd8104eb3e144e27bcd87dddedb249a5, State: Running, Role: LEADER
I20260927 15:16:00.157866 5131 consensus_queue.cc:237] T 3f1cd1c8afe040f1804c34abaadbe8c3 P dd8104eb3e144e27bcd87dddedb249a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1a92b3db3c64a4cb1580b6ae5d00435" member_type: VOTER last_known_addr { host: "127.17.136.2" port: 44211 } } peers { permanent_uuid: "dd8104eb3e144e27bcd87dddedb249a5" member_type: VOTER last_known_addr { host: "127.17.136.3" port: 33977 } } peers { permanent_uuid: "53d92b179ccd4fedb7d20fd0f7a40673" member_type: VOTER last_known_addr { host: "127.17.136.1" port: 35295 } }
I20260927 15:16:00.161017 4648 catalog_manager.cc:5495] T 3f1cd1c8afe040f1804c34abaadbe8c3 P dd8104eb3e144e27bcd87dddedb249a5 reported cstate change: term changed from 0 to 1, leader changed from <none> to dd8104eb3e144e27bcd87dddedb249a5 (127.17.136.3). New cstate: current_term: 1 leader_uuid: "dd8104eb3e144e27bcd87dddedb249a5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1a92b3db3c64a4cb1580b6ae5d00435" member_type: VOTER last_known_addr { host: "127.17.136.2" port: 44211 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dd8104eb3e144e27bcd87dddedb249a5" member_type: VOTER last_known_addr { host: "127.17.136.3" port: 33977 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "53d92b179ccd4fedb7d20fd0f7a40673" member_type: VOTER last_known_addr { host: "127.17.136.1" port: 35295 } health_report { overall_health: UNKNOWN } } }
I20260927 15:16:00.217626 5124 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:16:00.214519 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46040 (local address 127.17.136.3:33977)
0927 15:16:00.214653 (+ 134us) server_negotiation.cc:206] Beginning negotiation
0927 15:16:00.214657 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0927 15:16:00.214670 (+ 13us) server_negotiation.cc:407] Connection header received
0927 15:16:00.214741 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:16:00.214743 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:16:00.214793 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:16:00.214875 (+ 82us) server_negotiation.cc:226] Negotiated authn=TOKEN
0927 15:16:00.215057 (+ 182us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:16:00.215561 (+ 504us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:16:00.216342 (+ 781us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:16:00.216544 (+ 202us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:16:00.216613 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:16:00.216897 (+ 284us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0927 15:16:00.217302 (+ 405us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0927 15:16:00.217385 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0927 15:16:00.217430 (+ 45us) server_negotiation.cc:299] Negotiation successful
0927 15:16:00.217478 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260927 15:16:00.222982 4794 raft_consensus.cc:1261] T 3f1cd1c8afe040f1804c34abaadbe8c3 P 53d92b179ccd4fedb7d20fd0f7a40673 [term 1 FOLLOWER]: Refusing update from remote peer dd8104eb3e144e27bcd87dddedb249a5: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260927 15:16:00.222983 4928 raft_consensus.cc:1261] T 3f1cd1c8afe040f1804c34abaadbe8c3 P d1a92b3db3c64a4cb1580b6ae5d00435 [term 1 FOLLOWER]: Refusing update from remote peer dd8104eb3e144e27bcd87dddedb249a5: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260927 15:16:00.223670 5131 consensus_queue.cc:1035] T 3f1cd1c8afe040f1804c34abaadbe8c3 P dd8104eb3e144e27bcd87dddedb249a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "53d92b179ccd4fedb7d20fd0f7a40673" member_type: VOTER last_known_addr { host: "127.17.136.1" port: 35295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260927 15:16:00.223852 5135 consensus_queue.cc:1035] T 3f1cd1c8afe040f1804c34abaadbe8c3 P dd8104eb3e144e27bcd87dddedb249a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d1a92b3db3c64a4cb1580b6ae5d00435" member_type: VOTER last_known_addr { host: "127.17.136.2" port: 44211 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260927 15:16:00.237838 4647 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:41572:
table { table_name: "test-table" } modify_external_catalogs: true
I20260927 15:16:00.237995 4647 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:41572:
table { table_name: "test-table" } modify_external_catalogs: true
I20260927 15:16:00.240152 4647 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 571a1f28677843db8290f45b29660701: Sending DeleteTablet for 3 replicas of tablet 3f1cd1c8afe040f1804c34abaadbe8c3
I20260927 15:16:00.240886 5042 tablet_service.cc:1514] Processing DeleteTablet for tablet 3f1cd1c8afe040f1804c34abaadbe8c3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:16:00 UTC) from {username='kudu', principal='kudu/127.17.136.62@KRBTEST.COM'} at 127.0.0.1:46032
I20260927 15:16:00.240899 4908 tablet_service.cc:1514] Processing DeleteTablet for tablet 3f1cd1c8afe040f1804c34abaadbe8c3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:16:00 UTC) from {username='kudu', principal='kudu/127.17.136.62@KRBTEST.COM'} at 127.0.0.1:50548
I20260927 15:16:00.240988 4774 tablet_service.cc:1514] Processing DeleteTablet for tablet 3f1cd1c8afe040f1804c34abaadbe8c3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:16:00 UTC) from {username='kudu', principal='kudu/127.17.136.62@KRBTEST.COM'} at 127.0.0.1:47594
I20260927 15:16:00.241340 5148 tablet_replica.cc:330] T 3f1cd1c8afe040f1804c34abaadbe8c3 P dd8104eb3e144e27bcd87dddedb249a5: stopping tablet replica
I20260927 15:16:00.241587 5148 raft_consensus.cc:2229] T 3f1cd1c8afe040f1804c34abaadbe8c3 P dd8104eb3e144e27bcd87dddedb249a5 [term 1 LEADER]: Raft consensus shutting down.
I20260927 15:16:00.241750 5149 tablet_replica.cc:330] T 3f1cd1c8afe040f1804c34abaadbe8c3 P d1a92b3db3c64a4cb1580b6ae5d00435: stopping tablet replica
I20260927 15:16:00.241950 5148 raft_consensus.cc:2258] T 3f1cd1c8afe040f1804c34abaadbe8c3 P dd8104eb3e144e27bcd87dddedb249a5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 15:16:00.241950 5150 tablet_replica.cc:330] T 3f1cd1c8afe040f1804c34abaadbe8c3 P 53d92b179ccd4fedb7d20fd0f7a40673: stopping tablet replica
I20260927 15:16:00.242141 17952 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu with pid 4711
I20260927 15:16:00.242259 5150 raft_consensus.cc:2229] T 3f1cd1c8afe040f1804c34abaadbe8c3 P 53d92b179ccd4fedb7d20fd0f7a40673 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260927 15:16:00.243391 5149 raft_consensus.cc:2229] T 3f1cd1c8afe040f1804c34abaadbe8c3 P d1a92b3db3c64a4cb1580b6ae5d00435 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260927 15:16:00.243434 5148 ts_tablet_manager.cc:1905] T 3f1cd1c8afe040f1804c34abaadbe8c3 P dd8104eb3e144e27bcd87dddedb249a5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:16:00.243681 5149 raft_consensus.cc:2258] T 3f1cd1c8afe040f1804c34abaadbe8c3 P d1a92b3db3c64a4cb1580b6ae5d00435 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 15:16:00.245168 5149 ts_tablet_manager.cc:1905] T 3f1cd1c8afe040f1804c34abaadbe8c3 P d1a92b3db3c64a4cb1580b6ae5d00435: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:16:00.246207 5148 ts_tablet_manager.cc:1918] T 3f1cd1c8afe040f1804c34abaadbe8c3 P dd8104eb3e144e27bcd87dddedb249a5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260927 15:16:00.246348 5148 log.cc:1196] T 3f1cd1c8afe040f1804c34abaadbe8c3 P dd8104eb3e144e27bcd87dddedb249a5: Deleting WAL directory at /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790521920546562-17952-0/minicluster-data/ts-2/wal/wals/3f1cd1c8afe040f1804c34abaadbe8c3
I20260927 15:16:00.246738 5148 ts_tablet_manager.cc:1939] T 3f1cd1c8afe040f1804c34abaadbe8c3 P dd8104eb3e144e27bcd87dddedb249a5: Deleting consensus metadata
I20260927 15:16:00.248034 5149 ts_tablet_manager.cc:1918] T 3f1cd1c8afe040f1804c34abaadbe8c3 P d1a92b3db3c64a4cb1580b6ae5d00435: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260927 15:16:00.248190 5149 log.cc:1196] T 3f1cd1c8afe040f1804c34abaadbe8c3 P d1a92b3db3c64a4cb1580b6ae5d00435: Deleting WAL directory at /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790521920546562-17952-0/minicluster-data/ts-1/wal/wals/3f1cd1c8afe040f1804c34abaadbe8c3
I20260927 15:16:00.248178 4634 catalog_manager.cc:4841] TS dd8104eb3e144e27bcd87dddedb249a5 (127.17.136.3:33977): tablet 3f1cd1c8afe040f1804c34abaadbe8c3 (table test-table [id=1a2e18825bc840b39345edf56e457509]) successfully deleted
I20260927 15:16:00.248519 5149 ts_tablet_manager.cc:1939] T 3f1cd1c8afe040f1804c34abaadbe8c3 P d1a92b3db3c64a4cb1580b6ae5d00435: Deleting consensus metadata
I20260927 15:16:00.249683 4635 catalog_manager.cc:4841] TS d1a92b3db3c64a4cb1580b6ae5d00435 (127.17.136.2:44211): tablet 3f1cd1c8afe040f1804c34abaadbe8c3 (table test-table [id=1a2e18825bc840b39345edf56e457509]) successfully deleted
W20260927 15:16:00.250401 4633 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.17.136.1:35295 (error 108)
I20260927 15:16:00.251152 17952 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu with pid 4845
I20260927 15:16:00.251375 5122 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:16:00.251061 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.1:35295 (local address 127.0.0.1:47598)
0927 15:16:00.251193 (+ 132us) negotiation.cc:107] Waiting for socket to connect
0927 15:16:00.251294 (+ 101us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.136.1:35295: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":47}
W20260927 15:16:00.252063 4633 catalog_manager.cc:4584] TS 53d92b179ccd4fedb7d20fd0f7a40673 (127.17.136.1:35295): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 3f1cd1c8afe040f1804c34abaadbe8c3: Network error: Client connection negotiation failed: client connection to 127.17.136.1:35295: connect: Connection refused (error 111)
I20260927 15:16:00.256187 17952 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu with pid 4979
I20260927 15:16:00.260615 17952 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu with pid 4617
2026-09-27T15:16:00Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/4 (2490 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/5
2026-09-27T15:16:00Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-27T15:16:00Z Disabled control of system clock
I20260927 15:16:00.287689 17952 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu
/tmp/dist-test-taskiFOyeW/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790521920546562-17952-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790521920546562-17952-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790521920546562-17952-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790521920546562-17952-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.136.62:46645
--webserver_interface=127.17.136.62
--webserver_port=0
--builtin_ntp_servers=127.17.136.20:36043
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.136.62:46645
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260927 15:16:00.395303 5155 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260927 15:16:00.395581 5155 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260927 15:16:00.395617 5155 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260927 15:16:00.399622 5155 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260927 15:16:00.399684 5155 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260927 15:16:00.399699 5155 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260927 15:16:00.399714 5155 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260927 15:16:00.399729 5155 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260927 15:16:00.404598 5155 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.136.20:36043
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790521920546562-17952-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790521920546562-17952-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.17.136.62:46645
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.136.62:46645
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790521920546562-17952-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.17.136.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5155
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790521920546562-17952-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 27 Sep 2026 14:27:13 UTC on ccycloud.quasar-psqrth.root.comops.site
build id 4676138
I20260927 15:16:00.405711 5155 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260927 15:16:00.407409 5155 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260927 15:16:00.415793 5163 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260927 15:16:00.415800 5160 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260927 15:16:00.416066 5155 server_base.cc:1034] running on GCE node
W20260927 15:16:00.415807 5161 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260927 15:16:00.416721 5155 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260927 15:16:00.417778 5155 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260927 15:16:00.418947 5155 hybrid_clock.cc:648] HybridClock initialized: now 1790522160418920 us; error 38 us; skew 500 ppm
I20260927 15:16:00.420718 5155 webserver.cc:460] Webserver started at http://127.17.136.62:45515/ using document root <none> and password file <none>
I20260927 15:16:00.421250 5155 fs_manager.cc:359] Metadata directory not provided
I20260927 15:16:00.421307 5155 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260927 15:16:00.421497 5155 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260927 15:16:00.423539 5155 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790521920546562-17952-0/minicluster-data/master-0/data/instance:
uuid: "d67b91f0cd6843e7aec51c4827732b3d"
format_stamp: "Formatted at 2026-09-27 15:16:00 on dist-test-slave-5s2t"
server_key: "fa89b149d1e25a73b8361858b90ddfcb"
server_key_iv: "6bbae3704c8bbda55dfee9f5d9df9f59"
server_key_version: "encryptionkey@0"
I20260927 15:16:00.424072 5155 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790521920546562-17952-0/minicluster-data/master-0/wal/instance:
uuid: "d67b91f0cd6843e7aec51c4827732b3d"
format_stamp: "Formatted at 2026-09-27 15:16:00 on dist-test-slave-5s2t"
server_key: "fa89b149d1e25a73b8361858b90ddfcb"
server_key_iv: "6bbae3704c8bbda55dfee9f5d9df9f59"
server_key_version: "encryptionkey@0"
I20260927 15:16:00.427549 5155 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.001s
I20260927 15:16:00.429934 5169 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260927 15:16:00.431216 5155 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260927 15:16:00.431362 5155 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790521920546562-17952-0/minicluster-data/master-0/data,/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790521920546562-17952-0/minicluster-data/master-0/wal
uuid: "d67b91f0cd6843e7aec51c4827732b3d"
format_stamp: "Formatted at 2026-09-27 15:16:00 on dist-test-slave-5s2t"
server_key: "fa89b149d1e25a73b8361858b90ddfcb"
server_key_iv: "6bbae3704c8bbda55dfee9f5d9df9f59"
server_key_version: "encryptionkey@0"
I20260927 15:16:00.431455 5155 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790521920546562-17952-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790521920546562-17952-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790521920546562-17952-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260927 15:16:00.443015 5155 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260927 15:16:00.443703 5155 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260927 15:16:00.443878 5155 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260927 15:16:00.450443 5155 rpc_server.cc:307] RPC server started. Bound to: 127.17.136.62:46645
I20260927 15:16:00.450453 5221 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.136.62:46645 every 8 connection(s)
I20260927 15:16:00.451393 5155 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790521920546562-17952-0/minicluster-data/master-0/data/info.pb
I20260927 15:16:00.452701 17952 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu as pid 5155
I20260927 15:16:00.452819 17952 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790521920546562-17952-0/minicluster-data/master-0/wal/instance
I20260927 15:16:00.453080 17952 external_mini_cluster.cc:1428] Setting key d0a39b63fbc87059921c32729327f5e1
I20260927 15:16:00.454546 5222 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:16:00.460695 5222 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d67b91f0cd6843e7aec51c4827732b3d: Bootstrap starting.
I20260927 15:16:00.461926 5225 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:16:00.454341 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39782 (local address 127.17.136.62:46645)
0927 15:16:00.454918 (+ 577us) server_negotiation.cc:206] Beginning negotiation
0927 15:16:00.454932 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0927 15:16:00.454967 (+ 35us) server_negotiation.cc:407] Connection header received
0927 15:16:00.455631 (+ 664us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:16:00.455647 (+ 16us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:16:00.456035 (+ 388us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:16:00.456305 (+ 270us) server_negotiation.cc:226] Negotiated authn=SASL
0927 15:16:00.456632 (+ 327us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:16:00.457606 (+ 974us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:16:00.458876 (+ 1270us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:16:00.459361 (+ 485us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:16:00.459473 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:16:00.460322 (+ 849us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0927 15:16:00.460327 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0927 15:16:00.460339 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0927 15:16:00.460701 (+ 362us) server_negotiation.cc:922] calling sasl_server_start()
0927 15:16:00.460762 (+ 61us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0927 15:16:00.460783 (+ 21us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0927 15:16:00.460867 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0927 15:16:00.460986 (+ 119us) server_negotiation.cc:299] Negotiation successful
0927 15:16:00.461240 (+ 254us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":245,"thread_start_us":110,"threads_started":1}
I20260927 15:16:00.462916 5222 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d67b91f0cd6843e7aec51c4827732b3d: Neither blocks nor log segments found. Creating new log.
I20260927 15:16:00.463809 5222 log.cc:824] T 00000000000000000000000000000000 P d67b91f0cd6843e7aec51c4827732b3d: Log is configured to *not* fsync() on all Append() calls
I20260927 15:16:00.465620 5222 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d67b91f0cd6843e7aec51c4827732b3d: No bootstrap required, opened a new log
I20260927 15:16:00.469009 5222 raft_consensus.cc:348] T 00000000000000000000000000000000 P d67b91f0cd6843e7aec51c4827732b3d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d67b91f0cd6843e7aec51c4827732b3d" member_type: VOTER last_known_addr { host: "127.17.136.62" port: 46645 } }
I20260927 15:16:00.469234 5222 raft_consensus.cc:374] T 00000000000000000000000000000000 P d67b91f0cd6843e7aec51c4827732b3d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:16:00.469292 5222 raft_consensus.cc:729] T 00000000000000000000000000000000 P d67b91f0cd6843e7aec51c4827732b3d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d67b91f0cd6843e7aec51c4827732b3d, State: Initialized, Role: FOLLOWER
I20260927 15:16:00.469691 5222 consensus_queue.cc:260] T 00000000000000000000000000000000 P d67b91f0cd6843e7aec51c4827732b3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d67b91f0cd6843e7aec51c4827732b3d" member_type: VOTER last_known_addr { host: "127.17.136.62" port: 46645 } }
I20260927 15:16:00.469813 5222 raft_consensus.cc:388] T 00000000000000000000000000000000 P d67b91f0cd6843e7aec51c4827732b3d [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260927 15:16:00.469878 5222 raft_consensus.cc:482] T 00000000000000000000000000000000 P d67b91f0cd6843e7aec51c4827732b3d [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260927 15:16:00.469973 5222 raft_consensus.cc:3037] T 00000000000000000000000000000000 P d67b91f0cd6843e7aec51c4827732b3d [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:16:00.470816 5222 raft_consensus.cc:504] T 00000000000000000000000000000000 P d67b91f0cd6843e7aec51c4827732b3d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d67b91f0cd6843e7aec51c4827732b3d" member_type: VOTER last_known_addr { host: "127.17.136.62" port: 46645 } }
I20260927 15:16:00.471129 5222 leader_election.cc:302] T 00000000000000000000000000000000 P d67b91f0cd6843e7aec51c4827732b3d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: d67b91f0cd6843e7aec51c4827732b3d; no voters:
I20260927 15:16:00.471436 5222 leader_election.cc:288] T 00000000000000000000000000000000 P d67b91f0cd6843e7aec51c4827732b3d [CANDIDATE]: Term 1 election: Requested vote from peers
I20260927 15:16:00.471535 5227 raft_consensus.cc:2781] T 00000000000000000000000000000000 P d67b91f0cd6843e7aec51c4827732b3d [term 1 FOLLOWER]: Leader election won for term 1
I20260927 15:16:00.471741 5227 raft_consensus.cc:686] T 00000000000000000000000000000000 P d67b91f0cd6843e7aec51c4827732b3d [term 1 LEADER]: Becoming Leader. State: Replica: d67b91f0cd6843e7aec51c4827732b3d, State: Running, Role: LEADER
I20260927 15:16:00.472108 5227 consensus_queue.cc:237] T 00000000000000000000000000000000 P d67b91f0cd6843e7aec51c4827732b3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d67b91f0cd6843e7aec51c4827732b3d" member_type: VOTER last_known_addr { host: "127.17.136.62" port: 46645 } }
I20260927 15:16:00.472638 5222 sys_catalog.cc:564] T 00000000000000000000000000000000 P d67b91f0cd6843e7aec51c4827732b3d [sys.catalog]: configured and running, proceeding with master startup.
I20260927 15:16:00.473773 5229 sys_catalog.cc:455] T 00000000000000000000000000000000 P d67b91f0cd6843e7aec51c4827732b3d [sys.catalog]: SysCatalogTable state changed. Reason: New leader d67b91f0cd6843e7aec51c4827732b3d. Latest consensus state: current_term: 1 leader_uuid: "d67b91f0cd6843e7aec51c4827732b3d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d67b91f0cd6843e7aec51c4827732b3d" member_type: VOTER last_known_addr { host: "127.17.136.62" port: 46645 } } }
I20260927 15:16:00.473771 5228 sys_catalog.cc:455] T 00000000000000000000000000000000 P d67b91f0cd6843e7aec51c4827732b3d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "d67b91f0cd6843e7aec51c4827732b3d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d67b91f0cd6843e7aec51c4827732b3d" member_type: VOTER last_known_addr { host: "127.17.136.62" port: 46645 } } }
I20260927 15:16:00.473912 5229 sys_catalog.cc:458] T 00000000000000000000000000000000 P d67b91f0cd6843e7aec51c4827732b3d [sys.catalog]: This master's current role is: LEADER
I20260927 15:16:00.473912 5228 sys_catalog.cc:458] T 00000000000000000000000000000000 P d67b91f0cd6843e7aec51c4827732b3d [sys.catalog]: This master's current role is: LEADER
I20260927 15:16:00.474433 5237 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260927 15:16:00.477308 5237 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260927 15:16:00.482196 5237 catalog_manager.cc:1347] Generated new cluster ID: 75d2feb2d5034126adb6b108effbed0a
I20260927 15:16:00.482260 5237 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260927 15:16:00.489297 5237 catalog_manager.cc:1370] Generated new certificate authority record
I20260927 15:16:00.490121 5237 catalog_manager.cc:1504] Loading token signing keys...
I20260927 15:16:00.495082 5237 catalog_manager.cc:5868] T 00000000000000000000000000000000 P d67b91f0cd6843e7aec51c4827732b3d: Generated new TSK 0
I20260927 15:16:00.495709 5237 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260927 15:16:00.503304 17952 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu
/tmp/dist-test-taskiFOyeW/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790521920546562-17952-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790521920546562-17952-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790521920546562-17952-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790521920546562-17952-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.136.1:0
--local_ip_for_outbound_sockets=127.17.136.1
--webserver_interface=127.17.136.1
--webserver_port=0
--tserver_master_addrs=127.17.136.62:46645
--builtin_ntp_servers=127.17.136.20:36043
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260927 15:16:00.611418 5246 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260927 15:16:00.611667 5246 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260927 15:16:00.611703 5246 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260927 15:16:00.615828 5246 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260927 15:16:00.615888 5246 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260927 15:16:00.615943 5246 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.136.1
I20260927 15:16:00.620702 5246 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.136.20:36043
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790521920546562-17952-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790521920546562-17952-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.136.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790521920546562-17952-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.17.136.1
--webserver_port=0
--tserver_master_addrs=127.17.136.62:46645
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5246
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.136.1
--log_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790521920546562-17952-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 27 Sep 2026 14:27:13 UTC on ccycloud.quasar-psqrth.root.comops.site
build id 4676138
I20260927 15:16:00.621716 5246 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260927 15:16:00.623063 5246 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260927 15:16:00.632093 5251 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260927 15:16:00.632125 5252 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260927 15:16:00.632239 5246 server_base.cc:1034] running on GCE node
W20260927 15:16:00.632253 5254 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260927 15:16:00.632784 5246 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260927 15:16:00.633380 5246 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260927 15:16:00.634533 5246 hybrid_clock.cc:648] HybridClock initialized: now 1790522160634502 us; error 44 us; skew 500 ppm
I20260927 15:16:00.636324 5246 webserver.cc:460] Webserver started at http://127.17.136.1:35093/ using document root <none> and password file <none>
I20260927 15:16:00.636878 5246 fs_manager.cc:359] Metadata directory not provided
I20260927 15:16:00.636945 5246 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260927 15:16:00.637151 5246 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260927 15:16:00.639221 5246 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790521920546562-17952-0/minicluster-data/ts-0/data/instance:
uuid: "0b94295847684dddae54e0310c8a2802"
format_stamp: "Formatted at 2026-09-27 15:16:00 on dist-test-slave-5s2t"
server_key: "65c573cdaa261463e1f8ba937a59cc2e"
server_key_iv: "748ccb15b444bcef2a2920121dbe09f4"
server_key_version: "encryptionkey@0"
I20260927 15:16:00.639792 5246 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790521920546562-17952-0/minicluster-data/ts-0/wal/instance:
uuid: "0b94295847684dddae54e0310c8a2802"
format_stamp: "Formatted at 2026-09-27 15:16:00 on dist-test-slave-5s2t"
server_key: "65c573cdaa261463e1f8ba937a59cc2e"
server_key_iv: "748ccb15b444bcef2a2920121dbe09f4"
server_key_version: "encryptionkey@0"
I20260927 15:16:00.643391 5246 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.000s
I20260927 15:16:00.645723 5260 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260927 15:16:00.646936 5246 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260927 15:16:00.647042 5246 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790521920546562-17952-0/minicluster-data/ts-0/data,/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790521920546562-17952-0/minicluster-data/ts-0/wal
uuid: "0b94295847684dddae54e0310c8a2802"
format_stamp: "Formatted at 2026-09-27 15:16:00 on dist-test-slave-5s2t"
server_key: "65c573cdaa261463e1f8ba937a59cc2e"
server_key_iv: "748ccb15b444bcef2a2920121dbe09f4"
server_key_version: "encryptionkey@0"
I20260927 15:16:00.647137 5246 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790521920546562-17952-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790521920546562-17952-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790521920546562-17952-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260927 15:16:00.661772 5246 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260927 15:16:00.662617 5246 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260927 15:16:00.662834 5246 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260927 15:16:00.663645 5246 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260927 15:16:00.664819 5246 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260927 15:16:00.664868 5246 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260927 15:16:00.664909 5246 ts_tablet_manager.cc:610] Registered 0 tablets
I20260927 15:16:00.664929 5246 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260927 15:16:00.673060 5246 rpc_server.cc:307] RPC server started. Bound to: 127.17.136.1:38371
I20260927 15:16:00.673107 5373 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.136.1:38371 every 8 connection(s)
I20260927 15:16:00.674048 5246 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790521920546562-17952-0/minicluster-data/ts-0/data/info.pb
I20260927 15:16:00.679062 17952 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu as pid 5246
I20260927 15:16:00.679188 17952 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790521920546562-17952-0/minicluster-data/ts-0/wal/instance
I20260927 15:16:00.679533 17952 external_mini_cluster.cc:1428] Setting key 4fef59e7800c3e49cbd290b95073e604
I20260927 15:16:00.681422 17952 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu
/tmp/dist-test-taskiFOyeW/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790521920546562-17952-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790521920546562-17952-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790521920546562-17952-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790521920546562-17952-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.136.2:0
--local_ip_for_outbound_sockets=127.17.136.2
--webserver_interface=127.17.136.2
--webserver_port=0
--tserver_master_addrs=127.17.136.62:46645
--builtin_ntp_servers=127.17.136.20:36043
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260927 15:16:00.683532 5225 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:16:00.675799 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.136.1:60277 (local address 127.17.136.62:46645)
0927 15:16:00.675924 (+ 125us) server_negotiation.cc:206] Beginning negotiation
0927 15:16:00.675927 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0927 15:16:00.676976 (+ 1049us) server_negotiation.cc:407] Connection header received
0927 15:16:00.678311 (+ 1335us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:16:00.678313 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:16:00.678363 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:16:00.678433 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0927 15:16:00.679522 (+ 1089us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:16:00.680115 (+ 593us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:16:00.681494 (+ 1379us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:16:00.681784 (+ 290us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:16:00.681889 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:16:00.683086 (+ 1197us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0927 15:16:00.683089 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0927 15:16:00.683091 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0927 15:16:00.683103 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0927 15:16:00.683125 (+ 22us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0927 15:16:00.683133 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0927 15:16:00.683187 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0927 15:16:00.683366 (+ 179us) server_negotiation.cc:299] Negotiation successful
0927 15:16:00.683422 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260927 15:16:00.684603 5376 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:16:00.676219 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.62:46645 (local address 127.17.136.1:60277)
0927 15:16:00.676848 (+ 629us) negotiation.cc:107] Waiting for socket to connect
0927 15:16:00.676893 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0927 15:16:00.678106 (+ 1213us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0927 15:16:00.678583 (+ 477us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0927 15:16:00.678590 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0927 15:16:00.678676 (+ 86us) client_negotiation.cc:189] Negotiated authn=SASL
0927 15:16:00.679379 (+ 703us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:16:00.679401 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:16:00.680251 (+ 850us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:16:00.680254 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:16:00.681367 (+ 1113us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:16:00.681377 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:16:00.681979 (+ 602us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:16:00.681983 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:16:00.682179 (+ 196us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:16:00.682799 (+ 620us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0927 15:16:00.682802 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0927 15:16:00.682858 (+ 56us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0927 15:16:00.682937 (+ 79us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0927 15:16:00.683204 (+ 267us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0927 15:16:00.683211 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0927 15:16:00.683216 (+ 5us) client_negotiation.cc:769] Sending connection context
0927 15:16:00.683353 (+ 137us) client_negotiation.cc:240] Negotiation successful
0927 15:16:00.683665 (+ 312us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":237,"thread_start_us":109,"threads_started":1}
I20260927 15:16:00.685818 5374 heartbeater.cc:347] Connected to a master server at 127.17.136.62:46645
I20260927 15:16:00.686028 5374 heartbeater.cc:464] Registering TS with master...
I20260927 15:16:00.686515 5374 heartbeater.cc:511] Master 127.17.136.62:46645 requested a full tablet report, sending...
I20260927 15:16:00.687954 5186 ts_manager.cc:194] Registered new tserver with Master: 0b94295847684dddae54e0310c8a2802 (127.17.136.1:38371)
I20260927 15:16:00.689069 5186 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.17.136.1:60277
W20260927 15:16:00.787531 5377 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260927 15:16:00.787786 5377 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260927 15:16:00.787840 5377 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260927 15:16:00.791762 5377 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260927 15:16:00.791814 5377 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260927 15:16:00.791888 5377 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.136.2
I20260927 15:16:00.796509 5377 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.136.20:36043
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790521920546562-17952-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790521920546562-17952-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.136.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790521920546562-17952-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.17.136.2
--webserver_port=0
--tserver_master_addrs=127.17.136.62:46645
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5377
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.136.2
--log_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790521920546562-17952-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 27 Sep 2026 14:27:13 UTC on ccycloud.quasar-psqrth.root.comops.site
build id 4676138
I20260927 15:16:00.797576 5377 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260927 15:16:00.798928 5377 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260927 15:16:00.807971 5382 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260927 15:16:00.808061 5385 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260927 15:16:00.808174 5383 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260927 15:16:00.808061 5377 server_base.cc:1034] running on GCE node
I20260927 15:16:00.808662 5377 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260927 15:16:00.809276 5377 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260927 15:16:00.810424 5377 hybrid_clock.cc:648] HybridClock initialized: now 1790522160810395 us; error 39 us; skew 500 ppm
I20260927 15:16:00.812189 5377 webserver.cc:460] Webserver started at http://127.17.136.2:41045/ using document root <none> and password file <none>
I20260927 15:16:00.812790 5377 fs_manager.cc:359] Metadata directory not provided
I20260927 15:16:00.812855 5377 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260927 15:16:00.813046 5377 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260927 15:16:00.814966 5377 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790521920546562-17952-0/minicluster-data/ts-1/data/instance:
uuid: "24e1fd2e77e1484c85fc247784c22f56"
format_stamp: "Formatted at 2026-09-27 15:16:00 on dist-test-slave-5s2t"
server_key: "600b50909794b05cfd07587cbeb1cf2d"
server_key_iv: "a97d28abfc73365eefd6e2136e10ac43"
server_key_version: "encryptionkey@0"
I20260927 15:16:00.815498 5377 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790521920546562-17952-0/minicluster-data/ts-1/wal/instance:
uuid: "24e1fd2e77e1484c85fc247784c22f56"
format_stamp: "Formatted at 2026-09-27 15:16:00 on dist-test-slave-5s2t"
server_key: "600b50909794b05cfd07587cbeb1cf2d"
server_key_iv: "a97d28abfc73365eefd6e2136e10ac43"
server_key_version: "encryptionkey@0"
I20260927 15:16:00.818902 5377 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.001s
I20260927 15:16:00.821187 5391 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260927 15:16:00.822278 5377 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.000s sys 0.002s
I20260927 15:16:00.822381 5377 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790521920546562-17952-0/minicluster-data/ts-1/data,/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790521920546562-17952-0/minicluster-data/ts-1/wal
uuid: "24e1fd2e77e1484c85fc247784c22f56"
format_stamp: "Formatted at 2026-09-27 15:16:00 on dist-test-slave-5s2t"
server_key: "600b50909794b05cfd07587cbeb1cf2d"
server_key_iv: "a97d28abfc73365eefd6e2136e10ac43"
server_key_version: "encryptionkey@0"
I20260927 15:16:00.822467 5377 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790521920546562-17952-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790521920546562-17952-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790521920546562-17952-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260927 15:16:00.838625 5377 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260927 15:16:00.839282 5377 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260927 15:16:00.839444 5377 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260927 15:16:00.839986 5377 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260927 15:16:00.840866 5377 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260927 15:16:00.840912 5377 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260927 15:16:00.840962 5377 ts_tablet_manager.cc:610] Registered 0 tablets
I20260927 15:16:00.840991 5377 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260927 15:16:00.848994 5377 rpc_server.cc:307] RPC server started. Bound to: 127.17.136.2:33917
I20260927 15:16:00.849026 5504 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.136.2:33917 every 8 connection(s)
I20260927 15:16:00.849890 5377 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790521920546562-17952-0/minicluster-data/ts-1/data/info.pb
I20260927 15:16:00.857393 17952 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu as pid 5377
I20260927 15:16:00.857491 17952 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790521920546562-17952-0/minicluster-data/ts-1/wal/instance
I20260927 15:16:00.857762 17952 external_mini_cluster.cc:1428] Setting key 4a217ababdbe9a76d72d7256949be507
I20260927 15:16:00.858484 5225 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:16:00.851658 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.136.2:36385 (local address 127.17.136.62:46645)
0927 15:16:00.851789 (+ 131us) server_negotiation.cc:206] Beginning negotiation
0927 15:16:00.851792 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0927 15:16:00.852813 (+ 1021us) server_negotiation.cc:407] Connection header received
0927 15:16:00.854124 (+ 1311us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:16:00.854126 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:16:00.854181 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:16:00.854251 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0927 15:16:00.855078 (+ 827us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:16:00.855650 (+ 572us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:16:00.856697 (+ 1047us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:16:00.856906 (+ 209us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:16:00.856974 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:16:00.858025 (+ 1051us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0927 15:16:00.858029 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0927 15:16:00.858032 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0927 15:16:00.858045 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0927 15:16:00.858065 (+ 20us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0927 15:16:00.858073 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0927 15:16:00.858131 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0927 15:16:00.858280 (+ 149us) server_negotiation.cc:299] Negotiation successful
0927 15:16:00.858342 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260927 15:16:00.859373 5507 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:16:00.852054 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.62:46645 (local address 127.17.136.2:36385)
0927 15:16:00.852687 (+ 633us) negotiation.cc:107] Waiting for socket to connect
0927 15:16:00.852726 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0927 15:16:00.853941 (+ 1215us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0927 15:16:00.854409 (+ 468us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0927 15:16:00.854416 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0927 15:16:00.854499 (+ 83us) client_negotiation.cc:189] Negotiated authn=SASL
0927 15:16:00.854973 (+ 474us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:16:00.854985 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:16:00.855742 (+ 757us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:16:00.855745 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:16:00.856607 (+ 862us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:16:00.856616 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:16:00.857012 (+ 396us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:16:00.857015 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:16:00.857168 (+ 153us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:16:00.857761 (+ 593us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0927 15:16:00.857763 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0927 15:16:00.857804 (+ 41us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0927 15:16:00.857878 (+ 74us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0927 15:16:00.858139 (+ 261us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0927 15:16:00.858148 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0927 15:16:00.858153 (+ 5us) client_negotiation.cc:769] Sending connection context
0927 15:16:00.858271 (+ 118us) client_negotiation.cc:240] Negotiation successful
0927 15:16:00.858539 (+ 268us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":246,"thread_start_us":101,"threads_started":1}
I20260927 15:16:00.859676 17952 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu
/tmp/dist-test-taskiFOyeW/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790521920546562-17952-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790521920546562-17952-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790521920546562-17952-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790521920546562-17952-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.136.3:0
--local_ip_for_outbound_sockets=127.17.136.3
--webserver_interface=127.17.136.3
--webserver_port=0
--tserver_master_addrs=127.17.136.62:46645
--builtin_ntp_servers=127.17.136.20:36043
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260927 15:16:00.860379 5505 heartbeater.cc:347] Connected to a master server at 127.17.136.62:46645
I20260927 15:16:00.860608 5505 heartbeater.cc:464] Registering TS with master...
I20260927 15:16:00.861166 5505 heartbeater.cc:511] Master 127.17.136.62:46645 requested a full tablet report, sending...
I20260927 15:16:00.862147 5186 ts_manager.cc:194] Registered new tserver with Master: 24e1fd2e77e1484c85fc247784c22f56 (127.17.136.2:33917)
I20260927 15:16:00.862700 5186 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.17.136.2:36385
W20260927 15:16:00.964494 5508 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260927 15:16:00.964792 5508 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260927 15:16:00.964847 5508 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260927 15:16:00.968799 5508 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260927 15:16:00.968847 5508 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260927 15:16:00.968917 5508 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.136.3
I20260927 15:16:00.973696 5508 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.136.20:36043
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790521920546562-17952-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790521920546562-17952-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.136.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790521920546562-17952-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.17.136.3
--webserver_port=0
--tserver_master_addrs=127.17.136.62:46645
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5508
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.136.3
--log_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790521920546562-17952-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 27 Sep 2026 14:27:13 UTC on ccycloud.quasar-psqrth.root.comops.site
build id 4676138
I20260927 15:16:00.974750 5508 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260927 15:16:00.976099 5508 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260927 15:16:00.984890 5514 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260927 15:16:00.984944 5513 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260927 15:16:00.984900 5516 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260927 15:16:00.985252 5508 server_base.cc:1034] running on GCE node
I20260927 15:16:00.985600 5508 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260927 15:16:00.986183 5508 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260927 15:16:00.987303 5508 hybrid_clock.cc:648] HybridClock initialized: now 1790522160987282 us; error 31 us; skew 500 ppm
I20260927 15:16:00.988942 5508 webserver.cc:460] Webserver started at http://127.17.136.3:42125/ using document root <none> and password file <none>
I20260927 15:16:00.989480 5508 fs_manager.cc:359] Metadata directory not provided
I20260927 15:16:00.989544 5508 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260927 15:16:00.989727 5508 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260927 15:16:00.991704 5508 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790521920546562-17952-0/minicluster-data/ts-2/data/instance:
uuid: "2ad83eeda71047e7a23709a3b089ca64"
format_stamp: "Formatted at 2026-09-27 15:16:00 on dist-test-slave-5s2t"
server_key: "744aeab5b960599c2b14dab1de8d88e0"
server_key_iv: "db3ac0dee992aa26a5b1bc9d9f09b349"
server_key_version: "encryptionkey@0"
I20260927 15:16:00.992218 5508 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790521920546562-17952-0/minicluster-data/ts-2/wal/instance:
uuid: "2ad83eeda71047e7a23709a3b089ca64"
format_stamp: "Formatted at 2026-09-27 15:16:00 on dist-test-slave-5s2t"
server_key: "744aeab5b960599c2b14dab1de8d88e0"
server_key_iv: "db3ac0dee992aa26a5b1bc9d9f09b349"
server_key_version: "encryptionkey@0"
I20260927 15:16:00.995657 5508 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.000s
I20260927 15:16:00.997912 5522 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260927 15:16:00.999018 5508 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260927 15:16:00.999125 5508 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790521920546562-17952-0/minicluster-data/ts-2/data,/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790521920546562-17952-0/minicluster-data/ts-2/wal
uuid: "2ad83eeda71047e7a23709a3b089ca64"
format_stamp: "Formatted at 2026-09-27 15:16:00 on dist-test-slave-5s2t"
server_key: "744aeab5b960599c2b14dab1de8d88e0"
server_key_iv: "db3ac0dee992aa26a5b1bc9d9f09b349"
server_key_version: "encryptionkey@0"
I20260927 15:16:00.999219 5508 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790521920546562-17952-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790521920546562-17952-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790521920546562-17952-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260927 15:16:01.020263 5508 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260927 15:16:01.020896 5508 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260927 15:16:01.021054 5508 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260927 15:16:01.021598 5508 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260927 15:16:01.022482 5508 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260927 15:16:01.022527 5508 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260927 15:16:01.022576 5508 ts_tablet_manager.cc:610] Registered 0 tablets
I20260927 15:16:01.022605 5508 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260927 15:16:01.031073 5508 rpc_server.cc:307] RPC server started. Bound to: 127.17.136.3:35031
I20260927 15:16:01.031109 5635 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.136.3:35031 every 8 connection(s)
I20260927 15:16:01.031955 5508 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790521920546562-17952-0/minicluster-data/ts-2/data/info.pb
I20260927 15:16:01.035763 17952 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu as pid 5508
I20260927 15:16:01.035882 17952 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790521920546562-17952-0/minicluster-data/ts-2/wal/instance
I20260927 15:16:01.036181 17952 external_mini_cluster.cc:1428] Setting key 5e60c09f934a73b6013ef09bf4a7a2ca
I20260927 15:16:01.041199 5225 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:16:01.033664 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.136.3:35323 (local address 127.17.136.62:46645)
0927 15:16:01.033786 (+ 122us) server_negotiation.cc:206] Beginning negotiation
0927 15:16:01.033790 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0927 15:16:01.034948 (+ 1158us) server_negotiation.cc:407] Connection header received
0927 15:16:01.036588 (+ 1640us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:16:01.036591 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:16:01.036647 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:16:01.036721 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0927 15:16:01.037694 (+ 973us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:16:01.038264 (+ 570us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:16:01.039406 (+ 1142us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:16:01.039636 (+ 230us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:16:01.039720 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:16:01.040749 (+ 1029us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0927 15:16:01.040753 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0927 15:16:01.040756 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0927 15:16:01.040769 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0927 15:16:01.040789 (+ 20us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0927 15:16:01.040797 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0927 15:16:01.040854 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0927 15:16:01.040994 (+ 140us) server_negotiation.cc:299] Negotiation successful
0927 15:16:01.041056 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260927 15:16:01.042021 5638 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:16:01.034060 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.62:46645 (local address 127.17.136.3:35323)
0927 15:16:01.034804 (+ 744us) negotiation.cc:107] Waiting for socket to connect
0927 15:16:01.034856 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0927 15:16:01.036358 (+ 1502us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0927 15:16:01.036912 (+ 554us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0927 15:16:01.036919 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0927 15:16:01.037005 (+ 86us) client_negotiation.cc:189] Negotiated authn=SASL
0927 15:16:01.037564 (+ 559us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:16:01.037578 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:16:01.038378 (+ 800us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:16:01.038381 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:16:01.039296 (+ 915us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:16:01.039306 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:16:01.039787 (+ 481us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:16:01.039791 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:16:01.039941 (+ 150us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:16:01.040504 (+ 563us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0927 15:16:01.040506 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0927 15:16:01.040545 (+ 39us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0927 15:16:01.040609 (+ 64us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0927 15:16:01.040863 (+ 254us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0927 15:16:01.040871 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0927 15:16:01.040877 (+ 6us) client_negotiation.cc:769] Sending connection context
0927 15:16:01.040987 (+ 110us) client_negotiation.cc:240] Negotiation successful
0927 15:16:01.041264 (+ 277us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":267,"thread_start_us":139,"threads_started":1}
I20260927 15:16:01.042984 5636 heartbeater.cc:347] Connected to a master server at 127.17.136.62:46645
I20260927 15:16:01.043185 5636 heartbeater.cc:464] Registering TS with master...
I20260927 15:16:01.043694 5636 heartbeater.cc:511] Master 127.17.136.62:46645 requested a full tablet report, sending...
I20260927 15:16:01.044589 5186 ts_manager.cc:194] Registered new tserver with Master: 2ad83eeda71047e7a23709a3b089ca64 (127.17.136.3:35031)
I20260927 15:16:01.045109 5186 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.17.136.3:35323
I20260927 15:16:01.049810 17952 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260927 15:16:01.054998 5225 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:16:01.051709 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39786 (local address 127.17.136.62:46645)
0927 15:16:01.051825 (+ 116us) server_negotiation.cc:206] Beginning negotiation
0927 15:16:01.051829 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0927 15:16:01.052048 (+ 219us) server_negotiation.cc:407] Connection header received
0927 15:16:01.052163 (+ 115us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:16:01.052165 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:16:01.052207 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:16:01.052268 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0927 15:16:01.052483 (+ 215us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:16:01.052974 (+ 491us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:16:01.053734 (+ 760us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:16:01.053934 (+ 200us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:16:01.054001 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:16:01.054675 (+ 674us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0927 15:16:01.054677 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0927 15:16:01.054679 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0927 15:16:01.054689 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0927 15:16:01.054704 (+ 15us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0927 15:16:01.054711 (+ 7us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0927 15:16:01.054757 (+ 46us) server_negotiation.cc:1035] Waiting for connection context
0927 15:16:01.054823 (+ 66us) server_negotiation.cc:299] Negotiation successful
0927 15:16:01.054864 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260927 15:16:01.057608 5186 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39786:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:16:01.060613 5186 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:16:01.074033 5648 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:16:01.068401 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.2:33917 (local address 127.0.0.1:42742)
0927 15:16:01.068853 (+ 452us) negotiation.cc:107] Waiting for socket to connect
0927 15:16:01.068900 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0927 15:16:01.069016 (+ 116us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0927 15:16:01.069978 (+ 962us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0927 15:16:01.069984 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0927 15:16:01.070008 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0927 15:16:01.070144 (+ 136us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:16:01.070151 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:16:01.071695 (+ 1544us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:16:01.071697 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:16:01.072739 (+ 1042us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:16:01.072750 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:16:01.073509 (+ 759us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:16:01.073513 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:16:01.073628 (+ 115us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:16:01.073666 (+ 38us) client_negotiation.cc:769] Sending connection context
0927 15:16:01.073765 (+ 99us) client_negotiation.cc:240] Negotiation successful
0927 15:16:01.073883 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":280,"mutex_wait_us":30,"thread_start_us":74,"threads_started":1}
I20260927 15:16:01.074291 5649 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:16:01.068677 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42742 (local address 127.17.136.2:33917)
0927 15:16:01.069329 (+ 652us) server_negotiation.cc:206] Beginning negotiation
0927 15:16:01.069342 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0927 15:16:01.069367 (+ 25us) server_negotiation.cc:407] Connection header received
0927 15:16:01.069443 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:16:01.069449 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:16:01.069820 (+ 371us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:16:01.069979 (+ 159us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0927 15:16:01.070264 (+ 285us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:16:01.071562 (+ 1298us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:16:01.072846 (+ 1284us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:16:01.073407 (+ 561us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:16:01.073507 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:16:01.073811 (+ 304us) server_negotiation.cc:1035] Waiting for connection context
0927 15:16:01.073862 (+ 51us) server_negotiation.cc:299] Negotiation successful
0927 15:16:01.073978 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":548,"thread_start_us":93,"threads_started":1}
I20260927 15:16:01.074308 5651 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:16:01.069102 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.1:38371 (local address 127.0.0.1:44488)
0927 15:16:01.069687 (+ 585us) negotiation.cc:107] Waiting for socket to connect
0927 15:16:01.069699 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0927 15:16:01.069772 (+ 73us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0927 15:16:01.070370 (+ 598us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0927 15:16:01.070373 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0927 15:16:01.070389 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0927 15:16:01.070470 (+ 81us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:16:01.070476 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:16:01.071469 (+ 993us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:16:01.071472 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:16:01.072644 (+ 1172us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:16:01.072655 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:16:01.073674 (+ 1019us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:16:01.073678 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:16:01.074014 (+ 336us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:16:01.074037 (+ 23us) client_negotiation.cc:769] Sending connection context
0927 15:16:01.074099 (+ 62us) client_negotiation.cc:240] Negotiation successful
0927 15:16:01.074178 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":510,"thread_start_us":114,"threads_started":1}
I20260927 15:16:01.074705 5652 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:16:01.069546 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44488 (local address 127.17.136.1:38371)
0927 15:16:01.069945 (+ 399us) server_negotiation.cc:206] Beginning negotiation
0927 15:16:01.069961 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0927 15:16:01.069982 (+ 21us) server_negotiation.cc:407] Connection header received
0927 15:16:01.070049 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:16:01.070053 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:16:01.070253 (+ 200us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:16:01.070386 (+ 133us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0927 15:16:01.070571 (+ 185us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:16:01.071374 (+ 803us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:16:01.072750 (+ 1376us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:16:01.073528 (+ 778us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:16:01.073736 (+ 208us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:16:01.073914 (+ 178us) server_negotiation.cc:1035] Waiting for connection context
0927 15:16:01.074455 (+ 541us) server_negotiation.cc:299] Negotiation successful
0927 15:16:01.074548 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":312,"thread_start_us":104,"threads_started":1}
I20260927 15:16:01.075680 5647 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:16:01.068507 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.3:35031 (local address 127.0.0.1:40152)
0927 15:16:01.069396 (+ 889us) negotiation.cc:107] Waiting for socket to connect
0927 15:16:01.069408 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0927 15:16:01.069491 (+ 83us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0927 15:16:01.070170 (+ 679us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0927 15:16:01.070173 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0927 15:16:01.070189 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0927 15:16:01.070295 (+ 106us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:16:01.070302 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:16:01.071687 (+ 1385us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:16:01.071690 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:16:01.073800 (+ 2110us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:16:01.073808 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:16:01.075304 (+ 1496us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:16:01.075307 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:16:01.075392 (+ 85us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:16:01.075414 (+ 22us) client_negotiation.cc:769] Sending connection context
0927 15:16:01.075481 (+ 67us) client_negotiation.cc:240] Negotiation successful
0927 15:16:01.075545 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":830,"thread_start_us":100,"threads_started":1}
I20260927 15:16:01.076100 5650 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:16:01.069015 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40152 (local address 127.17.136.3:35031)
0927 15:16:01.069673 (+ 658us) server_negotiation.cc:206] Beginning negotiation
0927 15:16:01.069684 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0927 15:16:01.069706 (+ 22us) server_negotiation.cc:407] Connection header received
0927 15:16:01.069774 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:16:01.069779 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:16:01.069932 (+ 153us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:16:01.070046 (+ 114us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0927 15:16:01.070419 (+ 373us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:16:01.071562 (+ 1143us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:16:01.073924 (+ 2362us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:16:01.074964 (+ 1040us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:16:01.075057 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:16:01.075214 (+ 157us) server_negotiation.cc:1035] Waiting for connection context
0927 15:16:01.075908 (+ 694us) server_negotiation.cc:299] Negotiation successful
0927 15:16:01.075986 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":563,"thread_start_us":193,"threads_started":1}
I20260927 15:16:01.077280 5439 tablet_service.cc:1467] Processing CreateTablet for tablet 83f9758fbcad481ba399a87a96dbbf06 (DEFAULT_TABLE table=test-table [id=fbaa547394184719aa62b76bd9d028ab]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:16:01.077280 5308 tablet_service.cc:1467] Processing CreateTablet for tablet 83f9758fbcad481ba399a87a96dbbf06 (DEFAULT_TABLE table=test-table [id=fbaa547394184719aa62b76bd9d028ab]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:16:01.078413 5308 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 83f9758fbcad481ba399a87a96dbbf06. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:16:01.078413 5439 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 83f9758fbcad481ba399a87a96dbbf06. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:16:01.078369 5570 tablet_service.cc:1467] Processing CreateTablet for tablet 83f9758fbcad481ba399a87a96dbbf06 (DEFAULT_TABLE table=test-table [id=fbaa547394184719aa62b76bd9d028ab]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:16:01.079276 5570 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 83f9758fbcad481ba399a87a96dbbf06. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:16:01.085345 5653 tablet_bootstrap.cc:492] T 83f9758fbcad481ba399a87a96dbbf06 P 2ad83eeda71047e7a23709a3b089ca64: Bootstrap starting.
I20260927 15:16:01.086225 5655 tablet_bootstrap.cc:492] T 83f9758fbcad481ba399a87a96dbbf06 P 0b94295847684dddae54e0310c8a2802: Bootstrap starting.
I20260927 15:16:01.086225 5654 tablet_bootstrap.cc:492] T 83f9758fbcad481ba399a87a96dbbf06 P 24e1fd2e77e1484c85fc247784c22f56: Bootstrap starting.
I20260927 15:16:01.087379 5653 tablet_bootstrap.cc:654] T 83f9758fbcad481ba399a87a96dbbf06 P 2ad83eeda71047e7a23709a3b089ca64: Neither blocks nor log segments found. Creating new log.
I20260927 15:16:01.088042 5653 log.cc:824] T 83f9758fbcad481ba399a87a96dbbf06 P 2ad83eeda71047e7a23709a3b089ca64: Log is configured to *not* fsync() on all Append() calls
I20260927 15:16:01.088349 5655 tablet_bootstrap.cc:654] T 83f9758fbcad481ba399a87a96dbbf06 P 0b94295847684dddae54e0310c8a2802: Neither blocks nor log segments found. Creating new log.
I20260927 15:16:01.088349 5654 tablet_bootstrap.cc:654] T 83f9758fbcad481ba399a87a96dbbf06 P 24e1fd2e77e1484c85fc247784c22f56: Neither blocks nor log segments found. Creating new log.
I20260927 15:16:01.089191 5655 log.cc:824] T 83f9758fbcad481ba399a87a96dbbf06 P 0b94295847684dddae54e0310c8a2802: Log is configured to *not* fsync() on all Append() calls
I20260927 15:16:01.089191 5654 log.cc:824] T 83f9758fbcad481ba399a87a96dbbf06 P 24e1fd2e77e1484c85fc247784c22f56: Log is configured to *not* fsync() on all Append() calls
I20260927 15:16:01.089769 5653 tablet_bootstrap.cc:492] T 83f9758fbcad481ba399a87a96dbbf06 P 2ad83eeda71047e7a23709a3b089ca64: No bootstrap required, opened a new log
I20260927 15:16:01.089986 5653 ts_tablet_manager.cc:1397] T 83f9758fbcad481ba399a87a96dbbf06 P 2ad83eeda71047e7a23709a3b089ca64: Time spent bootstrapping tablet: real 0.005s user 0.000s sys 0.003s
I20260927 15:16:01.091104 5655 tablet_bootstrap.cc:492] T 83f9758fbcad481ba399a87a96dbbf06 P 0b94295847684dddae54e0310c8a2802: No bootstrap required, opened a new log
I20260927 15:16:01.091312 5655 ts_tablet_manager.cc:1397] T 83f9758fbcad481ba399a87a96dbbf06 P 0b94295847684dddae54e0310c8a2802: Time spent bootstrapping tablet: real 0.005s user 0.005s sys 0.000s
I20260927 15:16:01.091487 5654 tablet_bootstrap.cc:492] T 83f9758fbcad481ba399a87a96dbbf06 P 24e1fd2e77e1484c85fc247784c22f56: No bootstrap required, opened a new log
I20260927 15:16:01.091676 5654 ts_tablet_manager.cc:1397] T 83f9758fbcad481ba399a87a96dbbf06 P 24e1fd2e77e1484c85fc247784c22f56: Time spent bootstrapping tablet: real 0.006s user 0.003s sys 0.001s
I20260927 15:16:01.094151 5653 raft_consensus.cc:348] T 83f9758fbcad481ba399a87a96dbbf06 P 2ad83eeda71047e7a23709a3b089ca64 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24e1fd2e77e1484c85fc247784c22f56" member_type: VOTER last_known_addr { host: "127.17.136.2" port: 33917 } } peers { permanent_uuid: "2ad83eeda71047e7a23709a3b089ca64" member_type: VOTER last_known_addr { host: "127.17.136.3" port: 35031 } } peers { permanent_uuid: "0b94295847684dddae54e0310c8a2802" member_type: VOTER last_known_addr { host: "127.17.136.1" port: 38371 } }
I20260927 15:16:01.094238 5655 raft_consensus.cc:348] T 83f9758fbcad481ba399a87a96dbbf06 P 0b94295847684dddae54e0310c8a2802 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24e1fd2e77e1484c85fc247784c22f56" member_type: VOTER last_known_addr { host: "127.17.136.2" port: 33917 } } peers { permanent_uuid: "2ad83eeda71047e7a23709a3b089ca64" member_type: VOTER last_known_addr { host: "127.17.136.3" port: 35031 } } peers { permanent_uuid: "0b94295847684dddae54e0310c8a2802" member_type: VOTER last_known_addr { host: "127.17.136.1" port: 38371 } }
I20260927 15:16:01.094411 5653 raft_consensus.cc:374] T 83f9758fbcad481ba399a87a96dbbf06 P 2ad83eeda71047e7a23709a3b089ca64 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:16:01.094448 5655 raft_consensus.cc:374] T 83f9758fbcad481ba399a87a96dbbf06 P 0b94295847684dddae54e0310c8a2802 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:16:01.094470 5653 raft_consensus.cc:729] T 83f9758fbcad481ba399a87a96dbbf06 P 2ad83eeda71047e7a23709a3b089ca64 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2ad83eeda71047e7a23709a3b089ca64, State: Initialized, Role: FOLLOWER
I20260927 15:16:01.094489 5655 raft_consensus.cc:729] T 83f9758fbcad481ba399a87a96dbbf06 P 0b94295847684dddae54e0310c8a2802 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b94295847684dddae54e0310c8a2802, State: Initialized, Role: FOLLOWER
I20260927 15:16:01.094868 5655 consensus_queue.cc:260] T 83f9758fbcad481ba399a87a96dbbf06 P 0b94295847684dddae54e0310c8a2802 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24e1fd2e77e1484c85fc247784c22f56" member_type: VOTER last_known_addr { host: "127.17.136.2" port: 33917 } } peers { permanent_uuid: "2ad83eeda71047e7a23709a3b089ca64" member_type: VOTER last_known_addr { host: "127.17.136.3" port: 35031 } } peers { permanent_uuid: "0b94295847684dddae54e0310c8a2802" member_type: VOTER last_known_addr { host: "127.17.136.1" port: 38371 } }
I20260927 15:16:01.094882 5653 consensus_queue.cc:260] T 83f9758fbcad481ba399a87a96dbbf06 P 2ad83eeda71047e7a23709a3b089ca64 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24e1fd2e77e1484c85fc247784c22f56" member_type: VOTER last_known_addr { host: "127.17.136.2" port: 33917 } } peers { permanent_uuid: "2ad83eeda71047e7a23709a3b089ca64" member_type: VOTER last_known_addr { host: "127.17.136.3" port: 35031 } } peers { permanent_uuid: "0b94295847684dddae54e0310c8a2802" member_type: VOTER last_known_addr { host: "127.17.136.1" port: 38371 } }
I20260927 15:16:01.095477 5374 heartbeater.cc:503] Master 127.17.136.62:46645 was elected leader, sending a full tablet report...
I20260927 15:16:01.095832 5653 ts_tablet_manager.cc:1428] T 83f9758fbcad481ba399a87a96dbbf06 P 2ad83eeda71047e7a23709a3b089ca64: Time spent starting tablet: real 0.006s user 0.005s sys 0.002s
I20260927 15:16:01.095832 5655 ts_tablet_manager.cc:1428] T 83f9758fbcad481ba399a87a96dbbf06 P 0b94295847684dddae54e0310c8a2802: Time spent starting tablet: real 0.004s user 0.004s sys 0.000s
I20260927 15:16:01.095698 5654 raft_consensus.cc:348] T 83f9758fbcad481ba399a87a96dbbf06 P 24e1fd2e77e1484c85fc247784c22f56 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24e1fd2e77e1484c85fc247784c22f56" member_type: VOTER last_known_addr { host: "127.17.136.2" port: 33917 } } peers { permanent_uuid: "2ad83eeda71047e7a23709a3b089ca64" member_type: VOTER last_known_addr { host: "127.17.136.3" port: 35031 } } peers { permanent_uuid: "0b94295847684dddae54e0310c8a2802" member_type: VOTER last_known_addr { host: "127.17.136.1" port: 38371 } }
I20260927 15:16:01.095907 5654 raft_consensus.cc:374] T 83f9758fbcad481ba399a87a96dbbf06 P 24e1fd2e77e1484c85fc247784c22f56 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:16:01.095948 5654 raft_consensus.cc:729] T 83f9758fbcad481ba399a87a96dbbf06 P 24e1fd2e77e1484c85fc247784c22f56 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24e1fd2e77e1484c85fc247784c22f56, State: Initialized, Role: FOLLOWER
I20260927 15:16:01.096345 5636 heartbeater.cc:503] Master 127.17.136.62:46645 was elected leader, sending a full tablet report...
I20260927 15:16:01.096292 5654 consensus_queue.cc:260] T 83f9758fbcad481ba399a87a96dbbf06 P 24e1fd2e77e1484c85fc247784c22f56 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24e1fd2e77e1484c85fc247784c22f56" member_type: VOTER last_known_addr { host: "127.17.136.2" port: 33917 } } peers { permanent_uuid: "2ad83eeda71047e7a23709a3b089ca64" member_type: VOTER last_known_addr { host: "127.17.136.3" port: 35031 } } peers { permanent_uuid: "0b94295847684dddae54e0310c8a2802" member_type: VOTER last_known_addr { host: "127.17.136.1" port: 38371 } }
I20260927 15:16:01.096879 5505 heartbeater.cc:503] Master 127.17.136.62:46645 was elected leader, sending a full tablet report...
I20260927 15:16:01.097105 5654 ts_tablet_manager.cc:1428] T 83f9758fbcad481ba399a87a96dbbf06 P 24e1fd2e77e1484c85fc247784c22f56: Time spent starting tablet: real 0.005s user 0.003s sys 0.002s
W20260927 15:16:01.100740 5506 tablet.cc:2369] T 83f9758fbcad481ba399a87a96dbbf06 P 24e1fd2e77e1484c85fc247784c22f56: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260927 15:16:01.175171 5375 tablet.cc:2369] T 83f9758fbcad481ba399a87a96dbbf06 P 0b94295847684dddae54e0310c8a2802: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260927 15:16:01.282847 5637 tablet.cc:2369] T 83f9758fbcad481ba399a87a96dbbf06 P 2ad83eeda71047e7a23709a3b089ca64: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260927 15:16:01.317725 5659 raft_consensus.cc:482] T 83f9758fbcad481ba399a87a96dbbf06 P 0b94295847684dddae54e0310c8a2802 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:16:01.317961 5659 raft_consensus.cc:504] T 83f9758fbcad481ba399a87a96dbbf06 P 0b94295847684dddae54e0310c8a2802 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24e1fd2e77e1484c85fc247784c22f56" member_type: VOTER last_known_addr { host: "127.17.136.2" port: 33917 } } peers { permanent_uuid: "2ad83eeda71047e7a23709a3b089ca64" member_type: VOTER last_known_addr { host: "127.17.136.3" port: 35031 } } peers { permanent_uuid: "0b94295847684dddae54e0310c8a2802" member_type: VOTER last_known_addr { host: "127.17.136.1" port: 38371 } }
I20260927 15:16:01.319192 5659 leader_election.cc:288] T 83f9758fbcad481ba399a87a96dbbf06 P 0b94295847684dddae54e0310c8a2802 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 24e1fd2e77e1484c85fc247784c22f56 (127.17.136.2:33917), 2ad83eeda71047e7a23709a3b089ca64 (127.17.136.3:35031)
I20260927 15:16:01.323074 5662 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:16:01.319461 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.2:33917 (local address 127.17.136.1:55481)
0927 15:16:01.319791 (+ 330us) negotiation.cc:107] Waiting for socket to connect
0927 15:16:01.319808 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0927 15:16:01.319942 (+ 134us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0927 15:16:01.320199 (+ 257us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0927 15:16:01.320202 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0927 15:16:01.320220 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0927 15:16:01.320398 (+ 178us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:16:01.320405 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:16:01.321105 (+ 700us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:16:01.321109 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:16:01.321974 (+ 865us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:16:01.321985 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:16:01.322644 (+ 659us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:16:01.322647 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:16:01.322740 (+ 93us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:16:01.322773 (+ 33us) client_negotiation.cc:769] Sending connection context
0927 15:16:01.322844 (+ 71us) client_negotiation.cc:240] Negotiation successful
0927 15:16:01.322913 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":242,"mutex_wait_us":5,"thread_start_us":90,"threads_started":1}
I20260927 15:16:01.323148 5650 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:16:01.319666 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.136.1:52627 (local address 127.17.136.3:35031)
0927 15:16:01.319790 (+ 124us) server_negotiation.cc:206] Beginning negotiation
0927 15:16:01.319796 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0927 15:16:01.319999 (+ 203us) server_negotiation.cc:407] Connection header received
0927 15:16:01.320103 (+ 104us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:16:01.320105 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:16:01.320150 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:16:01.320231 (+ 81us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0927 15:16:01.320529 (+ 298us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:16:01.321161 (+ 632us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:16:01.322135 (+ 974us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:16:01.322544 (+ 409us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:16:01.322665 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:16:01.322715 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0927 15:16:01.322975 (+ 260us) server_negotiation.cc:299] Negotiation successful
0927 15:16:01.323045 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260927 15:16:01.323377 5649 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:16:01.319572 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.136.1:55481 (local address 127.17.136.2:33917)
0927 15:16:01.319802 (+ 230us) server_negotiation.cc:206] Beginning negotiation
0927 15:16:01.319807 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0927 15:16:01.319902 (+ 95us) server_negotiation.cc:407] Connection header received
0927 15:16:01.320062 (+ 160us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:16:01.320065 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:16:01.320116 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:16:01.320169 (+ 53us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0927 15:16:01.320504 (+ 335us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:16:01.321003 (+ 499us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:16:01.322110 (+ 1107us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:16:01.322514 (+ 404us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:16:01.322638 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:16:01.322685 (+ 47us) server_negotiation.cc:1035] Waiting for connection context
0927 15:16:01.322899 (+ 214us) server_negotiation.cc:299] Negotiation successful
0927 15:16:01.323012 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":138}
I20260927 15:16:01.323508 5663 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:16:01.319461 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.3:35031 (local address 127.17.136.1:52627)
0927 15:16:01.319904 (+ 443us) negotiation.cc:107] Waiting for socket to connect
0927 15:16:01.319918 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0927 15:16:01.320015 (+ 97us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0927 15:16:01.320254 (+ 239us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0927 15:16:01.320257 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0927 15:16:01.320273 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0927 15:16:01.320412 (+ 139us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:16:01.320417 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:16:01.321276 (+ 859us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:16:01.321278 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:16:01.322016 (+ 738us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:16:01.322024 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:16:01.322765 (+ 741us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:16:01.322768 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:16:01.322850 (+ 82us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:16:01.322867 (+ 17us) client_negotiation.cc:769] Sending connection context
0927 15:16:01.323281 (+ 414us) client_negotiation.cc:240] Negotiation successful
0927 15:16:01.323357 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":370,"mutex_wait_us":144,"thread_start_us":63,"threads_started":1}
I20260927 15:16:01.324128 5459 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "83f9758fbcad481ba399a87a96dbbf06" candidate_uuid: "0b94295847684dddae54e0310c8a2802" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24e1fd2e77e1484c85fc247784c22f56" is_pre_election: true
I20260927 15:16:01.324188 5590 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "83f9758fbcad481ba399a87a96dbbf06" candidate_uuid: "0b94295847684dddae54e0310c8a2802" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ad83eeda71047e7a23709a3b089ca64" is_pre_election: true
I20260927 15:16:01.324431 5459 raft_consensus.cc:2454] T 83f9758fbcad481ba399a87a96dbbf06 P 24e1fd2e77e1484c85fc247784c22f56 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b94295847684dddae54e0310c8a2802 in term 0.
I20260927 15:16:01.324440 5590 raft_consensus.cc:2454] T 83f9758fbcad481ba399a87a96dbbf06 P 2ad83eeda71047e7a23709a3b089ca64 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b94295847684dddae54e0310c8a2802 in term 0.
I20260927 15:16:01.324894 5261 leader_election.cc:302] T 83f9758fbcad481ba399a87a96dbbf06 P 0b94295847684dddae54e0310c8a2802 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b94295847684dddae54e0310c8a2802, 24e1fd2e77e1484c85fc247784c22f56; no voters:
I20260927 15:16:01.325152 5659 raft_consensus.cc:2781] T 83f9758fbcad481ba399a87a96dbbf06 P 0b94295847684dddae54e0310c8a2802 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 15:16:01.325237 5659 raft_consensus.cc:482] T 83f9758fbcad481ba399a87a96dbbf06 P 0b94295847684dddae54e0310c8a2802 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 15:16:01.325274 5659 raft_consensus.cc:3037] T 83f9758fbcad481ba399a87a96dbbf06 P 0b94295847684dddae54e0310c8a2802 [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:16:01.326406 5659 raft_consensus.cc:504] T 83f9758fbcad481ba399a87a96dbbf06 P 0b94295847684dddae54e0310c8a2802 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24e1fd2e77e1484c85fc247784c22f56" member_type: VOTER last_known_addr { host: "127.17.136.2" port: 33917 } } peers { permanent_uuid: "2ad83eeda71047e7a23709a3b089ca64" member_type: VOTER last_known_addr { host: "127.17.136.3" port: 35031 } } peers { permanent_uuid: "0b94295847684dddae54e0310c8a2802" member_type: VOTER last_known_addr { host: "127.17.136.1" port: 38371 } }
I20260927 15:16:01.326810 5659 leader_election.cc:288] T 83f9758fbcad481ba399a87a96dbbf06 P 0b94295847684dddae54e0310c8a2802 [CANDIDATE]: Term 1 election: Requested vote from peers 24e1fd2e77e1484c85fc247784c22f56 (127.17.136.2:33917), 2ad83eeda71047e7a23709a3b089ca64 (127.17.136.3:35031)
I20260927 15:16:01.327142 5459 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "83f9758fbcad481ba399a87a96dbbf06" candidate_uuid: "0b94295847684dddae54e0310c8a2802" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24e1fd2e77e1484c85fc247784c22f56"
I20260927 15:16:01.327178 5590 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "83f9758fbcad481ba399a87a96dbbf06" candidate_uuid: "0b94295847684dddae54e0310c8a2802" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ad83eeda71047e7a23709a3b089ca64"
I20260927 15:16:01.327310 5459 raft_consensus.cc:3037] T 83f9758fbcad481ba399a87a96dbbf06 P 24e1fd2e77e1484c85fc247784c22f56 [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:16:01.327318 5590 raft_consensus.cc:3037] T 83f9758fbcad481ba399a87a96dbbf06 P 2ad83eeda71047e7a23709a3b089ca64 [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:16:01.328588 5590 raft_consensus.cc:2454] T 83f9758fbcad481ba399a87a96dbbf06 P 2ad83eeda71047e7a23709a3b089ca64 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b94295847684dddae54e0310c8a2802 in term 1.
I20260927 15:16:01.328588 5459 raft_consensus.cc:2454] T 83f9758fbcad481ba399a87a96dbbf06 P 24e1fd2e77e1484c85fc247784c22f56 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b94295847684dddae54e0310c8a2802 in term 1.
I20260927 15:16:01.328902 5262 leader_election.cc:302] T 83f9758fbcad481ba399a87a96dbbf06 P 0b94295847684dddae54e0310c8a2802 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b94295847684dddae54e0310c8a2802, 2ad83eeda71047e7a23709a3b089ca64; no voters:
I20260927 15:16:01.329068 5659 raft_consensus.cc:2781] T 83f9758fbcad481ba399a87a96dbbf06 P 0b94295847684dddae54e0310c8a2802 [term 1 FOLLOWER]: Leader election won for term 1
I20260927 15:16:01.329308 5659 raft_consensus.cc:686] T 83f9758fbcad481ba399a87a96dbbf06 P 0b94295847684dddae54e0310c8a2802 [term 1 LEADER]: Becoming Leader. State: Replica: 0b94295847684dddae54e0310c8a2802, State: Running, Role: LEADER
I20260927 15:16:01.329635 5659 consensus_queue.cc:237] T 83f9758fbcad481ba399a87a96dbbf06 P 0b94295847684dddae54e0310c8a2802 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24e1fd2e77e1484c85fc247784c22f56" member_type: VOTER last_known_addr { host: "127.17.136.2" port: 33917 } } peers { permanent_uuid: "2ad83eeda71047e7a23709a3b089ca64" member_type: VOTER last_known_addr { host: "127.17.136.3" port: 35031 } } peers { permanent_uuid: "0b94295847684dddae54e0310c8a2802" member_type: VOTER last_known_addr { host: "127.17.136.1" port: 38371 } }
I20260927 15:16:01.332911 5185 catalog_manager.cc:5495] T 83f9758fbcad481ba399a87a96dbbf06 P 0b94295847684dddae54e0310c8a2802 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0b94295847684dddae54e0310c8a2802 (127.17.136.1). New cstate: current_term: 1 leader_uuid: "0b94295847684dddae54e0310c8a2802" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24e1fd2e77e1484c85fc247784c22f56" member_type: VOTER last_known_addr { host: "127.17.136.2" port: 33917 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2ad83eeda71047e7a23709a3b089ca64" member_type: VOTER last_known_addr { host: "127.17.136.3" port: 35031 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0b94295847684dddae54e0310c8a2802" member_type: VOTER last_known_addr { host: "127.17.136.1" port: 38371 } health_report { overall_health: HEALTHY } } }
I20260927 15:16:01.363965 5652 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:16:01.360863 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44500 (local address 127.17.136.1:38371)
0927 15:16:01.361015 (+ 152us) server_negotiation.cc:206] Beginning negotiation
0927 15:16:01.361019 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0927 15:16:01.361033 (+ 14us) server_negotiation.cc:407] Connection header received
0927 15:16:01.361113 (+ 80us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:16:01.361115 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:16:01.361187 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:16:01.361273 (+ 86us) server_negotiation.cc:226] Negotiated authn=TOKEN
0927 15:16:01.361451 (+ 178us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:16:01.361941 (+ 490us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:16:01.362728 (+ 787us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:16:01.362930 (+ 202us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:16:01.362997 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:16:01.363215 (+ 218us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0927 15:16:01.363639 (+ 424us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0927 15:16:01.363724 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0927 15:16:01.363778 (+ 54us) server_negotiation.cc:299] Negotiation successful
0927 15:16:01.363824 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260927 15:16:01.369858 5590 raft_consensus.cc:1261] T 83f9758fbcad481ba399a87a96dbbf06 P 2ad83eeda71047e7a23709a3b089ca64 [term 1 FOLLOWER]: Refusing update from remote peer 0b94295847684dddae54e0310c8a2802: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260927 15:16:01.369860 5459 raft_consensus.cc:1261] T 83f9758fbcad481ba399a87a96dbbf06 P 24e1fd2e77e1484c85fc247784c22f56 [term 1 FOLLOWER]: Refusing update from remote peer 0b94295847684dddae54e0310c8a2802: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260927 15:16:01.370581 5664 consensus_queue.cc:1035] T 83f9758fbcad481ba399a87a96dbbf06 P 0b94295847684dddae54e0310c8a2802 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ad83eeda71047e7a23709a3b089ca64" member_type: VOTER last_known_addr { host: "127.17.136.3" port: 35031 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260927 15:16:01.370748 5659 consensus_queue.cc:1035] T 83f9758fbcad481ba399a87a96dbbf06 P 0b94295847684dddae54e0310c8a2802 [LEADER]: Connected to new peer: Peer: permanent_uuid: "24e1fd2e77e1484c85fc247784c22f56" member_type: VOTER last_known_addr { host: "127.17.136.2" port: 33917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260927 15:16:01.376881 5667 mvcc.cc:205] Tried to move back new op lower bound from 7333978772963328000 to 7333978772808933376. Current Snapshot: MvccSnapshot[applied={T|T < 7333978772963328000}]
I20260927 15:16:01.379946 5669 mvcc.cc:205] Tried to move back new op lower bound from 7333978772963328000 to 7333978772808933376. Current Snapshot: MvccSnapshot[applied={T|T < 7333978772963328000}]
I20260927 15:16:01.387192 5183 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:39786:
table { table_name: "test-table" } modify_external_catalogs: true
I20260927 15:16:01.387389 5183 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:39786:
table { table_name: "test-table" } modify_external_catalogs: true
I20260927 15:16:01.389693 5183 catalog_manager.cc:5782] T 00000000000000000000000000000000 P d67b91f0cd6843e7aec51c4827732b3d: Sending DeleteTablet for 3 replicas of tablet 83f9758fbcad481ba399a87a96dbbf06
I20260927 15:16:01.390413 5570 tablet_service.cc:1514] Processing DeleteTablet for tablet 83f9758fbcad481ba399a87a96dbbf06 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:16:01 UTC) from {username='slave'} at 127.0.0.1:40152
I20260927 15:16:01.390457 5439 tablet_service.cc:1514] Processing DeleteTablet for tablet 83f9758fbcad481ba399a87a96dbbf06 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:16:01 UTC) from {username='slave'} at 127.0.0.1:42742
I20260927 15:16:01.390537 5308 tablet_service.cc:1514] Processing DeleteTablet for tablet 83f9758fbcad481ba399a87a96dbbf06 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:16:01 UTC) from {username='slave'} at 127.0.0.1:44488
I20260927 15:16:01.390952 5677 tablet_replica.cc:330] T 83f9758fbcad481ba399a87a96dbbf06 P 0b94295847684dddae54e0310c8a2802: stopping tablet replica
I20260927 15:16:01.391183 5678 tablet_replica.cc:330] T 83f9758fbcad481ba399a87a96dbbf06 P 24e1fd2e77e1484c85fc247784c22f56: stopping tablet replica
I20260927 15:16:01.391307 5677 raft_consensus.cc:2229] T 83f9758fbcad481ba399a87a96dbbf06 P 0b94295847684dddae54e0310c8a2802 [term 1 LEADER]: Raft consensus shutting down.
I20260927 15:16:01.391646 17952 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu with pid 5246
I20260927 15:16:01.392925 5678 raft_consensus.cc:2229] T 83f9758fbcad481ba399a87a96dbbf06 P 24e1fd2e77e1484c85fc247784c22f56 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260927 15:16:01.393218 5678 raft_consensus.cc:2258] T 83f9758fbcad481ba399a87a96dbbf06 P 24e1fd2e77e1484c85fc247784c22f56 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 15:16:01.393558 5676 tablet_replica.cc:330] T 83f9758fbcad481ba399a87a96dbbf06 P 2ad83eeda71047e7a23709a3b089ca64: stopping tablet replica
I20260927 15:16:01.393858 5676 raft_consensus.cc:2229] T 83f9758fbcad481ba399a87a96dbbf06 P 2ad83eeda71047e7a23709a3b089ca64 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260927 15:16:01.394120 5676 raft_consensus.cc:2258] T 83f9758fbcad481ba399a87a96dbbf06 P 2ad83eeda71047e7a23709a3b089ca64 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 15:16:01.394621 5678 ts_tablet_manager.cc:1905] T 83f9758fbcad481ba399a87a96dbbf06 P 24e1fd2e77e1484c85fc247784c22f56: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:16:01.395355 5676 ts_tablet_manager.cc:1905] T 83f9758fbcad481ba399a87a96dbbf06 P 2ad83eeda71047e7a23709a3b089ca64: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:16:01.397243 5678 ts_tablet_manager.cc:1918] T 83f9758fbcad481ba399a87a96dbbf06 P 24e1fd2e77e1484c85fc247784c22f56: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260927 15:16:01.397337 5678 log.cc:1196] T 83f9758fbcad481ba399a87a96dbbf06 P 24e1fd2e77e1484c85fc247784c22f56: Deleting WAL directory at /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790521920546562-17952-0/minicluster-data/ts-1/wal/wals/83f9758fbcad481ba399a87a96dbbf06
I20260927 15:16:01.397385 5676 ts_tablet_manager.cc:1918] T 83f9758fbcad481ba399a87a96dbbf06 P 2ad83eeda71047e7a23709a3b089ca64: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260927 15:16:01.397475 5676 log.cc:1196] T 83f9758fbcad481ba399a87a96dbbf06 P 2ad83eeda71047e7a23709a3b089ca64: Deleting WAL directory at /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790521920546562-17952-0/minicluster-data/ts-2/wal/wals/83f9758fbcad481ba399a87a96dbbf06
I20260927 15:16:01.397609 5678 ts_tablet_manager.cc:1939] T 83f9758fbcad481ba399a87a96dbbf06 P 24e1fd2e77e1484c85fc247784c22f56: Deleting consensus metadata
I20260927 15:16:01.397739 5676 ts_tablet_manager.cc:1939] T 83f9758fbcad481ba399a87a96dbbf06 P 2ad83eeda71047e7a23709a3b089ca64: Deleting consensus metadata
W20260927 15:16:01.398530 5170 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.17.136.1:38371 (error 108)
I20260927 15:16:01.398806 5171 catalog_manager.cc:4841] TS 2ad83eeda71047e7a23709a3b089ca64 (127.17.136.3:35031): tablet 83f9758fbcad481ba399a87a96dbbf06 (table test-table [id=fbaa547394184719aa62b76bd9d028ab]) successfully deleted
I20260927 15:16:01.399068 5170 catalog_manager.cc:4841] TS 24e1fd2e77e1484c85fc247784c22f56 (127.17.136.2:33917): tablet 83f9758fbcad481ba399a87a96dbbf06 (table test-table [id=fbaa547394184719aa62b76bd9d028ab]) successfully deleted
I20260927 15:16:01.399416 17952 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu with pid 5377
I20260927 15:16:01.399660 5647 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:16:01.399367 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.1:38371 (local address 127.0.0.1:44508)
0927 15:16:01.399498 (+ 131us) negotiation.cc:107] Waiting for socket to connect
0927 15:16:01.399568 (+ 70us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.136.1:38371: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":40}
W20260927 15:16:01.399994 5170 catalog_manager.cc:4584] TS 0b94295847684dddae54e0310c8a2802 (127.17.136.1:38371): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 83f9758fbcad481ba399a87a96dbbf06: Network error: Client connection negotiation failed: client connection to 127.17.136.1:38371: connect: Connection refused (error 111)
I20260927 15:16:01.406563 17952 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu with pid 5508
I20260927 15:16:01.411208 17952 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu with pid 5155
2026-09-27T15:16:01Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/5 (1150 ms)
[----------] 6 tests from EncryptionPolicyTest (9942 ms total)
[----------] 18 tests from AuthTokenIssuingTest
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/0
Loading random data
Initializing database '/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1790521920546562-17952-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 27 15:16:01 dist-test-slave-5s2t krb5kdc[5682](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 27 15:16:01 dist-test-slave-5s2t krb5kdc[5682](info): set up 2 sockets
Sep 27 15:16:01 dist-test-slave-5s2t krb5kdc[5682](info): commencing operation
krb5kdc: starting...
W20260927 15:16:02.367072 17952 mini_kdc.cc:121] Time spent starting KDC: real 0.937s user 0.003s sys 0.002s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1790521920546562-17952-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1790521920546562-17952-0/krb5kdc/test-user.keytab.
Sep 27 15:16:02 dist-test-slave-5s2t krb5kdc[5682](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790522162, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-27T15:16:02Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-27T15:16:02Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1790521920546562-17952-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1790521920546562-17952-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260927 15:16:02.478588 17952 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu
/tmp/dist-test-taskiFOyeW/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1790521920546562-17952-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1790521920546562-17952-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1790521920546562-17952-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1790521920546562-17952-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:45917
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1790521920546562-17952-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:40203
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:45917
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1790521920546562-17952-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1790521920546562-17952-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1790521920546562-17952-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260927 15:16:02.583654 5695 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260927 15:16:02.583901 5695 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260927 15:16:02.583958 5695 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260927 15:16:02.587900 5695 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260927 15:16:02.587955 5695 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260927 15:16:02.587981 5695 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260927 15:16:02.588004 5695 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260927 15:16:02.588032 5695 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260927 15:16:02.593112 5695 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:40203
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1790521920546562-17952-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1790521920546562-17952-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:45917
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1790521920546562-17952-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:45917
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1790521920546562-17952-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5695
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1790521920546562-17952-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 27 Sep 2026 14:27:13 UTC on ccycloud.quasar-psqrth.root.comops.site
build id 4676138
I20260927 15:16:02.594085 5695 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260927 15:16:02.595032 5695 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260927 15:16:02.603147 5695 server_base.cc:1034] running on GCE node
W20260927 15:16:02.603075 5701 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260927 15:16:02.603195 5700 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260927 15:16:02.603340 5703 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260927 15:16:02.603849 5695 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260927 15:16:02.604921 5695 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260927 15:16:02.606109 5695 hybrid_clock.cc:648] HybridClock initialized: now 1790522162606091 us; error 37 us; skew 500 ppm
Sep 27 15:16:02 dist-test-slave-5s2t krb5kdc[5682](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790522162, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260927 15:16:02.608693 5695 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260927 15:16:02.609493 5695 webserver.cc:460] Webserver started at http://127.0.0.1:33001/ using document root <none> and password file <none>
I20260927 15:16:02.609982 5695 fs_manager.cc:359] Metadata directory not provided
I20260927 15:16:02.610036 5695 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260927 15:16:02.610205 5695 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260927 15:16:02.612157 5695 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1790521920546562-17952-0/minicluster-data/master-0/data/instance:
uuid: "5e9535b4845548a89312951ecb4c880b"
format_stamp: "Formatted at 2026-09-27 15:16:02 on dist-test-slave-5s2t"
server_key: "8ccaa2369cbe696eb7a4ef63ca6b45d9"
server_key_iv: "58e6b6e08c78a9dadec10ee14c092160"
server_key_version: "encryptionkey@0"
I20260927 15:16:02.612644 5695 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1790521920546562-17952-0/minicluster-data/master-0/wal/instance:
uuid: "5e9535b4845548a89312951ecb4c880b"
format_stamp: "Formatted at 2026-09-27 15:16:02 on dist-test-slave-5s2t"
server_key: "8ccaa2369cbe696eb7a4ef63ca6b45d9"
server_key_iv: "58e6b6e08c78a9dadec10ee14c092160"
server_key_version: "encryptionkey@0"
I20260927 15:16:02.616014 5695 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260927 15:16:02.618203 5710 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260927 15:16:02.619395 5695 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260927 15:16:02.619494 5695 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1790521920546562-17952-0/minicluster-data/master-0/data,/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1790521920546562-17952-0/minicluster-data/master-0/wal
uuid: "5e9535b4845548a89312951ecb4c880b"
format_stamp: "Formatted at 2026-09-27 15:16:02 on dist-test-slave-5s2t"
server_key: "8ccaa2369cbe696eb7a4ef63ca6b45d9"
server_key_iv: "58e6b6e08c78a9dadec10ee14c092160"
server_key_version: "encryptionkey@0"
I20260927 15:16:02.619585 5695 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1790521920546562-17952-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1790521920546562-17952-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1790521920546562-17952-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260927 15:16:02.633594 5695 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260927 15:16:02.636149 5695 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260927 15:16:02.636312 5695 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260927 15:16:02.642589 5695 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:45917
I20260927 15:16:02.642635 5762 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:45917 every 8 connection(s)
I20260927 15:16:02.643504 5695 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1790521920546562-17952-0/minicluster-data/master-0/data/info.pb
I20260927 15:16:02.646116 5763 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:16:02.651418 5763 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5e9535b4845548a89312951ecb4c880b: Bootstrap starting.
I20260927 15:16:02.653766 17952 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu as pid 5695
I20260927 15:16:02.653815 5763 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 5e9535b4845548a89312951ecb4c880b: Neither blocks nor log segments found. Creating new log.
I20260927 15:16:02.653883 17952 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1790521920546562-17952-0/minicluster-data/master-0/wal/instance
I20260927 15:16:02.654129 17952 external_mini_cluster.cc:1428] Setting key a6e0881cb69443449d8ec549e0416ff3
I20260927 15:16:02.654538 5763 log.cc:824] T 00000000000000000000000000000000 P 5e9535b4845548a89312951ecb4c880b: Log is configured to *not* fsync() on all Append() calls
I20260927 15:16:02.656824 5763 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5e9535b4845548a89312951ecb4c880b: No bootstrap required, opened a new log
I20260927 15:16:02.661044 5763 raft_consensus.cc:348] T 00000000000000000000000000000000 P 5e9535b4845548a89312951ecb4c880b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5e9535b4845548a89312951ecb4c880b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45917 } }
I20260927 15:16:02.661317 5763 raft_consensus.cc:374] T 00000000000000000000000000000000 P 5e9535b4845548a89312951ecb4c880b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:16:02.661379 5763 raft_consensus.cc:729] T 00000000000000000000000000000000 P 5e9535b4845548a89312951ecb4c880b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e9535b4845548a89312951ecb4c880b, State: Initialized, Role: FOLLOWER
I20260927 15:16:02.662165 5763 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5e9535b4845548a89312951ecb4c880b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5e9535b4845548a89312951ecb4c880b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45917 } }
I20260927 15:16:02.662338 5763 raft_consensus.cc:388] T 00000000000000000000000000000000 P 5e9535b4845548a89312951ecb4c880b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260927 15:16:02.662400 5763 raft_consensus.cc:482] T 00000000000000000000000000000000 P 5e9535b4845548a89312951ecb4c880b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260927 15:16:02.662503 5763 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 5e9535b4845548a89312951ecb4c880b [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:16:02.663542 5763 raft_consensus.cc:504] T 00000000000000000000000000000000 P 5e9535b4845548a89312951ecb4c880b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5e9535b4845548a89312951ecb4c880b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45917 } }
Sep 27 15:16:02 dist-test-slave-5s2t krb5kdc[5682](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790522162, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260927 15:16:02.663899 5763 leader_election.cc:302] T 00000000000000000000000000000000 P 5e9535b4845548a89312951ecb4c880b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 5e9535b4845548a89312951ecb4c880b; no voters:
I20260927 15:16:02.664204 5763 leader_election.cc:288] T 00000000000000000000000000000000 P 5e9535b4845548a89312951ecb4c880b [CANDIDATE]: Term 1 election: Requested vote from peers
I20260927 15:16:02.664314 5768 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 5e9535b4845548a89312951ecb4c880b [term 1 FOLLOWER]: Leader election won for term 1
I20260927 15:16:02.664528 5768 raft_consensus.cc:686] T 00000000000000000000000000000000 P 5e9535b4845548a89312951ecb4c880b [term 1 LEADER]: Becoming Leader. State: Replica: 5e9535b4845548a89312951ecb4c880b, State: Running, Role: LEADER
I20260927 15:16:02.664846 5768 consensus_queue.cc:237] T 00000000000000000000000000000000 P 5e9535b4845548a89312951ecb4c880b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5e9535b4845548a89312951ecb4c880b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45917 } }
I20260927 15:16:02.665787 5763 sys_catalog.cc:564] T 00000000000000000000000000000000 P 5e9535b4845548a89312951ecb4c880b [sys.catalog]: configured and running, proceeding with master startup.
I20260927 15:16:02.666664 5769 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5e9535b4845548a89312951ecb4c880b [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5e9535b4845548a89312951ecb4c880b. Latest consensus state: current_term: 1 leader_uuid: "5e9535b4845548a89312951ecb4c880b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5e9535b4845548a89312951ecb4c880b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45917 } } }
I20260927 15:16:02.666781 5769 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5e9535b4845548a89312951ecb4c880b [sys.catalog]: This master's current role is: LEADER
I20260927 15:16:02.667078 5770 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5e9535b4845548a89312951ecb4c880b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "5e9535b4845548a89312951ecb4c880b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5e9535b4845548a89312951ecb4c880b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45917 } } }
I20260927 15:16:02.667800 5770 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5e9535b4845548a89312951ecb4c880b [sys.catalog]: This master's current role is: LEADER
I20260927 15:16:02.668035 5777 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260927 15:16:02.670877 5767 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:16:02.655153 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51833 (local address 127.0.0.1:45917)
0927 15:16:02.655630 (+ 477us) server_negotiation.cc:206] Beginning negotiation
0927 15:16:02.655647 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0927 15:16:02.655689 (+ 42us) server_negotiation.cc:407] Connection header received
0927 15:16:02.656503 (+ 814us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:16:02.656526 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:16:02.656943 (+ 417us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:16:02.657323 (+ 380us) server_negotiation.cc:226] Negotiated authn=SASL
0927 15:16:02.657957 (+ 634us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:16:02.659453 (+ 1496us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:16:02.660281 (+ 828us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:16:02.660962 (+ 681us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:16:02.661112 (+ 150us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:16:02.664204 (+ 3092us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0927 15:16:02.664210 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0927 15:16:02.664264 (+ 54us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0927 15:16:02.664296 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0927 15:16:02.667563 (+ 3267us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:16:02.668199 (+ 636us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:16:02.668206 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:16:02.668212 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:16:02.668453 (+ 241us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:16:02.668860 (+ 407us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:16:02.668863 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:16:02.668865 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:16:02.669340 (+ 475us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0927 15:16:02.669566 (+ 226us) server_negotiation.cc:1035] Waiting for connection context
0927 15:16:02.669926 (+ 360us) server_negotiation.cc:299] Negotiation successful
0927 15:16:02.670131 (+ 205us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":329,"thread_start_us":125,"threads_started":1}
I20260927 15:16:02.671790 5777 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260927 15:16:02.674365 17952 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260927 15:16:02.677196 5777 catalog_manager.cc:1347] Generated new cluster ID: 540f129d11e64a6ea1c5ac5d437c72e4
I20260927 15:16:02.677259 5777 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260927 15:16:02.684348 5777 catalog_manager.cc:1370] Generated new certificate authority record
I20260927 15:16:02.685146 5777 catalog_manager.cc:1504] Loading token signing keys...
I20260927 15:16:02.688584 5767 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:16:02.676790 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56681 (local address 127.0.0.1:45917)
0927 15:16:02.676898 (+ 108us) server_negotiation.cc:206] Beginning negotiation
0927 15:16:02.676903 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0927 15:16:02.677021 (+ 118us) server_negotiation.cc:407] Connection header received
0927 15:16:02.677131 (+ 110us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:16:02.677134 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:16:02.677180 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:16:02.677345 (+ 165us) server_negotiation.cc:226] Negotiated authn=SASL
0927 15:16:02.678240 (+ 895us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:16:02.678991 (+ 751us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:16:02.680157 (+ 1166us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:16:02.680504 (+ 347us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:16:02.680594 (+ 90us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:16:02.682154 (+ 1560us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0927 15:16:02.682158 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0927 15:16:02.682161 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0927 15:16:02.682185 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0927 15:16:02.683735 (+ 1550us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:16:02.684178 (+ 443us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:16:02.684182 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:16:02.684183 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:16:02.684259 (+ 76us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:16:02.687588 (+ 3329us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:16:02.687591 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:16:02.687593 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:16:02.687796 (+ 203us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0927 15:16:02.687948 (+ 152us) server_negotiation.cc:1035] Waiting for connection context
0927 15:16:02.688190 (+ 242us) server_negotiation.cc:299] Negotiation successful
0927 15:16:02.688283 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260927 15:16:02.705755 5777 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 5e9535b4845548a89312951ecb4c880b: Generated new TSK 0
I20260927 15:16:02.706614 5777 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260927 15:16:02.718787 17952 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu with pid 5695
W20260927 15:16:02.723553 5680 connection.cc:535] client connection to 127.0.0.1:45917 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:45917): Connection reset by peer (error 104)
2026-09-27T15:16:02Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/0 (1306 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/1
Loading random data
Initializing database '/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1790521920546562-17952-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 27 15:16:02 dist-test-slave-5s2t krb5kdc[5794](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 27 15:16:02 dist-test-slave-5s2t krb5kdc[5794](info): set up 2 sockets
Sep 27 15:16:02 dist-test-slave-5s2t krb5kdc[5794](info): commencing operation
krb5kdc: starting...
W20260927 15:16:03.675827 17952 mini_kdc.cc:121] Time spent starting KDC: real 0.939s user 0.001s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1790521920546562-17952-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1790521920546562-17952-0/krb5kdc/test-user.keytab.
Sep 27 15:16:03 dist-test-slave-5s2t krb5kdc[5794](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790522163, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-27T15:16:03Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-27T15:16:03Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1790521920546562-17952-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1790521920546562-17952-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260927 15:16:03.785884 17952 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu
/tmp/dist-test-taskiFOyeW/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1790521920546562-17952-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1790521920546562-17952-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1790521920546562-17952-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1790521920546562-17952-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:36087
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1790521920546562-17952-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:43017
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:36087
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1790521920546562-17952-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1790521920546562-17952-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1790521920546562-17952-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260927 15:16:03.890952 5807 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260927 15:16:03.891216 5807 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260927 15:16:03.891287 5807 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260927 15:16:03.895207 5807 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260927 15:16:03.895287 5807 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260927 15:16:03.895323 5807 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260927 15:16:03.895350 5807 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260927 15:16:03.895380 5807 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260927 15:16:03.900498 5807 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:43017
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1790521920546562-17952-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1790521920546562-17952-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:36087
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1790521920546562-17952-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:36087
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1790521920546562-17952-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5807
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1790521920546562-17952-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 27 Sep 2026 14:27:13 UTC on ccycloud.quasar-psqrth.root.comops.site
build id 4676138
I20260927 15:16:03.901464 5807 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260927 15:16:03.902391 5807 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260927 15:16:03.910296 5813 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260927 15:16:03.910403 5812 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260927 15:16:03.910302 5815 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260927 15:16:03.910389 5807 server_base.cc:1034] running on GCE node
I20260927 15:16:03.911145 5807 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260927 15:16:03.912190 5807 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260927 15:16:03.913344 5807 hybrid_clock.cc:648] HybridClock initialized: now 1790522163913328 us; error 33 us; skew 500 ppm
Sep 27 15:16:03 dist-test-slave-5s2t krb5kdc[5794](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790522163, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260927 15:16:03.915861 5807 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260927 15:16:03.916712 5807 webserver.cc:460] Webserver started at http://127.0.0.1:40229/ using document root <none> and password file <none>
I20260927 15:16:03.917238 5807 fs_manager.cc:359] Metadata directory not provided
I20260927 15:16:03.917299 5807 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260927 15:16:03.917476 5807 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260927 15:16:03.919466 5807 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1790521920546562-17952-0/minicluster-data/master-0/data/instance:
uuid: "6b2d6e97b81141ceaf288cb362c5e3c8"
format_stamp: "Formatted at 2026-09-27 15:16:03 on dist-test-slave-5s2t"
server_key: "6c9c2538a751de5f9886a62fda61bbb4"
server_key_iv: "9f255b0fca836b36e9d3649928780432"
server_key_version: "encryptionkey@0"
I20260927 15:16:03.919991 5807 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1790521920546562-17952-0/minicluster-data/master-0/wal/instance:
uuid: "6b2d6e97b81141ceaf288cb362c5e3c8"
format_stamp: "Formatted at 2026-09-27 15:16:03 on dist-test-slave-5s2t"
server_key: "6c9c2538a751de5f9886a62fda61bbb4"
server_key_iv: "9f255b0fca836b36e9d3649928780432"
server_key_version: "encryptionkey@0"
I20260927 15:16:03.923557 5807 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.000s
I20260927 15:16:03.925777 5822 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260927 15:16:03.926959 5807 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260927 15:16:03.927073 5807 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1790521920546562-17952-0/minicluster-data/master-0/data,/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1790521920546562-17952-0/minicluster-data/master-0/wal
uuid: "6b2d6e97b81141ceaf288cb362c5e3c8"
format_stamp: "Formatted at 2026-09-27 15:16:03 on dist-test-slave-5s2t"
server_key: "6c9c2538a751de5f9886a62fda61bbb4"
server_key_iv: "9f255b0fca836b36e9d3649928780432"
server_key_version: "encryptionkey@0"
I20260927 15:16:03.927181 5807 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1790521920546562-17952-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1790521920546562-17952-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1790521920546562-17952-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260927 15:16:03.946753 5807 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260927 15:16:03.949365 5807 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260927 15:16:03.949532 5807 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260927 15:16:03.956293 5807 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:36087
I20260927 15:16:03.956319 5874 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:36087 every 8 connection(s)
I20260927 15:16:03.957212 5807 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1790521920546562-17952-0/minicluster-data/master-0/data/info.pb
I20260927 15:16:03.959966 5875 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:16:03.961513 17952 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu as pid 5807
I20260927 15:16:03.961633 17952 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1790521920546562-17952-0/minicluster-data/master-0/wal/instance
I20260927 15:16:03.961906 17952 external_mini_cluster.cc:1428] Setting key 46b60f128d7bf475b2ac8c05f04b919e
I20260927 15:16:03.966434 5875 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6b2d6e97b81141ceaf288cb362c5e3c8: Bootstrap starting.
I20260927 15:16:03.968961 5875 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 6b2d6e97b81141ceaf288cb362c5e3c8: Neither blocks nor log segments found. Creating new log.
I20260927 15:16:03.969801 5875 log.cc:824] T 00000000000000000000000000000000 P 6b2d6e97b81141ceaf288cb362c5e3c8: Log is configured to *not* fsync() on all Append() calls
I20260927 15:16:03.971521 5878 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:16:03.963241 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33805 (local address 127.0.0.1:36087)
0927 15:16:03.963676 (+ 435us) server_negotiation.cc:206] Beginning negotiation
0927 15:16:03.963697 (+ 21us) server_negotiation.cc:399] Waiting for connection header
0927 15:16:03.963740 (+ 43us) server_negotiation.cc:407] Connection header received
0927 15:16:03.964558 (+ 818us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:16:03.964583 (+ 25us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:16:03.965038 (+ 455us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:16:03.965425 (+ 387us) server_negotiation.cc:226] Negotiated authn=SASL
0927 15:16:03.965828 (+ 403us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:16:03.967277 (+ 1449us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:16:03.968118 (+ 841us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:16:03.968781 (+ 663us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:16:03.968939 (+ 158us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:16:03.969756 (+ 817us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0927 15:16:03.969762 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0927 15:16:03.969778 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0927 15:16:03.970260 (+ 482us) server_negotiation.cc:922] calling sasl_server_start()
0927 15:16:03.970315 (+ 55us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0927 15:16:03.970337 (+ 22us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0927 15:16:03.970456 (+ 119us) server_negotiation.cc:1035] Waiting for connection context
0927 15:16:03.970658 (+ 202us) server_negotiation.cc:299] Negotiation successful
0927 15:16:03.970792 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":252,"thread_start_us":107,"threads_started":1}
I20260927 15:16:03.971824 5875 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6b2d6e97b81141ceaf288cb362c5e3c8: No bootstrap required, opened a new log
I20260927 15:16:03.974259 17952 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260927 15:16:03.975621 5875 raft_consensus.cc:348] T 00000000000000000000000000000000 P 6b2d6e97b81141ceaf288cb362c5e3c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6b2d6e97b81141ceaf288cb362c5e3c8" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36087 } }
I20260927 15:16:03.975836 5875 raft_consensus.cc:374] T 00000000000000000000000000000000 P 6b2d6e97b81141ceaf288cb362c5e3c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:16:03.975888 5875 raft_consensus.cc:729] T 00000000000000000000000000000000 P 6b2d6e97b81141ceaf288cb362c5e3c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b2d6e97b81141ceaf288cb362c5e3c8, State: Initialized, Role: FOLLOWER
I20260927 15:16:03.976303 5875 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6b2d6e97b81141ceaf288cb362c5e3c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6b2d6e97b81141ceaf288cb362c5e3c8" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36087 } }
I20260927 15:16:03.976446 5875 raft_consensus.cc:388] T 00000000000000000000000000000000 P 6b2d6e97b81141ceaf288cb362c5e3c8 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260927 15:16:03.976508 5875 raft_consensus.cc:482] T 00000000000000000000000000000000 P 6b2d6e97b81141ceaf288cb362c5e3c8 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260927 15:16:03.976606 5875 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 6b2d6e97b81141ceaf288cb362c5e3c8 [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:16:03.977470 5875 raft_consensus.cc:504] T 00000000000000000000000000000000 P 6b2d6e97b81141ceaf288cb362c5e3c8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6b2d6e97b81141ceaf288cb362c5e3c8" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36087 } }
I20260927 15:16:03.977830 5875 leader_election.cc:302] T 00000000000000000000000000000000 P 6b2d6e97b81141ceaf288cb362c5e3c8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 6b2d6e97b81141ceaf288cb362c5e3c8; no voters:
I20260927 15:16:03.978128 5875 leader_election.cc:288] T 00000000000000000000000000000000 P 6b2d6e97b81141ceaf288cb362c5e3c8 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260927 15:16:03.978214 5885 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 6b2d6e97b81141ceaf288cb362c5e3c8 [term 1 FOLLOWER]: Leader election won for term 1
I20260927 15:16:03.978446 5885 raft_consensus.cc:686] T 00000000000000000000000000000000 P 6b2d6e97b81141ceaf288cb362c5e3c8 [term 1 LEADER]: Becoming Leader. State: Replica: 6b2d6e97b81141ceaf288cb362c5e3c8, State: Running, Role: LEADER
I20260927 15:16:03.978757 5885 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6b2d6e97b81141ceaf288cb362c5e3c8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6b2d6e97b81141ceaf288cb362c5e3c8" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36087 } }
I20260927 15:16:03.979403 5875 sys_catalog.cc:564] T 00000000000000000000000000000000 P 6b2d6e97b81141ceaf288cb362c5e3c8 [sys.catalog]: configured and running, proceeding with master startup.
I20260927 15:16:03.979823 5885 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6b2d6e97b81141ceaf288cb362c5e3c8 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6b2d6e97b81141ceaf288cb362c5e3c8. Latest consensus state: current_term: 1 leader_uuid: "6b2d6e97b81141ceaf288cb362c5e3c8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6b2d6e97b81141ceaf288cb362c5e3c8" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36087 } } }
I20260927 15:16:03.979995 5885 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6b2d6e97b81141ceaf288cb362c5e3c8 [sys.catalog]: This master's current role is: LEADER
I20260927 15:16:03.980208 5886 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6b2d6e97b81141ceaf288cb362c5e3c8 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "6b2d6e97b81141ceaf288cb362c5e3c8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6b2d6e97b81141ceaf288cb362c5e3c8" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36087 } } }
I20260927 15:16:03.980504 5886 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6b2d6e97b81141ceaf288cb362c5e3c8 [sys.catalog]: This master's current role is: LEADER
I20260927 15:16:03.980487 5891 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260927 15:16:03.980629 5878 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:16:03.976120 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42855 (local address 127.0.0.1:36087)
0927 15:16:03.976226 (+ 106us) server_negotiation.cc:206] Beginning negotiation
0927 15:16:03.976230 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0927 15:16:03.976364 (+ 134us) server_negotiation.cc:407] Connection header received
0927 15:16:03.976465 (+ 101us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:16:03.976468 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:16:03.976508 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:16:03.976574 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0927 15:16:03.976861 (+ 287us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:16:03.977393 (+ 532us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:16:03.978444 (+ 1051us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:16:03.978769 (+ 325us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:16:03.978841 (+ 72us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:16:03.979819 (+ 978us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0927 15:16:03.979822 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0927 15:16:03.979825 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0927 15:16:03.979836 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0927 15:16:03.979861 (+ 25us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0927 15:16:03.979872 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0927 15:16:03.979930 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0927 15:16:03.980170 (+ 240us) server_negotiation.cc:299] Negotiation successful
0927 15:16:03.980207 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260927 15:16:03.984270 5891 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260927 15:16:03.989794 5891 catalog_manager.cc:1347] Generated new cluster ID: e05a6c7fc94140b19368606b095ab793
I20260927 15:16:03.989846 5891 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260927 15:16:03.998061 5891 catalog_manager.cc:1370] Generated new certificate authority record
I20260927 15:16:03.998932 5891 catalog_manager.cc:1504] Loading token signing keys...
I20260927 15:16:04.003288 5891 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 6b2d6e97b81141ceaf288cb362c5e3c8: Generated new TSK 0
I20260927 15:16:04.003891 5891 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260927 15:16:04.014194 17952 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu with pid 5807
W20260927 15:16:04.018512 5792 connection.cc:535] client connection to 127.0.0.1:36087 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:36087): Connection reset by peer (error 104)
2026-09-27T15:16:04Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/1 (1294 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/2
Loading random data
Initializing database '/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1790521920546562-17952-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 27 15:16:04 dist-test-slave-5s2t krb5kdc[5906](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 27 15:16:04 dist-test-slave-5s2t krb5kdc[5906](info): set up 2 sockets
Sep 27 15:16:04 dist-test-slave-5s2t krb5kdc[5906](info): commencing operation
krb5kdc: starting...
W20260927 15:16:04.959113 17952 mini_kdc.cc:121] Time spent starting KDC: real 0.927s user 0.000s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1790521920546562-17952-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1790521920546562-17952-0/krb5kdc/test-user.keytab.
Sep 27 15:16:05 dist-test-slave-5s2t krb5kdc[5906](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790522165, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-27T15:16:05Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-27T15:16:05Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1790521920546562-17952-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1790521920546562-17952-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260927 15:16:05.078768 17952 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu
/tmp/dist-test-taskiFOyeW/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1790521920546562-17952-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1790521920546562-17952-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1790521920546562-17952-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1790521920546562-17952-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:33759
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1790521920546562-17952-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:34459
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:33759
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1790521920546562-17952-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1790521920546562-17952-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1790521920546562-17952-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260927 15:16:05.185117 5919 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260927 15:16:05.185369 5919 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260927 15:16:05.185427 5919 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260927 15:16:05.189342 5919 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260927 15:16:05.189397 5919 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260927 15:16:05.189424 5919 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260927 15:16:05.189447 5919 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260927 15:16:05.189474 5919 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260927 15:16:05.194561 5919 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:34459
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1790521920546562-17952-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1790521920546562-17952-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:33759
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1790521920546562-17952-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:33759
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1790521920546562-17952-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5919
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1790521920546562-17952-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 27 Sep 2026 14:27:13 UTC on ccycloud.quasar-psqrth.root.comops.site
build id 4676138
I20260927 15:16:05.195596 5919 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260927 15:16:05.196576 5919 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260927 15:16:05.204562 5927 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260927 15:16:05.204586 5925 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260927 15:16:05.204579 5924 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260927 15:16:05.204821 5919 server_base.cc:1034] running on GCE node
I20260927 15:16:05.205368 5919 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260927 15:16:05.206504 5919 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260927 15:16:05.207681 5919 hybrid_clock.cc:648] HybridClock initialized: now 1790522165207660 us; error 31 us; skew 500 ppm
Sep 27 15:16:05 dist-test-slave-5s2t krb5kdc[5906](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790522165, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260927 15:16:05.210335 5919 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260927 15:16:05.211220 5919 webserver.cc:460] Webserver started at http://127.0.0.1:41183/ using document root <none> and password file <none>
I20260927 15:16:05.211782 5919 fs_manager.cc:359] Metadata directory not provided
I20260927 15:16:05.211849 5919 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260927 15:16:05.212045 5919 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260927 15:16:05.214054 5919 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1790521920546562-17952-0/minicluster-data/master-0/data/instance:
uuid: "e932fc0895b04e808b6640c561e615f5"
format_stamp: "Formatted at 2026-09-27 15:16:05 on dist-test-slave-5s2t"
server_key: "f7495b125515caa71c2c1c21182678c0"
server_key_iv: "495421ae10819f680a4ca1266d28867f"
server_key_version: "encryptionkey@0"
I20260927 15:16:05.214581 5919 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1790521920546562-17952-0/minicluster-data/master-0/wal/instance:
uuid: "e932fc0895b04e808b6640c561e615f5"
format_stamp: "Formatted at 2026-09-27 15:16:05 on dist-test-slave-5s2t"
server_key: "f7495b125515caa71c2c1c21182678c0"
server_key_iv: "495421ae10819f680a4ca1266d28867f"
server_key_version: "encryptionkey@0"
I20260927 15:16:05.218104 5919 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.006s sys 0.000s
I20260927 15:16:05.220381 5934 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260927 15:16:05.221635 5919 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260927 15:16:05.221750 5919 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1790521920546562-17952-0/minicluster-data/master-0/data,/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1790521920546562-17952-0/minicluster-data/master-0/wal
uuid: "e932fc0895b04e808b6640c561e615f5"
format_stamp: "Formatted at 2026-09-27 15:16:05 on dist-test-slave-5s2t"
server_key: "f7495b125515caa71c2c1c21182678c0"
server_key_iv: "495421ae10819f680a4ca1266d28867f"
server_key_version: "encryptionkey@0"
I20260927 15:16:05.221837 5919 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1790521920546562-17952-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1790521920546562-17952-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1790521920546562-17952-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260927 15:16:05.226181 5919 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260927 15:16:05.228813 5919 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260927 15:16:05.228969 5919 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260927 15:16:05.235174 5919 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:33759
I20260927 15:16:05.235184 5986 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:33759 every 8 connection(s)
I20260927 15:16:05.236042 5919 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1790521920546562-17952-0/minicluster-data/master-0/data/info.pb
I20260927 15:16:05.238525 5987 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:16:05.243681 5987 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e932fc0895b04e808b6640c561e615f5: Bootstrap starting.
I20260927 15:16:05.244261 17952 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu as pid 5919
I20260927 15:16:05.244383 17952 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1790521920546562-17952-0/minicluster-data/master-0/wal/instance
I20260927 15:16:05.244626 17952 external_mini_cluster.cc:1428] Setting key dd6371387f3fe08d3606360b320c52ea
I20260927 15:16:05.246188 5987 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e932fc0895b04e808b6640c561e615f5: Neither blocks nor log segments found. Creating new log.
I20260927 15:16:05.246871 5987 log.cc:824] T 00000000000000000000000000000000 P e932fc0895b04e808b6640c561e615f5: Log is configured to *not* fsync() on all Append() calls
I20260927 15:16:05.248852 5987 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e932fc0895b04e808b6640c561e615f5: No bootstrap required, opened a new log
I20260927 15:16:05.249243 5990 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:16:05.245716 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54227 (local address 127.0.0.1:33759)
0927 15:16:05.246093 (+ 377us) server_negotiation.cc:206] Beginning negotiation
0927 15:16:05.246107 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0927 15:16:05.246140 (+ 33us) server_negotiation.cc:407] Connection header received
0927 15:16:05.246767 (+ 627us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:16:05.246784 (+ 17us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:16:05.247074 (+ 290us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:16:05.247420 (+ 346us) server_negotiation.cc:226] Negotiated authn=SASL
0927 15:16:05.248103 (+ 683us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0927 15:16:05.248107 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0927 15:16:05.248117 (+ 10us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0927 15:16:05.248125 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0927 15:16:05.248172 (+ 47us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0927 15:16:05.248189 (+ 17us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0927 15:16:05.248266 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0927 15:16:05.248380 (+ 114us) server_negotiation.cc:299] Negotiation successful
0927 15:16:05.248534 (+ 154us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":239,"thread_start_us":98,"threads_started":1}
I20260927 15:16:05.251969 17952 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260927 15:16:05.252825 5987 raft_consensus.cc:348] T 00000000000000000000000000000000 P e932fc0895b04e808b6640c561e615f5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e932fc0895b04e808b6640c561e615f5" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33759 } }
I20260927 15:16:05.253082 5987 raft_consensus.cc:374] T 00000000000000000000000000000000 P e932fc0895b04e808b6640c561e615f5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:16:05.253136 5987 raft_consensus.cc:729] T 00000000000000000000000000000000 P e932fc0895b04e808b6640c561e615f5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e932fc0895b04e808b6640c561e615f5, State: Initialized, Role: FOLLOWER
I20260927 15:16:05.253602 5987 consensus_queue.cc:260] T 00000000000000000000000000000000 P e932fc0895b04e808b6640c561e615f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e932fc0895b04e808b6640c561e615f5" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33759 } }
I20260927 15:16:05.253762 5987 raft_consensus.cc:388] T 00000000000000000000000000000000 P e932fc0895b04e808b6640c561e615f5 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260927 15:16:05.253834 5987 raft_consensus.cc:482] T 00000000000000000000000000000000 P e932fc0895b04e808b6640c561e615f5 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260927 15:16:05.253930 5987 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e932fc0895b04e808b6640c561e615f5 [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:16:05.255003 5987 raft_consensus.cc:504] T 00000000000000000000000000000000 P e932fc0895b04e808b6640c561e615f5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e932fc0895b04e808b6640c561e615f5" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33759 } }
I20260927 15:16:05.255388 5987 leader_election.cc:302] T 00000000000000000000000000000000 P e932fc0895b04e808b6640c561e615f5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e932fc0895b04e808b6640c561e615f5; no voters:
I20260927 15:16:05.255513 5990 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:16:05.254057 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54731 (local address 127.0.0.1:33759)
0927 15:16:05.254153 (+ 96us) server_negotiation.cc:206] Beginning negotiation
0927 15:16:05.254157 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0927 15:16:05.254314 (+ 157us) server_negotiation.cc:407] Connection header received
0927 15:16:05.254417 (+ 103us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:16:05.254419 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:16:05.254443 (+ 24us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:16:05.254499 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0927 15:16:05.255121 (+ 622us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0927 15:16:05.255124 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0927 15:16:05.255127 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0927 15:16:05.255139 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0927 15:16:05.255169 (+ 30us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0927 15:16:05.255181 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0927 15:16:05.255288 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0927 15:16:05.255356 (+ 68us) server_negotiation.cc:299] Negotiation successful
0927 15:16:05.255385 (+ 29us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260927 15:16:05.255716 5987 leader_election.cc:288] T 00000000000000000000000000000000 P e932fc0895b04e808b6640c561e615f5 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260927 15:16:05.255779 5997 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e932fc0895b04e808b6640c561e615f5 [term 1 FOLLOWER]: Leader election won for term 1
I20260927 15:16:05.256404 5997 raft_consensus.cc:686] T 00000000000000000000000000000000 P e932fc0895b04e808b6640c561e615f5 [term 1 LEADER]: Becoming Leader. State: Replica: e932fc0895b04e808b6640c561e615f5, State: Running, Role: LEADER
I20260927 15:16:05.256738 5997 consensus_queue.cc:237] T 00000000000000000000000000000000 P e932fc0895b04e808b6640c561e615f5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e932fc0895b04e808b6640c561e615f5" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33759 } }
I20260927 15:16:05.256937 5987 sys_catalog.cc:564] T 00000000000000000000000000000000 P e932fc0895b04e808b6640c561e615f5 [sys.catalog]: configured and running, proceeding with master startup.
I20260927 15:16:05.258387 5999 sys_catalog.cc:455] T 00000000000000000000000000000000 P e932fc0895b04e808b6640c561e615f5 [sys.catalog]: SysCatalogTable state changed. Reason: New leader e932fc0895b04e808b6640c561e615f5. Latest consensus state: current_term: 1 leader_uuid: "e932fc0895b04e808b6640c561e615f5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e932fc0895b04e808b6640c561e615f5" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33759 } } }
I20260927 15:16:05.258435 5998 sys_catalog.cc:455] T 00000000000000000000000000000000 P e932fc0895b04e808b6640c561e615f5 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "e932fc0895b04e808b6640c561e615f5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e932fc0895b04e808b6640c561e615f5" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33759 } } }
I20260927 15:16:05.258545 5998 sys_catalog.cc:458] T 00000000000000000000000000000000 P e932fc0895b04e808b6640c561e615f5 [sys.catalog]: This master's current role is: LEADER
I20260927 15:16:05.258493 5999 sys_catalog.cc:458] T 00000000000000000000000000000000 P e932fc0895b04e808b6640c561e615f5 [sys.catalog]: This master's current role is: LEADER
I20260927 15:16:05.258855 6010 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260927 15:16:05.261857 6010 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260927 15:16:05.267148 6010 catalog_manager.cc:1347] Generated new cluster ID: 8c42c811532847e39521936b69cddfbd
I20260927 15:16:05.267211 6010 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260927 15:16:05.292480 6010 catalog_manager.cc:1370] Generated new certificate authority record
I20260927 15:16:05.292802 6010 catalog_manager.cc:1504] Loading token signing keys...
I20260927 15:16:05.299786 6010 catalog_manager.cc:5868] T 00000000000000000000000000000000 P e932fc0895b04e808b6640c561e615f5: Generated new TSK 0
I20260927 15:16:05.300424 6010 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260927 15:16:05.309433 17952 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu with pid 5919
2026-09-27T15:16:05Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/2 (1295 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/3
Loading random data
Initializing database '/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1790521920546562-17952-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 27 15:16:05 dist-test-slave-5s2t krb5kdc[6018](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 27 15:16:05 dist-test-slave-5s2t krb5kdc[6018](info): set up 2 sockets
Sep 27 15:16:05 dist-test-slave-5s2t krb5kdc[6018](info): commencing operation
krb5kdc: starting...
W20260927 15:16:06.255059 17952 mini_kdc.cc:121] Time spent starting KDC: real 0.927s user 0.004s sys 0.001s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1790521920546562-17952-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1790521920546562-17952-0/krb5kdc/test-user.keytab.
Sep 27 15:16:06 dist-test-slave-5s2t krb5kdc[6018](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790522166, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-27T15:16:06Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-27T15:16:06Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1790521920546562-17952-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1790521920546562-17952-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260927 15:16:06.375486 17952 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu
/tmp/dist-test-taskiFOyeW/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1790521920546562-17952-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1790521920546562-17952-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1790521920546562-17952-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1790521920546562-17952-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:40055
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1790521920546562-17952-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:40745
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:40055
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1790521920546562-17952-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1790521920546562-17952-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1790521920546562-17952-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260927 15:16:06.481050 6031 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260927 15:16:06.481295 6031 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260927 15:16:06.481334 6031 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260927 15:16:06.485312 6031 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260927 15:16:06.485376 6031 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260927 15:16:06.485394 6031 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260927 15:16:06.485409 6031 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260927 15:16:06.485423 6031 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260927 15:16:06.490607 6031 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:40745
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1790521920546562-17952-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1790521920546562-17952-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:40055
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1790521920546562-17952-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:40055
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1790521920546562-17952-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6031
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1790521920546562-17952-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 27 Sep 2026 14:27:13 UTC on ccycloud.quasar-psqrth.root.comops.site
build id 4676138
I20260927 15:16:06.491652 6031 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260927 15:16:06.492585 6031 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260927 15:16:06.500277 6036 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260927 15:16:06.500407 6031 server_base.cc:1034] running on GCE node
W20260927 15:16:06.500319 6037 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260927 15:16:06.500301 6039 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260927 15:16:06.501058 6031 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260927 15:16:06.502060 6031 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260927 15:16:06.503218 6031 hybrid_clock.cc:648] HybridClock initialized: now 1790522166503200 us; error 28 us; skew 500 ppm
Sep 27 15:16:06 dist-test-slave-5s2t krb5kdc[6018](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790522166, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260927 15:16:06.505812 6031 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260927 15:16:06.506649 6031 webserver.cc:460] Webserver started at http://127.0.0.1:39273/ using document root <none> and password file <none>
I20260927 15:16:06.507161 6031 fs_manager.cc:359] Metadata directory not provided
I20260927 15:16:06.507226 6031 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260927 15:16:06.507438 6031 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260927 15:16:06.509356 6031 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1790521920546562-17952-0/minicluster-data/master-0/data/instance:
uuid: "a5d1fc7912434bdebf37e8497a931dc6"
format_stamp: "Formatted at 2026-09-27 15:16:06 on dist-test-slave-5s2t"
server_key: "82bc78a289e62c55ddef1f8219c2e38c"
server_key_iv: "cad3c15187124bedb41e63c60b81cbd8"
server_key_version: "encryptionkey@0"
I20260927 15:16:06.509855 6031 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1790521920546562-17952-0/minicluster-data/master-0/wal/instance:
uuid: "a5d1fc7912434bdebf37e8497a931dc6"
format_stamp: "Formatted at 2026-09-27 15:16:06 on dist-test-slave-5s2t"
server_key: "82bc78a289e62c55ddef1f8219c2e38c"
server_key_iv: "cad3c15187124bedb41e63c60b81cbd8"
server_key_version: "encryptionkey@0"
I20260927 15:16:06.513415 6031 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.002s
I20260927 15:16:06.515643 6046 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260927 15:16:06.516819 6031 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260927 15:16:06.516947 6031 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1790521920546562-17952-0/minicluster-data/master-0/data,/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1790521920546562-17952-0/minicluster-data/master-0/wal
uuid: "a5d1fc7912434bdebf37e8497a931dc6"
format_stamp: "Formatted at 2026-09-27 15:16:06 on dist-test-slave-5s2t"
server_key: "82bc78a289e62c55ddef1f8219c2e38c"
server_key_iv: "cad3c15187124bedb41e63c60b81cbd8"
server_key_version: "encryptionkey@0"
I20260927 15:16:06.517079 6031 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1790521920546562-17952-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1790521920546562-17952-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1790521920546562-17952-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260927 15:16:06.541909 6031 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260927 15:16:06.544559 6031 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260927 15:16:06.544730 6031 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260927 15:16:06.550911 6031 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:40055
I20260927 15:16:06.550962 6098 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:40055 every 8 connection(s)
I20260927 15:16:06.551836 6031 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1790521920546562-17952-0/minicluster-data/master-0/data/info.pb
I20260927 15:16:06.554368 6099 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:16:06.559490 6099 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a5d1fc7912434bdebf37e8497a931dc6: Bootstrap starting.
I20260927 15:16:06.561493 17952 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu as pid 6031
I20260927 15:16:06.561628 17952 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1790521920546562-17952-0/minicluster-data/master-0/wal/instance
I20260927 15:16:06.561849 17952 external_mini_cluster.cc:1428] Setting key a8965288a3cc067ff7c535a833e8c9a6
I20260927 15:16:06.561878 6099 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a5d1fc7912434bdebf37e8497a931dc6: Neither blocks nor log segments found. Creating new log.
I20260927 15:16:06.562633 6099 log.cc:824] T 00000000000000000000000000000000 P a5d1fc7912434bdebf37e8497a931dc6: Log is configured to *not* fsync() on all Append() calls
I20260927 15:16:06.564801 6099 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a5d1fc7912434bdebf37e8497a931dc6: No bootstrap required, opened a new log
I20260927 15:16:06.568969 6099 raft_consensus.cc:348] T 00000000000000000000000000000000 P a5d1fc7912434bdebf37e8497a931dc6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a5d1fc7912434bdebf37e8497a931dc6" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40055 } }
I20260927 15:16:06.569226 6099 raft_consensus.cc:374] T 00000000000000000000000000000000 P a5d1fc7912434bdebf37e8497a931dc6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:16:06.569293 6099 raft_consensus.cc:729] T 00000000000000000000000000000000 P a5d1fc7912434bdebf37e8497a931dc6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a5d1fc7912434bdebf37e8497a931dc6, State: Initialized, Role: FOLLOWER
I20260927 15:16:06.569711 6099 consensus_queue.cc:260] T 00000000000000000000000000000000 P a5d1fc7912434bdebf37e8497a931dc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a5d1fc7912434bdebf37e8497a931dc6" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40055 } }
I20260927 15:16:06.569828 6099 raft_consensus.cc:388] T 00000000000000000000000000000000 P a5d1fc7912434bdebf37e8497a931dc6 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260927 15:16:06.569886 6099 raft_consensus.cc:482] T 00000000000000000000000000000000 P a5d1fc7912434bdebf37e8497a931dc6 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260927 15:16:06.569975 6099 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a5d1fc7912434bdebf37e8497a931dc6 [term 0 FOLLOWER]: Advancing to term 1
Sep 27 15:16:06 dist-test-slave-5s2t krb5kdc[6018](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790522166, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260927 15:16:06.570986 6099 raft_consensus.cc:504] T 00000000000000000000000000000000 P a5d1fc7912434bdebf37e8497a931dc6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a5d1fc7912434bdebf37e8497a931dc6" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40055 } }
I20260927 15:16:06.571321 6099 leader_election.cc:302] T 00000000000000000000000000000000 P a5d1fc7912434bdebf37e8497a931dc6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a5d1fc7912434bdebf37e8497a931dc6; no voters:
I20260927 15:16:06.571638 6099 leader_election.cc:288] T 00000000000000000000000000000000 P a5d1fc7912434bdebf37e8497a931dc6 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260927 15:16:06.571729 6104 raft_consensus.cc:2781] T 00000000000000000000000000000000 P a5d1fc7912434bdebf37e8497a931dc6 [term 1 FOLLOWER]: Leader election won for term 1
I20260927 15:16:06.571951 6104 raft_consensus.cc:686] T 00000000000000000000000000000000 P a5d1fc7912434bdebf37e8497a931dc6 [term 1 LEADER]: Becoming Leader. State: Replica: a5d1fc7912434bdebf37e8497a931dc6, State: Running, Role: LEADER
I20260927 15:16:06.572328 6104 consensus_queue.cc:237] T 00000000000000000000000000000000 P a5d1fc7912434bdebf37e8497a931dc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a5d1fc7912434bdebf37e8497a931dc6" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40055 } }
I20260927 15:16:06.572984 6099 sys_catalog.cc:564] T 00000000000000000000000000000000 P a5d1fc7912434bdebf37e8497a931dc6 [sys.catalog]: configured and running, proceeding with master startup.
I20260927 15:16:06.573367 6104 sys_catalog.cc:455] T 00000000000000000000000000000000 P a5d1fc7912434bdebf37e8497a931dc6 [sys.catalog]: SysCatalogTable state changed. Reason: New leader a5d1fc7912434bdebf37e8497a931dc6. Latest consensus state: current_term: 1 leader_uuid: "a5d1fc7912434bdebf37e8497a931dc6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a5d1fc7912434bdebf37e8497a931dc6" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40055 } } }
I20260927 15:16:06.574023 6104 sys_catalog.cc:458] T 00000000000000000000000000000000 P a5d1fc7912434bdebf37e8497a931dc6 [sys.catalog]: This master's current role is: LEADER
I20260927 15:16:06.573920 6105 sys_catalog.cc:455] T 00000000000000000000000000000000 P a5d1fc7912434bdebf37e8497a931dc6 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "a5d1fc7912434bdebf37e8497a931dc6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a5d1fc7912434bdebf37e8497a931dc6" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40055 } } }
I20260927 15:16:06.574291 6105 sys_catalog.cc:458] T 00000000000000000000000000000000 P a5d1fc7912434bdebf37e8497a931dc6 [sys.catalog]: This master's current role is: LEADER
I20260927 15:16:06.576434 6103 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:16:06.562891 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47755 (local address 127.0.0.1:40055)
0927 15:16:06.563311 (+ 420us) server_negotiation.cc:206] Beginning negotiation
0927 15:16:06.563326 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0927 15:16:06.563360 (+ 34us) server_negotiation.cc:407] Connection header received
0927 15:16:06.564158 (+ 798us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:16:06.564181 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:16:06.564581 (+ 400us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:16:06.564925 (+ 344us) server_negotiation.cc:226] Negotiated authn=SASL
0927 15:16:06.565582 (+ 657us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:16:06.567022 (+ 1440us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:16:06.567846 (+ 824us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:16:06.568543 (+ 697us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:16:06.568698 (+ 155us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:16:06.571211 (+ 2513us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0927 15:16:06.571217 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0927 15:16:06.571232 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0927 15:16:06.571279 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0927 15:16:06.573246 (+ 1967us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:16:06.573753 (+ 507us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:16:06.573759 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:16:06.573765 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:16:06.573908 (+ 143us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:16:06.574245 (+ 337us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:16:06.574248 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:16:06.574250 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:16:06.574748 (+ 498us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0927 15:16:06.574936 (+ 188us) server_negotiation.cc:1035] Waiting for connection context
0927 15:16:06.575227 (+ 291us) server_negotiation.cc:299] Negotiation successful
0927 15:16:06.575526 (+ 299us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":263,"thread_start_us":118,"threads_started":1}
W20260927 15:16:06.577863 6120 catalog_manager.cc:1558] T 00000000000000000000000000000000 P a5d1fc7912434bdebf37e8497a931dc6: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260927 15:16:06.577924 6120 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260927 15:16:06.577993 6113 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260927 15:16:06.578751 6113 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260927 15:16:06.579327 17952 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260927 15:16:06.584473 6113 catalog_manager.cc:1347] Generated new cluster ID: c40550ad8cfe49c580f9f40c6672bd9f
I20260927 15:16:06.584528 6113 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260927 15:16:06.591281 6103 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:16:06.581250 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53889 (local address 127.0.0.1:40055)
0927 15:16:06.581344 (+ 94us) server_negotiation.cc:206] Beginning negotiation
0927 15:16:06.581348 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0927 15:16:06.581540 (+ 192us) server_negotiation.cc:407] Connection header received
0927 15:16:06.581630 (+ 90us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:16:06.581634 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:16:06.581674 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:16:06.581733 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0927 15:16:06.582293 (+ 560us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:16:06.582830 (+ 537us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:16:06.583989 (+ 1159us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:16:06.584322 (+ 333us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:16:06.584421 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:16:06.588500 (+ 4079us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0927 15:16:06.588503 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0927 15:16:06.588505 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0927 15:16:06.588525 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0927 15:16:06.589730 (+ 1205us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:16:06.590082 (+ 352us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:16:06.590085 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:16:06.590086 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:16:06.590161 (+ 75us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:16:06.590384 (+ 223us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:16:06.590387 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:16:06.590389 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:16:06.590538 (+ 149us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0927 15:16:06.590646 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0927 15:16:06.590875 (+ 229us) server_negotiation.cc:299] Negotiation successful
0927 15:16:06.590973 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260927 15:16:06.591699 6113 catalog_manager.cc:1370] Generated new certificate authority record
I20260927 15:16:06.592803 6113 catalog_manager.cc:1504] Loading token signing keys...
I20260927 15:16:06.611418 6113 catalog_manager.cc:5868] T 00000000000000000000000000000000 P a5d1fc7912434bdebf37e8497a931dc6: Generated new TSK 0
I20260927 15:16:06.612270 6113 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260927 15:16:06.623593 17952 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu with pid 6031
2026-09-27T15:16:06Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/3 (1313 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/4
Loading random data
Initializing database '/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1790521920546562-17952-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 27 15:16:06 dist-test-slave-5s2t krb5kdc[6130](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 27 15:16:06 dist-test-slave-5s2t krb5kdc[6130](info): set up 2 sockets
Sep 27 15:16:06 dist-test-slave-5s2t krb5kdc[6130](info): commencing operation
krb5kdc: starting...
W20260927 15:16:07.567035 17952 mini_kdc.cc:121] Time spent starting KDC: real 0.925s user 0.003s sys 0.003s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1790521920546562-17952-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1790521920546562-17952-0/krb5kdc/test-user.keytab.
Sep 27 15:16:07 dist-test-slave-5s2t krb5kdc[6130](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790522167, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-27T15:16:07Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-27T15:16:07Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1790521920546562-17952-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1790521920546562-17952-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260927 15:16:07.681484 17952 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu
/tmp/dist-test-taskiFOyeW/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1790521920546562-17952-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1790521920546562-17952-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1790521920546562-17952-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1790521920546562-17952-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:42447
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1790521920546562-17952-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:41689
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:42447
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1790521920546562-17952-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1790521920546562-17952-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1790521920546562-17952-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260927 15:16:07.786975 6143 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260927 15:16:07.787226 6143 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260927 15:16:07.787295 6143 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260927 15:16:07.791191 6143 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260927 15:16:07.791266 6143 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260927 15:16:07.791296 6143 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260927 15:16:07.791313 6143 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260927 15:16:07.791344 6143 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260927 15:16:07.796514 6143 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:41689
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1790521920546562-17952-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1790521920546562-17952-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:42447
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1790521920546562-17952-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:42447
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1790521920546562-17952-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6143
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1790521920546562-17952-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 27 Sep 2026 14:27:13 UTC on ccycloud.quasar-psqrth.root.comops.site
build id 4676138
I20260927 15:16:07.797497 6143 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260927 15:16:07.798454 6143 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260927 15:16:07.806473 6149 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260927 15:16:07.806655 6143 server_base.cc:1034] running on GCE node
W20260927 15:16:07.806488 6148 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260927 15:16:07.806478 6151 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260927 15:16:07.807400 6143 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260927 15:16:07.808461 6143 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260927 15:16:07.809649 6143 hybrid_clock.cc:648] HybridClock initialized: now 1790522167809631 us; error 34 us; skew 500 ppm
Sep 27 15:16:07 dist-test-slave-5s2t krb5kdc[6130](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790522167, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260927 15:16:07.812318 6143 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260927 15:16:07.813190 6143 webserver.cc:460] Webserver started at http://127.0.0.1:41287/ using document root <none> and password file <none>
I20260927 15:16:07.813751 6143 fs_manager.cc:359] Metadata directory not provided
I20260927 15:16:07.813823 6143 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260927 15:16:07.814033 6143 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260927 15:16:07.816092 6143 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1790521920546562-17952-0/minicluster-data/master-0/data/instance:
uuid: "f7b9f21804024510bd144f38c851683e"
format_stamp: "Formatted at 2026-09-27 15:16:07 on dist-test-slave-5s2t"
server_key: "c865a46ed79a2b30bff9f7c2a7215d2e"
server_key_iv: "8d7ac482510f8265b3ef83d4d00e132b"
server_key_version: "encryptionkey@0"
I20260927 15:16:07.816638 6143 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1790521920546562-17952-0/minicluster-data/master-0/wal/instance:
uuid: "f7b9f21804024510bd144f38c851683e"
format_stamp: "Formatted at 2026-09-27 15:16:07 on dist-test-slave-5s2t"
server_key: "c865a46ed79a2b30bff9f7c2a7215d2e"
server_key_iv: "8d7ac482510f8265b3ef83d4d00e132b"
server_key_version: "encryptionkey@0"
I20260927 15:16:07.820228 6143 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.001s
I20260927 15:16:07.822532 6158 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260927 15:16:07.823742 6143 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260927 15:16:07.823858 6143 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1790521920546562-17952-0/minicluster-data/master-0/data,/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1790521920546562-17952-0/minicluster-data/master-0/wal
uuid: "f7b9f21804024510bd144f38c851683e"
format_stamp: "Formatted at 2026-09-27 15:16:07 on dist-test-slave-5s2t"
server_key: "c865a46ed79a2b30bff9f7c2a7215d2e"
server_key_iv: "8d7ac482510f8265b3ef83d4d00e132b"
server_key_version: "encryptionkey@0"
I20260927 15:16:07.823951 6143 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1790521920546562-17952-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1790521920546562-17952-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1790521920546562-17952-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260927 15:16:07.847164 6143 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260927 15:16:07.849958 6143 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260927 15:16:07.850138 6143 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260927 15:16:07.856726 6143 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:42447
I20260927 15:16:07.856752 6210 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:42447 every 8 connection(s)
I20260927 15:16:07.857620 6143 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1790521920546562-17952-0/minicluster-data/master-0/data/info.pb
I20260927 15:16:07.860265 6211 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:16:07.865530 6211 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f7b9f21804024510bd144f38c851683e: Bootstrap starting.
I20260927 15:16:07.866988 17952 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu as pid 6143
I20260927 15:16:07.867133 17952 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1790521920546562-17952-0/minicluster-data/master-0/wal/instance
I20260927 15:16:07.867439 17952 external_mini_cluster.cc:1428] Setting key e24f8e44fdb0011a95d3dde88d0b7704
I20260927 15:16:07.868109 6211 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f7b9f21804024510bd144f38c851683e: Neither blocks nor log segments found. Creating new log.
I20260927 15:16:07.868943 6211 log.cc:824] T 00000000000000000000000000000000 P f7b9f21804024510bd144f38c851683e: Log is configured to *not* fsync() on all Append() calls
I20260927 15:16:07.870779 6211 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f7b9f21804024510bd144f38c851683e: No bootstrap required, opened a new log
I20260927 15:16:07.874073 6211 raft_consensus.cc:348] T 00000000000000000000000000000000 P f7b9f21804024510bd144f38c851683e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f7b9f21804024510bd144f38c851683e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42447 } }
I20260927 15:16:07.874282 6211 raft_consensus.cc:374] T 00000000000000000000000000000000 P f7b9f21804024510bd144f38c851683e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:16:07.874317 6211 raft_consensus.cc:729] T 00000000000000000000000000000000 P f7b9f21804024510bd144f38c851683e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f7b9f21804024510bd144f38c851683e, State: Initialized, Role: FOLLOWER
I20260927 15:16:07.874743 6211 consensus_queue.cc:260] T 00000000000000000000000000000000 P f7b9f21804024510bd144f38c851683e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f7b9f21804024510bd144f38c851683e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42447 } }
I20260927 15:16:07.874874 6211 raft_consensus.cc:388] T 00000000000000000000000000000000 P f7b9f21804024510bd144f38c851683e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260927 15:16:07.874967 6211 raft_consensus.cc:482] T 00000000000000000000000000000000 P f7b9f21804024510bd144f38c851683e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260927 15:16:07.875077 6211 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f7b9f21804024510bd144f38c851683e [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:16:07.875892 6214 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:16:07.868485 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41345 (local address 127.0.0.1:42447)
0927 15:16:07.868922 (+ 437us) server_negotiation.cc:206] Beginning negotiation
0927 15:16:07.868936 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0927 15:16:07.868972 (+ 36us) server_negotiation.cc:407] Connection header received
0927 15:16:07.869767 (+ 795us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:16:07.869786 (+ 19us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:16:07.870153 (+ 367us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:16:07.870462 (+ 309us) server_negotiation.cc:226] Negotiated authn=SASL
0927 15:16:07.870896 (+ 434us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:16:07.871900 (+ 1004us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:16:07.872745 (+ 845us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:16:07.873215 (+ 470us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:16:07.873355 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:16:07.874111 (+ 756us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0927 15:16:07.874116 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0927 15:16:07.874128 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0927 15:16:07.874545 (+ 417us) server_negotiation.cc:922] calling sasl_server_start()
0927 15:16:07.874606 (+ 61us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0927 15:16:07.874628 (+ 22us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0927 15:16:07.874711 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0927 15:16:07.874843 (+ 132us) server_negotiation.cc:299] Negotiation successful
0927 15:16:07.875053 (+ 210us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":301,"thread_start_us":128,"threads_started":1}
I20260927 15:16:07.875953 6211 raft_consensus.cc:504] T 00000000000000000000000000000000 P f7b9f21804024510bd144f38c851683e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f7b9f21804024510bd144f38c851683e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42447 } }
I20260927 15:16:07.876271 6211 leader_election.cc:302] T 00000000000000000000000000000000 P f7b9f21804024510bd144f38c851683e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f7b9f21804024510bd144f38c851683e; no voters:
I20260927 15:16:07.876557 6211 leader_election.cc:288] T 00000000000000000000000000000000 P f7b9f21804024510bd144f38c851683e [CANDIDATE]: Term 1 election: Requested vote from peers
I20260927 15:16:07.876626 6216 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f7b9f21804024510bd144f38c851683e [term 1 FOLLOWER]: Leader election won for term 1
I20260927 15:16:07.876814 6216 raft_consensus.cc:686] T 00000000000000000000000000000000 P f7b9f21804024510bd144f38c851683e [term 1 LEADER]: Becoming Leader. State: Replica: f7b9f21804024510bd144f38c851683e, State: Running, Role: LEADER
I20260927 15:16:07.877161 6216 consensus_queue.cc:237] T 00000000000000000000000000000000 P f7b9f21804024510bd144f38c851683e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f7b9f21804024510bd144f38c851683e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42447 } }
I20260927 15:16:07.878312 6216 sys_catalog.cc:455] T 00000000000000000000000000000000 P f7b9f21804024510bd144f38c851683e [sys.catalog]: SysCatalogTable state changed. Reason: New leader f7b9f21804024510bd144f38c851683e. Latest consensus state: current_term: 1 leader_uuid: "f7b9f21804024510bd144f38c851683e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f7b9f21804024510bd144f38c851683e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42447 } } }
I20260927 15:16:07.878427 6216 sys_catalog.cc:458] T 00000000000000000000000000000000 P f7b9f21804024510bd144f38c851683e [sys.catalog]: This master's current role is: LEADER
I20260927 15:16:07.878718 17952 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260927 15:16:07.878696 6217 sys_catalog.cc:455] T 00000000000000000000000000000000 P f7b9f21804024510bd144f38c851683e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "f7b9f21804024510bd144f38c851683e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f7b9f21804024510bd144f38c851683e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42447 } } }
I20260927 15:16:07.878782 6217 sys_catalog.cc:458] T 00000000000000000000000000000000 P f7b9f21804024510bd144f38c851683e [sys.catalog]: This master's current role is: LEADER
I20260927 15:16:07.879133 6211 sys_catalog.cc:564] T 00000000000000000000000000000000 P f7b9f21804024510bd144f38c851683e [sys.catalog]: configured and running, proceeding with master startup.
I20260927 15:16:07.879444 6220 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260927 15:16:07.882586 6220 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260927 15:16:07.885663 6214 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:16:07.881058 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46919 (local address 127.0.0.1:42447)
0927 15:16:07.881152 (+ 94us) server_negotiation.cc:206] Beginning negotiation
0927 15:16:07.881156 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0927 15:16:07.881340 (+ 184us) server_negotiation.cc:407] Connection header received
0927 15:16:07.881477 (+ 137us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:16:07.881480 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:16:07.881537 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:16:07.881615 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0927 15:16:07.881927 (+ 312us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:16:07.882661 (+ 734us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:16:07.884015 (+ 1354us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:16:07.884339 (+ 324us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:16:07.884436 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:16:07.885263 (+ 827us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0927 15:16:07.885266 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0927 15:16:07.885269 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0927 15:16:07.885281 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0927 15:16:07.885310 (+ 29us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0927 15:16:07.885322 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0927 15:16:07.885392 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0927 15:16:07.885479 (+ 87us) server_negotiation.cc:299] Negotiation successful
0927 15:16:07.885531 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":29}
I20260927 15:16:07.888442 6220 catalog_manager.cc:1347] Generated new cluster ID: e02b4b057d8443a98c517bdf7542a9c3
I20260927 15:16:07.888491 6220 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260927 15:16:07.897729 6220 catalog_manager.cc:1370] Generated new certificate authority record
I20260927 15:16:07.898612 6220 catalog_manager.cc:1504] Loading token signing keys...
I20260927 15:16:07.903497 6220 catalog_manager.cc:5868] T 00000000000000000000000000000000 P f7b9f21804024510bd144f38c851683e: Generated new TSK 0
I20260927 15:16:07.904143 6220 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260927 15:16:07.908466 17952 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu with pid 6143
2026-09-27T15:16:07Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/4 (1284 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/5
Loading random data
Initializing database '/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1790521920546562-17952-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 27 15:16:07 dist-test-slave-5s2t krb5kdc[6242](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 27 15:16:07 dist-test-slave-5s2t krb5kdc[6242](info): set up 2 sockets
Sep 27 15:16:07 dist-test-slave-5s2t krb5kdc[6242](info): commencing operation
krb5kdc: starting...
W20260927 15:16:08.851163 17952 mini_kdc.cc:121] Time spent starting KDC: real 0.924s user 0.000s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1790521920546562-17952-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1790521920546562-17952-0/krb5kdc/test-user.keytab.
Sep 27 15:16:08 dist-test-slave-5s2t krb5kdc[6242](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790522168, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-27T15:16:08Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-27T15:16:08Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1790521920546562-17952-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1790521920546562-17952-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260927 15:16:08.979986 17952 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu
/tmp/dist-test-taskiFOyeW/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1790521920546562-17952-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1790521920546562-17952-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1790521920546562-17952-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1790521920546562-17952-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:40487
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1790521920546562-17952-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:35379
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:40487
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1790521920546562-17952-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1790521920546562-17952-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1790521920546562-17952-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260927 15:16:09.085358 6255 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260927 15:16:09.085614 6255 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260927 15:16:09.085660 6255 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260927 15:16:09.089603 6255 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260927 15:16:09.089656 6255 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260927 15:16:09.089674 6255 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260927 15:16:09.089694 6255 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260927 15:16:09.089721 6255 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260927 15:16:09.094892 6255 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:35379
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1790521920546562-17952-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1790521920546562-17952-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:40487
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1790521920546562-17952-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:40487
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1790521920546562-17952-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6255
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1790521920546562-17952-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 27 Sep 2026 14:27:13 UTC on ccycloud.quasar-psqrth.root.comops.site
build id 4676138
I20260927 15:16:09.095968 6255 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260927 15:16:09.096948 6255 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260927 15:16:09.104964 6261 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260927 15:16:09.104965 6263 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260927 15:16:09.104964 6260 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260927 15:16:09.105247 6255 server_base.cc:1034] running on GCE node
I20260927 15:16:09.105791 6255 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260927 15:16:09.106848 6255 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260927 15:16:09.108034 6255 hybrid_clock.cc:648] HybridClock initialized: now 1790522169108006 us; error 38 us; skew 500 ppm
Sep 27 15:16:09 dist-test-slave-5s2t krb5kdc[6242](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790522169, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260927 15:16:09.113700 6255 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260927 15:16:09.114581 6255 webserver.cc:460] Webserver started at http://127.0.0.1:34711/ using document root <none> and password file <none>
I20260927 15:16:09.115098 6255 fs_manager.cc:359] Metadata directory not provided
I20260927 15:16:09.115162 6255 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260927 15:16:09.115379 6255 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260927 15:16:09.117352 6255 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1790521920546562-17952-0/minicluster-data/master-0/data/instance:
uuid: "77ab03e8f88f434dad0641568742e24e"
format_stamp: "Formatted at 2026-09-27 15:16:09 on dist-test-slave-5s2t"
server_key: "acff5b4e6591958a92f8da76544286b5"
server_key_iv: "d3d2c214632945dcb5fb67d0c8fd076d"
server_key_version: "encryptionkey@0"
I20260927 15:16:09.117901 6255 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1790521920546562-17952-0/minicluster-data/master-0/wal/instance:
uuid: "77ab03e8f88f434dad0641568742e24e"
format_stamp: "Formatted at 2026-09-27 15:16:09 on dist-test-slave-5s2t"
server_key: "acff5b4e6591958a92f8da76544286b5"
server_key_iv: "d3d2c214632945dcb5fb67d0c8fd076d"
server_key_version: "encryptionkey@0"
I20260927 15:16:09.121445 6255 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.001s sys 0.004s
I20260927 15:16:09.123750 6270 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260927 15:16:09.124958 6255 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260927 15:16:09.125073 6255 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1790521920546562-17952-0/minicluster-data/master-0/data,/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1790521920546562-17952-0/minicluster-data/master-0/wal
uuid: "77ab03e8f88f434dad0641568742e24e"
format_stamp: "Formatted at 2026-09-27 15:16:09 on dist-test-slave-5s2t"
server_key: "acff5b4e6591958a92f8da76544286b5"
server_key_iv: "d3d2c214632945dcb5fb67d0c8fd076d"
server_key_version: "encryptionkey@0"
I20260927 15:16:09.125162 6255 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1790521920546562-17952-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1790521920546562-17952-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1790521920546562-17952-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260927 15:16:09.129541 6255 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260927 15:16:09.132205 6255 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260927 15:16:09.132359 6255 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260927 15:16:09.138856 6255 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:40487
I20260927 15:16:09.138870 6322 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:40487 every 8 connection(s)
I20260927 15:16:09.139779 6255 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1790521920546562-17952-0/minicluster-data/master-0/data/info.pb
I20260927 15:16:09.142428 6323 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:16:09.145370 17952 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu as pid 6255
I20260927 15:16:09.145509 17952 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1790521920546562-17952-0/minicluster-data/master-0/wal/instance
I20260927 15:16:09.145771 17952 external_mini_cluster.cc:1428] Setting key 86d571644fbbbfa0b8d2f05c7e68ac9f
I20260927 15:16:09.148396 6323 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 77ab03e8f88f434dad0641568742e24e: Bootstrap starting.
I20260927 15:16:09.150840 6323 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 77ab03e8f88f434dad0641568742e24e: Neither blocks nor log segments found. Creating new log.
I20260927 15:16:09.150961 6326 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:16:09.147108 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57155 (local address 127.0.0.1:40487)
0927 15:16:09.147576 (+ 468us) server_negotiation.cc:206] Beginning negotiation
0927 15:16:09.147593 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0927 15:16:09.147633 (+ 40us) server_negotiation.cc:407] Connection header received
0927 15:16:09.148280 (+ 647us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:16:09.148297 (+ 17us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:16:09.148606 (+ 309us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:16:09.148898 (+ 292us) server_negotiation.cc:226] Negotiated authn=SASL
0927 15:16:09.149741 (+ 843us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0927 15:16:09.149746 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0927 15:16:09.149758 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0927 15:16:09.149769 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0927 15:16:09.149825 (+ 56us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0927 15:16:09.149845 (+ 20us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0927 15:16:09.149957 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0927 15:16:09.150068 (+ 111us) server_negotiation.cc:299] Negotiation successful
0927 15:16:09.150220 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":323,"thread_start_us":160,"threads_started":1}
I20260927 15:16:09.151751 6323 log.cc:824] T 00000000000000000000000000000000 P 77ab03e8f88f434dad0641568742e24e: Log is configured to *not* fsync() on all Append() calls
I20260927 15:16:09.153801 6323 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 77ab03e8f88f434dad0641568742e24e: No bootstrap required, opened a new log
I20260927 15:16:09.153887 17952 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260927 15:16:09.157402 6326 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:16:09.155862 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38651 (local address 127.0.0.1:40487)
0927 15:16:09.155969 (+ 107us) server_negotiation.cc:206] Beginning negotiation
0927 15:16:09.155974 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0927 15:16:09.156171 (+ 197us) server_negotiation.cc:407] Connection header received
0927 15:16:09.156283 (+ 112us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:16:09.156285 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:16:09.156316 (+ 31us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:16:09.156387 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0927 15:16:09.157042 (+ 655us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0927 15:16:09.157045 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0927 15:16:09.157047 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0927 15:16:09.157058 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0927 15:16:09.157084 (+ 26us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0927 15:16:09.157096 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0927 15:16:09.157166 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0927 15:16:09.157240 (+ 74us) server_negotiation.cc:299] Negotiation successful
0927 15:16:09.157273 (+ 33us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260927 15:16:09.157801 6323 raft_consensus.cc:348] T 00000000000000000000000000000000 P 77ab03e8f88f434dad0641568742e24e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "77ab03e8f88f434dad0641568742e24e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40487 } }
I20260927 15:16:09.158080 6323 raft_consensus.cc:374] T 00000000000000000000000000000000 P 77ab03e8f88f434dad0641568742e24e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:16:09.158159 6323 raft_consensus.cc:729] T 00000000000000000000000000000000 P 77ab03e8f88f434dad0641568742e24e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 77ab03e8f88f434dad0641568742e24e, State: Initialized, Role: FOLLOWER
I20260927 15:16:09.158612 6323 consensus_queue.cc:260] T 00000000000000000000000000000000 P 77ab03e8f88f434dad0641568742e24e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "77ab03e8f88f434dad0641568742e24e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40487 } }
I20260927 15:16:09.158741 6323 raft_consensus.cc:388] T 00000000000000000000000000000000 P 77ab03e8f88f434dad0641568742e24e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260927 15:16:09.158787 6323 raft_consensus.cc:482] T 00000000000000000000000000000000 P 77ab03e8f88f434dad0641568742e24e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260927 15:16:09.158857 6323 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 77ab03e8f88f434dad0641568742e24e [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:16:09.159782 6323 raft_consensus.cc:504] T 00000000000000000000000000000000 P 77ab03e8f88f434dad0641568742e24e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "77ab03e8f88f434dad0641568742e24e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40487 } }
I20260927 15:16:09.160140 6323 leader_election.cc:302] T 00000000000000000000000000000000 P 77ab03e8f88f434dad0641568742e24e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 77ab03e8f88f434dad0641568742e24e; no voters:
I20260927 15:16:09.160445 6323 leader_election.cc:288] T 00000000000000000000000000000000 P 77ab03e8f88f434dad0641568742e24e [CANDIDATE]: Term 1 election: Requested vote from peers
I20260927 15:16:09.160521 6333 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 77ab03e8f88f434dad0641568742e24e [term 1 FOLLOWER]: Leader election won for term 1
I20260927 15:16:09.160723 6333 raft_consensus.cc:686] T 00000000000000000000000000000000 P 77ab03e8f88f434dad0641568742e24e [term 1 LEADER]: Becoming Leader. State: Replica: 77ab03e8f88f434dad0641568742e24e, State: Running, Role: LEADER
I20260927 15:16:09.161087 6333 consensus_queue.cc:237] T 00000000000000000000000000000000 P 77ab03e8f88f434dad0641568742e24e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "77ab03e8f88f434dad0641568742e24e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40487 } }
I20260927 15:16:09.161573 6323 sys_catalog.cc:564] T 00000000000000000000000000000000 P 77ab03e8f88f434dad0641568742e24e [sys.catalog]: configured and running, proceeding with master startup.
I20260927 15:16:09.162762 6334 sys_catalog.cc:455] T 00000000000000000000000000000000 P 77ab03e8f88f434dad0641568742e24e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "77ab03e8f88f434dad0641568742e24e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "77ab03e8f88f434dad0641568742e24e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40487 } } }
I20260927 15:16:09.162878 6334 sys_catalog.cc:458] T 00000000000000000000000000000000 P 77ab03e8f88f434dad0641568742e24e [sys.catalog]: This master's current role is: LEADER
I20260927 15:16:09.163131 6335 sys_catalog.cc:455] T 00000000000000000000000000000000 P 77ab03e8f88f434dad0641568742e24e [sys.catalog]: SysCatalogTable state changed. Reason: New leader 77ab03e8f88f434dad0641568742e24e. Latest consensus state: current_term: 1 leader_uuid: "77ab03e8f88f434dad0641568742e24e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "77ab03e8f88f434dad0641568742e24e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40487 } } }
I20260927 15:16:09.163275 6335 sys_catalog.cc:458] T 00000000000000000000000000000000 P 77ab03e8f88f434dad0641568742e24e [sys.catalog]: This master's current role is: LEADER
I20260927 15:16:09.163336 6344 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260927 15:16:09.166162 6344 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260927 15:16:09.171816 6344 catalog_manager.cc:1347] Generated new cluster ID: bd097ae0b5a942feb6e8724fa2a11c8c
I20260927 15:16:09.171876 6344 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260927 15:16:09.196393 6344 catalog_manager.cc:1370] Generated new certificate authority record
I20260927 15:16:09.196697 6344 catalog_manager.cc:1504] Loading token signing keys...
I20260927 15:16:09.200757 6344 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 77ab03e8f88f434dad0641568742e24e: Generated new TSK 0
I20260927 15:16:09.201355 6344 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260927 15:16:09.206331 17952 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu with pid 6255
2026-09-27T15:16:09Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/5 (1298 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/6
Loading random data
Initializing database '/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1790521920546562-17952-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 27 15:16:09 dist-test-slave-5s2t krb5kdc[6354](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 27 15:16:09 dist-test-slave-5s2t krb5kdc[6354](info): set up 2 sockets
Sep 27 15:16:09 dist-test-slave-5s2t krb5kdc[6354](info): commencing operation
krb5kdc: starting...
W20260927 15:16:10.151240 17952 mini_kdc.cc:121] Time spent starting KDC: real 0.926s user 0.000s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1790521920546562-17952-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1790521920546562-17952-0/krb5kdc/test-user.keytab.
Sep 27 15:16:10 dist-test-slave-5s2t krb5kdc[6354](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790522170, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-27T15:16:10Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-27T15:16:10Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1790521920546562-17952-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1790521920546562-17952-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260927 15:16:10.266850 17952 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu
/tmp/dist-test-taskiFOyeW/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1790521920546562-17952-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1790521920546562-17952-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1790521920546562-17952-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1790521920546562-17952-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:43937
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1790521920546562-17952-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:44967
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:43937
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1790521920546562-17952-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1790521920546562-17952-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1790521920546562-17952-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260927 15:16:10.375144 6367 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260927 15:16:10.375490 6367 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260927 15:16:10.375566 6367 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260927 15:16:10.379586 6367 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260927 15:16:10.379647 6367 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260927 15:16:10.379678 6367 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260927 15:16:10.379700 6367 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260927 15:16:10.379729 6367 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260927 15:16:10.385222 6367 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:44967
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1790521920546562-17952-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1790521920546562-17952-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:43937
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1790521920546562-17952-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:43937
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1790521920546562-17952-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6367
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1790521920546562-17952-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 27 Sep 2026 14:27:13 UTC on ccycloud.quasar-psqrth.root.comops.site
build id 4676138
I20260927 15:16:10.386240 6367 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260927 15:16:10.387223 6367 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260927 15:16:10.395112 6375 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260927 15:16:10.395283 6367 server_base.cc:1034] running on GCE node
W20260927 15:16:10.395151 6372 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260927 15:16:10.395484 6373 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260927 15:16:10.396010 6367 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260927 15:16:10.397033 6367 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260927 15:16:10.398202 6367 hybrid_clock.cc:648] HybridClock initialized: now 1790522170398187 us; error 28 us; skew 500 ppm
Sep 27 15:16:10 dist-test-slave-5s2t krb5kdc[6354](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790522170, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260927 15:16:10.400758 6367 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260927 15:16:10.401575 6367 webserver.cc:460] Webserver started at http://127.0.0.1:33637/ using document root <none> and password file <none>
I20260927 15:16:10.402076 6367 fs_manager.cc:359] Metadata directory not provided
I20260927 15:16:10.402141 6367 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260927 15:16:10.402318 6367 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260927 15:16:10.404310 6367 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1790521920546562-17952-0/minicluster-data/master-0/data/instance:
uuid: "cfd1eeeb8448418abec7c03438ddd815"
format_stamp: "Formatted at 2026-09-27 15:16:10 on dist-test-slave-5s2t"
server_key: "e0c876ddccb04cad3d00c1692807e0d6"
server_key_iv: "a439c89984ae971e7f8e6396e78c4509"
server_key_version: "encryptionkey@0"
I20260927 15:16:10.404798 6367 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1790521920546562-17952-0/minicluster-data/master-0/wal/instance:
uuid: "cfd1eeeb8448418abec7c03438ddd815"
format_stamp: "Formatted at 2026-09-27 15:16:10 on dist-test-slave-5s2t"
server_key: "e0c876ddccb04cad3d00c1692807e0d6"
server_key_iv: "a439c89984ae971e7f8e6396e78c4509"
server_key_version: "encryptionkey@0"
I20260927 15:16:10.408254 6367 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260927 15:16:10.410651 6382 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260927 15:16:10.411877 6367 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260927 15:16:10.411998 6367 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1790521920546562-17952-0/minicluster-data/master-0/data,/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1790521920546562-17952-0/minicluster-data/master-0/wal
uuid: "cfd1eeeb8448418abec7c03438ddd815"
format_stamp: "Formatted at 2026-09-27 15:16:10 on dist-test-slave-5s2t"
server_key: "e0c876ddccb04cad3d00c1692807e0d6"
server_key_iv: "a439c89984ae971e7f8e6396e78c4509"
server_key_version: "encryptionkey@0"
I20260927 15:16:10.412101 6367 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1790521920546562-17952-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1790521920546562-17952-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1790521920546562-17952-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260927 15:16:10.427732 6367 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260927 15:16:10.430385 6367 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260927 15:16:10.430546 6367 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260927 15:16:10.436921 6367 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:43937
I20260927 15:16:10.436939 6434 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:43937 every 8 connection(s)
I20260927 15:16:10.437824 6367 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1790521920546562-17952-0/minicluster-data/master-0/data/info.pb
I20260927 15:16:10.440527 6435 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:16:10.442194 17952 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu as pid 6367
I20260927 15:16:10.442302 17952 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1790521920546562-17952-0/minicluster-data/master-0/wal/instance
I20260927 15:16:10.442548 17952 external_mini_cluster.cc:1428] Setting key cae25cf7e69a6687172aeb43022dcafc
I20260927 15:16:10.446412 6435 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cfd1eeeb8448418abec7c03438ddd815: Bootstrap starting.
I20260927 15:16:10.448570 6435 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P cfd1eeeb8448418abec7c03438ddd815: Neither blocks nor log segments found. Creating new log.
I20260927 15:16:10.449255 6435 log.cc:824] T 00000000000000000000000000000000 P cfd1eeeb8448418abec7c03438ddd815: Log is configured to *not* fsync() on all Append() calls
Sep 27 15:16:10 dist-test-slave-5s2t krb5kdc[6354](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790522170, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260927 15:16:10.451288 6435 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cfd1eeeb8448418abec7c03438ddd815: No bootstrap required, opened a new log
I20260927 15:16:10.454466 6435 raft_consensus.cc:348] T 00000000000000000000000000000000 P cfd1eeeb8448418abec7c03438ddd815 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cfd1eeeb8448418abec7c03438ddd815" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43937 } }
I20260927 15:16:10.454718 6435 raft_consensus.cc:374] T 00000000000000000000000000000000 P cfd1eeeb8448418abec7c03438ddd815 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:16:10.454767 6435 raft_consensus.cc:729] T 00000000000000000000000000000000 P cfd1eeeb8448418abec7c03438ddd815 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cfd1eeeb8448418abec7c03438ddd815, State: Initialized, Role: FOLLOWER
I20260927 15:16:10.455183 6435 consensus_queue.cc:260] T 00000000000000000000000000000000 P cfd1eeeb8448418abec7c03438ddd815 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cfd1eeeb8448418abec7c03438ddd815" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43937 } }
I20260927 15:16:10.455353 6435 raft_consensus.cc:388] T 00000000000000000000000000000000 P cfd1eeeb8448418abec7c03438ddd815 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260927 15:16:10.455425 6435 raft_consensus.cc:482] T 00000000000000000000000000000000 P cfd1eeeb8448418abec7c03438ddd815 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260927 15:16:10.455525 6435 raft_consensus.cc:3037] T 00000000000000000000000000000000 P cfd1eeeb8448418abec7c03438ddd815 [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:16:10.456372 6435 raft_consensus.cc:504] T 00000000000000000000000000000000 P cfd1eeeb8448418abec7c03438ddd815 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cfd1eeeb8448418abec7c03438ddd815" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43937 } }
I20260927 15:16:10.456588 6438 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:16:10.443876 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.148:54863 (local address 127.0.0.1:43937)
0927 15:16:10.444284 (+ 408us) server_negotiation.cc:206] Beginning negotiation
0927 15:16:10.444298 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0927 15:16:10.444334 (+ 36us) server_negotiation.cc:407] Connection header received
0927 15:16:10.444962 (+ 628us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:16:10.444979 (+ 17us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:16:10.445322 (+ 343us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:16:10.445616 (+ 294us) server_negotiation.cc:226] Negotiated authn=SASL
0927 15:16:10.446378 (+ 762us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:16:10.447433 (+ 1055us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:16:10.448271 (+ 838us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:16:10.448763 (+ 492us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:16:10.448902 (+ 139us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:16:10.451538 (+ 2636us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0927 15:16:10.451542 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0927 15:16:10.451555 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0927 15:16:10.451580 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0927 15:16:10.453623 (+ 2043us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:16:10.454165 (+ 542us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:16:10.454170 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:16:10.454175 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:16:10.454283 (+ 108us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:16:10.454585 (+ 302us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:16:10.454587 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:16:10.454588 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:16:10.455059 (+ 471us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0927 15:16:10.455232 (+ 173us) server_negotiation.cc:1035] Waiting for connection context
0927 15:16:10.455585 (+ 353us) server_negotiation.cc:299] Negotiation successful
0927 15:16:10.455823 (+ 238us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":273,"thread_start_us":131,"threads_started":1}
I20260927 15:16:10.456674 6435 leader_election.cc:302] T 00000000000000000000000000000000 P cfd1eeeb8448418abec7c03438ddd815 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: cfd1eeeb8448418abec7c03438ddd815; no voters:
I20260927 15:16:10.456992 6435 leader_election.cc:288] T 00000000000000000000000000000000 P cfd1eeeb8448418abec7c03438ddd815 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260927 15:16:10.457079 6440 raft_consensus.cc:2781] T 00000000000000000000000000000000 P cfd1eeeb8448418abec7c03438ddd815 [term 1 FOLLOWER]: Leader election won for term 1
I20260927 15:16:10.457238 6440 raft_consensus.cc:686] T 00000000000000000000000000000000 P cfd1eeeb8448418abec7c03438ddd815 [term 1 LEADER]: Becoming Leader. State: Replica: cfd1eeeb8448418abec7c03438ddd815, State: Running, Role: LEADER
I20260927 15:16:10.457592 6440 consensus_queue.cc:237] T 00000000000000000000000000000000 P cfd1eeeb8448418abec7c03438ddd815 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cfd1eeeb8448418abec7c03438ddd815" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43937 } }
I20260927 15:16:10.458232 6435 sys_catalog.cc:564] T 00000000000000000000000000000000 P cfd1eeeb8448418abec7c03438ddd815 [sys.catalog]: configured and running, proceeding with master startup.
I20260927 15:16:10.459079 6441 sys_catalog.cc:455] T 00000000000000000000000000000000 P cfd1eeeb8448418abec7c03438ddd815 [sys.catalog]: SysCatalogTable state changed. Reason: New leader cfd1eeeb8448418abec7c03438ddd815. Latest consensus state: current_term: 1 leader_uuid: "cfd1eeeb8448418abec7c03438ddd815" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cfd1eeeb8448418abec7c03438ddd815" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43937 } } }
I20260927 15:16:10.459201 6441 sys_catalog.cc:458] T 00000000000000000000000000000000 P cfd1eeeb8448418abec7c03438ddd815 [sys.catalog]: This master's current role is: LEADER
I20260927 15:16:10.459447 17952 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260927 15:16:10.460479 6449 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260927 15:16:10.460819 6442 sys_catalog.cc:455] T 00000000000000000000000000000000 P cfd1eeeb8448418abec7c03438ddd815 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "cfd1eeeb8448418abec7c03438ddd815" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cfd1eeeb8448418abec7c03438ddd815" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43937 } } }
I20260927 15:16:10.461150 6442 sys_catalog.cc:458] T 00000000000000000000000000000000 P cfd1eeeb8448418abec7c03438ddd815 [sys.catalog]: This master's current role is: LEADER
I20260927 15:16:10.464089 6449 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260927 15:16:10.468385 6438 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:16:10.461462 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.148:55535 (local address 127.0.0.1:43937)
0927 15:16:10.461581 (+ 119us) server_negotiation.cc:206] Beginning negotiation
0927 15:16:10.461586 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0927 15:16:10.461802 (+ 216us) server_negotiation.cc:407] Connection header received
0927 15:16:10.461872 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:16:10.461875 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:16:10.461916 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:16:10.461992 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0927 15:16:10.462568 (+ 576us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:16:10.463063 (+ 495us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:16:10.463886 (+ 823us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:16:10.464104 (+ 218us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:16:10.464183 (+ 79us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:16:10.465476 (+ 1293us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0927 15:16:10.465479 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0927 15:16:10.465482 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0927 15:16:10.465502 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0927 15:16:10.466731 (+ 1229us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:16:10.467160 (+ 429us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:16:10.467162 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:16:10.467163 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:16:10.467230 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:16:10.467532 (+ 302us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:16:10.467535 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:16:10.467536 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:16:10.467699 (+ 163us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0927 15:16:10.468019 (+ 320us) server_negotiation.cc:1035] Waiting for connection context
0927 15:16:10.468160 (+ 141us) server_negotiation.cc:299] Negotiation successful
0927 15:16:10.468249 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260927 15:16:10.469883 6449 catalog_manager.cc:1347] Generated new cluster ID: 3741052d61b940bfb9f6981b2b38d922
I20260927 15:16:10.469946 6449 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260927 15:16:10.485517 6449 catalog_manager.cc:1370] Generated new certificate authority record
I20260927 15:16:10.486416 6449 catalog_manager.cc:1504] Loading token signing keys...
I20260927 15:16:10.494102 6449 catalog_manager.cc:5868] T 00000000000000000000000000000000 P cfd1eeeb8448418abec7c03438ddd815: Generated new TSK 0
I20260927 15:16:10.494913 6449 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260927 15:16:10.501869 17952 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu with pid 6367
W20260927 15:16:10.506332 6352 connection.cc:535] client connection to 127.0.0.1:43937 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:43937): Connection reset by peer (error 104)
2026-09-27T15:16:10Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/6 (1295 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/7
Loading random data
Initializing database '/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1790521920546562-17952-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 27 15:16:10 dist-test-slave-5s2t krb5kdc[6466](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 27 15:16:10 dist-test-slave-5s2t krb5kdc[6466](info): set up 2 sockets
Sep 27 15:16:10 dist-test-slave-5s2t krb5kdc[6466](info): commencing operation
krb5kdc: starting...
W20260927 15:16:11.439119 17952 mini_kdc.cc:121] Time spent starting KDC: real 0.919s user 0.000s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1790521920546562-17952-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1790521920546562-17952-0/krb5kdc/test-user.keytab.
Sep 27 15:16:11 dist-test-slave-5s2t krb5kdc[6466](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790522171, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-27T15:16:11Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-27T15:16:11Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1790521920546562-17952-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1790521920546562-17952-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260927 15:16:11.549811 17952 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu
/tmp/dist-test-taskiFOyeW/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1790521920546562-17952-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1790521920546562-17952-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1790521920546562-17952-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1790521920546562-17952-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:35039
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1790521920546562-17952-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:38245
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:35039
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1790521920546562-17952-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1790521920546562-17952-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1790521920546562-17952-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260927 15:16:11.651889 6479 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260927 15:16:11.652145 6479 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260927 15:16:11.652200 6479 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260927 15:16:11.656090 6479 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260927 15:16:11.656145 6479 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260927 15:16:11.656170 6479 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260927 15:16:11.656191 6479 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260927 15:16:11.656215 6479 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260927 15:16:11.661226 6479 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:38245
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1790521920546562-17952-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1790521920546562-17952-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:35039
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1790521920546562-17952-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:35039
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1790521920546562-17952-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6479
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1790521920546562-17952-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 27 Sep 2026 14:27:13 UTC on ccycloud.quasar-psqrth.root.comops.site
build id 4676138
I20260927 15:16:11.662156 6479 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260927 15:16:11.663060 6479 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260927 15:16:11.670790 6484 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260927 15:16:11.670804 6485 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260927 15:16:11.670917 6479 server_base.cc:1034] running on GCE node
W20260927 15:16:11.670817 6487 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260927 15:16:11.671582 6479 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260927 15:16:11.672561 6479 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260927 15:16:11.673718 6479 hybrid_clock.cc:648] HybridClock initialized: now 1790522171673702 us; error 26 us; skew 500 ppm
Sep 27 15:16:11 dist-test-slave-5s2t krb5kdc[6466](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790522171, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260927 15:16:11.676290 6479 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260927 15:16:11.677062 6479 webserver.cc:460] Webserver started at http://127.0.0.1:41489/ using document root <none> and password file <none>
I20260927 15:16:11.677551 6479 fs_manager.cc:359] Metadata directory not provided
I20260927 15:16:11.677609 6479 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260927 15:16:11.677803 6479 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260927 15:16:11.679726 6479 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1790521920546562-17952-0/minicluster-data/master-0/data/instance:
uuid: "3cd6e88a18714eccb82308fbc03248bc"
format_stamp: "Formatted at 2026-09-27 15:16:11 on dist-test-slave-5s2t"
server_key: "1e109baa73c5854b28d3db37a3a48a49"
server_key_iv: "8a611e695f0c662fd56a72d12040d0db"
server_key_version: "encryptionkey@0"
I20260927 15:16:11.680230 6479 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1790521920546562-17952-0/minicluster-data/master-0/wal/instance:
uuid: "3cd6e88a18714eccb82308fbc03248bc"
format_stamp: "Formatted at 2026-09-27 15:16:11 on dist-test-slave-5s2t"
server_key: "1e109baa73c5854b28d3db37a3a48a49"
server_key_iv: "8a611e695f0c662fd56a72d12040d0db"
server_key_version: "encryptionkey@0"
I20260927 15:16:11.683617 6479 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260927 15:16:11.685788 6494 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260927 15:16:11.686924 6479 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260927 15:16:11.687029 6479 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1790521920546562-17952-0/minicluster-data/master-0/data,/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1790521920546562-17952-0/minicluster-data/master-0/wal
uuid: "3cd6e88a18714eccb82308fbc03248bc"
format_stamp: "Formatted at 2026-09-27 15:16:11 on dist-test-slave-5s2t"
server_key: "1e109baa73c5854b28d3db37a3a48a49"
server_key_iv: "8a611e695f0c662fd56a72d12040d0db"
server_key_version: "encryptionkey@0"
I20260927 15:16:11.687132 6479 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1790521920546562-17952-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1790521920546562-17952-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1790521920546562-17952-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260927 15:16:11.699167 6479 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260927 15:16:11.702466 6479 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260927 15:16:11.702629 6479 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260927 15:16:11.709029 6479 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:35039
I20260927 15:16:11.709040 6546 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:35039 every 8 connection(s)
I20260927 15:16:11.709892 6479 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1790521920546562-17952-0/minicluster-data/master-0/data/info.pb
I20260927 15:16:11.712482 6547 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:16:11.714443 17952 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu as pid 6479
I20260927 15:16:11.714562 17952 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1790521920546562-17952-0/minicluster-data/master-0/wal/instance
I20260927 15:16:11.714798 17952 external_mini_cluster.cc:1428] Setting key 343ab18059efaf6102f9f11d898ea063
I20260927 15:16:11.718271 6547 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3cd6e88a18714eccb82308fbc03248bc: Bootstrap starting.
I20260927 15:16:11.720733 6547 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3cd6e88a18714eccb82308fbc03248bc: Neither blocks nor log segments found. Creating new log.
I20260927 15:16:11.721563 6547 log.cc:824] T 00000000000000000000000000000000 P 3cd6e88a18714eccb82308fbc03248bc: Log is configured to *not* fsync() on all Append() calls
I20260927 15:16:11.723639 6547 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3cd6e88a18714eccb82308fbc03248bc: No bootstrap required, opened a new log
I20260927 15:16:11.724280 6550 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:16:11.716083 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.148:45705 (local address 127.0.0.1:35039)
0927 15:16:11.716485 (+ 402us) server_negotiation.cc:206] Beginning negotiation
0927 15:16:11.716502 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0927 15:16:11.716542 (+ 40us) server_negotiation.cc:407] Connection header received
0927 15:16:11.717311 (+ 769us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:16:11.717334 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:16:11.717751 (+ 417us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:16:11.718089 (+ 338us) server_negotiation.cc:226] Negotiated authn=SASL
0927 15:16:11.718493 (+ 404us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:16:11.719980 (+ 1487us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:16:11.720832 (+ 852us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:16:11.721507 (+ 675us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:16:11.721667 (+ 160us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:16:11.722427 (+ 760us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0927 15:16:11.722433 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0927 15:16:11.722448 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0927 15:16:11.722902 (+ 454us) server_negotiation.cc:922] calling sasl_server_start()
0927 15:16:11.722970 (+ 68us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0927 15:16:11.722999 (+ 29us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0927 15:16:11.723134 (+ 135us) server_negotiation.cc:1035] Waiting for connection context
0927 15:16:11.723242 (+ 108us) server_negotiation.cc:299] Negotiation successful
0927 15:16:11.723394 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":254,"thread_start_us":102,"threads_started":1}
I20260927 15:16:11.727046 17952 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260927 15:16:11.727519 6547 raft_consensus.cc:348] T 00000000000000000000000000000000 P 3cd6e88a18714eccb82308fbc03248bc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3cd6e88a18714eccb82308fbc03248bc" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35039 } }
I20260927 15:16:11.727734 6547 raft_consensus.cc:374] T 00000000000000000000000000000000 P 3cd6e88a18714eccb82308fbc03248bc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:16:11.727787 6547 raft_consensus.cc:729] T 00000000000000000000000000000000 P 3cd6e88a18714eccb82308fbc03248bc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3cd6e88a18714eccb82308fbc03248bc, State: Initialized, Role: FOLLOWER
I20260927 15:16:11.728183 6547 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3cd6e88a18714eccb82308fbc03248bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3cd6e88a18714eccb82308fbc03248bc" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35039 } }
I20260927 15:16:11.728317 6547 raft_consensus.cc:388] T 00000000000000000000000000000000 P 3cd6e88a18714eccb82308fbc03248bc [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260927 15:16:11.728376 6547 raft_consensus.cc:482] T 00000000000000000000000000000000 P 3cd6e88a18714eccb82308fbc03248bc [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260927 15:16:11.728470 6547 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3cd6e88a18714eccb82308fbc03248bc [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:16:11.729450 6547 raft_consensus.cc:504] T 00000000000000000000000000000000 P 3cd6e88a18714eccb82308fbc03248bc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3cd6e88a18714eccb82308fbc03248bc" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35039 } }
I20260927 15:16:11.729806 6547 leader_election.cc:302] T 00000000000000000000000000000000 P 3cd6e88a18714eccb82308fbc03248bc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 3cd6e88a18714eccb82308fbc03248bc; no voters:
I20260927 15:16:11.730063 6547 leader_election.cc:288] T 00000000000000000000000000000000 P 3cd6e88a18714eccb82308fbc03248bc [CANDIDATE]: Term 1 election: Requested vote from peers
I20260927 15:16:11.730167 6557 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 3cd6e88a18714eccb82308fbc03248bc [term 1 FOLLOWER]: Leader election won for term 1
I20260927 15:16:11.730370 6557 raft_consensus.cc:686] T 00000000000000000000000000000000 P 3cd6e88a18714eccb82308fbc03248bc [term 1 LEADER]: Becoming Leader. State: Replica: 3cd6e88a18714eccb82308fbc03248bc, State: Running, Role: LEADER
I20260927 15:16:11.730734 6557 consensus_queue.cc:237] T 00000000000000000000000000000000 P 3cd6e88a18714eccb82308fbc03248bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3cd6e88a18714eccb82308fbc03248bc" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35039 } }
I20260927 15:16:11.731189 6547 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3cd6e88a18714eccb82308fbc03248bc [sys.catalog]: configured and running, proceeding with master startup.
I20260927 15:16:11.731863 6557 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3cd6e88a18714eccb82308fbc03248bc [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3cd6e88a18714eccb82308fbc03248bc. Latest consensus state: current_term: 1 leader_uuid: "3cd6e88a18714eccb82308fbc03248bc" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3cd6e88a18714eccb82308fbc03248bc" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35039 } } }
I20260927 15:16:11.731978 6557 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3cd6e88a18714eccb82308fbc03248bc [sys.catalog]: This master's current role is: LEADER
I20260927 15:16:11.732473 6558 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3cd6e88a18714eccb82308fbc03248bc [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "3cd6e88a18714eccb82308fbc03248bc" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3cd6e88a18714eccb82308fbc03248bc" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35039 } } }
I20260927 15:16:11.732832 6558 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3cd6e88a18714eccb82308fbc03248bc [sys.catalog]: This master's current role is: LEADER
I20260927 15:16:11.733188 6550 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:16:11.728959 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.148:47333 (local address 127.0.0.1:35039)
0927 15:16:11.729068 (+ 109us) server_negotiation.cc:206] Beginning negotiation
0927 15:16:11.729072 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0927 15:16:11.729241 (+ 169us) server_negotiation.cc:407] Connection header received
0927 15:16:11.729369 (+ 128us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:16:11.729371 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:16:11.729406 (+ 35us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:16:11.729456 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0927 15:16:11.729709 (+ 253us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:16:11.730333 (+ 624us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:16:11.731426 (+ 1093us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:16:11.731738 (+ 312us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:16:11.731843 (+ 105us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:16:11.732613 (+ 770us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0927 15:16:11.732616 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0927 15:16:11.732620 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0927 15:16:11.732633 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0927 15:16:11.732661 (+ 28us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0927 15:16:11.732673 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0927 15:16:11.732757 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0927 15:16:11.733030 (+ 273us) server_negotiation.cc:299] Negotiation successful
0927 15:16:11.733065 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
W20260927 15:16:11.736078 6572 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 3cd6e88a18714eccb82308fbc03248bc: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260927 15:16:11.736147 6572 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260927 15:16:11.736200 6566 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260927 15:16:11.736871 6566 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260927 15:16:11.741387 6566 catalog_manager.cc:1347] Generated new cluster ID: c8e0eb90cc894d08b87c3bf0174e8658
I20260927 15:16:11.741449 6566 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260927 15:16:11.757942 6566 catalog_manager.cc:1370] Generated new certificate authority record
I20260927 15:16:11.758800 6566 catalog_manager.cc:1504] Loading token signing keys...
I20260927 15:16:11.763612 6566 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 3cd6e88a18714eccb82308fbc03248bc: Generated new TSK 0
I20260927 15:16:11.764243 6566 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260927 15:16:11.768170 17952 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu with pid 6479
W20260927 15:16:11.772899 6464 connection.cc:535] client connection to 127.0.0.1:35039 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:35039): Connection reset by peer (error 104)
2026-09-27T15:16:11Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/7 (1266 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/8
Loading random data
Initializing database '/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1790521920546562-17952-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 27 15:16:11 dist-test-slave-5s2t krb5kdc[6578](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 27 15:16:11 dist-test-slave-5s2t krb5kdc[6578](info): set up 2 sockets
Sep 27 15:16:11 dist-test-slave-5s2t krb5kdc[6578](info): commencing operation
krb5kdc: starting...
W20260927 15:16:12.719043 17952 mini_kdc.cc:121] Time spent starting KDC: real 0.932s user 0.000s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1790521920546562-17952-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1790521920546562-17952-0/krb5kdc/test-user.keytab.
Sep 27 15:16:12 dist-test-slave-5s2t krb5kdc[6578](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790522172, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-27T15:16:12Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-27T15:16:12Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1790521920546562-17952-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1790521920546562-17952-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260927 15:16:12.830060 17952 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu
/tmp/dist-test-taskiFOyeW/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1790521920546562-17952-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1790521920546562-17952-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1790521920546562-17952-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1790521920546562-17952-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:45697
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1790521920546562-17952-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:35747
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:45697
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1790521920546562-17952-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1790521920546562-17952-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1790521920546562-17952-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260927 15:16:12.936014 6591 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260927 15:16:12.936285 6591 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260927 15:16:12.936350 6591 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260927 15:16:12.940299 6591 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260927 15:16:12.940359 6591 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260927 15:16:12.940392 6591 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260927 15:16:12.940428 6591 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260927 15:16:12.940457 6591 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260927 15:16:12.945564 6591 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:35747
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1790521920546562-17952-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1790521920546562-17952-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:45697
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1790521920546562-17952-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:45697
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1790521920546562-17952-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6591
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1790521920546562-17952-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 27 Sep 2026 14:27:13 UTC on ccycloud.quasar-psqrth.root.comops.site
build id 4676138
I20260927 15:16:12.946560 6591 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260927 15:16:12.947564 6591 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260927 15:16:12.955724 6599 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260927 15:16:12.955750 6597 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260927 15:16:12.955825 6591 server_base.cc:1034] running on GCE node
W20260927 15:16:12.955878 6596 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260927 15:16:12.956571 6591 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260927 15:16:12.957628 6591 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260927 15:16:12.958814 6591 hybrid_clock.cc:648] HybridClock initialized: now 1790522172958801 us; error 27 us; skew 500 ppm
Sep 27 15:16:12 dist-test-slave-5s2t krb5kdc[6578](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790522172, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260927 15:16:12.961592 6591 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260927 15:16:12.962473 6591 webserver.cc:460] Webserver started at http://127.0.0.1:37067/ using document root <none> and password file <none>
I20260927 15:16:12.962985 6591 fs_manager.cc:359] Metadata directory not provided
I20260927 15:16:12.963047 6591 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260927 15:16:12.963220 6591 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260927 15:16:12.965263 6591 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1790521920546562-17952-0/minicluster-data/master-0/data/instance:
uuid: "44fc91a63df34373bea16cb5c8c77aed"
format_stamp: "Formatted at 2026-09-27 15:16:12 on dist-test-slave-5s2t"
server_key: "e91fa830b97503740629582a64d87288"
server_key_iv: "63ca189d7a53b858c1fd4af3235a1cf0"
server_key_version: "encryptionkey@0"
I20260927 15:16:12.965770 6591 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1790521920546562-17952-0/minicluster-data/master-0/wal/instance:
uuid: "44fc91a63df34373bea16cb5c8c77aed"
format_stamp: "Formatted at 2026-09-27 15:16:12 on dist-test-slave-5s2t"
server_key: "e91fa830b97503740629582a64d87288"
server_key_iv: "63ca189d7a53b858c1fd4af3235a1cf0"
server_key_version: "encryptionkey@0"
I20260927 15:16:12.969419 6591 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.002s
I20260927 15:16:12.971701 6606 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260927 15:16:12.972915 6591 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260927 15:16:12.973065 6591 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1790521920546562-17952-0/minicluster-data/master-0/data,/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1790521920546562-17952-0/minicluster-data/master-0/wal
uuid: "44fc91a63df34373bea16cb5c8c77aed"
format_stamp: "Formatted at 2026-09-27 15:16:12 on dist-test-slave-5s2t"
server_key: "e91fa830b97503740629582a64d87288"
server_key_iv: "63ca189d7a53b858c1fd4af3235a1cf0"
server_key_version: "encryptionkey@0"
I20260927 15:16:12.973161 6591 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1790521920546562-17952-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1790521920546562-17952-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1790521920546562-17952-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260927 15:16:12.977576 6591 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260927 15:16:12.980342 6591 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260927 15:16:12.980509 6591 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260927 15:16:12.986976 6591 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:45697
I20260927 15:16:12.986994 6658 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:45697 every 8 connection(s)
I20260927 15:16:12.987914 6591 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1790521920546562-17952-0/minicluster-data/master-0/data/info.pb
I20260927 15:16:12.990466 6659 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:16:12.994834 17952 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu as pid 6591
I20260927 15:16:12.994943 17952 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1790521920546562-17952-0/minicluster-data/master-0/wal/instance
I20260927 15:16:12.995184 17952 external_mini_cluster.cc:1428] Setting key c335821a935f295e2c0372004ef258a2
I20260927 15:16:12.995734 6659 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 44fc91a63df34373bea16cb5c8c77aed: Bootstrap starting.
I20260927 15:16:12.998200 6659 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 44fc91a63df34373bea16cb5c8c77aed: Neither blocks nor log segments found. Creating new log.
I20260927 15:16:12.999040 6659 log.cc:824] T 00000000000000000000000000000000 P 44fc91a63df34373bea16cb5c8c77aed: Log is configured to *not* fsync() on all Append() calls
I20260927 15:16:13.000486 6662 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:16:12.996531 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.148:46727 (local address 127.0.0.1:45697)
0927 15:16:12.996953 (+ 422us) server_negotiation.cc:206] Beginning negotiation
0927 15:16:12.996971 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0927 15:16:12.997013 (+ 42us) server_negotiation.cc:407] Connection header received
0927 15:16:12.997795 (+ 782us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:16:12.997817 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:16:12.998163 (+ 346us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:16:12.998528 (+ 365us) server_negotiation.cc:226] Negotiated authn=SASL
0927 15:16:12.999164 (+ 636us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0927 15:16:12.999170 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0927 15:16:12.999183 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0927 15:16:12.999194 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0927 15:16:12.999273 (+ 79us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0927 15:16:12.999303 (+ 30us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0927 15:16:12.999406 (+ 103us) server_negotiation.cc:1035] Waiting for connection context
0927 15:16:12.999498 (+ 92us) server_negotiation.cc:299] Negotiation successful
0927 15:16:12.999644 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":261,"thread_start_us":107,"threads_started":1}
I20260927 15:16:13.001113 6659 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 44fc91a63df34373bea16cb5c8c77aed: No bootstrap required, opened a new log
I20260927 15:16:13.003188 17952 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260927 15:16:13.004944 6659 raft_consensus.cc:348] T 00000000000000000000000000000000 P 44fc91a63df34373bea16cb5c8c77aed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "44fc91a63df34373bea16cb5c8c77aed" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45697 } }
I20260927 15:16:13.005201 6659 raft_consensus.cc:374] T 00000000000000000000000000000000 P 44fc91a63df34373bea16cb5c8c77aed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:16:13.005259 6659 raft_consensus.cc:729] T 00000000000000000000000000000000 P 44fc91a63df34373bea16cb5c8c77aed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 44fc91a63df34373bea16cb5c8c77aed, State: Initialized, Role: FOLLOWER
I20260927 15:16:13.005692 6659 consensus_queue.cc:260] T 00000000000000000000000000000000 P 44fc91a63df34373bea16cb5c8c77aed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "44fc91a63df34373bea16cb5c8c77aed" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45697 } }
I20260927 15:16:13.005846 6659 raft_consensus.cc:388] T 00000000000000000000000000000000 P 44fc91a63df34373bea16cb5c8c77aed [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260927 15:16:13.005915 6659 raft_consensus.cc:482] T 00000000000000000000000000000000 P 44fc91a63df34373bea16cb5c8c77aed [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260927 15:16:13.006006 6659 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 44fc91a63df34373bea16cb5c8c77aed [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:16:13.006685 6662 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:16:13.005112 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.148:51461 (local address 127.0.0.1:45697)
0927 15:16:13.005228 (+ 116us) server_negotiation.cc:206] Beginning negotiation
0927 15:16:13.005232 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0927 15:16:13.005449 (+ 217us) server_negotiation.cc:407] Connection header received
0927 15:16:13.005572 (+ 123us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:16:13.005575 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:16:13.005617 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:16:13.005691 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0927 15:16:13.006332 (+ 641us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0927 15:16:13.006335 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0927 15:16:13.006338 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0927 15:16:13.006349 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0927 15:16:13.006376 (+ 27us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0927 15:16:13.006387 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0927 15:16:13.006466 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0927 15:16:13.006534 (+ 68us) server_negotiation.cc:299] Negotiation successful
0927 15:16:13.006570 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260927 15:16:13.007067 6659 raft_consensus.cc:504] T 00000000000000000000000000000000 P 44fc91a63df34373bea16cb5c8c77aed [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "44fc91a63df34373bea16cb5c8c77aed" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45697 } }
I20260927 15:16:13.007441 6659 leader_election.cc:302] T 00000000000000000000000000000000 P 44fc91a63df34373bea16cb5c8c77aed [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 44fc91a63df34373bea16cb5c8c77aed; no voters:
I20260927 15:16:13.007733 6659 leader_election.cc:288] T 00000000000000000000000000000000 P 44fc91a63df34373bea16cb5c8c77aed [CANDIDATE]: Term 1 election: Requested vote from peers
I20260927 15:16:13.007855 6669 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 44fc91a63df34373bea16cb5c8c77aed [term 1 FOLLOWER]: Leader election won for term 1
I20260927 15:16:13.008095 6669 raft_consensus.cc:686] T 00000000000000000000000000000000 P 44fc91a63df34373bea16cb5c8c77aed [term 1 LEADER]: Becoming Leader. State: Replica: 44fc91a63df34373bea16cb5c8c77aed, State: Running, Role: LEADER
I20260927 15:16:13.008387 6669 consensus_queue.cc:237] T 00000000000000000000000000000000 P 44fc91a63df34373bea16cb5c8c77aed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "44fc91a63df34373bea16cb5c8c77aed" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45697 } }
I20260927 15:16:13.008841 6659 sys_catalog.cc:564] T 00000000000000000000000000000000 P 44fc91a63df34373bea16cb5c8c77aed [sys.catalog]: configured and running, proceeding with master startup.
I20260927 15:16:13.009939 6671 sys_catalog.cc:455] T 00000000000000000000000000000000 P 44fc91a63df34373bea16cb5c8c77aed [sys.catalog]: SysCatalogTable state changed. Reason: New leader 44fc91a63df34373bea16cb5c8c77aed. Latest consensus state: current_term: 1 leader_uuid: "44fc91a63df34373bea16cb5c8c77aed" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "44fc91a63df34373bea16cb5c8c77aed" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45697 } } }
I20260927 15:16:13.010040 6671 sys_catalog.cc:458] T 00000000000000000000000000000000 P 44fc91a63df34373bea16cb5c8c77aed [sys.catalog]: This master's current role is: LEADER
I20260927 15:16:13.010320 6670 sys_catalog.cc:455] T 00000000000000000000000000000000 P 44fc91a63df34373bea16cb5c8c77aed [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "44fc91a63df34373bea16cb5c8c77aed" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "44fc91a63df34373bea16cb5c8c77aed" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45697 } } }
I20260927 15:16:13.010381 6678 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260927 15:16:13.010460 6670 sys_catalog.cc:458] T 00000000000000000000000000000000 P 44fc91a63df34373bea16cb5c8c77aed [sys.catalog]: This master's current role is: LEADER
I20260927 15:16:13.013060 6678 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260927 15:16:13.018229 6678 catalog_manager.cc:1347] Generated new cluster ID: 0e898cf9a09841bb822c61a69d4fe731
I20260927 15:16:13.018287 6678 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260927 15:16:13.027038 6678 catalog_manager.cc:1370] Generated new certificate authority record
I20260927 15:16:13.027334 6678 catalog_manager.cc:1504] Loading token signing keys...
I20260927 15:16:13.033344 6678 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 44fc91a63df34373bea16cb5c8c77aed: Generated new TSK 0
I20260927 15:16:13.033939 6678 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260927 15:16:13.045158 17952 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu with pid 6591
2026-09-27T15:16:13Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/8 (1276 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/9
Loading random data
Initializing database '/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1790521920546562-17952-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 27 15:16:13 dist-test-slave-5s2t krb5kdc[6690](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 27 15:16:13 dist-test-slave-5s2t krb5kdc[6690](info): set up 2 sockets
Sep 27 15:16:13 dist-test-slave-5s2t krb5kdc[6690](info): commencing operation
krb5kdc: starting...
W20260927 15:16:13.995038 17952 mini_kdc.cc:121] Time spent starting KDC: real 0.931s user 0.003s sys 0.002s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1790521920546562-17952-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1790521920546562-17952-0/krb5kdc/test-user.keytab.
Sep 27 15:16:14 dist-test-slave-5s2t krb5kdc[6690](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790522174, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-27T15:16:14Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-27T15:16:14Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1790521920546562-17952-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1790521920546562-17952-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260927 15:16:14.106178 17952 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu
/tmp/dist-test-taskiFOyeW/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1790521920546562-17952-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1790521920546562-17952-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1790521920546562-17952-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1790521920546562-17952-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:35703
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1790521920546562-17952-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:44621
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:35703
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1790521920546562-17952-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1790521920546562-17952-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1790521920546562-17952-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260927 15:16:14.213281 6703 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260927 15:16:14.213550 6703 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260927 15:16:14.213609 6703 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260927 15:16:14.217799 6703 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260927 15:16:14.217870 6703 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260927 15:16:14.217909 6703 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260927 15:16:14.217936 6703 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260927 15:16:14.217970 6703 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260927 15:16:14.223194 6703 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:44621
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1790521920546562-17952-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1790521920546562-17952-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:35703
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1790521920546562-17952-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:35703
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1790521920546562-17952-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6703
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1790521920546562-17952-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 27 Sep 2026 14:27:13 UTC on ccycloud.quasar-psqrth.root.comops.site
build id 4676138
I20260927 15:16:14.224252 6703 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260927 15:16:14.225239 6703 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260927 15:16:14.233551 6709 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260927 15:16:14.233563 6708 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260927 15:16:14.233533 6711 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260927 15:16:14.233839 6703 server_base.cc:1034] running on GCE node
I20260927 15:16:14.234334 6703 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260927 15:16:14.235373 6703 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260927 15:16:14.236524 6703 hybrid_clock.cc:648] HybridClock initialized: now 1790522174236502 us; error 34 us; skew 500 ppm
Sep 27 15:16:14 dist-test-slave-5s2t krb5kdc[6690](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790522174, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260927 15:16:14.242534 6703 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260927 15:16:14.243435 6703 webserver.cc:460] Webserver started at http://127.0.0.1:33793/ using document root <none> and password file <none>
I20260927 15:16:14.243945 6703 fs_manager.cc:359] Metadata directory not provided
I20260927 15:16:14.244026 6703 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260927 15:16:14.244221 6703 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260927 15:16:14.246196 6703 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1790521920546562-17952-0/minicluster-data/master-0/data/instance:
uuid: "61a5e626107c4b059903ef79458d23a3"
format_stamp: "Formatted at 2026-09-27 15:16:14 on dist-test-slave-5s2t"
server_key: "468423b63ec52586bea8eb997fc72158"
server_key_iv: "b4aba32fb345866c4d46bdfd7e89faa1"
server_key_version: "encryptionkey@0"
I20260927 15:16:14.246713 6703 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1790521920546562-17952-0/minicluster-data/master-0/wal/instance:
uuid: "61a5e626107c4b059903ef79458d23a3"
format_stamp: "Formatted at 2026-09-27 15:16:14 on dist-test-slave-5s2t"
server_key: "468423b63ec52586bea8eb997fc72158"
server_key_iv: "b4aba32fb345866c4d46bdfd7e89faa1"
server_key_version: "encryptionkey@0"
I20260927 15:16:14.250205 6703 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.006s sys 0.000s
I20260927 15:16:14.252454 6718 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260927 15:16:14.253615 6703 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260927 15:16:14.253727 6703 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1790521920546562-17952-0/minicluster-data/master-0/data,/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1790521920546562-17952-0/minicluster-data/master-0/wal
uuid: "61a5e626107c4b059903ef79458d23a3"
format_stamp: "Formatted at 2026-09-27 15:16:14 on dist-test-slave-5s2t"
server_key: "468423b63ec52586bea8eb997fc72158"
server_key_iv: "b4aba32fb345866c4d46bdfd7e89faa1"
server_key_version: "encryptionkey@0"
I20260927 15:16:14.253810 6703 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1790521920546562-17952-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1790521920546562-17952-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1790521920546562-17952-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260927 15:16:14.280551 6703 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260927 15:16:14.283659 6703 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260927 15:16:14.283833 6703 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260927 15:16:14.290504 6703 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:35703
I20260927 15:16:14.290517 6770 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:35703 every 8 connection(s)
I20260927 15:16:14.291428 6703 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1790521920546562-17952-0/minicluster-data/master-0/data/info.pb
I20260927 15:16:14.294023 6771 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:16:14.299336 6771 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 61a5e626107c4b059903ef79458d23a3: Bootstrap starting.
I20260927 15:16:14.301458 17952 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu as pid 6703
I20260927 15:16:14.301600 17952 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1790521920546562-17952-0/minicluster-data/master-0/wal/instance
I20260927 15:16:14.301808 6771 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 61a5e626107c4b059903ef79458d23a3: Neither blocks nor log segments found. Creating new log.
I20260927 15:16:14.301875 17952 external_mini_cluster.cc:1428] Setting key 6cae099c14ef0fac9482c1b355ed0b72
I20260927 15:16:14.302592 6771 log.cc:824] T 00000000000000000000000000000000 P 61a5e626107c4b059903ef79458d23a3: Log is configured to *not* fsync() on all Append() calls
I20260927 15:16:14.304545 6771 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 61a5e626107c4b059903ef79458d23a3: No bootstrap required, opened a new log
I20260927 15:16:14.308434 6771 raft_consensus.cc:348] T 00000000000000000000000000000000 P 61a5e626107c4b059903ef79458d23a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "61a5e626107c4b059903ef79458d23a3" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35703 } }
I20260927 15:16:14.308676 6771 raft_consensus.cc:374] T 00000000000000000000000000000000 P 61a5e626107c4b059903ef79458d23a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:16:14.308764 6771 raft_consensus.cc:729] T 00000000000000000000000000000000 P 61a5e626107c4b059903ef79458d23a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61a5e626107c4b059903ef79458d23a3, State: Initialized, Role: FOLLOWER
I20260927 15:16:14.309197 6771 consensus_queue.cc:260] T 00000000000000000000000000000000 P 61a5e626107c4b059903ef79458d23a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "61a5e626107c4b059903ef79458d23a3" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35703 } }
I20260927 15:16:14.309319 6771 raft_consensus.cc:388] T 00000000000000000000000000000000 P 61a5e626107c4b059903ef79458d23a3 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260927 15:16:14.309376 6771 raft_consensus.cc:482] T 00000000000000000000000000000000 P 61a5e626107c4b059903ef79458d23a3 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260927 15:16:14.309463 6771 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 61a5e626107c4b059903ef79458d23a3 [term 0 FOLLOWER]: Advancing to term 1
Sep 27 15:16:14 dist-test-slave-5s2t krb5kdc[6690](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790522174, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260927 15:16:14.310326 6771 raft_consensus.cc:504] T 00000000000000000000000000000000 P 61a5e626107c4b059903ef79458d23a3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "61a5e626107c4b059903ef79458d23a3" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35703 } }
I20260927 15:16:14.310667 6771 leader_election.cc:302] T 00000000000000000000000000000000 P 61a5e626107c4b059903ef79458d23a3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 61a5e626107c4b059903ef79458d23a3; no voters:
I20260927 15:16:14.311031 6771 leader_election.cc:288] T 00000000000000000000000000000000 P 61a5e626107c4b059903ef79458d23a3 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260927 15:16:14.311124 6776 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 61a5e626107c4b059903ef79458d23a3 [term 1 FOLLOWER]: Leader election won for term 1
I20260927 15:16:14.311347 6776 raft_consensus.cc:686] T 00000000000000000000000000000000 P 61a5e626107c4b059903ef79458d23a3 [term 1 LEADER]: Becoming Leader. State: Replica: 61a5e626107c4b059903ef79458d23a3, State: Running, Role: LEADER
I20260927 15:16:14.311688 6776 consensus_queue.cc:237] T 00000000000000000000000000000000 P 61a5e626107c4b059903ef79458d23a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "61a5e626107c4b059903ef79458d23a3" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35703 } }
I20260927 15:16:14.312327 6771 sys_catalog.cc:564] T 00000000000000000000000000000000 P 61a5e626107c4b059903ef79458d23a3 [sys.catalog]: configured and running, proceeding with master startup.
I20260927 15:16:14.313105 6777 sys_catalog.cc:455] T 00000000000000000000000000000000 P 61a5e626107c4b059903ef79458d23a3 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "61a5e626107c4b059903ef79458d23a3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "61a5e626107c4b059903ef79458d23a3" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35703 } } }
I20260927 15:16:14.313220 6777 sys_catalog.cc:458] T 00000000000000000000000000000000 P 61a5e626107c4b059903ef79458d23a3 [sys.catalog]: This master's current role is: LEADER
I20260927 15:16:14.313653 6785 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260927 15:16:14.314409 6778 sys_catalog.cc:455] T 00000000000000000000000000000000 P 61a5e626107c4b059903ef79458d23a3 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 61a5e626107c4b059903ef79458d23a3. Latest consensus state: current_term: 1 leader_uuid: "61a5e626107c4b059903ef79458d23a3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "61a5e626107c4b059903ef79458d23a3" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35703 } } }
I20260927 15:16:14.314502 6778 sys_catalog.cc:458] T 00000000000000000000000000000000 P 61a5e626107c4b059903ef79458d23a3 [sys.catalog]: This master's current role is: LEADER
I20260927 15:16:14.316300 6775 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:16:14.302964 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.148:57439 (local address 127.0.0.1:35703)
0927 15:16:14.303336 (+ 372us) server_negotiation.cc:206] Beginning negotiation
0927 15:16:14.303353 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0927 15:16:14.303387 (+ 34us) server_negotiation.cc:407] Connection header received
0927 15:16:14.304025 (+ 638us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:16:14.304048 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:16:14.304389 (+ 341us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:16:14.304689 (+ 300us) server_negotiation.cc:226] Negotiated authn=SASL
0927 15:16:14.305491 (+ 802us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:16:14.306424 (+ 933us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:16:14.307583 (+ 1159us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:16:14.308034 (+ 451us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:16:14.308152 (+ 118us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:16:14.310647 (+ 2495us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0927 15:16:14.310653 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0927 15:16:14.310668 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0927 15:16:14.310713 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0927 15:16:14.312686 (+ 1973us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:16:14.313336 (+ 650us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:16:14.313341 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:16:14.313348 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:16:14.313486 (+ 138us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:16:14.313894 (+ 408us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:16:14.313897 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:16:14.313899 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:16:14.314456 (+ 557us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0927 15:16:14.314670 (+ 214us) server_negotiation.cc:1035] Waiting for connection context
0927 15:16:14.315055 (+ 385us) server_negotiation.cc:299] Negotiation successful
0927 15:16:14.315327 (+ 272us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":213,"thread_start_us":76,"threads_started":1}
I20260927 15:16:14.317528 6785 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260927 15:16:14.319746 17952 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260927 15:16:14.324793 6785 catalog_manager.cc:1347] Generated new cluster ID: 946f040ad7454696bd9259469317debe
I20260927 15:16:14.324868 6785 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260927 15:16:14.332444 6775 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:16:14.322554 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.148:54521 (local address 127.0.0.1:35703)
0927 15:16:14.322756 (+ 202us) server_negotiation.cc:206] Beginning negotiation
0927 15:16:14.322760 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0927 15:16:14.322837 (+ 77us) server_negotiation.cc:407] Connection header received
0927 15:16:14.322989 (+ 152us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:16:14.322992 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:16:14.323067 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:16:14.323172 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0927 15:16:14.324492 (+ 1320us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:16:14.325831 (+ 1339us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:16:14.327005 (+ 1174us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:16:14.327385 (+ 380us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:16:14.327471 (+ 86us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:16:14.329111 (+ 1640us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0927 15:16:14.329115 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0927 15:16:14.329118 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0927 15:16:14.329141 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0927 15:16:14.330656 (+ 1515us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:16:14.331167 (+ 511us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:16:14.331170 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:16:14.331172 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:16:14.331279 (+ 107us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:16:14.331620 (+ 341us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:16:14.331623 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:16:14.331625 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:16:14.331810 (+ 185us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0927 15:16:14.331929 (+ 119us) server_negotiation.cc:1035] Waiting for connection context
0927 15:16:14.332198 (+ 269us) server_negotiation.cc:299] Negotiation successful
0927 15:16:14.332285 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":95}
I20260927 15:16:14.347641 6785 catalog_manager.cc:1370] Generated new certificate authority record
I20260927 15:16:14.348557 6785 catalog_manager.cc:1504] Loading token signing keys...
I20260927 15:16:14.360653 6785 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 61a5e626107c4b059903ef79458d23a3: Generated new TSK 0
I20260927 15:16:14.361331 6785 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260927 15:16:14.369539 17952 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu with pid 6703
W20260927 15:16:14.374135 6688 connection.cc:535] client connection to 127.0.0.1:35703 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:35703): Connection reset by peer (error 104)
2026-09-27T15:16:14Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/9 (1324 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/10
Loading random data
Initializing database '/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1790521920546562-17952-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 27 15:16:14 dist-test-slave-5s2t krb5kdc[6802](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 27 15:16:14 dist-test-slave-5s2t krb5kdc[6802](info): set up 2 sockets
Sep 27 15:16:14 dist-test-slave-5s2t krb5kdc[6802](info): commencing operation
krb5kdc: starting...
W20260927 15:16:15.311066 17952 mini_kdc.cc:121] Time spent starting KDC: real 0.923s user 0.001s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1790521920546562-17952-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1790521920546562-17952-0/krb5kdc/test-user.keytab.
Sep 27 15:16:15 dist-test-slave-5s2t krb5kdc[6802](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790522175, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-27T15:16:15Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-27T15:16:15Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1790521920546562-17952-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1790521920546562-17952-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260927 15:16:15.424304 17952 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu
/tmp/dist-test-taskiFOyeW/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1790521920546562-17952-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1790521920546562-17952-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1790521920546562-17952-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1790521920546562-17952-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:34721
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1790521920546562-17952-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:38169
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:34721
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1790521920546562-17952-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1790521920546562-17952-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1790521920546562-17952-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260927 15:16:15.528100 6815 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260927 15:16:15.528357 6815 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260927 15:16:15.528396 6815 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260927 15:16:15.532300 6815 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260927 15:16:15.532349 6815 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260927 15:16:15.532367 6815 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260927 15:16:15.532382 6815 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260927 15:16:15.532395 6815 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260927 15:16:15.537447 6815 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:38169
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1790521920546562-17952-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1790521920546562-17952-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:34721
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1790521920546562-17952-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:34721
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1790521920546562-17952-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6815
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1790521920546562-17952-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 27 Sep 2026 14:27:13 UTC on ccycloud.quasar-psqrth.root.comops.site
build id 4676138
I20260927 15:16:15.538395 6815 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260927 15:16:15.539394 6815 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260927 15:16:15.547387 6821 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260927 15:16:15.547410 6820 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260927 15:16:15.547410 6823 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260927 15:16:15.547474 6815 server_base.cc:1034] running on GCE node
I20260927 15:16:15.548106 6815 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260927 15:16:15.549127 6815 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260927 15:16:15.550279 6815 hybrid_clock.cc:648] HybridClock initialized: now 1790522175550268 us; error 24 us; skew 500 ppm
Sep 27 15:16:15 dist-test-slave-5s2t krb5kdc[6802](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790522175, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260927 15:16:15.552757 6815 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260927 15:16:15.553565 6815 webserver.cc:460] Webserver started at http://127.0.0.1:46507/ using document root <none> and password file <none>
I20260927 15:16:15.554064 6815 fs_manager.cc:359] Metadata directory not provided
I20260927 15:16:15.554126 6815 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260927 15:16:15.554301 6815 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260927 15:16:15.556239 6815 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1790521920546562-17952-0/minicluster-data/master-0/data/instance:
uuid: "7a2cacba400742a29021bb8491495764"
format_stamp: "Formatted at 2026-09-27 15:16:15 on dist-test-slave-5s2t"
server_key: "cb59372d9977ed34eecf24d81c8e3e41"
server_key_iv: "38e651c0342caea633ed7c1f269c9fc9"
server_key_version: "encryptionkey@0"
I20260927 15:16:15.556752 6815 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1790521920546562-17952-0/minicluster-data/master-0/wal/instance:
uuid: "7a2cacba400742a29021bb8491495764"
format_stamp: "Formatted at 2026-09-27 15:16:15 on dist-test-slave-5s2t"
server_key: "cb59372d9977ed34eecf24d81c8e3e41"
server_key_iv: "38e651c0342caea633ed7c1f269c9fc9"
server_key_version: "encryptionkey@0"
I20260927 15:16:15.560117 6815 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260927 15:16:15.562359 6830 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260927 15:16:15.563498 6815 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260927 15:16:15.563603 6815 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1790521920546562-17952-0/minicluster-data/master-0/data,/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1790521920546562-17952-0/minicluster-data/master-0/wal
uuid: "7a2cacba400742a29021bb8491495764"
format_stamp: "Formatted at 2026-09-27 15:16:15 on dist-test-slave-5s2t"
server_key: "cb59372d9977ed34eecf24d81c8e3e41"
server_key_iv: "38e651c0342caea633ed7c1f269c9fc9"
server_key_version: "encryptionkey@0"
I20260927 15:16:15.563701 6815 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1790521920546562-17952-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1790521920546562-17952-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1790521920546562-17952-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260927 15:16:15.576135 6815 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260927 15:16:15.578702 6815 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260927 15:16:15.578861 6815 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260927 15:16:15.585242 6815 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:34721
I20260927 15:16:15.585310 6882 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:34721 every 8 connection(s)
I20260927 15:16:15.586122 6815 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1790521920546562-17952-0/minicluster-data/master-0/data/info.pb
I20260927 15:16:15.588711 6883 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:16:15.588995 17952 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu as pid 6815
I20260927 15:16:15.589123 17952 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1790521920546562-17952-0/minicluster-data/master-0/wal/instance
I20260927 15:16:15.589421 17952 external_mini_cluster.cc:1428] Setting key e1731d07b35dc71ec4e50ef236a4146b
I20260927 15:16:15.594807 6883 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7a2cacba400742a29021bb8491495764: Bootstrap starting.
I20260927 15:16:15.596827 6883 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 7a2cacba400742a29021bb8491495764: Neither blocks nor log segments found. Creating new log.
I20260927 15:16:15.597491 6883 log.cc:824] T 00000000000000000000000000000000 P 7a2cacba400742a29021bb8491495764: Log is configured to *not* fsync() on all Append() calls
I20260927 15:16:15.597739 6886 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:16:15.590736 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.148:40641 (local address 127.0.0.1:34721)
0927 15:16:15.591147 (+ 411us) server_negotiation.cc:206] Beginning negotiation
0927 15:16:15.591160 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0927 15:16:15.591196 (+ 36us) server_negotiation.cc:407] Connection header received
0927 15:16:15.591892 (+ 696us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:16:15.591908 (+ 16us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:16:15.592228 (+ 320us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:16:15.592514 (+ 286us) server_negotiation.cc:226] Negotiated authn=SASL
0927 15:16:15.592898 (+ 384us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:16:15.593845 (+ 947us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:16:15.594713 (+ 868us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:16:15.595187 (+ 474us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:16:15.595360 (+ 173us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:16:15.596154 (+ 794us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0927 15:16:15.596158 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0927 15:16:15.596170 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0927 15:16:15.596529 (+ 359us) server_negotiation.cc:922] calling sasl_server_start()
0927 15:16:15.596578 (+ 49us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0927 15:16:15.596599 (+ 21us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0927 15:16:15.596719 (+ 120us) server_negotiation.cc:1035] Waiting for connection context
0927 15:16:15.596880 (+ 161us) server_negotiation.cc:299] Negotiation successful
0927 15:16:15.597015 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":278,"thread_start_us":123,"threads_started":1}
I20260927 15:16:15.599432 6883 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7a2cacba400742a29021bb8491495764: No bootstrap required, opened a new log
I20260927 15:16:15.600569 17952 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260927 15:16:15.603693 6883 raft_consensus.cc:348] T 00000000000000000000000000000000 P 7a2cacba400742a29021bb8491495764 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7a2cacba400742a29021bb8491495764" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34721 } }
I20260927 15:16:15.603899 6883 raft_consensus.cc:374] T 00000000000000000000000000000000 P 7a2cacba400742a29021bb8491495764 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:16:15.603976 6883 raft_consensus.cc:729] T 00000000000000000000000000000000 P 7a2cacba400742a29021bb8491495764 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7a2cacba400742a29021bb8491495764, State: Initialized, Role: FOLLOWER
I20260927 15:16:15.604442 6883 consensus_queue.cc:260] T 00000000000000000000000000000000 P 7a2cacba400742a29021bb8491495764 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7a2cacba400742a29021bb8491495764" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34721 } }
I20260927 15:16:15.604595 6883 raft_consensus.cc:388] T 00000000000000000000000000000000 P 7a2cacba400742a29021bb8491495764 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260927 15:16:15.604653 6883 raft_consensus.cc:482] T 00000000000000000000000000000000 P 7a2cacba400742a29021bb8491495764 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260927 15:16:15.604753 6883 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 7a2cacba400742a29021bb8491495764 [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:16:15.605719 6883 raft_consensus.cc:504] T 00000000000000000000000000000000 P 7a2cacba400742a29021bb8491495764 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7a2cacba400742a29021bb8491495764" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34721 } }
I20260927 15:16:15.606065 6883 leader_election.cc:302] T 00000000000000000000000000000000 P 7a2cacba400742a29021bb8491495764 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 7a2cacba400742a29021bb8491495764; no voters:
I20260927 15:16:15.606385 6883 leader_election.cc:288] T 00000000000000000000000000000000 P 7a2cacba400742a29021bb8491495764 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260927 15:16:15.606406 6886 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:16:15.602685 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.148:37589 (local address 127.0.0.1:34721)
0927 15:16:15.602786 (+ 101us) server_negotiation.cc:206] Beginning negotiation
0927 15:16:15.602790 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0927 15:16:15.602906 (+ 116us) server_negotiation.cc:407] Connection header received
0927 15:16:15.603014 (+ 108us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:16:15.603016 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:16:15.603049 (+ 33us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:16:15.603111 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0927 15:16:15.603400 (+ 289us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:16:15.603874 (+ 474us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:16:15.604922 (+ 1048us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:16:15.605139 (+ 217us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:16:15.605211 (+ 72us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:16:15.605984 (+ 773us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0927 15:16:15.605988 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0927 15:16:15.605991 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0927 15:16:15.606002 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0927 15:16:15.606027 (+ 25us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0927 15:16:15.606037 (+ 10us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0927 15:16:15.606114 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0927 15:16:15.606253 (+ 139us) server_negotiation.cc:299] Negotiation successful
0927 15:16:15.606284 (+ 31us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260927 15:16:15.606717 6894 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 7a2cacba400742a29021bb8491495764 [term 1 FOLLOWER]: Leader election won for term 1
I20260927 15:16:15.606901 6894 raft_consensus.cc:686] T 00000000000000000000000000000000 P 7a2cacba400742a29021bb8491495764 [term 1 LEADER]: Becoming Leader. State: Replica: 7a2cacba400742a29021bb8491495764, State: Running, Role: LEADER
I20260927 15:16:15.607230 6894 consensus_queue.cc:237] T 00000000000000000000000000000000 P 7a2cacba400742a29021bb8491495764 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7a2cacba400742a29021bb8491495764" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34721 } }
I20260927 15:16:15.607595 6883 sys_catalog.cc:564] T 00000000000000000000000000000000 P 7a2cacba400742a29021bb8491495764 [sys.catalog]: configured and running, proceeding with master startup.
I20260927 15:16:15.608304 6894 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7a2cacba400742a29021bb8491495764 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7a2cacba400742a29021bb8491495764. Latest consensus state: current_term: 1 leader_uuid: "7a2cacba400742a29021bb8491495764" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7a2cacba400742a29021bb8491495764" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34721 } } }
I20260927 15:16:15.608886 6895 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7a2cacba400742a29021bb8491495764 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "7a2cacba400742a29021bb8491495764" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7a2cacba400742a29021bb8491495764" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34721 } } }
I20260927 15:16:15.608992 6894 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7a2cacba400742a29021bb8491495764 [sys.catalog]: This master's current role is: LEADER
I20260927 15:16:15.609086 6895 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7a2cacba400742a29021bb8491495764 [sys.catalog]: This master's current role is: LEADER
W20260927 15:16:15.611711 6908 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 7a2cacba400742a29021bb8491495764: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260927 15:16:15.611783 6908 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260927 15:16:15.611833 6907 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260927 15:16:15.612502 6907 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260927 15:16:15.617195 6907 catalog_manager.cc:1347] Generated new cluster ID: e6ff9bff160440d3981e8ad12d871c32
I20260927 15:16:15.617256 6907 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260927 15:16:15.647455 6907 catalog_manager.cc:1370] Generated new certificate authority record
I20260927 15:16:15.648766 6907 catalog_manager.cc:1504] Loading token signing keys...
I20260927 15:16:15.656692 6907 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 7a2cacba400742a29021bb8491495764: Generated new TSK 0
I20260927 15:16:15.657545 6907 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260927 15:16:15.662631 17952 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu with pid 6815
W20260927 15:16:15.667303 6800 connection.cc:535] client connection to 127.0.0.1:34721 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:34721): Connection reset by peer (error 104)
2026-09-27T15:16:15Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/10 (1293 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/11
Loading random data
Initializing database '/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1790521920546562-17952-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 27 15:16:15 dist-test-slave-5s2t krb5kdc[6914](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 27 15:16:15 dist-test-slave-5s2t krb5kdc[6914](info): set up 2 sockets
Sep 27 15:16:15 dist-test-slave-5s2t krb5kdc[6914](info): commencing operation
krb5kdc: starting...
W20260927 15:16:16.619176 17952 mini_kdc.cc:121] Time spent starting KDC: real 0.938s user 0.002s sys 0.003s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1790521920546562-17952-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1790521920546562-17952-0/krb5kdc/test-user.keytab.
Sep 27 15:16:16 dist-test-slave-5s2t krb5kdc[6914](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790522176, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-27T15:16:16Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-27T15:16:16Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1790521920546562-17952-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1790521920546562-17952-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260927 15:16:16.734038 17952 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu
/tmp/dist-test-taskiFOyeW/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1790521920546562-17952-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1790521920546562-17952-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1790521920546562-17952-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1790521920546562-17952-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:34839
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1790521920546562-17952-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:43767
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:34839
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1790521920546562-17952-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1790521920546562-17952-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1790521920546562-17952-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260927 15:16:16.839825 6927 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260927 15:16:16.840083 6927 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260927 15:16:16.840123 6927 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260927 15:16:16.843991 6927 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260927 15:16:16.844058 6927 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260927 15:16:16.844082 6927 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260927 15:16:16.844098 6927 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260927 15:16:16.844112 6927 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260927 15:16:16.849257 6927 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:43767
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1790521920546562-17952-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1790521920546562-17952-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:34839
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1790521920546562-17952-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:34839
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1790521920546562-17952-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6927
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1790521920546562-17952-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 27 Sep 2026 14:27:13 UTC on ccycloud.quasar-psqrth.root.comops.site
build id 4676138
I20260927 15:16:16.850236 6927 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260927 15:16:16.851194 6927 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260927 15:16:16.859315 6935 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260927 15:16:16.859320 6932 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260927 15:16:16.859413 6927 server_base.cc:1034] running on GCE node
W20260927 15:16:16.859315 6933 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260927 15:16:16.860160 6927 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260927 15:16:16.861207 6927 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260927 15:16:16.862358 6927 hybrid_clock.cc:648] HybridClock initialized: now 1790522176862343 us; error 27 us; skew 500 ppm
Sep 27 15:16:16 dist-test-slave-5s2t krb5kdc[6914](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790522176, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260927 15:16:16.864887 6927 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260927 15:16:16.865700 6927 webserver.cc:460] Webserver started at http://127.0.0.1:41449/ using document root <none> and password file <none>
I20260927 15:16:16.866183 6927 fs_manager.cc:359] Metadata directory not provided
I20260927 15:16:16.866237 6927 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260927 15:16:16.866391 6927 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260927 15:16:16.868327 6927 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1790521920546562-17952-0/minicluster-data/master-0/data/instance:
uuid: "ab0a5323824e4005b30fb34a50b589bc"
format_stamp: "Formatted at 2026-09-27 15:16:16 on dist-test-slave-5s2t"
server_key: "234c136af6f6ed470dc72e4f1846a85c"
server_key_iv: "1ea6d42f6f2880ff1c3cfe6ab7a5d403"
server_key_version: "encryptionkey@0"
I20260927 15:16:16.868816 6927 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1790521920546562-17952-0/minicluster-data/master-0/wal/instance:
uuid: "ab0a5323824e4005b30fb34a50b589bc"
format_stamp: "Formatted at 2026-09-27 15:16:16 on dist-test-slave-5s2t"
server_key: "234c136af6f6ed470dc72e4f1846a85c"
server_key_iv: "1ea6d42f6f2880ff1c3cfe6ab7a5d403"
server_key_version: "encryptionkey@0"
I20260927 15:16:16.872251 6927 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260927 15:16:16.874553 6942 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260927 15:16:16.875835 6927 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260927 15:16:16.875947 6927 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1790521920546562-17952-0/minicluster-data/master-0/data,/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1790521920546562-17952-0/minicluster-data/master-0/wal
uuid: "ab0a5323824e4005b30fb34a50b589bc"
format_stamp: "Formatted at 2026-09-27 15:16:16 on dist-test-slave-5s2t"
server_key: "234c136af6f6ed470dc72e4f1846a85c"
server_key_iv: "1ea6d42f6f2880ff1c3cfe6ab7a5d403"
server_key_version: "encryptionkey@0"
I20260927 15:16:16.876045 6927 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1790521920546562-17952-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1790521920546562-17952-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1790521920546562-17952-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260927 15:16:16.880427 6927 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260927 15:16:16.883217 6927 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260927 15:16:16.883436 6927 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260927 15:16:16.889654 6927 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:34839
I20260927 15:16:16.889684 6994 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:34839 every 8 connection(s)
I20260927 15:16:16.890537 6927 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1790521920546562-17952-0/minicluster-data/master-0/data/info.pb
I20260927 15:16:16.893286 6995 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:16:16.898595 6995 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ab0a5323824e4005b30fb34a50b589bc: Bootstrap starting.
I20260927 15:16:16.899271 17952 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu as pid 6927
I20260927 15:16:16.899396 17952 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1790521920546562-17952-0/minicluster-data/master-0/wal/instance
I20260927 15:16:16.899678 17952 external_mini_cluster.cc:1428] Setting key 09663940dcdcc76d27ed0465326c8276
I20260927 15:16:16.901376 6995 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ab0a5323824e4005b30fb34a50b589bc: Neither blocks nor log segments found. Creating new log.
I20260927 15:16:16.902067 6995 log.cc:824] T 00000000000000000000000000000000 P ab0a5323824e4005b30fb34a50b589bc: Log is configured to *not* fsync() on all Append() calls
I20260927 15:16:16.904181 6995 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ab0a5323824e4005b30fb34a50b589bc: No bootstrap required, opened a new log
I20260927 15:16:16.904700 6998 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:16:16.900878 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.148:45787 (local address 127.0.0.1:34839)
0927 15:16:16.901297 (+ 419us) server_negotiation.cc:206] Beginning negotiation
0927 15:16:16.901311 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0927 15:16:16.901346 (+ 35us) server_negotiation.cc:407] Connection header received
0927 15:16:16.901995 (+ 649us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:16:16.902013 (+ 18us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:16:16.902332 (+ 319us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:16:16.902703 (+ 371us) server_negotiation.cc:226] Negotiated authn=SASL
0927 15:16:16.903430 (+ 727us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0927 15:16:16.903434 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0927 15:16:16.903446 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0927 15:16:16.903455 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0927 15:16:16.903505 (+ 50us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0927 15:16:16.903523 (+ 18us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0927 15:16:16.903604 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0927 15:16:16.903735 (+ 131us) server_negotiation.cc:299] Negotiation successful
0927 15:16:16.903884 (+ 149us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":271,"thread_start_us":125,"threads_started":1}
I20260927 15:16:16.907598 17952 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260927 15:16:16.908174 6995 raft_consensus.cc:348] T 00000000000000000000000000000000 P ab0a5323824e4005b30fb34a50b589bc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ab0a5323824e4005b30fb34a50b589bc" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34839 } }
I20260927 15:16:16.908452 6995 raft_consensus.cc:374] T 00000000000000000000000000000000 P ab0a5323824e4005b30fb34a50b589bc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:16:16.908509 6995 raft_consensus.cc:729] T 00000000000000000000000000000000 P ab0a5323824e4005b30fb34a50b589bc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab0a5323824e4005b30fb34a50b589bc, State: Initialized, Role: FOLLOWER
I20260927 15:16:16.908973 6995 consensus_queue.cc:260] T 00000000000000000000000000000000 P ab0a5323824e4005b30fb34a50b589bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ab0a5323824e4005b30fb34a50b589bc" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34839 } }
I20260927 15:16:16.909150 6995 raft_consensus.cc:388] T 00000000000000000000000000000000 P ab0a5323824e4005b30fb34a50b589bc [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260927 15:16:16.909219 6995 raft_consensus.cc:482] T 00000000000000000000000000000000 P ab0a5323824e4005b30fb34a50b589bc [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260927 15:16:16.909314 6995 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ab0a5323824e4005b30fb34a50b589bc [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:16:16.910429 6995 raft_consensus.cc:504] T 00000000000000000000000000000000 P ab0a5323824e4005b30fb34a50b589bc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ab0a5323824e4005b30fb34a50b589bc" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34839 } }
I20260927 15:16:16.910787 6995 leader_election.cc:302] T 00000000000000000000000000000000 P ab0a5323824e4005b30fb34a50b589bc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ab0a5323824e4005b30fb34a50b589bc; no voters:
I20260927 15:16:16.911125 6995 leader_election.cc:288] T 00000000000000000000000000000000 P ab0a5323824e4005b30fb34a50b589bc [CANDIDATE]: Term 1 election: Requested vote from peers
I20260927 15:16:16.911177 7005 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ab0a5323824e4005b30fb34a50b589bc [term 1 FOLLOWER]: Leader election won for term 1
I20260927 15:16:16.911378 7005 raft_consensus.cc:686] T 00000000000000000000000000000000 P ab0a5323824e4005b30fb34a50b589bc [term 1 LEADER]: Becoming Leader. State: Replica: ab0a5323824e4005b30fb34a50b589bc, State: Running, Role: LEADER
I20260927 15:16:16.911751 6998 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:16:16.909788 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.148:37421 (local address 127.0.0.1:34839)
0927 15:16:16.909899 (+ 111us) server_negotiation.cc:206] Beginning negotiation
0927 15:16:16.909903 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0927 15:16:16.910136 (+ 233us) server_negotiation.cc:407] Connection header received
0927 15:16:16.910261 (+ 125us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:16:16.910263 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:16:16.910294 (+ 31us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:16:16.910346 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0927 15:16:16.911116 (+ 770us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0927 15:16:16.911119 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0927 15:16:16.911121 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0927 15:16:16.911133 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0927 15:16:16.911166 (+ 33us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0927 15:16:16.911179 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0927 15:16:16.911316 (+ 137us) server_negotiation.cc:1035] Waiting for connection context
0927 15:16:16.911583 (+ 267us) server_negotiation.cc:299] Negotiation successful
0927 15:16:16.911627 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260927 15:16:16.911727 7005 consensus_queue.cc:237] T 00000000000000000000000000000000 P ab0a5323824e4005b30fb34a50b589bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ab0a5323824e4005b30fb34a50b589bc" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34839 } }
I20260927 15:16:16.912406 6995 sys_catalog.cc:564] T 00000000000000000000000000000000 P ab0a5323824e4005b30fb34a50b589bc [sys.catalog]: configured and running, proceeding with master startup.
I20260927 15:16:16.913267 7007 sys_catalog.cc:455] T 00000000000000000000000000000000 P ab0a5323824e4005b30fb34a50b589bc [sys.catalog]: SysCatalogTable state changed. Reason: New leader ab0a5323824e4005b30fb34a50b589bc. Latest consensus state: current_term: 1 leader_uuid: "ab0a5323824e4005b30fb34a50b589bc" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ab0a5323824e4005b30fb34a50b589bc" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34839 } } }
I20260927 15:16:16.913383 7007 sys_catalog.cc:458] T 00000000000000000000000000000000 P ab0a5323824e4005b30fb34a50b589bc [sys.catalog]: This master's current role is: LEADER
I20260927 15:16:16.913686 7006 sys_catalog.cc:455] T 00000000000000000000000000000000 P ab0a5323824e4005b30fb34a50b589bc [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "ab0a5323824e4005b30fb34a50b589bc" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ab0a5323824e4005b30fb34a50b589bc" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34839 } } }
I20260927 15:16:16.913762 7006 sys_catalog.cc:458] T 00000000000000000000000000000000 P ab0a5323824e4005b30fb34a50b589bc [sys.catalog]: This master's current role is: LEADER
I20260927 15:16:16.913769 7014 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260927 15:16:16.916826 7014 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260927 15:16:16.917153 7022 catalog_manager.cc:795] Waiting for catalog manager background task thread to start: Service unavailable: Catalog manager is not initialized. State: Starting
I20260927 15:16:16.922091 7014 catalog_manager.cc:1347] Generated new cluster ID: 0c382ee2a75c4ce499a87380e14eba5c
I20260927 15:16:16.922142 7014 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260927 15:16:16.942725 7014 catalog_manager.cc:1370] Generated new certificate authority record
I20260927 15:16:16.943127 7014 catalog_manager.cc:1504] Loading token signing keys...
I20260927 15:16:16.955404 7014 catalog_manager.cc:5868] T 00000000000000000000000000000000 P ab0a5323824e4005b30fb34a50b589bc: Generated new TSK 0
I20260927 15:16:16.956096 7014 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260927 15:16:16.958956 17952 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu with pid 6927
2026-09-27T15:16:16Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/11 (1296 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/12
Loading random data
Initializing database '/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1790521920546562-17952-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 27 15:16:17 dist-test-slave-5s2t krb5kdc[7026](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 27 15:16:17 dist-test-slave-5s2t krb5kdc[7026](info): set up 2 sockets
Sep 27 15:16:17 dist-test-slave-5s2t krb5kdc[7026](info): commencing operation
krb5kdc: starting...
W20260927 15:16:17.899106 17952 mini_kdc.cc:121] Time spent starting KDC: real 0.921s user 0.001s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1790521920546562-17952-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1790521920546562-17952-0/krb5kdc/test-user.keytab.
Sep 27 15:16:17 dist-test-slave-5s2t krb5kdc[7026](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790522177, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-27T15:16:17Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-27T15:16:17Z Disabled control of system clock
WARNING: no policy specified for kudu/127.17.136.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.136.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.136.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1790521920546562-17952-0/krb5kdc/kudu_127.17.136.62.keytab.
Entry for principal kudu/127.17.136.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1790521920546562-17952-0/krb5kdc/kudu_127.17.136.62.keytab.
I20260927 15:16:18.012362 17952 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu
/tmp/dist-test-taskiFOyeW/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1790521920546562-17952-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1790521920546562-17952-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1790521920546562-17952-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1790521920546562-17952-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.136.62:41119
--webserver_interface=127.17.136.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1790521920546562-17952-0/krb5kdc/kudu_127.17.136.62.keytab
--principal=kudu/127.17.136.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.136.20:42257
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.136.62:41119
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1790521920546562-17952-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1790521920546562-17952-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1790521920546562-17952-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260927 15:16:18.117146 7039 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260927 15:16:18.117412 7039 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260927 15:16:18.117468 7039 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260927 15:16:18.121397 7039 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260927 15:16:18.121452 7039 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260927 15:16:18.121479 7039 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260927 15:16:18.121500 7039 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260927 15:16:18.121524 7039 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260927 15:16:18.126628 7039 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.136.20:42257
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1790521920546562-17952-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1790521920546562-17952-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.17.136.62:41119
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1790521920546562-17952-0/krb5kdc/kudu_127.17.136.62.keytab
--principal=kudu/127.17.136.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.136.62:41119
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1790521920546562-17952-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.17.136.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7039
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1790521920546562-17952-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 27 Sep 2026 14:27:13 UTC on ccycloud.quasar-psqrth.root.comops.site
build id 4676138
I20260927 15:16:18.127684 7039 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260927 15:16:18.128665 7039 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260927 15:16:18.136818 7039 server_base.cc:1034] running on GCE node
W20260927 15:16:18.136759 7044 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260927 15:16:18.136772 7047 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260927 15:16:18.136772 7045 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260927 15:16:18.137508 7039 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260927 15:16:18.138590 7039 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260927 15:16:18.139737 7039 hybrid_clock.cc:648] HybridClock initialized: now 1790522178139714 us; error 38 us; skew 500 ppm
Sep 27 15:16:18 dist-test-slave-5s2t krb5kdc[7026](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790522178, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.136.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260927 15:16:18.142228 7039 init.cc:377] Logged in from keytab as kudu/127.17.136.62@KRBTEST.COM (short username kudu)
I20260927 15:16:18.143015 7039 webserver.cc:460] Webserver started at http://127.17.136.62:41379/ using document root <none> and password file <none>
I20260927 15:16:18.143566 7039 fs_manager.cc:359] Metadata directory not provided
I20260927 15:16:18.143636 7039 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260927 15:16:18.143824 7039 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260927 15:16:18.145745 7039 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1790521920546562-17952-0/minicluster-data/master-0/data/instance:
uuid: "4778381f375043f5b9585cbb554064f4"
format_stamp: "Formatted at 2026-09-27 15:16:18 on dist-test-slave-5s2t"
server_key: "29e0f15fa240fcf6da74fd6062e72305"
server_key_iv: "5f90a1a56f6f197ab40ff104069bfa47"
server_key_version: "encryptionkey@0"
I20260927 15:16:18.146262 7039 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1790521920546562-17952-0/minicluster-data/master-0/wal/instance:
uuid: "4778381f375043f5b9585cbb554064f4"
format_stamp: "Formatted at 2026-09-27 15:16:18 on dist-test-slave-5s2t"
server_key: "29e0f15fa240fcf6da74fd6062e72305"
server_key_iv: "5f90a1a56f6f197ab40ff104069bfa47"
server_key_version: "encryptionkey@0"
I20260927 15:16:18.149705 7039 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.006s sys 0.000s
I20260927 15:16:18.151988 7054 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260927 15:16:18.153175 7039 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260927 15:16:18.153283 7039 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1790521920546562-17952-0/minicluster-data/master-0/data,/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1790521920546562-17952-0/minicluster-data/master-0/wal
uuid: "4778381f375043f5b9585cbb554064f4"
format_stamp: "Formatted at 2026-09-27 15:16:18 on dist-test-slave-5s2t"
server_key: "29e0f15fa240fcf6da74fd6062e72305"
server_key_iv: "5f90a1a56f6f197ab40ff104069bfa47"
server_key_version: "encryptionkey@0"
I20260927 15:16:18.153369 7039 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1790521920546562-17952-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1790521920546562-17952-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1790521920546562-17952-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260927 15:16:18.180297 7039 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260927 15:16:18.182999 7039 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260927 15:16:18.183180 7039 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260927 15:16:18.189718 7039 rpc_server.cc:307] RPC server started. Bound to: 127.17.136.62:41119
I20260927 15:16:18.189735 7106 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.136.62:41119 every 8 connection(s)
I20260927 15:16:18.190606 7039 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1790521920546562-17952-0/minicluster-data/master-0/data/info.pb
I20260927 15:16:18.193579 7107 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:16:18.197867 17952 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu as pid 7039
I20260927 15:16:18.198002 17952 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1790521920546562-17952-0/minicluster-data/master-0/wal/instance
I20260927 15:16:18.198304 17952 external_mini_cluster.cc:1428] Setting key 03cadb75886ad6dcf05ed74a48cd092f
I20260927 15:16:18.199203 7107 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4778381f375043f5b9585cbb554064f4: Bootstrap starting.
I20260927 15:16:18.201383 7107 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 4778381f375043f5b9585cbb554064f4: Neither blocks nor log segments found. Creating new log.
I20260927 15:16:18.202208 7107 log.cc:824] T 00000000000000000000000000000000 P 4778381f375043f5b9585cbb554064f4: Log is configured to *not* fsync() on all Append() calls
I20260927 15:16:18.204123 7107 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4778381f375043f5b9585cbb554064f4: No bootstrap required, opened a new log
Sep 27 15:16:18 dist-test-slave-5s2t krb5kdc[7026](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790522177, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.136.62@KRBTEST.COM
I20260927 15:16:18.208067 7107 raft_consensus.cc:348] T 00000000000000000000000000000000 P 4778381f375043f5b9585cbb554064f4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4778381f375043f5b9585cbb554064f4" member_type: VOTER last_known_addr { host: "127.17.136.62" port: 41119 } }
I20260927 15:16:18.208282 7107 raft_consensus.cc:374] T 00000000000000000000000000000000 P 4778381f375043f5b9585cbb554064f4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:16:18.208335 7107 raft_consensus.cc:729] T 00000000000000000000000000000000 P 4778381f375043f5b9585cbb554064f4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4778381f375043f5b9585cbb554064f4, State: Initialized, Role: FOLLOWER
I20260927 15:16:18.208787 7107 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4778381f375043f5b9585cbb554064f4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4778381f375043f5b9585cbb554064f4" member_type: VOTER last_known_addr { host: "127.17.136.62" port: 41119 } }
I20260927 15:16:18.208915 7107 raft_consensus.cc:388] T 00000000000000000000000000000000 P 4778381f375043f5b9585cbb554064f4 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260927 15:16:18.208981 7107 raft_consensus.cc:482] T 00000000000000000000000000000000 P 4778381f375043f5b9585cbb554064f4 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260927 15:16:18.209072 7107 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 4778381f375043f5b9585cbb554064f4 [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:16:18.210031 7107 raft_consensus.cc:504] T 00000000000000000000000000000000 P 4778381f375043f5b9585cbb554064f4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4778381f375043f5b9585cbb554064f4" member_type: VOTER last_known_addr { host: "127.17.136.62" port: 41119 } }
I20260927 15:16:18.210371 7107 leader_election.cc:302] T 00000000000000000000000000000000 P 4778381f375043f5b9585cbb554064f4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 4778381f375043f5b9585cbb554064f4; no voters:
I20260927 15:16:18.210654 7107 leader_election.cc:288] T 00000000000000000000000000000000 P 4778381f375043f5b9585cbb554064f4 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260927 15:16:18.210762 7112 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 4778381f375043f5b9585cbb554064f4 [term 1 FOLLOWER]: Leader election won for term 1
I20260927 15:16:18.210995 7112 raft_consensus.cc:686] T 00000000000000000000000000000000 P 4778381f375043f5b9585cbb554064f4 [term 1 LEADER]: Becoming Leader. State: Replica: 4778381f375043f5b9585cbb554064f4, State: Running, Role: LEADER
I20260927 15:16:18.211334 7112 consensus_queue.cc:237] T 00000000000000000000000000000000 P 4778381f375043f5b9585cbb554064f4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4778381f375043f5b9585cbb554064f4" member_type: VOTER last_known_addr { host: "127.17.136.62" port: 41119 } }
I20260927 15:16:18.211889 7107 sys_catalog.cc:564] T 00000000000000000000000000000000 P 4778381f375043f5b9585cbb554064f4 [sys.catalog]: configured and running, proceeding with master startup.
I20260927 15:16:18.212535 7112 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4778381f375043f5b9585cbb554064f4 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4778381f375043f5b9585cbb554064f4. Latest consensus state: current_term: 1 leader_uuid: "4778381f375043f5b9585cbb554064f4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4778381f375043f5b9585cbb554064f4" member_type: VOTER last_known_addr { host: "127.17.136.62" port: 41119 } } }
I20260927 15:16:18.212662 7112 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4778381f375043f5b9585cbb554064f4 [sys.catalog]: This master's current role is: LEADER
I20260927 15:16:18.212757 7110 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:16:18.199594 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41101 (local address 127.17.136.62:41119)
0927 15:16:18.199961 (+ 367us) server_negotiation.cc:206] Beginning negotiation
0927 15:16:18.199976 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0927 15:16:18.200010 (+ 34us) server_negotiation.cc:407] Connection header received
0927 15:16:18.200615 (+ 605us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:16:18.200632 (+ 17us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:16:18.200954 (+ 322us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:16:18.201215 (+ 261us) server_negotiation.cc:226] Negotiated authn=SASL
0927 15:16:18.202044 (+ 829us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:16:18.203042 (+ 998us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:16:18.204142 (+ 1100us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:16:18.204614 (+ 472us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:16:18.204722 (+ 108us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:16:18.207454 (+ 2732us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0927 15:16:18.207460 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0927 15:16:18.207472 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0927 15:16:18.207500 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0927 15:16:18.209268 (+ 1768us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:16:18.209778 (+ 510us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:16:18.209783 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:16:18.209787 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:16:18.209903 (+ 116us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:16:18.210273 (+ 370us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:16:18.210276 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:16:18.210277 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:16:18.210723 (+ 446us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0927 15:16:18.210977 (+ 254us) server_negotiation.cc:1035] Waiting for connection context
0927 15:16:18.211317 (+ 340us) server_negotiation.cc:299] Negotiation successful
0927 15:16:18.211768 (+ 451us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":235,"thread_start_us":103,"threads_started":1}
I20260927 15:16:18.213027 7113 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4778381f375043f5b9585cbb554064f4 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "4778381f375043f5b9585cbb554064f4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4778381f375043f5b9585cbb554064f4" member_type: VOTER last_known_addr { host: "127.17.136.62" port: 41119 } } }
I20260927 15:16:18.213145 7113 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4778381f375043f5b9585cbb554064f4 [sys.catalog]: This master's current role is: LEADER
I20260927 15:16:18.217049 17952 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
W20260927 15:16:18.217103 7127 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 4778381f375043f5b9585cbb554064f4: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260927 15:16:18.217192 7127 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260927 15:16:18.217283 7121 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260927 15:16:18.218158 7121 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260927 15:16:18.223778 7121 catalog_manager.cc:1347] Generated new cluster ID: 7535630616334969bad7d9401e2a222b
I20260927 15:16:18.223912 7121 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260927 15:16:18.227782 7110 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:16:18.219243 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33447 (local address 127.17.136.62:41119)
0927 15:16:18.219363 (+ 120us) server_negotiation.cc:206] Beginning negotiation
0927 15:16:18.219368 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0927 15:16:18.219688 (+ 320us) server_negotiation.cc:407] Connection header received
0927 15:16:18.219862 (+ 174us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:16:18.219865 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:16:18.219909 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:16:18.219956 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0927 15:16:18.220884 (+ 928us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:16:18.221591 (+ 707us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:16:18.222525 (+ 934us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:16:18.222776 (+ 251us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:16:18.222861 (+ 85us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:16:18.224494 (+ 1633us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0927 15:16:18.224498 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0927 15:16:18.224501 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0927 15:16:18.224526 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0927 15:16:18.226100 (+ 1574us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:16:18.226587 (+ 487us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:16:18.226590 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:16:18.226592 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:16:18.226676 (+ 84us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:16:18.226948 (+ 272us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:16:18.226951 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:16:18.226953 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:16:18.227152 (+ 199us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0927 15:16:18.227323 (+ 171us) server_negotiation.cc:1035] Waiting for connection context
0927 15:16:18.227528 (+ 205us) server_negotiation.cc:299] Negotiation successful
0927 15:16:18.227629 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260927 15:16:18.240599 7121 catalog_manager.cc:1370] Generated new certificate authority record
I20260927 15:16:18.241483 7121 catalog_manager.cc:1504] Loading token signing keys...
I20260927 15:16:18.251418 7121 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 4778381f375043f5b9585cbb554064f4: Generated new TSK 0
I20260927 15:16:18.252375 7121 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260927 15:16:18.261368 17952 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu with pid 7039
W20260927 15:16:18.265729 7024 connection.cc:535] client connection to 127.17.136.62:41119 recv error: Network error: failed to read from TLS socket (remote: 127.17.136.62:41119): Connection reset by peer (error 104)
2026-09-27T15:16:18Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/12 (1301 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/13
Loading random data
Initializing database '/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1790521920546562-17952-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 27 15:16:18 dist-test-slave-5s2t krb5kdc[7138](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 27 15:16:18 dist-test-slave-5s2t krb5kdc[7138](info): set up 2 sockets
Sep 27 15:16:18 dist-test-slave-5s2t krb5kdc[7138](info): commencing operation
krb5kdc: starting...
W20260927 15:16:19.215148 17952 mini_kdc.cc:121] Time spent starting KDC: real 0.936s user 0.003s sys 0.003s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1790521920546562-17952-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1790521920546562-17952-0/krb5kdc/test-user.keytab.
Sep 27 15:16:19 dist-test-slave-5s2t krb5kdc[7138](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790522179, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-27T15:16:19Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-27T15:16:19Z Disabled control of system clock
WARNING: no policy specified for kudu/127.17.136.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.136.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.136.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1790521920546562-17952-0/krb5kdc/kudu_127.17.136.62.keytab.
Entry for principal kudu/127.17.136.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1790521920546562-17952-0/krb5kdc/kudu_127.17.136.62.keytab.
I20260927 15:16:19.325997 17952 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu
/tmp/dist-test-taskiFOyeW/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1790521920546562-17952-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1790521920546562-17952-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1790521920546562-17952-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1790521920546562-17952-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.136.62:32943
--webserver_interface=127.17.136.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1790521920546562-17952-0/krb5kdc/kudu_127.17.136.62.keytab
--principal=kudu/127.17.136.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.136.20:40665
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.136.62:32943
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1790521920546562-17952-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1790521920546562-17952-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1790521920546562-17952-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260927 15:16:19.432431 7151 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260927 15:16:19.432701 7151 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260927 15:16:19.432744 7151 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260927 15:16:19.436689 7151 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260927 15:16:19.436754 7151 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260927 15:16:19.436777 7151 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260927 15:16:19.436797 7151 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260927 15:16:19.436831 7151 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260927 15:16:19.442065 7151 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.136.20:40665
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1790521920546562-17952-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1790521920546562-17952-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.17.136.62:32943
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1790521920546562-17952-0/krb5kdc/kudu_127.17.136.62.keytab
--principal=kudu/127.17.136.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.136.62:32943
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1790521920546562-17952-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.17.136.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7151
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1790521920546562-17952-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 27 Sep 2026 14:27:13 UTC on ccycloud.quasar-psqrth.root.comops.site
build id 4676138
I20260927 15:16:19.443030 7151 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260927 15:16:19.444002 7151 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260927 15:16:19.452325 7151 server_base.cc:1034] running on GCE node
W20260927 15:16:19.452266 7157 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260927 15:16:19.452244 7156 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260927 15:16:19.452239 7159 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260927 15:16:19.453012 7151 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260927 15:16:19.454044 7151 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260927 15:16:19.455199 7151 hybrid_clock.cc:648] HybridClock initialized: now 1790522179455186 us; error 25 us; skew 500 ppm
Sep 27 15:16:19 dist-test-slave-5s2t krb5kdc[7138](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790522179, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.136.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260927 15:16:19.469034 7151 init.cc:377] Logged in from keytab as kudu/127.17.136.62@KRBTEST.COM (short username kudu)
I20260927 15:16:19.469951 7151 webserver.cc:460] Webserver started at http://127.17.136.62:33263/ using document root <none> and password file <none>
I20260927 15:16:19.470481 7151 fs_manager.cc:359] Metadata directory not provided
I20260927 15:16:19.470546 7151 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260927 15:16:19.470769 7151 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260927 15:16:19.472815 7151 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1790521920546562-17952-0/minicluster-data/master-0/data/instance:
uuid: "a996cbac3a8a4e149b9935f702455554"
format_stamp: "Formatted at 2026-09-27 15:16:19 on dist-test-slave-5s2t"
server_key: "8dabba2fc82f4aed1f095a14a45d9c9b"
server_key_iv: "e0462b2eb3bedbc729b22cafbb0fe894"
server_key_version: "encryptionkey@0"
I20260927 15:16:19.473309 7151 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1790521920546562-17952-0/minicluster-data/master-0/wal/instance:
uuid: "a996cbac3a8a4e149b9935f702455554"
format_stamp: "Formatted at 2026-09-27 15:16:19 on dist-test-slave-5s2t"
server_key: "8dabba2fc82f4aed1f095a14a45d9c9b"
server_key_iv: "e0462b2eb3bedbc729b22cafbb0fe894"
server_key_version: "encryptionkey@0"
I20260927 15:16:19.476737 7151 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.001s
I20260927 15:16:19.478878 7166 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260927 15:16:19.480033 7151 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260927 15:16:19.480151 7151 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1790521920546562-17952-0/minicluster-data/master-0/data,/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1790521920546562-17952-0/minicluster-data/master-0/wal
uuid: "a996cbac3a8a4e149b9935f702455554"
format_stamp: "Formatted at 2026-09-27 15:16:19 on dist-test-slave-5s2t"
server_key: "8dabba2fc82f4aed1f095a14a45d9c9b"
server_key_iv: "e0462b2eb3bedbc729b22cafbb0fe894"
server_key_version: "encryptionkey@0"
I20260927 15:16:19.480237 7151 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1790521920546562-17952-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1790521920546562-17952-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1790521920546562-17952-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260927 15:16:19.494746 7151 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260927 15:16:19.497709 7151 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260927 15:16:19.497877 7151 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260927 15:16:19.504390 7151 rpc_server.cc:307] RPC server started. Bound to: 127.17.136.62:32943
I20260927 15:16:19.504402 7218 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.136.62:32943 every 8 connection(s)
I20260927 15:16:19.505272 7151 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1790521920546562-17952-0/minicluster-data/master-0/data/info.pb
I20260927 15:16:19.507877 7219 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:16:19.511427 17952 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu as pid 7151
I20260927 15:16:19.511561 17952 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1790521920546562-17952-0/minicluster-data/master-0/wal/instance
I20260927 15:16:19.511868 17952 external_mini_cluster.cc:1428] Setting key a7819005e20560c73523703e8e77b6b1
I20260927 15:16:19.513502 7219 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a996cbac3a8a4e149b9935f702455554: Bootstrap starting.
I20260927 15:16:19.515719 7219 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a996cbac3a8a4e149b9935f702455554: Neither blocks nor log segments found. Creating new log.
I20260927 15:16:19.516405 7219 log.cc:824] T 00000000000000000000000000000000 P a996cbac3a8a4e149b9935f702455554: Log is configured to *not* fsync() on all Append() calls
I20260927 15:16:19.518307 7219 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a996cbac3a8a4e149b9935f702455554: No bootstrap required, opened a new log
I20260927 15:16:19.520473 7222 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:16:19.513243 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51633 (local address 127.17.136.62:32943)
0927 15:16:19.513659 (+ 416us) server_negotiation.cc:206] Beginning negotiation
0927 15:16:19.513675 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0927 15:16:19.513710 (+ 35us) server_negotiation.cc:407] Connection header received
0927 15:16:19.514310 (+ 600us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:16:19.514326 (+ 16us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:16:19.514648 (+ 322us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:16:19.514916 (+ 268us) server_negotiation.cc:226] Negotiated authn=SASL
0927 15:16:19.515264 (+ 348us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:16:19.516257 (+ 993us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:16:19.517253 (+ 996us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:16:19.517707 (+ 454us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:16:19.517817 (+ 110us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:16:19.518656 (+ 839us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0927 15:16:19.518661 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0927 15:16:19.518673 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0927 15:16:19.519032 (+ 359us) server_negotiation.cc:922] calling sasl_server_start()
0927 15:16:19.519107 (+ 75us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0927 15:16:19.519130 (+ 23us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0927 15:16:19.519225 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0927 15:16:19.519425 (+ 200us) server_negotiation.cc:299] Negotiation successful
0927 15:16:19.519552 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":268,"thread_start_us":123,"threads_started":1}
I20260927 15:16:19.521324 7219 raft_consensus.cc:348] T 00000000000000000000000000000000 P a996cbac3a8a4e149b9935f702455554 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a996cbac3a8a4e149b9935f702455554" member_type: VOTER last_known_addr { host: "127.17.136.62" port: 32943 } }
I20260927 15:16:19.521528 7219 raft_consensus.cc:374] T 00000000000000000000000000000000 P a996cbac3a8a4e149b9935f702455554 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:16:19.521588 7219 raft_consensus.cc:729] T 00000000000000000000000000000000 P a996cbac3a8a4e149b9935f702455554 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a996cbac3a8a4e149b9935f702455554, State: Initialized, Role: FOLLOWER
I20260927 15:16:19.521976 7219 consensus_queue.cc:260] T 00000000000000000000000000000000 P a996cbac3a8a4e149b9935f702455554 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a996cbac3a8a4e149b9935f702455554" member_type: VOTER last_known_addr { host: "127.17.136.62" port: 32943 } }
I20260927 15:16:19.522099 7219 raft_consensus.cc:388] T 00000000000000000000000000000000 P a996cbac3a8a4e149b9935f702455554 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260927 15:16:19.522202 7219 raft_consensus.cc:482] T 00000000000000000000000000000000 P a996cbac3a8a4e149b9935f702455554 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260927 15:16:19.522306 7219 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a996cbac3a8a4e149b9935f702455554 [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:16:19.523218 17952 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260927 15:16:19.523242 7219 raft_consensus.cc:504] T 00000000000000000000000000000000 P a996cbac3a8a4e149b9935f702455554 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a996cbac3a8a4e149b9935f702455554" member_type: VOTER last_known_addr { host: "127.17.136.62" port: 32943 } }
I20260927 15:16:19.523586 7219 leader_election.cc:302] T 00000000000000000000000000000000 P a996cbac3a8a4e149b9935f702455554 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a996cbac3a8a4e149b9935f702455554; no voters:
I20260927 15:16:19.523862 7219 leader_election.cc:288] T 00000000000000000000000000000000 P a996cbac3a8a4e149b9935f702455554 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260927 15:16:19.523929 7224 raft_consensus.cc:2781] T 00000000000000000000000000000000 P a996cbac3a8a4e149b9935f702455554 [term 1 FOLLOWER]: Leader election won for term 1
I20260927 15:16:19.524103 7224 raft_consensus.cc:686] T 00000000000000000000000000000000 P a996cbac3a8a4e149b9935f702455554 [term 1 LEADER]: Becoming Leader. State: Replica: a996cbac3a8a4e149b9935f702455554, State: Running, Role: LEADER
I20260927 15:16:19.524444 7224 consensus_queue.cc:237] T 00000000000000000000000000000000 P a996cbac3a8a4e149b9935f702455554 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a996cbac3a8a4e149b9935f702455554" member_type: VOTER last_known_addr { host: "127.17.136.62" port: 32943 } }
I20260927 15:16:19.525097 7219 sys_catalog.cc:564] T 00000000000000000000000000000000 P a996cbac3a8a4e149b9935f702455554 [sys.catalog]: configured and running, proceeding with master startup.
I20260927 15:16:19.526062 7225 sys_catalog.cc:455] T 00000000000000000000000000000000 P a996cbac3a8a4e149b9935f702455554 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "a996cbac3a8a4e149b9935f702455554" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a996cbac3a8a4e149b9935f702455554" member_type: VOTER last_known_addr { host: "127.17.136.62" port: 32943 } } }
I20260927 15:16:19.526190 7225 sys_catalog.cc:458] T 00000000000000000000000000000000 P a996cbac3a8a4e149b9935f702455554 [sys.catalog]: This master's current role is: LEADER
I20260927 15:16:19.526466 7226 sys_catalog.cc:455] T 00000000000000000000000000000000 P a996cbac3a8a4e149b9935f702455554 [sys.catalog]: SysCatalogTable state changed. Reason: New leader a996cbac3a8a4e149b9935f702455554. Latest consensus state: current_term: 1 leader_uuid: "a996cbac3a8a4e149b9935f702455554" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a996cbac3a8a4e149b9935f702455554" member_type: VOTER last_known_addr { host: "127.17.136.62" port: 32943 } } }
I20260927 15:16:19.526541 7238 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260927 15:16:19.526546 7226 sys_catalog.cc:458] T 00000000000000000000000000000000 P a996cbac3a8a4e149b9935f702455554 [sys.catalog]: This master's current role is: LEADER
I20260927 15:16:19.529611 7238 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260927 15:16:19.530200 7222 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:16:19.525161 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44197 (local address 127.17.136.62:32943)
0927 15:16:19.525262 (+ 101us) server_negotiation.cc:206] Beginning negotiation
0927 15:16:19.525266 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0927 15:16:19.525457 (+ 191us) server_negotiation.cc:407] Connection header received
0927 15:16:19.525666 (+ 209us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:16:19.525669 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:16:19.525713 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:16:19.525794 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0927 15:16:19.526228 (+ 434us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:16:19.526973 (+ 745us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:16:19.528134 (+ 1161us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:16:19.528449 (+ 315us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:16:19.528537 (+ 88us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:16:19.529487 (+ 950us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0927 15:16:19.529491 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0927 15:16:19.529494 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0927 15:16:19.529507 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0927 15:16:19.529533 (+ 26us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0927 15:16:19.529548 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0927 15:16:19.529651 (+ 103us) server_negotiation.cc:1035] Waiting for connection context
0927 15:16:19.530024 (+ 373us) server_negotiation.cc:299] Negotiation successful
0927 15:16:19.530060 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260927 15:16:19.534837 7238 catalog_manager.cc:1347] Generated new cluster ID: 4ce6e6c745b94599a90042f490a26f46
I20260927 15:16:19.534899 7238 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260927 15:16:19.549933 7238 catalog_manager.cc:1370] Generated new certificate authority record
I20260927 15:16:19.550832 7238 catalog_manager.cc:1504] Loading token signing keys...
I20260927 15:16:19.567804 7238 catalog_manager.cc:5868] T 00000000000000000000000000000000 P a996cbac3a8a4e149b9935f702455554: Generated new TSK 0
I20260927 15:16:19.568472 7238 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260927 15:16:19.577898 17952 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu with pid 7151
W20260927 15:16:19.582639 7136 connection.cc:535] client connection to 127.17.136.62:32943 recv error: Network error: failed to read from TLS socket (remote: 127.17.136.62:32943): Connection reset by peer (error 104)
2026-09-27T15:16:19Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/13 (1316 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/14
Loading random data
Initializing database '/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1790521920546562-17952-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 27 15:16:19 dist-test-slave-5s2t krb5kdc[7250](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 27 15:16:19 dist-test-slave-5s2t krb5kdc[7250](info): set up 2 sockets
Sep 27 15:16:19 dist-test-slave-5s2t krb5kdc[7250](info): commencing operation
krb5kdc: starting...
W20260927 15:16:20.523135 17952 mini_kdc.cc:121] Time spent starting KDC: real 0.927s user 0.003s sys 0.002s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1790521920546562-17952-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1790521920546562-17952-0/krb5kdc/test-user.keytab.
Sep 27 15:16:20 dist-test-slave-5s2t krb5kdc[7250](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790522180, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-27T15:16:20Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-27T15:16:20Z Disabled control of system clock
WARNING: no policy specified for kudu/127.17.136.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.136.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.136.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1790521920546562-17952-0/krb5kdc/kudu_127.17.136.62.keytab.
Entry for principal kudu/127.17.136.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1790521920546562-17952-0/krb5kdc/kudu_127.17.136.62.keytab.
I20260927 15:16:20.633733 17952 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu
/tmp/dist-test-taskiFOyeW/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1790521920546562-17952-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1790521920546562-17952-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1790521920546562-17952-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1790521920546562-17952-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.136.62:33773
--webserver_interface=127.17.136.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1790521920546562-17952-0/krb5kdc/kudu_127.17.136.62.keytab
--principal=kudu/127.17.136.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.136.20:39145
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.136.62:33773
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1790521920546562-17952-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1790521920546562-17952-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1790521920546562-17952-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260927 15:16:20.737468 7263 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260927 15:16:20.737730 7263 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260927 15:16:20.737771 7263 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260927 15:16:20.741709 7263 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260927 15:16:20.741762 7263 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260927 15:16:20.741780 7263 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260927 15:16:20.741796 7263 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260927 15:16:20.741815 7263 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260927 15:16:20.746917 7263 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.136.20:39145
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1790521920546562-17952-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1790521920546562-17952-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.17.136.62:33773
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1790521920546562-17952-0/krb5kdc/kudu_127.17.136.62.keytab
--principal=kudu/127.17.136.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.136.62:33773
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1790521920546562-17952-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.17.136.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7263
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1790521920546562-17952-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 27 Sep 2026 14:27:13 UTC on ccycloud.quasar-psqrth.root.comops.site
build id 4676138
I20260927 15:16:20.747932 7263 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260927 15:16:20.748872 7263 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260927 15:16:20.756891 7269 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260927 15:16:20.756903 7268 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260927 15:16:20.757025 7263 server_base.cc:1034] running on GCE node
W20260927 15:16:20.756896 7271 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260927 15:16:20.757648 7263 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260927 15:16:20.758701 7263 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260927 15:16:20.759851 7263 hybrid_clock.cc:648] HybridClock initialized: now 1790522180759832 us; error 33 us; skew 500 ppm
Sep 27 15:16:20 dist-test-slave-5s2t krb5kdc[7250](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790522180, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.136.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260927 15:16:20.762316 7263 init.cc:377] Logged in from keytab as kudu/127.17.136.62@KRBTEST.COM (short username kudu)
I20260927 15:16:20.763064 7263 webserver.cc:460] Webserver started at http://127.17.136.62:38015/ using document root <none> and password file <none>
I20260927 15:16:20.763577 7263 fs_manager.cc:359] Metadata directory not provided
I20260927 15:16:20.763634 7263 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260927 15:16:20.763789 7263 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260927 15:16:20.765622 7263 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1790521920546562-17952-0/minicluster-data/master-0/data/instance:
uuid: "81e16f2f7e02439bb58e6ca1ed65417d"
format_stamp: "Formatted at 2026-09-27 15:16:20 on dist-test-slave-5s2t"
server_key: "cfa2f9caf2c00ead539e05ca86483080"
server_key_iv: "0065431f404d6591fc664efdc423de51"
server_key_version: "encryptionkey@0"
I20260927 15:16:20.766093 7263 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1790521920546562-17952-0/minicluster-data/master-0/wal/instance:
uuid: "81e16f2f7e02439bb58e6ca1ed65417d"
format_stamp: "Formatted at 2026-09-27 15:16:20 on dist-test-slave-5s2t"
server_key: "cfa2f9caf2c00ead539e05ca86483080"
server_key_iv: "0065431f404d6591fc664efdc423de51"
server_key_version: "encryptionkey@0"
I20260927 15:16:20.769424 7263 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260927 15:16:20.771631 7278 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260927 15:16:20.772738 7263 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260927 15:16:20.772835 7263 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1790521920546562-17952-0/minicluster-data/master-0/data,/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1790521920546562-17952-0/minicluster-data/master-0/wal
uuid: "81e16f2f7e02439bb58e6ca1ed65417d"
format_stamp: "Formatted at 2026-09-27 15:16:20 on dist-test-slave-5s2t"
server_key: "cfa2f9caf2c00ead539e05ca86483080"
server_key_iv: "0065431f404d6591fc664efdc423de51"
server_key_version: "encryptionkey@0"
I20260927 15:16:20.772927 7263 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1790521920546562-17952-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1790521920546562-17952-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1790521920546562-17952-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260927 15:16:20.777217 7263 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260927 15:16:20.780090 7263 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260927 15:16:20.780241 7263 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260927 15:16:20.786758 7263 rpc_server.cc:307] RPC server started. Bound to: 127.17.136.62:33773
I20260927 15:16:20.786813 7330 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.136.62:33773 every 8 connection(s)
I20260927 15:16:20.787731 7263 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1790521920546562-17952-0/minicluster-data/master-0/data/info.pb
I20260927 15:16:20.788383 17952 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu as pid 7263
I20260927 15:16:20.788533 17952 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1790521920546562-17952-0/minicluster-data/master-0/wal/instance
I20260927 15:16:20.788834 17952 external_mini_cluster.cc:1428] Setting key e588d3e0d8ea248779b42fe0ac621aaa
I20260927 15:16:20.790741 7331 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:16:20.793845 7334 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:16:20.790104 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52313 (local address 127.17.136.62:33773)
0927 15:16:20.790481 (+ 377us) server_negotiation.cc:206] Beginning negotiation
0927 15:16:20.790498 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0927 15:16:20.790693 (+ 195us) server_negotiation.cc:407] Connection header received
0927 15:16:20.791461 (+ 768us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:16:20.791478 (+ 17us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:16:20.791751 (+ 273us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:16:20.792047 (+ 296us) server_negotiation.cc:226] Negotiated authn=SASL
0927 15:16:20.792775 (+ 728us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0927 15:16:20.792780 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0927 15:16:20.792791 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0927 15:16:20.792801 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0927 15:16:20.792852 (+ 51us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0927 15:16:20.792869 (+ 17us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0927 15:16:20.792987 (+ 118us) server_negotiation.cc:1035] Waiting for connection context
0927 15:16:20.793053 (+ 66us) server_negotiation.cc:299] Negotiation successful
0927 15:16:20.793208 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":239,"thread_start_us":101,"threads_started":1}
I20260927 15:16:20.796546 17952 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260927 15:16:20.796622 7331 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 81e16f2f7e02439bb58e6ca1ed65417d: Bootstrap starting.
I20260927 15:16:20.798799 7331 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 81e16f2f7e02439bb58e6ca1ed65417d: Neither blocks nor log segments found. Creating new log.
I20260927 15:16:20.799525 7331 log.cc:824] T 00000000000000000000000000000000 P 81e16f2f7e02439bb58e6ca1ed65417d: Log is configured to *not* fsync() on all Append() calls
I20260927 15:16:20.800668 7334 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:16:20.798415 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52239 (local address 127.17.136.62:33773)
0927 15:16:20.798532 (+ 117us) server_negotiation.cc:206] Beginning negotiation
0927 15:16:20.798536 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0927 15:16:20.799497 (+ 961us) server_negotiation.cc:407] Connection header received
0927 15:16:20.799597 (+ 100us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:16:20.799600 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:16:20.799636 (+ 36us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:16:20.799707 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0927 15:16:20.800338 (+ 631us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0927 15:16:20.800341 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0927 15:16:20.800344 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0927 15:16:20.800355 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0927 15:16:20.800380 (+ 25us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0927 15:16:20.800392 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0927 15:16:20.800481 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0927 15:16:20.800525 (+ 44us) server_negotiation.cc:299] Negotiation successful
0927 15:16:20.800558 (+ 33us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260927 15:16:20.801440 7331 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 81e16f2f7e02439bb58e6ca1ed65417d: No bootstrap required, opened a new log
I20260927 15:16:20.804767 7331 raft_consensus.cc:348] T 00000000000000000000000000000000 P 81e16f2f7e02439bb58e6ca1ed65417d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "81e16f2f7e02439bb58e6ca1ed65417d" member_type: VOTER last_known_addr { host: "127.17.136.62" port: 33773 } }
I20260927 15:16:20.804978 7331 raft_consensus.cc:374] T 00000000000000000000000000000000 P 81e16f2f7e02439bb58e6ca1ed65417d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:16:20.805033 7331 raft_consensus.cc:729] T 00000000000000000000000000000000 P 81e16f2f7e02439bb58e6ca1ed65417d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 81e16f2f7e02439bb58e6ca1ed65417d, State: Initialized, Role: FOLLOWER
I20260927 15:16:20.805459 7331 consensus_queue.cc:260] T 00000000000000000000000000000000 P 81e16f2f7e02439bb58e6ca1ed65417d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "81e16f2f7e02439bb58e6ca1ed65417d" member_type: VOTER last_known_addr { host: "127.17.136.62" port: 33773 } }
I20260927 15:16:20.805581 7331 raft_consensus.cc:388] T 00000000000000000000000000000000 P 81e16f2f7e02439bb58e6ca1ed65417d [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260927 15:16:20.805640 7331 raft_consensus.cc:482] T 00000000000000000000000000000000 P 81e16f2f7e02439bb58e6ca1ed65417d [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260927 15:16:20.805732 7331 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 81e16f2f7e02439bb58e6ca1ed65417d [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:16:20.806545 7331 raft_consensus.cc:504] T 00000000000000000000000000000000 P 81e16f2f7e02439bb58e6ca1ed65417d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "81e16f2f7e02439bb58e6ca1ed65417d" member_type: VOTER last_known_addr { host: "127.17.136.62" port: 33773 } }
I20260927 15:16:20.806850 7331 leader_election.cc:302] T 00000000000000000000000000000000 P 81e16f2f7e02439bb58e6ca1ed65417d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 81e16f2f7e02439bb58e6ca1ed65417d; no voters:
I20260927 15:16:20.807113 7331 leader_election.cc:288] T 00000000000000000000000000000000 P 81e16f2f7e02439bb58e6ca1ed65417d [CANDIDATE]: Term 1 election: Requested vote from peers
I20260927 15:16:20.807204 7341 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 81e16f2f7e02439bb58e6ca1ed65417d [term 1 FOLLOWER]: Leader election won for term 1
I20260927 15:16:20.807415 7341 raft_consensus.cc:686] T 00000000000000000000000000000000 P 81e16f2f7e02439bb58e6ca1ed65417d [term 1 LEADER]: Becoming Leader. State: Replica: 81e16f2f7e02439bb58e6ca1ed65417d, State: Running, Role: LEADER
I20260927 15:16:20.807732 7341 consensus_queue.cc:237] T 00000000000000000000000000000000 P 81e16f2f7e02439bb58e6ca1ed65417d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "81e16f2f7e02439bb58e6ca1ed65417d" member_type: VOTER last_known_addr { host: "127.17.136.62" port: 33773 } }
I20260927 15:16:20.808197 7331 sys_catalog.cc:564] T 00000000000000000000000000000000 P 81e16f2f7e02439bb58e6ca1ed65417d [sys.catalog]: configured and running, proceeding with master startup.
I20260927 15:16:20.809290 7343 sys_catalog.cc:455] T 00000000000000000000000000000000 P 81e16f2f7e02439bb58e6ca1ed65417d [sys.catalog]: SysCatalogTable state changed. Reason: New leader 81e16f2f7e02439bb58e6ca1ed65417d. Latest consensus state: current_term: 1 leader_uuid: "81e16f2f7e02439bb58e6ca1ed65417d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "81e16f2f7e02439bb58e6ca1ed65417d" member_type: VOTER last_known_addr { host: "127.17.136.62" port: 33773 } } }
I20260927 15:16:20.809290 7342 sys_catalog.cc:455] T 00000000000000000000000000000000 P 81e16f2f7e02439bb58e6ca1ed65417d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "81e16f2f7e02439bb58e6ca1ed65417d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "81e16f2f7e02439bb58e6ca1ed65417d" member_type: VOTER last_known_addr { host: "127.17.136.62" port: 33773 } } }
I20260927 15:16:20.809433 7342 sys_catalog.cc:458] T 00000000000000000000000000000000 P 81e16f2f7e02439bb58e6ca1ed65417d [sys.catalog]: This master's current role is: LEADER
I20260927 15:16:20.809688 7343 sys_catalog.cc:458] T 00000000000000000000000000000000 P 81e16f2f7e02439bb58e6ca1ed65417d [sys.catalog]: This master's current role is: LEADER
I20260927 15:16:20.809814 7351 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260927 15:16:20.812618 7351 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260927 15:16:20.817271 7351 catalog_manager.cc:1347] Generated new cluster ID: 31b7cbc640204f91b33377f4668ec825
I20260927 15:16:20.817335 7351 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260927 15:16:20.844254 7351 catalog_manager.cc:1370] Generated new certificate authority record
I20260927 15:16:20.844585 7351 catalog_manager.cc:1504] Loading token signing keys...
I20260927 15:16:20.851894 7351 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 81e16f2f7e02439bb58e6ca1ed65417d: Generated new TSK 0
I20260927 15:16:20.852706 7351 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260927 15:16:20.857402 17952 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu with pid 7263
2026-09-27T15:16:20Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/14 (1279 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/15
Loading random data
Initializing database '/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1790521920546562-17952-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 27 15:16:20 dist-test-slave-5s2t krb5kdc[7362](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 27 15:16:20 dist-test-slave-5s2t krb5kdc[7362](info): set up 2 sockets
Sep 27 15:16:20 dist-test-slave-5s2t krb5kdc[7362](info): commencing operation
krb5kdc: starting...
W20260927 15:16:21.811096 17952 mini_kdc.cc:121] Time spent starting KDC: real 0.935s user 0.005s sys 0.000s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1790521920546562-17952-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1790521920546562-17952-0/krb5kdc/test-user.keytab.
Sep 27 15:16:21 dist-test-slave-5s2t krb5kdc[7362](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790522181, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-27T15:16:21Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-27T15:16:21Z Disabled control of system clock
WARNING: no policy specified for kudu/127.17.136.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.136.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.136.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1790521920546562-17952-0/krb5kdc/kudu_127.17.136.62.keytab.
Entry for principal kudu/127.17.136.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1790521920546562-17952-0/krb5kdc/kudu_127.17.136.62.keytab.
I20260927 15:16:21.921664 17952 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu
/tmp/dist-test-taskiFOyeW/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1790521920546562-17952-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1790521920546562-17952-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1790521920546562-17952-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1790521920546562-17952-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.136.62:36949
--webserver_interface=127.17.136.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1790521920546562-17952-0/krb5kdc/kudu_127.17.136.62.keytab
--principal=kudu/127.17.136.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.136.20:34113
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.136.62:36949
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1790521920546562-17952-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1790521920546562-17952-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1790521920546562-17952-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260927 15:16:22.029152 7375 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260927 15:16:22.029404 7375 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260927 15:16:22.029461 7375 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260927 15:16:22.033461 7375 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260927 15:16:22.033516 7375 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260927 15:16:22.033542 7375 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260927 15:16:22.033563 7375 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260927 15:16:22.033588 7375 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260927 15:16:22.038689 7375 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.136.20:34113
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1790521920546562-17952-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1790521920546562-17952-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.17.136.62:36949
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1790521920546562-17952-0/krb5kdc/kudu_127.17.136.62.keytab
--principal=kudu/127.17.136.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.136.62:36949
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1790521920546562-17952-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.17.136.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7375
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1790521920546562-17952-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 27 Sep 2026 14:27:13 UTC on ccycloud.quasar-psqrth.root.comops.site
build id 4676138
I20260927 15:16:22.039710 7375 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260927 15:16:22.040663 7375 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260927 15:16:22.048449 7383 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260927 15:16:22.048449 7381 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260927 15:16:22.048503 7380 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260927 15:16:22.048527 7375 server_base.cc:1034] running on GCE node
I20260927 15:16:22.049250 7375 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260927 15:16:22.050297 7375 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260927 15:16:22.051445 7375 hybrid_clock.cc:648] HybridClock initialized: now 1790522182051428 us; error 30 us; skew 500 ppm
Sep 27 15:16:22 dist-test-slave-5s2t krb5kdc[7362](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790522182, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.136.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260927 15:16:22.054020 7375 init.cc:377] Logged in from keytab as kudu/127.17.136.62@KRBTEST.COM (short username kudu)
I20260927 15:16:22.054870 7375 webserver.cc:460] Webserver started at http://127.17.136.62:46457/ using document root <none> and password file <none>
I20260927 15:16:22.055428 7375 fs_manager.cc:359] Metadata directory not provided
I20260927 15:16:22.055495 7375 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260927 15:16:22.055660 7375 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260927 15:16:22.057705 7375 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1790521920546562-17952-0/minicluster-data/master-0/data/instance:
uuid: "8d986b35730f49169f1e3df5eff25cef"
format_stamp: "Formatted at 2026-09-27 15:16:22 on dist-test-slave-5s2t"
server_key: "477376c9bfd67e95ce6cf0cd3247205b"
server_key_iv: "17a1222d532ac5700fe7d6ff949493d0"
server_key_version: "encryptionkey@0"
I20260927 15:16:22.058238 7375 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1790521920546562-17952-0/minicluster-data/master-0/wal/instance:
uuid: "8d986b35730f49169f1e3df5eff25cef"
format_stamp: "Formatted at 2026-09-27 15:16:22 on dist-test-slave-5s2t"
server_key: "477376c9bfd67e95ce6cf0cd3247205b"
server_key_iv: "17a1222d532ac5700fe7d6ff949493d0"
server_key_version: "encryptionkey@0"
I20260927 15:16:22.061795 7375 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.006s sys 0.000s
I20260927 15:16:22.064193 7390 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260927 15:16:22.065389 7375 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260927 15:16:22.065485 7375 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1790521920546562-17952-0/minicluster-data/master-0/data,/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1790521920546562-17952-0/minicluster-data/master-0/wal
uuid: "8d986b35730f49169f1e3df5eff25cef"
format_stamp: "Formatted at 2026-09-27 15:16:22 on dist-test-slave-5s2t"
server_key: "477376c9bfd67e95ce6cf0cd3247205b"
server_key_iv: "17a1222d532ac5700fe7d6ff949493d0"
server_key_version: "encryptionkey@0"
I20260927 15:16:22.065579 7375 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1790521920546562-17952-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1790521920546562-17952-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1790521920546562-17952-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260927 15:16:22.082535 7375 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260927 15:16:22.085268 7375 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260927 15:16:22.085409 7375 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260927 15:16:22.091907 7375 rpc_server.cc:307] RPC server started. Bound to: 127.17.136.62:36949
I20260927 15:16:22.091920 7442 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.136.62:36949 every 8 connection(s)
I20260927 15:16:22.092810 7375 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1790521920546562-17952-0/minicluster-data/master-0/data/info.pb
I20260927 15:16:22.095561 7443 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:16:22.096546 17952 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu as pid 7375
I20260927 15:16:22.096653 17952 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1790521920546562-17952-0/minicluster-data/master-0/wal/instance
I20260927 15:16:22.096911 17952 external_mini_cluster.cc:1428] Setting key 6d595ce395fc54bfe446dae7186d0a71
I20260927 15:16:22.101800 7443 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8d986b35730f49169f1e3df5eff25cef: Bootstrap starting.
I20260927 15:16:22.104272 7443 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 8d986b35730f49169f1e3df5eff25cef: Neither blocks nor log segments found. Creating new log.
I20260927 15:16:22.104952 7443 log.cc:824] T 00000000000000000000000000000000 P 8d986b35730f49169f1e3df5eff25cef: Log is configured to *not* fsync() on all Append() calls
Sep 27 15:16:22 dist-test-slave-5s2t krb5kdc[7362](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790522181, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.136.62@KRBTEST.COM
I20260927 15:16:22.106890 7443 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8d986b35730f49169f1e3df5eff25cef: No bootstrap required, opened a new log
I20260927 15:16:22.111181 7443 raft_consensus.cc:348] T 00000000000000000000000000000000 P 8d986b35730f49169f1e3df5eff25cef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8d986b35730f49169f1e3df5eff25cef" member_type: VOTER last_known_addr { host: "127.17.136.62" port: 36949 } }
I20260927 15:16:22.111467 7446 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:16:22.098175 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57891 (local address 127.17.136.62:36949)
0927 15:16:22.098584 (+ 409us) server_negotiation.cc:206] Beginning negotiation
0927 15:16:22.098612 (+ 28us) server_negotiation.cc:399] Waiting for connection header
0927 15:16:22.098736 (+ 124us) server_negotiation.cc:407] Connection header received
0927 15:16:22.099564 (+ 828us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:16:22.099597 (+ 33us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:16:22.100024 (+ 427us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:16:22.100391 (+ 367us) server_negotiation.cc:226] Negotiated authn=SASL
0927 15:16:22.101101 (+ 710us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:16:22.102484 (+ 1383us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:16:22.103443 (+ 959us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:16:22.104099 (+ 656us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:16:22.104258 (+ 159us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:16:22.106705 (+ 2447us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0927 15:16:22.106711 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0927 15:16:22.106726 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0927 15:16:22.106754 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0927 15:16:22.108576 (+ 1822us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:16:22.108991 (+ 415us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:16:22.108997 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:16:22.109003 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:16:22.109149 (+ 146us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:16:22.109365 (+ 216us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:16:22.109368 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:16:22.109370 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:16:22.109846 (+ 476us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0927 15:16:22.110050 (+ 204us) server_negotiation.cc:1035] Waiting for connection context
0927 15:16:22.110217 (+ 167us) server_negotiation.cc:299] Negotiation successful
0927 15:16:22.110500 (+ 283us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":254,"thread_start_us":98,"threads_started":1}
I20260927 15:16:22.111451 7443 raft_consensus.cc:374] T 00000000000000000000000000000000 P 8d986b35730f49169f1e3df5eff25cef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:16:22.111562 7443 raft_consensus.cc:729] T 00000000000000000000000000000000 P 8d986b35730f49169f1e3df5eff25cef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8d986b35730f49169f1e3df5eff25cef, State: Initialized, Role: FOLLOWER
I20260927 15:16:22.111956 7443 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8d986b35730f49169f1e3df5eff25cef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8d986b35730f49169f1e3df5eff25cef" member_type: VOTER last_known_addr { host: "127.17.136.62" port: 36949 } }
I20260927 15:16:22.112083 7443 raft_consensus.cc:388] T 00000000000000000000000000000000 P 8d986b35730f49169f1e3df5eff25cef [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260927 15:16:22.112155 7443 raft_consensus.cc:482] T 00000000000000000000000000000000 P 8d986b35730f49169f1e3df5eff25cef [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260927 15:16:22.112249 7443 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 8d986b35730f49169f1e3df5eff25cef [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:16:22.113220 7443 raft_consensus.cc:504] T 00000000000000000000000000000000 P 8d986b35730f49169f1e3df5eff25cef [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8d986b35730f49169f1e3df5eff25cef" member_type: VOTER last_known_addr { host: "127.17.136.62" port: 36949 } }
I20260927 15:16:22.113574 7443 leader_election.cc:302] T 00000000000000000000000000000000 P 8d986b35730f49169f1e3df5eff25cef [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 8d986b35730f49169f1e3df5eff25cef; no voters:
I20260927 15:16:22.113902 7443 leader_election.cc:288] T 00000000000000000000000000000000 P 8d986b35730f49169f1e3df5eff25cef [CANDIDATE]: Term 1 election: Requested vote from peers
I20260927 15:16:22.113950 7448 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 8d986b35730f49169f1e3df5eff25cef [term 1 FOLLOWER]: Leader election won for term 1
I20260927 15:16:22.114194 17952 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260927 15:16:22.114193 7448 raft_consensus.cc:686] T 00000000000000000000000000000000 P 8d986b35730f49169f1e3df5eff25cef [term 1 LEADER]: Becoming Leader. State: Replica: 8d986b35730f49169f1e3df5eff25cef, State: Running, Role: LEADER
I20260927 15:16:22.114460 7448 consensus_queue.cc:237] T 00000000000000000000000000000000 P 8d986b35730f49169f1e3df5eff25cef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8d986b35730f49169f1e3df5eff25cef" member_type: VOTER last_known_addr { host: "127.17.136.62" port: 36949 } }
I20260927 15:16:22.115108 7443 sys_catalog.cc:564] T 00000000000000000000000000000000 P 8d986b35730f49169f1e3df5eff25cef [sys.catalog]: configured and running, proceeding with master startup.
I20260927 15:16:22.115732 7449 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8d986b35730f49169f1e3df5eff25cef [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "8d986b35730f49169f1e3df5eff25cef" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8d986b35730f49169f1e3df5eff25cef" member_type: VOTER last_known_addr { host: "127.17.136.62" port: 36949 } } }
I20260927 15:16:22.115834 7449 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8d986b35730f49169f1e3df5eff25cef [sys.catalog]: This master's current role is: LEADER
I20260927 15:16:22.116030 7449 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8d986b35730f49169f1e3df5eff25cef [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8d986b35730f49169f1e3df5eff25cef. Latest consensus state: current_term: 1 leader_uuid: "8d986b35730f49169f1e3df5eff25cef" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8d986b35730f49169f1e3df5eff25cef" member_type: VOTER last_known_addr { host: "127.17.136.62" port: 36949 } } }
I20260927 15:16:22.116119 7449 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8d986b35730f49169f1e3df5eff25cef [sys.catalog]: This master's current role is: LEADER
I20260927 15:16:22.116407 7460 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260927 15:16:22.119622 7460 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260927 15:16:22.125181 7460 catalog_manager.cc:1347] Generated new cluster ID: 340af7b05bbc4f5198050fcf9c468dc3
I20260927 15:16:22.125285 7460 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260927 15:16:22.125960 7446 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:16:22.117361 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43567 (local address 127.17.136.62:36949)
0927 15:16:22.117457 (+ 96us) server_negotiation.cc:206] Beginning negotiation
0927 15:16:22.117461 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0927 15:16:22.117639 (+ 178us) server_negotiation.cc:407] Connection header received
0927 15:16:22.117775 (+ 136us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:16:22.117778 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:16:22.117819 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:16:22.117884 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0927 15:16:22.118648 (+ 764us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:16:22.119412 (+ 764us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:16:22.120743 (+ 1331us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:16:22.121081 (+ 338us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:16:22.121185 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:16:22.122376 (+ 1191us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0927 15:16:22.122379 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0927 15:16:22.122382 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0927 15:16:22.122407 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0927 15:16:22.124073 (+ 1666us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:16:22.124430 (+ 357us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:16:22.124434 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:16:22.124436 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:16:22.124503 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:16:22.124739 (+ 236us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:16:22.124742 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:16:22.124743 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:16:22.124925 (+ 182us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0927 15:16:22.125060 (+ 135us) server_negotiation.cc:1035] Waiting for connection context
0927 15:16:22.125712 (+ 652us) server_negotiation.cc:299] Negotiation successful
0927 15:16:22.125821 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260927 15:16:22.134685 7460 catalog_manager.cc:1370] Generated new certificate authority record
I20260927 15:16:22.135587 7460 catalog_manager.cc:1504] Loading token signing keys...
I20260927 15:16:22.140578 7460 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 8d986b35730f49169f1e3df5eff25cef: Generated new TSK 0
I20260927 15:16:22.141170 7460 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260927 15:16:22.147048 17952 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu with pid 7375
2026-09-27T15:16:22Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/15 (1289 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/16
Loading random data
Initializing database '/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1790521920546562-17952-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 27 15:16:22 dist-test-slave-5s2t krb5kdc[7474](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 27 15:16:22 dist-test-slave-5s2t krb5kdc[7474](info): set up 2 sockets
Sep 27 15:16:22 dist-test-slave-5s2t krb5kdc[7474](info): commencing operation
krb5kdc: starting...
W20260927 15:16:23.095209 17952 mini_kdc.cc:121] Time spent starting KDC: real 0.930s user 0.001s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1790521920546562-17952-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1790521920546562-17952-0/krb5kdc/test-user.keytab.
Sep 27 15:16:23 dist-test-slave-5s2t krb5kdc[7474](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790522183, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-27T15:16:23Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-27T15:16:23Z Disabled control of system clock
WARNING: no policy specified for kudu/127.17.136.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.136.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.136.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1790521920546562-17952-0/krb5kdc/kudu_127.17.136.62.keytab.
Entry for principal kudu/127.17.136.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1790521920546562-17952-0/krb5kdc/kudu_127.17.136.62.keytab.
I20260927 15:16:23.205747 17952 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu
/tmp/dist-test-taskiFOyeW/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1790521920546562-17952-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1790521920546562-17952-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1790521920546562-17952-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1790521920546562-17952-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.136.62:32841
--webserver_interface=127.17.136.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1790521920546562-17952-0/krb5kdc/kudu_127.17.136.62.keytab
--principal=kudu/127.17.136.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.136.20:38795
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.136.62:32841
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1790521920546562-17952-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1790521920546562-17952-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1790521920546562-17952-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260927 15:16:23.312346 7487 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260927 15:16:23.312623 7487 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260927 15:16:23.312678 7487 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260927 15:16:23.316691 7487 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260927 15:16:23.316749 7487 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260927 15:16:23.316776 7487 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260927 15:16:23.316797 7487 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260927 15:16:23.316823 7487 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260927 15:16:23.321944 7487 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.136.20:38795
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1790521920546562-17952-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1790521920546562-17952-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.17.136.62:32841
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1790521920546562-17952-0/krb5kdc/kudu_127.17.136.62.keytab
--principal=kudu/127.17.136.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.136.62:32841
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1790521920546562-17952-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.17.136.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7487
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1790521920546562-17952-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 27 Sep 2026 14:27:13 UTC on ccycloud.quasar-psqrth.root.comops.site
build id 4676138
I20260927 15:16:23.322966 7487 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260927 15:16:23.323946 7487 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260927 15:16:23.332129 7493 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260927 15:16:23.332124 7492 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260927 15:16:23.332124 7495 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260927 15:16:23.332267 7487 server_base.cc:1034] running on GCE node
I20260927 15:16:23.332813 7487 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260927 15:16:23.333899 7487 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260927 15:16:23.335060 7487 hybrid_clock.cc:648] HybridClock initialized: now 1790522183335039 us; error 29 us; skew 500 ppm
Sep 27 15:16:23 dist-test-slave-5s2t krb5kdc[7474](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790522183, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.136.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260927 15:16:23.337592 7487 init.cc:377] Logged in from keytab as kudu/127.17.136.62@KRBTEST.COM (short username kudu)
I20260927 15:16:23.338420 7487 webserver.cc:460] Webserver started at http://127.17.136.62:41897/ using document root <none> and password file <none>
I20260927 15:16:23.338915 7487 fs_manager.cc:359] Metadata directory not provided
I20260927 15:16:23.338967 7487 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260927 15:16:23.339131 7487 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260927 15:16:23.341105 7487 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1790521920546562-17952-0/minicluster-data/master-0/data/instance:
uuid: "d33f418457d543b992499b14bd9b9b47"
format_stamp: "Formatted at 2026-09-27 15:16:23 on dist-test-slave-5s2t"
server_key: "7c948be3d8619f376bb3fce41807fb0a"
server_key_iv: "d306087b56a6c92a86216125392be70f"
server_key_version: "encryptionkey@0"
I20260927 15:16:23.341583 7487 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1790521920546562-17952-0/minicluster-data/master-0/wal/instance:
uuid: "d33f418457d543b992499b14bd9b9b47"
format_stamp: "Formatted at 2026-09-27 15:16:23 on dist-test-slave-5s2t"
server_key: "7c948be3d8619f376bb3fce41807fb0a"
server_key_iv: "d306087b56a6c92a86216125392be70f"
server_key_version: "encryptionkey@0"
I20260927 15:16:23.345036 7487 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.002s
I20260927 15:16:23.347263 7502 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260927 15:16:23.348433 7487 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260927 15:16:23.348536 7487 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1790521920546562-17952-0/minicluster-data/master-0/data,/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1790521920546562-17952-0/minicluster-data/master-0/wal
uuid: "d33f418457d543b992499b14bd9b9b47"
format_stamp: "Formatted at 2026-09-27 15:16:23 on dist-test-slave-5s2t"
server_key: "7c948be3d8619f376bb3fce41807fb0a"
server_key_iv: "d306087b56a6c92a86216125392be70f"
server_key_version: "encryptionkey@0"
I20260927 15:16:23.348616 7487 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1790521920546562-17952-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1790521920546562-17952-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1790521920546562-17952-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260927 15:16:23.387564 7487 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260927 15:16:23.390718 7487 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260927 15:16:23.390869 7487 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260927 15:16:23.397609 7487 rpc_server.cc:307] RPC server started. Bound to: 127.17.136.62:32841
I20260927 15:16:23.397635 7554 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.136.62:32841 every 8 connection(s)
I20260927 15:16:23.398545 7487 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1790521920546562-17952-0/minicluster-data/master-0/data/info.pb
I20260927 15:16:23.401284 7555 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:16:23.402002 17952 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu as pid 7487
I20260927 15:16:23.402153 17952 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1790521920546562-17952-0/minicluster-data/master-0/wal/instance
I20260927 15:16:23.402484 17952 external_mini_cluster.cc:1428] Setting key 56bea1c9f24bb51d4199d6ce322dd120
I20260927 15:16:23.407477 7555 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d33f418457d543b992499b14bd9b9b47: Bootstrap starting.
I20260927 15:16:23.409979 7555 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d33f418457d543b992499b14bd9b9b47: Neither blocks nor log segments found. Creating new log.
I20260927 15:16:23.410776 7555 log.cc:824] T 00000000000000000000000000000000 P d33f418457d543b992499b14bd9b9b47: Log is configured to *not* fsync() on all Append() calls
I20260927 15:16:23.411101 7558 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:16:23.403806 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49269 (local address 127.17.136.62:32841)
0927 15:16:23.404186 (+ 380us) server_negotiation.cc:206] Beginning negotiation
0927 15:16:23.404204 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0927 15:16:23.404238 (+ 34us) server_negotiation.cc:407] Connection header received
0927 15:16:23.404843 (+ 605us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:16:23.404858 (+ 15us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:16:23.405186 (+ 328us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:16:23.405444 (+ 258us) server_negotiation.cc:226] Negotiated authn=SASL
0927 15:16:23.405814 (+ 370us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:16:23.406743 (+ 929us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:16:23.407996 (+ 1253us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:16:23.408460 (+ 464us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:16:23.408572 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:16:23.409435 (+ 863us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0927 15:16:23.409439 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0927 15:16:23.409452 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0927 15:16:23.409817 (+ 365us) server_negotiation.cc:922] calling sasl_server_start()
0927 15:16:23.409868 (+ 51us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0927 15:16:23.409889 (+ 21us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0927 15:16:23.409958 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0927 15:16:23.410148 (+ 190us) server_negotiation.cc:299] Negotiation successful
0927 15:16:23.410344 (+ 196us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":254,"thread_start_us":96,"threads_started":1}
I20260927 15:16:23.412628 7555 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d33f418457d543b992499b14bd9b9b47: No bootstrap required, opened a new log
I20260927 15:16:23.413600 17952 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260927 15:16:23.416543 7555 raft_consensus.cc:348] T 00000000000000000000000000000000 P d33f418457d543b992499b14bd9b9b47 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d33f418457d543b992499b14bd9b9b47" member_type: VOTER last_known_addr { host: "127.17.136.62" port: 32841 } }
I20260927 15:16:23.416792 7555 raft_consensus.cc:374] T 00000000000000000000000000000000 P d33f418457d543b992499b14bd9b9b47 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:16:23.416855 7555 raft_consensus.cc:729] T 00000000000000000000000000000000 P d33f418457d543b992499b14bd9b9b47 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d33f418457d543b992499b14bd9b9b47, State: Initialized, Role: FOLLOWER
I20260927 15:16:23.417315 7555 consensus_queue.cc:260] T 00000000000000000000000000000000 P d33f418457d543b992499b14bd9b9b47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d33f418457d543b992499b14bd9b9b47" member_type: VOTER last_known_addr { host: "127.17.136.62" port: 32841 } }
I20260927 15:16:23.417484 7555 raft_consensus.cc:388] T 00000000000000000000000000000000 P d33f418457d543b992499b14bd9b9b47 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260927 15:16:23.417550 7555 raft_consensus.cc:482] T 00000000000000000000000000000000 P d33f418457d543b992499b14bd9b9b47 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260927 15:16:23.417651 7555 raft_consensus.cc:3037] T 00000000000000000000000000000000 P d33f418457d543b992499b14bd9b9b47 [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:16:23.418758 7555 raft_consensus.cc:504] T 00000000000000000000000000000000 P d33f418457d543b992499b14bd9b9b47 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d33f418457d543b992499b14bd9b9b47" member_type: VOTER last_known_addr { host: "127.17.136.62" port: 32841 } }
I20260927 15:16:23.419098 7555 leader_election.cc:302] T 00000000000000000000000000000000 P d33f418457d543b992499b14bd9b9b47 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: d33f418457d543b992499b14bd9b9b47; no voters:
I20260927 15:16:23.419297 7558 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:16:23.415378 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52987 (local address 127.17.136.62:32841)
0927 15:16:23.415482 (+ 104us) server_negotiation.cc:206] Beginning negotiation
0927 15:16:23.415485 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0927 15:16:23.415631 (+ 146us) server_negotiation.cc:407] Connection header received
0927 15:16:23.415763 (+ 132us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:16:23.415765 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:16:23.415801 (+ 36us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:16:23.415854 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0927 15:16:23.416156 (+ 302us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:16:23.416629 (+ 473us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:16:23.417707 (+ 1078us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:16:23.417976 (+ 269us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:16:23.418068 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:16:23.418831 (+ 763us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0927 15:16:23.418834 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0927 15:16:23.418836 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0927 15:16:23.418848 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0927 15:16:23.418879 (+ 31us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0927 15:16:23.418892 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0927 15:16:23.419005 (+ 113us) server_negotiation.cc:1035] Waiting for connection context
0927 15:16:23.419094 (+ 89us) server_negotiation.cc:299] Negotiation successful
0927 15:16:23.419154 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260927 15:16:23.419425 7555 leader_election.cc:288] T 00000000000000000000000000000000 P d33f418457d543b992499b14bd9b9b47 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260927 15:16:23.419651 7565 raft_consensus.cc:2781] T 00000000000000000000000000000000 P d33f418457d543b992499b14bd9b9b47 [term 1 FOLLOWER]: Leader election won for term 1
I20260927 15:16:23.419876 7565 raft_consensus.cc:686] T 00000000000000000000000000000000 P d33f418457d543b992499b14bd9b9b47 [term 1 LEADER]: Becoming Leader. State: Replica: d33f418457d543b992499b14bd9b9b47, State: Running, Role: LEADER
I20260927 15:16:23.420187 7565 consensus_queue.cc:237] T 00000000000000000000000000000000 P d33f418457d543b992499b14bd9b9b47 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d33f418457d543b992499b14bd9b9b47" member_type: VOTER last_known_addr { host: "127.17.136.62" port: 32841 } }
I20260927 15:16:23.420722 7555 sys_catalog.cc:564] T 00000000000000000000000000000000 P d33f418457d543b992499b14bd9b9b47 [sys.catalog]: configured and running, proceeding with master startup.
I20260927 15:16:23.422463 7566 sys_catalog.cc:455] T 00000000000000000000000000000000 P d33f418457d543b992499b14bd9b9b47 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "d33f418457d543b992499b14bd9b9b47" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d33f418457d543b992499b14bd9b9b47" member_type: VOTER last_known_addr { host: "127.17.136.62" port: 32841 } } }
I20260927 15:16:23.422483 7567 sys_catalog.cc:455] T 00000000000000000000000000000000 P d33f418457d543b992499b14bd9b9b47 [sys.catalog]: SysCatalogTable state changed. Reason: New leader d33f418457d543b992499b14bd9b9b47. Latest consensus state: current_term: 1 leader_uuid: "d33f418457d543b992499b14bd9b9b47" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d33f418457d543b992499b14bd9b9b47" member_type: VOTER last_known_addr { host: "127.17.136.62" port: 32841 } } }
I20260927 15:16:23.422580 7566 sys_catalog.cc:458] T 00000000000000000000000000000000 P d33f418457d543b992499b14bd9b9b47 [sys.catalog]: This master's current role is: LEADER
I20260927 15:16:23.422591 7567 sys_catalog.cc:458] T 00000000000000000000000000000000 P d33f418457d543b992499b14bd9b9b47 [sys.catalog]: This master's current role is: LEADER
I20260927 15:16:23.422984 7579 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260927 15:16:23.425665 7579 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260927 15:16:23.430678 7579 catalog_manager.cc:1347] Generated new cluster ID: f230159e08a242caad8ae4a260ac21b6
I20260927 15:16:23.430742 7579 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260927 15:16:23.455832 7579 catalog_manager.cc:1370] Generated new certificate authority record
I20260927 15:16:23.456780 7579 catalog_manager.cc:1504] Loading token signing keys...
I20260927 15:16:23.468941 7579 catalog_manager.cc:5868] T 00000000000000000000000000000000 P d33f418457d543b992499b14bd9b9b47: Generated new TSK 0
I20260927 15:16:23.469615 7579 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260927 15:16:23.480720 17952 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu with pid 7487
2026-09-27T15:16:23Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/16 (1333 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/17
Loading random data
Initializing database '/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1790521920546562-17952-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 27 15:16:23 dist-test-slave-5s2t krb5kdc[7586](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 27 15:16:23 dist-test-slave-5s2t krb5kdc[7586](info): set up 2 sockets
Sep 27 15:16:23 dist-test-slave-5s2t krb5kdc[7586](info): commencing operation
krb5kdc: starting...
W20260927 15:16:24.427227 17952 mini_kdc.cc:121] Time spent starting KDC: real 0.928s user 0.003s sys 0.003s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1790521920546562-17952-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1790521920546562-17952-0/krb5kdc/test-user.keytab.
Sep 27 15:16:24 dist-test-slave-5s2t krb5kdc[7586](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790522184, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-27T15:16:24Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-27T15:16:24Z Disabled control of system clock
WARNING: no policy specified for kudu/127.17.136.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.136.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.136.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1790521920546562-17952-0/krb5kdc/kudu_127.17.136.62.keytab.
Entry for principal kudu/127.17.136.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1790521920546562-17952-0/krb5kdc/kudu_127.17.136.62.keytab.
I20260927 15:16:24.540297 17952 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu
/tmp/dist-test-taskiFOyeW/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1790521920546562-17952-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1790521920546562-17952-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1790521920546562-17952-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1790521920546562-17952-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.136.62:42345
--webserver_interface=127.17.136.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1790521920546562-17952-0/krb5kdc/kudu_127.17.136.62.keytab
--principal=kudu/127.17.136.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.136.20:35829
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.136.62:42345
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1790521920546562-17952-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1790521920546562-17952-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1790521920546562-17952-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260927 15:16:24.644205 7599 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260927 15:16:24.644444 7599 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260927 15:16:24.644497 7599 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260927 15:16:24.648339 7599 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260927 15:16:24.648392 7599 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260927 15:16:24.648417 7599 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260927 15:16:24.648438 7599 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260927 15:16:24.648459 7599 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260927 15:16:24.653493 7599 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.136.20:35829
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1790521920546562-17952-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1790521920546562-17952-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.17.136.62:42345
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1790521920546562-17952-0/krb5kdc/kudu_127.17.136.62.keytab
--principal=kudu/127.17.136.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.136.62:42345
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1790521920546562-17952-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.17.136.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7599
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1790521920546562-17952-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 27 Sep 2026 14:27:13 UTC on ccycloud.quasar-psqrth.root.comops.site
build id 4676138
I20260927 15:16:24.654435 7599 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260927 15:16:24.655432 7599 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260927 15:16:24.663594 7607 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260927 15:16:24.663559 7604 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260927 15:16:24.663605 7605 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260927 15:16:24.663774 7599 server_base.cc:1034] running on GCE node
I20260927 15:16:24.664444 7599 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260927 15:16:24.665503 7599 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260927 15:16:24.666661 7599 hybrid_clock.cc:648] HybridClock initialized: now 1790522184666651 us; error 35 us; skew 500 ppm
Sep 27 15:16:24 dist-test-slave-5s2t krb5kdc[7586](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790522184, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.136.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260927 15:16:24.675462 7599 init.cc:377] Logged in from keytab as kudu/127.17.136.62@KRBTEST.COM (short username kudu)
I20260927 15:16:24.676353 7599 webserver.cc:460] Webserver started at http://127.17.136.62:46367/ using document root <none> and password file <none>
I20260927 15:16:24.676882 7599 fs_manager.cc:359] Metadata directory not provided
I20260927 15:16:24.676946 7599 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260927 15:16:24.677142 7599 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260927 15:16:24.679134 7599 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1790521920546562-17952-0/minicluster-data/master-0/data/instance:
uuid: "0047113204a84c40a2af7f5818f1016f"
format_stamp: "Formatted at 2026-09-27 15:16:24 on dist-test-slave-5s2t"
server_key: "a86e99af66994d31e2268ce7a388cdc4"
server_key_iv: "f08b96104f52a979e053ba43f7d73604"
server_key_version: "encryptionkey@0"
I20260927 15:16:24.679720 7599 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1790521920546562-17952-0/minicluster-data/master-0/wal/instance:
uuid: "0047113204a84c40a2af7f5818f1016f"
format_stamp: "Formatted at 2026-09-27 15:16:24 on dist-test-slave-5s2t"
server_key: "a86e99af66994d31e2268ce7a388cdc4"
server_key_iv: "f08b96104f52a979e053ba43f7d73604"
server_key_version: "encryptionkey@0"
I20260927 15:16:24.683231 7599 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.000s
I20260927 15:16:24.685473 7614 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260927 15:16:24.686656 7599 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.000s sys 0.002s
I20260927 15:16:24.686770 7599 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1790521920546562-17952-0/minicluster-data/master-0/data,/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1790521920546562-17952-0/minicluster-data/master-0/wal
uuid: "0047113204a84c40a2af7f5818f1016f"
format_stamp: "Formatted at 2026-09-27 15:16:24 on dist-test-slave-5s2t"
server_key: "a86e99af66994d31e2268ce7a388cdc4"
server_key_iv: "f08b96104f52a979e053ba43f7d73604"
server_key_version: "encryptionkey@0"
I20260927 15:16:24.686858 7599 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1790521920546562-17952-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1790521920546562-17952-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1790521920546562-17952-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260927 15:16:24.691211 7599 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260927 15:16:24.693876 7599 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260927 15:16:24.694028 7599 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260927 15:16:24.700670 7599 rpc_server.cc:307] RPC server started. Bound to: 127.17.136.62:42345
I20260927 15:16:24.700677 7666 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.136.62:42345 every 8 connection(s)
I20260927 15:16:24.701561 7599 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1790521920546562-17952-0/minicluster-data/master-0/data/info.pb
I20260927 15:16:24.704300 7667 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:16:24.705613 17952 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu as pid 7599
I20260927 15:16:24.705744 17952 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1790521920546562-17952-0/minicluster-data/master-0/wal/instance
I20260927 15:16:24.706053 17952 external_mini_cluster.cc:1428] Setting key 8244b3854cb3671bc80ca6cd89a2e7ee
I20260927 15:16:24.710418 7667 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0047113204a84c40a2af7f5818f1016f: Bootstrap starting.
I20260927 15:16:24.710938 7670 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:16:24.707343 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37947 (local address 127.17.136.62:42345)
0927 15:16:24.707719 (+ 376us) server_negotiation.cc:206] Beginning negotiation
0927 15:16:24.707734 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0927 15:16:24.707770 (+ 36us) server_negotiation.cc:407] Connection header received
0927 15:16:24.708371 (+ 601us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:16:24.708387 (+ 16us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:16:24.708669 (+ 282us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:16:24.708940 (+ 271us) server_negotiation.cc:226] Negotiated authn=SASL
0927 15:16:24.709732 (+ 792us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0927 15:16:24.709737 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0927 15:16:24.709748 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0927 15:16:24.709758 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0927 15:16:24.709809 (+ 51us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0927 15:16:24.709827 (+ 18us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0927 15:16:24.709924 (+ 97us) server_negotiation.cc:1035] Waiting for connection context
0927 15:16:24.710022 (+ 98us) server_negotiation.cc:299] Negotiation successful
0927 15:16:24.710163 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":242,"thread_start_us":102,"threads_started":1}
I20260927 15:16:24.712764 7667 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 0047113204a84c40a2af7f5818f1016f: Neither blocks nor log segments found. Creating new log.
I20260927 15:16:24.713536 7667 log.cc:824] T 00000000000000000000000000000000 P 0047113204a84c40a2af7f5818f1016f: Log is configured to *not* fsync() on all Append() calls
I20260927 15:16:24.713567 17952 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260927 15:16:24.715610 7667 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0047113204a84c40a2af7f5818f1016f: No bootstrap required, opened a new log
I20260927 15:16:24.716944 7670 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:16:24.715617 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47337 (local address 127.17.136.62:42345)
0927 15:16:24.715716 (+ 99us) server_negotiation.cc:206] Beginning negotiation
0927 15:16:24.715719 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0927 15:16:24.715849 (+ 130us) server_negotiation.cc:407] Connection header received
0927 15:16:24.715962 (+ 113us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:16:24.715965 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:16:24.715990 (+ 25us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:16:24.716041 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0927 15:16:24.716632 (+ 591us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0927 15:16:24.716634 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0927 15:16:24.716636 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0927 15:16:24.716645 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0927 15:16:24.716665 (+ 20us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0927 15:16:24.716674 (+ 9us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0927 15:16:24.716734 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0927 15:16:24.716819 (+ 85us) server_negotiation.cc:299] Negotiation successful
0927 15:16:24.716845 (+ 26us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260927 15:16:24.719503 7667 raft_consensus.cc:348] T 00000000000000000000000000000000 P 0047113204a84c40a2af7f5818f1016f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0047113204a84c40a2af7f5818f1016f" member_type: VOTER last_known_addr { host: "127.17.136.62" port: 42345 } }
I20260927 15:16:24.719708 7667 raft_consensus.cc:374] T 00000000000000000000000000000000 P 0047113204a84c40a2af7f5818f1016f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:16:24.719760 7667 raft_consensus.cc:729] T 00000000000000000000000000000000 P 0047113204a84c40a2af7f5818f1016f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0047113204a84c40a2af7f5818f1016f, State: Initialized, Role: FOLLOWER
I20260927 15:16:24.720131 7667 consensus_queue.cc:260] T 00000000000000000000000000000000 P 0047113204a84c40a2af7f5818f1016f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0047113204a84c40a2af7f5818f1016f" member_type: VOTER last_known_addr { host: "127.17.136.62" port: 42345 } }
I20260927 15:16:24.720248 7667 raft_consensus.cc:388] T 00000000000000000000000000000000 P 0047113204a84c40a2af7f5818f1016f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260927 15:16:24.720309 7667 raft_consensus.cc:482] T 00000000000000000000000000000000 P 0047113204a84c40a2af7f5818f1016f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260927 15:16:24.720403 7667 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 0047113204a84c40a2af7f5818f1016f [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:16:24.721222 7667 raft_consensus.cc:504] T 00000000000000000000000000000000 P 0047113204a84c40a2af7f5818f1016f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0047113204a84c40a2af7f5818f1016f" member_type: VOTER last_known_addr { host: "127.17.136.62" port: 42345 } }
I20260927 15:16:24.721517 7667 leader_election.cc:302] T 00000000000000000000000000000000 P 0047113204a84c40a2af7f5818f1016f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 0047113204a84c40a2af7f5818f1016f; no voters:
I20260927 15:16:24.721767 7667 leader_election.cc:288] T 00000000000000000000000000000000 P 0047113204a84c40a2af7f5818f1016f [CANDIDATE]: Term 1 election: Requested vote from peers
I20260927 15:16:24.721853 7677 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 0047113204a84c40a2af7f5818f1016f [term 1 FOLLOWER]: Leader election won for term 1
I20260927 15:16:24.722035 7677 raft_consensus.cc:686] T 00000000000000000000000000000000 P 0047113204a84c40a2af7f5818f1016f [term 1 LEADER]: Becoming Leader. State: Replica: 0047113204a84c40a2af7f5818f1016f, State: Running, Role: LEADER
I20260927 15:16:24.722347 7677 consensus_queue.cc:237] T 00000000000000000000000000000000 P 0047113204a84c40a2af7f5818f1016f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0047113204a84c40a2af7f5818f1016f" member_type: VOTER last_known_addr { host: "127.17.136.62" port: 42345 } }
I20260927 15:16:24.722935 7667 sys_catalog.cc:564] T 00000000000000000000000000000000 P 0047113204a84c40a2af7f5818f1016f [sys.catalog]: configured and running, proceeding with master startup.
I20260927 15:16:24.723955 7678 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0047113204a84c40a2af7f5818f1016f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "0047113204a84c40a2af7f5818f1016f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0047113204a84c40a2af7f5818f1016f" member_type: VOTER last_known_addr { host: "127.17.136.62" port: 42345 } } }
I20260927 15:16:24.723966 7679 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0047113204a84c40a2af7f5818f1016f [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0047113204a84c40a2af7f5818f1016f. Latest consensus state: current_term: 1 leader_uuid: "0047113204a84c40a2af7f5818f1016f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0047113204a84c40a2af7f5818f1016f" member_type: VOTER last_known_addr { host: "127.17.136.62" port: 42345 } } }
I20260927 15:16:24.724151 7678 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0047113204a84c40a2af7f5818f1016f [sys.catalog]: This master's current role is: LEADER
I20260927 15:16:24.724157 7679 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0047113204a84c40a2af7f5818f1016f [sys.catalog]: This master's current role is: LEADER
I20260927 15:16:24.724880 7687 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260927 15:16:24.727607 7687 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260927 15:16:24.732416 7687 catalog_manager.cc:1347] Generated new cluster ID: aca3c234f3674b62be432da12cab14ec
I20260927 15:16:24.732476 7687 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260927 15:16:24.755225 7687 catalog_manager.cc:1370] Generated new certificate authority record
I20260927 15:16:24.755581 7687 catalog_manager.cc:1504] Loading token signing keys...
I20260927 15:16:24.766388 7687 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 0047113204a84c40a2af7f5818f1016f: Generated new TSK 0
I20260927 15:16:24.767091 7687 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260927 15:16:24.773789 17952 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu with pid 7599
2026-09-27T15:16:24Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/17 (1295 ms)
[----------] 18 tests from AuthTokenIssuingTest (23363 ms total)
[----------] 2 tests from ConnectToFollowerMasterTest
[ RUN ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/0
Loading random data
Initializing database '/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790521920546562-17952-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 27 15:16:24 dist-test-slave-5s2t krb5kdc[7698](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 27 15:16:24 dist-test-slave-5s2t krb5kdc[7698](info): set up 2 sockets
Sep 27 15:16:24 dist-test-slave-5s2t krb5kdc[7698](info): commencing operation
krb5kdc: starting...
W20260927 15:16:25.723163 17952 mini_kdc.cc:121] Time spent starting KDC: real 0.929s user 0.000s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790521920546562-17952-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790521920546562-17952-0/krb5kdc/test-user.keytab.
Sep 27 15:16:25 dist-test-slave-5s2t krb5kdc[7698](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790522185, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-27T15:16:25Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-27T15:16:25Z Disabled control of system clock
WARNING: no policy specified for kudu/127.17.136.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.136.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.136.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790521920546562-17952-0/krb5kdc/kudu_127.17.136.62.keytab.
Entry for principal kudu/127.17.136.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790521920546562-17952-0/krb5kdc/kudu_127.17.136.62.keytab.
I20260927 15:16:25.836014 17952 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu
/tmp/dist-test-taskiFOyeW/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790521920546562-17952-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790521920546562-17952-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790521920546562-17952-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790521920546562-17952-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.136.62:43777
--webserver_interface=127.17.136.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790521920546562-17952-0/krb5kdc/kudu_127.17.136.62.keytab
--principal=kudu/127.17.136.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.136.20:41363
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.136.62:43777,127.17.136.61:43707,127.17.136.60:34161
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790521920546562-17952-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790521920546562-17952-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790521920546562-17952-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260927 15:16:25.939906 7711 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260927 15:16:25.940164 7711 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260927 15:16:25.940202 7711 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260927 15:16:25.940263 7711 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260927 15:16:25.944156 7711 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260927 15:16:25.944209 7711 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260927 15:16:25.944235 7711 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260927 15:16:25.944257 7711 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260927 15:16:25.944285 7711 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260927 15:16:25.949342 7711 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.136.20:41363
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790521920546562-17952-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790521920546562-17952-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.17.136.62:43777,127.17.136.61:43707,127.17.136.60:34161
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790521920546562-17952-0/krb5kdc/kudu_127.17.136.62.keytab
--principal=kudu/127.17.136.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.136.62:43777
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790521920546562-17952-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.17.136.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7711
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790521920546562-17952-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 27 Sep 2026 14:27:13 UTC on ccycloud.quasar-psqrth.root.comops.site
build id 4676138
I20260927 15:16:25.950333 7711 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260927 15:16:25.951305 7711 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260927 15:16:25.959072 7716 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260927 15:16:25.959089 7717 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260927 15:16:25.959301 7711 server_base.cc:1034] running on GCE node
W20260927 15:16:25.959367 7719 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260927 15:16:25.959880 7711 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260927 15:16:25.960880 7711 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260927 15:16:25.962038 7711 hybrid_clock.cc:648] HybridClock initialized: now 1790522185962011 us; error 37 us; skew 500 ppm
Sep 27 15:16:25 dist-test-slave-5s2t krb5kdc[7698](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790522185, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.136.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260927 15:16:25.964699 7711 init.cc:377] Logged in from keytab as kudu/127.17.136.62@KRBTEST.COM (short username kudu)
I20260927 15:16:25.965497 7711 webserver.cc:460] Webserver started at http://127.17.136.62:35895/ using document root <none> and password file <none>
I20260927 15:16:25.965986 7711 fs_manager.cc:359] Metadata directory not provided
I20260927 15:16:25.966048 7711 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260927 15:16:25.966229 7711 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260927 15:16:25.968174 7711 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790521920546562-17952-0/minicluster-data/master-0/data/instance:
uuid: "b55ca3fef6354166851d9cf8b53479b4"
format_stamp: "Formatted at 2026-09-27 15:16:25 on dist-test-slave-5s2t"
server_key: "03688cdd3a892da587fb6e54016cb14b"
server_key_iv: "a189605804f2e7a4bca59b186fccf943"
server_key_version: "encryptionkey@0"
I20260927 15:16:25.968678 7711 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790521920546562-17952-0/minicluster-data/master-0/wal/instance:
uuid: "b55ca3fef6354166851d9cf8b53479b4"
format_stamp: "Formatted at 2026-09-27 15:16:25 on dist-test-slave-5s2t"
server_key: "03688cdd3a892da587fb6e54016cb14b"
server_key_iv: "a189605804f2e7a4bca59b186fccf943"
server_key_version: "encryptionkey@0"
I20260927 15:16:25.972007 7711 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.001s
I20260927 15:16:25.974179 7726 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260927 15:16:25.975404 7711 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260927 15:16:25.975524 7711 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790521920546562-17952-0/minicluster-data/master-0/data,/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790521920546562-17952-0/minicluster-data/master-0/wal
uuid: "b55ca3fef6354166851d9cf8b53479b4"
format_stamp: "Formatted at 2026-09-27 15:16:25 on dist-test-slave-5s2t"
server_key: "03688cdd3a892da587fb6e54016cb14b"
server_key_iv: "a189605804f2e7a4bca59b186fccf943"
server_key_version: "encryptionkey@0"
I20260927 15:16:25.975608 7711 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790521920546562-17952-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790521920546562-17952-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790521920546562-17952-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260927 15:16:25.987236 7711 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260927 15:16:25.990127 7711 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260927 15:16:25.990288 7711 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260927 15:16:25.996531 7711 rpc_server.cc:307] RPC server started. Bound to: 127.17.136.62:43777
I20260927 15:16:25.996789 7778 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.136.62:43777 every 8 connection(s)
I20260927 15:16:25.997480 7711 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790521920546562-17952-0/minicluster-data/master-0/data/info.pb
I20260927 15:16:26.000145 7779 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:16:26.000761 17952 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu as pid 7711
I20260927 15:16:26.000875 17952 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790521920546562-17952-0/minicluster-data/master-0/wal/instance
I20260927 15:16:26.001143 17952 external_mini_cluster.cc:1428] Setting key 2942a6f710a3078fadd1447e2b469b61
I20260927 15:16:26.004276 7779 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.17.136.62" port: 43777 } has no permanent_uuid. Determining permanent_uuid...
WARNING: no policy specified for kudu/127.17.136.61@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.136.61@KRBTEST.COM" created.
Sep 27 15:16:26 dist-test-slave-5s2t krb5kdc[7698](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790522185, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.136.62@KRBTEST.COM for kudu/127.17.136.62@KRBTEST.COM
I20260927 15:16:26.018725 7783 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:16:26.007100 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57476 (local address 127.17.136.62:43777)
0927 15:16:26.007342 (+ 242us) server_negotiation.cc:206] Beginning negotiation
0927 15:16:26.007351 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0927 15:16:26.007385 (+ 34us) server_negotiation.cc:407] Connection header received
0927 15:16:26.008318 (+ 933us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:16:26.008322 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:16:26.008518 (+ 196us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:16:26.008673 (+ 155us) server_negotiation.cc:226] Negotiated authn=SASL
0927 15:16:26.009541 (+ 868us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:16:26.010420 (+ 879us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:16:26.011601 (+ 1181us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:16:26.011972 (+ 371us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:16:26.012109 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:16:26.014289 (+ 2180us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0927 15:16:26.014295 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0927 15:16:26.014304 (+ 9us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0927 15:16:26.014324 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0927 15:16:26.015898 (+ 1574us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:16:26.016425 (+ 527us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:16:26.016430 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:16:26.016431 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:16:26.016526 (+ 95us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:16:26.016832 (+ 306us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:16:26.016834 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:16:26.016836 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:16:26.017195 (+ 359us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0927 15:16:26.017293 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0927 15:16:26.017707 (+ 414us) server_negotiation.cc:299] Negotiation successful
0927 15:16:26.017916 (+ 209us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":2,"server-negotiator.queue_time_us":161,"thread_start_us":60,"threads_started":1}
I20260927 15:16:26.018729 7782 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:16:26.006395 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.62:43777 (local address 127.0.0.1:57476)
0927 15:16:26.006898 (+ 503us) negotiation.cc:107] Waiting for socket to connect
0927 15:16:26.006955 (+ 57us) client_negotiation.cc:174] Beginning negotiation
0927 15:16:26.008030 (+ 1075us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0927 15:16:26.008762 (+ 732us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0927 15:16:26.008766 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0927 15:16:26.009131 (+ 365us) client_negotiation.cc:189] Negotiated authn=SASL
0927 15:16:26.009393 (+ 262us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:16:26.009411 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:16:26.010541 (+ 1130us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:16:26.010545 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:16:26.011497 (+ 952us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:16:26.011506 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:16:26.012106 (+ 600us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:16:26.012110 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:16:26.012199 (+ 89us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:16:26.012718 (+ 519us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0927 15:16:26.012734 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0927 15:16:26.014159 (+ 1425us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0927 15:16:26.016006 (+ 1847us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0927 15:16:26.016016 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0927 15:16:26.016026 (+ 10us) client_negotiation.cc:760] calling sasl_client_step()
0927 15:16:26.016323 (+ 297us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0927 15:16:26.016615 (+ 292us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0927 15:16:26.016618 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0927 15:16:26.016620 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0927 15:16:26.016755 (+ 135us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0927 15:16:26.017305 (+ 550us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0927 15:16:26.017312 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0927 15:16:26.017472 (+ 160us) client_negotiation.cc:769] Sending connection context
0927 15:16:26.017657 (+ 185us) client_negotiation.cc:240] Negotiation successful
0927 15:16:26.017985 (+ 328us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":269,"mutex_wait_us":45,"thread_start_us":94,"threads_started":1}
I20260927 15:16:26.021247 7779 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.17.136.61" port: 43707 } has no permanent_uuid. Determining permanent_uuid...
I20260927 15:16:26.021912 7782 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:16:26.021691 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.61:43707 (local address 127.0.0.1:38496)
0927 15:16:26.021798 (+ 107us) negotiation.cc:107] Waiting for socket to connect
0927 15:16:26.021861 (+ 63us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.136.61:43707: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":43}
W20260927 15:16:26.022114 7728 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.17.136.61:43707: connect: Connection refused (error 111)
I20260927 15:16:26.022828 7782 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:16:26.022642 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.61:43707 (local address 127.0.0.1:38512)
0927 15:16:26.022737 (+ 95us) negotiation.cc:107] Waiting for socket to connect
0927 15:16:26.022782 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.136.61:43707: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":33}
W20260927 15:16:26.022945 7779 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.17.136.61:43707: Network error: Client connection negotiation failed: client connection to 127.17.136.61:43707: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.136.61 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790521920546562-17952-0/krb5kdc/kudu_127.17.136.61.keytab.
Entry for principal kudu/127.17.136.61 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790521920546562-17952-0/krb5kdc/kudu_127.17.136.61.keytab.
I20260927 15:16:26.026518 17952 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu
/tmp/dist-test-taskiFOyeW/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790521920546562-17952-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790521920546562-17952-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790521920546562-17952-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790521920546562-17952-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.136.61:43707
--webserver_interface=127.17.136.61
--webserver_port=0
--keytab_file=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790521920546562-17952-0/krb5kdc/kudu_127.17.136.61.keytab
--principal=kudu/127.17.136.61
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.136.20:41363
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.136.62:43777,127.17.136.61:43707,127.17.136.60:34161
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790521920546562-17952-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790521920546562-17952-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790521920546562-17952-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260927 15:16:26.072178 7779 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.17.136.61" port: 43707 } attempt: 1
I20260927 15:16:26.073026 7782 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:16:26.072738 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.61:43707 (local address 127.0.0.1:38524)
0927 15:16:26.072884 (+ 146us) negotiation.cc:107] Waiting for socket to connect
0927 15:16:26.072949 (+ 65us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.136.61:43707: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":51}
I20260927 15:16:26.073704 7782 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:16:26.073478 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.61:43707 (local address 127.0.0.1:38538)
0927 15:16:26.073598 (+ 120us) negotiation.cc:107] Waiting for socket to connect
0927 15:16:26.073643 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.136.61:43707: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":36}
W20260927 15:16:26.073844 7779 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.17.136.61:43707: Network error: Client connection negotiation failed: client connection to 127.17.136.61:43707: connect: Connection refused (error 111)
W20260927 15:16:26.131210 7786 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260927 15:16:26.131495 7786 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260927 15:16:26.131528 7786 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260927 15:16:26.131595 7786 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260927 15:16:26.135496 7786 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260927 15:16:26.135555 7786 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260927 15:16:26.135579 7786 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260927 15:16:26.135608 7786 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260927 15:16:26.135632 7786 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260927 15:16:26.140728 7786 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.136.20:41363
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790521920546562-17952-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790521920546562-17952-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.17.136.62:43777,127.17.136.61:43707,127.17.136.60:34161
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790521920546562-17952-0/krb5kdc/kudu_127.17.136.61.keytab
--principal=kudu/127.17.136.61
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.136.61:43707
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790521920546562-17952-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.17.136.61
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7786
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790521920546562-17952-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 27 Sep 2026 14:27:13 UTC on ccycloud.quasar-psqrth.root.comops.site
build id 4676138
I20260927 15:16:26.141698 7786 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260927 15:16:26.141978 7779 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.17.136.61" port: 43707 } attempt: 2
I20260927 15:16:26.142752 7782 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:16:26.142465 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.61:43707 (local address 127.0.0.1:38540)
0927 15:16:26.142618 (+ 153us) negotiation.cc:107] Waiting for socket to connect
0927 15:16:26.142679 (+ 61us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.136.61:43707: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":51}
I20260927 15:16:26.142761 7786 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260927 15:16:26.143419 7782 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:16:26.143203 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.61:43707 (local address 127.0.0.1:38550)
0927 15:16:26.143321 (+ 118us) negotiation.cc:107] Waiting for socket to connect
0927 15:16:26.143366 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.136.61:43707: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":58}
W20260927 15:16:26.143527 7779 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.17.136.61:43707: Network error: Client connection negotiation failed: client connection to 127.17.136.61:43707: connect: Connection refused (error 111)
W20260927 15:16:26.150612 7791 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260927 15:16:26.150556 7794 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260927 15:16:26.150542 7792 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260927 15:16:26.150674 7786 server_base.cc:1034] running on GCE node
I20260927 15:16:26.151351 7786 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260927 15:16:26.152341 7786 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260927 15:16:26.153496 7786 hybrid_clock.cc:648] HybridClock initialized: now 1790522186153465 us; error 39 us; skew 500 ppm
Sep 27 15:16:26 dist-test-slave-5s2t krb5kdc[7698](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790522186, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.136.61@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260927 15:16:26.156083 7786 init.cc:377] Logged in from keytab as kudu/127.17.136.61@KRBTEST.COM (short username kudu)
I20260927 15:16:26.156898 7786 webserver.cc:460] Webserver started at http://127.17.136.61:42531/ using document root <none> and password file <none>
I20260927 15:16:26.157400 7786 fs_manager.cc:359] Metadata directory not provided
I20260927 15:16:26.157460 7786 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260927 15:16:26.157635 7786 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260927 15:16:26.159603 7786 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790521920546562-17952-0/minicluster-data/master-1/data/instance:
uuid: "09ce7a71566e447594b77c1e01b69ced"
format_stamp: "Formatted at 2026-09-27 15:16:26 on dist-test-slave-5s2t"
server_key: "4ad17ce65383bcef76f3020294348e75"
server_key_iv: "f2b764108e167a2427d89a49f40fa624"
server_key_version: "encryptionkey@0"
I20260927 15:16:26.160109 7786 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790521920546562-17952-0/minicluster-data/master-1/wal/instance:
uuid: "09ce7a71566e447594b77c1e01b69ced"
format_stamp: "Formatted at 2026-09-27 15:16:26 on dist-test-slave-5s2t"
server_key: "4ad17ce65383bcef76f3020294348e75"
server_key_iv: "f2b764108e167a2427d89a49f40fa624"
server_key_version: "encryptionkey@0"
I20260927 15:16:26.163571 7786 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260927 15:16:26.165871 7801 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260927 15:16:26.167114 7786 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260927 15:16:26.167225 7786 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790521920546562-17952-0/minicluster-data/master-1/data,/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790521920546562-17952-0/minicluster-data/master-1/wal
uuid: "09ce7a71566e447594b77c1e01b69ced"
format_stamp: "Formatted at 2026-09-27 15:16:26 on dist-test-slave-5s2t"
server_key: "4ad17ce65383bcef76f3020294348e75"
server_key_iv: "f2b764108e167a2427d89a49f40fa624"
server_key_version: "encryptionkey@0"
I20260927 15:16:26.167356 7786 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790521920546562-17952-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790521920546562-17952-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790521920546562-17952-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260927 15:16:26.207046 7786 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260927 15:16:26.209894 7786 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260927 15:16:26.210083 7786 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260927 15:16:26.216547 7786 rpc_server.cc:307] RPC server started. Bound to: 127.17.136.61:43707
I20260927 15:16:26.216794 7853 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.136.61:43707 every 8 connection(s)
I20260927 15:16:26.217494 7786 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790521920546562-17952-0/minicluster-data/master-1/data/info.pb
I20260927 15:16:26.220155 7854 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:16:26.221915 17952 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu as pid 7786
I20260927 15:16:26.222031 17952 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790521920546562-17952-0/minicluster-data/master-1/wal/instance
I20260927 15:16:26.222316 17952 external_mini_cluster.cc:1428] Setting key 60fb56cc79a996c55cd92828be1ea45f
I20260927 15:16:26.223863 7854 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.17.136.62" port: 43777 } has no permanent_uuid. Determining permanent_uuid...
WARNING: no policy specified for kudu/127.17.136.60@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.136.60@KRBTEST.COM" created.
Sep 27 15:16:26 dist-test-slave-5s2t krb5kdc[7698](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790522186, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.136.61@KRBTEST.COM for kudu/127.17.136.62@KRBTEST.COM
I20260927 15:16:26.234660 7779 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.17.136.61" port: 43707 } attempt: 3
I20260927 15:16:26.236709 7783 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:16:26.225671 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57484 (local address 127.17.136.62:43777)
0927 15:16:26.225789 (+ 118us) server_negotiation.cc:206] Beginning negotiation
0927 15:16:26.225792 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0927 15:16:26.226768 (+ 976us) server_negotiation.cc:407] Connection header received
0927 15:16:26.227668 (+ 900us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:16:26.227671 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:16:26.227729 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:16:26.227795 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0927 15:16:26.228888 (+ 1093us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:16:26.229432 (+ 544us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:16:26.230526 (+ 1094us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:16:26.230770 (+ 244us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:16:26.230857 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:16:26.233115 (+ 2258us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0927 15:16:26.233118 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0927 15:16:26.233120 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0927 15:16:26.233144 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0927 15:16:26.234519 (+ 1375us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:16:26.235019 (+ 500us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:16:26.235023 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:16:26.235025 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:16:26.235125 (+ 100us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:16:26.235495 (+ 370us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:16:26.235499 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:16:26.235500 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:16:26.235712 (+ 212us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0927 15:16:26.235783 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0927 15:16:26.236420 (+ 637us) server_negotiation.cc:299] Negotiation successful
0927 15:16:26.236560 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260927 15:16:26.237491 7857 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:16:26.226165 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.62:43777 (local address 127.0.0.1:57484)
0927 15:16:26.226627 (+ 462us) negotiation.cc:107] Waiting for socket to connect
0927 15:16:26.226669 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0927 15:16:26.227474 (+ 805us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0927 15:16:26.227961 (+ 487us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0927 15:16:26.227968 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0927 15:16:26.228292 (+ 324us) client_negotiation.cc:189] Negotiated authn=SASL
0927 15:16:26.228748 (+ 456us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:16:26.228761 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:16:26.229547 (+ 786us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:16:26.229550 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:16:26.230412 (+ 862us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:16:26.230421 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:16:26.230902 (+ 481us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:16:26.230905 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:16:26.231074 (+ 169us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:16:26.231582 (+ 508us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0927 15:16:26.231597 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0927 15:16:26.232936 (+ 1339us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0927 15:16:26.234623 (+ 1687us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0927 15:16:26.234627 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0927 15:16:26.234638 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0927 15:16:26.234929 (+ 291us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0927 15:16:26.235210 (+ 281us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0927 15:16:26.235213 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0927 15:16:26.235215 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0927 15:16:26.235395 (+ 180us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0927 15:16:26.235851 (+ 456us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0927 15:16:26.235856 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0927 15:16:26.236154 (+ 298us) client_negotiation.cc:769] Sending connection context
0927 15:16:26.236329 (+ 175us) client_negotiation.cc:240] Negotiation successful
0927 15:16:26.236631 (+ 302us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":279,"thread_start_us":122,"threads_started":1}
I20260927 15:16:26.239130 7854 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.17.136.61" port: 43707 } has no permanent_uuid. Determining permanent_uuid...
Sep 27 15:16:26 dist-test-slave-5s2t krb5kdc[7698](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790522185, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.136.62@KRBTEST.COM for kudu/127.17.136.61@KRBTEST.COM
Sep 27 15:16:26 dist-test-slave-5s2t krb5kdc[7698](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790522186, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.136.61@KRBTEST.COM for kudu/127.17.136.61@KRBTEST.COM
I20260927 15:16:26.245332 7782 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:16:26.235058 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.61:43707 (local address 127.0.0.1:38558)
0927 15:16:26.235373 (+ 315us) negotiation.cc:107] Waiting for socket to connect
0927 15:16:26.235387 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0927 15:16:26.235457 (+ 70us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0927 15:16:26.236135 (+ 678us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0927 15:16:26.236138 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0927 15:16:26.236299 (+ 161us) client_negotiation.cc:189] Negotiated authn=SASL
0927 15:16:26.236417 (+ 118us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:16:26.236424 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:16:26.237791 (+ 1367us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:16:26.237795 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:16:26.238649 (+ 854us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:16:26.238661 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:16:26.239490 (+ 829us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:16:26.239493 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:16:26.239607 (+ 114us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:16:26.240082 (+ 475us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0927 15:16:26.240096 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0927 15:16:26.241828 (+ 1732us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0927 15:16:26.243735 (+ 1907us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0927 15:16:26.243738 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0927 15:16:26.243740 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0927 15:16:26.243964 (+ 224us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0927 15:16:26.244269 (+ 305us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0927 15:16:26.244273 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0927 15:16:26.244275 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0927 15:16:26.244353 (+ 78us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0927 15:16:26.244796 (+ 443us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0927 15:16:26.244800 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0927 15:16:26.244908 (+ 108us) client_negotiation.cc:769] Sending connection context
0927 15:16:26.245022 (+ 114us) client_negotiation.cc:240] Negotiation successful
0927 15:16:26.245161 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":239}
I20260927 15:16:26.245375 7859 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:16:26.235364 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38558 (local address 127.17.136.61:43707)
0927 15:16:26.235702 (+ 338us) server_negotiation.cc:206] Beginning negotiation
0927 15:16:26.235712 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0927 15:16:26.235736 (+ 24us) server_negotiation.cc:407] Connection header received
0927 15:16:26.235774 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:16:26.235779 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:16:26.235971 (+ 192us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:16:26.236118 (+ 147us) server_negotiation.cc:226] Negotiated authn=SASL
0927 15:16:26.236551 (+ 433us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:16:26.237655 (+ 1104us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:16:26.238797 (+ 1142us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:16:26.239391 (+ 594us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:16:26.239492 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:16:26.241945 (+ 2453us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0927 15:16:26.241954 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0927 15:16:26.241964 (+ 10us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0927 15:16:26.241984 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0927 15:16:26.243602 (+ 1618us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:16:26.244085 (+ 483us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:16:26.244091 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:16:26.244093 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:16:26.244181 (+ 88us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:16:26.244439 (+ 258us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:16:26.244442 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:16:26.244444 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:16:26.244699 (+ 255us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0927 15:16:26.244797 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0927 15:16:26.245111 (+ 314us) server_negotiation.cc:299] Negotiation successful
0927 15:16:26.245252 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":241,"thread_start_us":149,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.136.60 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790521920546562-17952-0/krb5kdc/kudu_127.17.136.60.keytab.
Entry for principal kudu/127.17.136.60 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790521920546562-17952-0/krb5kdc/kudu_127.17.136.60.keytab.
I20260927 15:16:26.247066 7779 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.17.136.60" port: 34161 } has no permanent_uuid. Determining permanent_uuid...
I20260927 15:16:26.247344 17952 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu
/tmp/dist-test-taskiFOyeW/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790521920546562-17952-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790521920546562-17952-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790521920546562-17952-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790521920546562-17952-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.136.60:34161
--webserver_interface=127.17.136.60
--webserver_port=0
--keytab_file=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790521920546562-17952-0/krb5kdc/kudu_127.17.136.60.keytab
--principal=kudu/127.17.136.60
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.136.20:41363
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.136.62:43777,127.17.136.61:43707,127.17.136.60:34161
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790521920546562-17952-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790521920546562-17952-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790521920546562-17952-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260927 15:16:26.247792 7782 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:16:26.247501 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.60:34161 (local address 127.0.0.1:43800)
0927 15:16:26.247670 (+ 169us) negotiation.cc:107] Waiting for socket to connect
0927 15:16:26.247720 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.136.60:34161: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":105}
I20260927 15:16:26.248183 7857 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:16:26.239576 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.61:43707 (local address 127.0.0.1:38572)
0927 15:16:26.239663 (+ 87us) negotiation.cc:107] Waiting for socket to connect
0927 15:16:26.239677 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0927 15:16:26.239740 (+ 63us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0927 15:16:26.240011 (+ 271us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0927 15:16:26.240013 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0927 15:16:26.240251 (+ 238us) client_negotiation.cc:189] Negotiated authn=SASL
0927 15:16:26.240358 (+ 107us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:16:26.240364 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:16:26.241107 (+ 743us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:16:26.241111 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:16:26.241798 (+ 687us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:16:26.241808 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:16:26.242236 (+ 428us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:16:26.242239 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:16:26.242306 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:16:26.242622 (+ 316us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0927 15:16:26.242636 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0927 15:16:26.243899 (+ 1263us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0927 15:16:26.246868 (+ 2969us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0927 15:16:26.246870 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0927 15:16:26.246872 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0927 15:16:26.247093 (+ 221us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0927 15:16:26.247326 (+ 233us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0927 15:16:26.247329 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0927 15:16:26.247331 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0927 15:16:26.247411 (+ 80us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0927 15:16:26.247786 (+ 375us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0927 15:16:26.247788 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0927 15:16:26.247867 (+ 79us) client_negotiation.cc:769] Sending connection context
0927 15:16:26.247955 (+ 88us) client_negotiation.cc:240] Negotiation successful
0927 15:16:26.248081 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":29}
I20260927 15:16:26.248560 7782 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:16:26.248293 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.60:34161 (local address 127.0.0.1:43806)
0927 15:16:26.248453 (+ 160us) negotiation.cc:107] Waiting for socket to connect
0927 15:16:26.248497 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.136.60:34161: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":106}
I20260927 15:16:26.248602 7860 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:16:26.239596 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38572 (local address 127.17.136.61:43707)
0927 15:16:26.239818 (+ 222us) server_negotiation.cc:206] Beginning negotiation
0927 15:16:26.239825 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0927 15:16:26.239837 (+ 12us) server_negotiation.cc:407] Connection header received
0927 15:16:26.239866 (+ 29us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:16:26.239869 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:16:26.239911 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:16:26.239991 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0927 15:16:26.240452 (+ 461us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:16:26.240996 (+ 544us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:16:26.241891 (+ 895us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:16:26.242136 (+ 245us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:16:26.242224 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:16:26.244031 (+ 1807us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0927 15:16:26.244035 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0927 15:16:26.244037 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0927 15:16:26.244059 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0927 15:16:26.246779 (+ 2720us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:16:26.247160 (+ 381us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:16:26.247163 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:16:26.247165 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:16:26.247240 (+ 75us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:16:26.247496 (+ 256us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:16:26.247499 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:16:26.247501 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:16:26.247674 (+ 173us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0927 15:16:26.247756 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0927 15:16:26.248349 (+ 593us) server_negotiation.cc:299] Negotiation successful
0927 15:16:26.248450 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":165,"thread_start_us":93,"threads_started":1}
W20260927 15:16:26.248966 7779 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.17.136.60:34161: Network error: Client connection negotiation failed: client connection to 127.17.136.60:34161: connect: Connection refused (error 111)
I20260927 15:16:26.249239 7854 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.17.136.60" port: 34161 } has no permanent_uuid. Determining permanent_uuid...
I20260927 15:16:26.249814 7857 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:16:26.249612 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.60:34161 (local address 127.0.0.1:43810)
0927 15:16:26.249707 (+ 95us) negotiation.cc:107] Waiting for socket to connect
0927 15:16:26.249767 (+ 60us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.136.60:34161: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":40}
W20260927 15:16:26.249992 7802 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.17.136.60:34161: connect: Connection refused (error 111)
I20260927 15:16:26.250737 7857 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:16:26.250529 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.60:34161 (local address 127.0.0.1:43824)
0927 15:16:26.250628 (+ 99us) negotiation.cc:107] Waiting for socket to connect
0927 15:16:26.250686 (+ 58us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.136.60:34161: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":38}
W20260927 15:16:26.250878 7854 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.17.136.60:34161: Network error: Client connection negotiation failed: client connection to 127.17.136.60:34161: connect: Connection refused (error 111)
I20260927 15:16:26.280126 7779 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.17.136.60" port: 34161 } attempt: 1
I20260927 15:16:26.280934 7782 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:16:26.280619 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.60:34161 (local address 127.0.0.1:43826)
0927 15:16:26.280773 (+ 154us) negotiation.cc:107] Waiting for socket to connect
0927 15:16:26.280843 (+ 70us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.136.60:34161: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":53}
I20260927 15:16:26.281589 7782 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:16:26.281354 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.60:34161 (local address 127.0.0.1:43828)
0927 15:16:26.281475 (+ 121us) negotiation.cc:107] Waiting for socket to connect
0927 15:16:26.281525 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.136.60:34161: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":38}
W20260927 15:16:26.281704 7779 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.17.136.60:34161: Network error: Client connection negotiation failed: client connection to 127.17.136.60:34161: connect: Connection refused (error 111)
I20260927 15:16:26.300109 7854 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.17.136.60" port: 34161 } attempt: 1
I20260927 15:16:26.300901 7857 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:16:26.300626 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.60:34161 (local address 127.0.0.1:43838)
0927 15:16:26.300767 (+ 141us) negotiation.cc:107] Waiting for socket to connect
0927 15:16:26.300828 (+ 61us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.136.60:34161: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":51}
I20260927 15:16:26.301512 7857 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:16:26.301339 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.60:34161 (local address 127.0.0.1:43848)
0927 15:16:26.301420 (+ 81us) negotiation.cc:107] Waiting for socket to connect
0927 15:16:26.301459 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.136.60:34161: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":29}
W20260927 15:16:26.301632 7854 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.17.136.60:34161: Network error: Client connection negotiation failed: client connection to 127.17.136.60:34161: connect: Connection refused (error 111)
W20260927 15:16:26.354835 7861 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260927 15:16:26.355108 7861 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260927 15:16:26.355150 7861 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260927 15:16:26.355204 7861 flags.cc:425] Enabled unsafe flag: --never_fsync=true
I20260927 15:16:26.356848 7779 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.17.136.60" port: 34161 } attempt: 2
I20260927 15:16:26.357628 7782 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:16:26.357327 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.60:34161 (local address 127.0.0.1:43856)
0927 15:16:26.357472 (+ 145us) negotiation.cc:107] Waiting for socket to connect
0927 15:16:26.357541 (+ 69us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.136.60:34161: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":50}
I20260927 15:16:26.358242 7782 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:16:26.358047 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.60:34161 (local address 127.0.0.1:43866)
0927 15:16:26.358134 (+ 87us) negotiation.cc:107] Waiting for socket to connect
0927 15:16:26.358180 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.136.60:34161: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":30}
W20260927 15:16:26.358346 7779 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.17.136.60:34161: Network error: Client connection negotiation failed: client connection to 127.17.136.60:34161: connect: Connection refused (error 111)
W20260927 15:16:26.359562 7861 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260927 15:16:26.359608 7861 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260927 15:16:26.359627 7861 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260927 15:16:26.359649 7861 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260927 15:16:26.359670 7861 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260927 15:16:26.364873 7861 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.136.20:41363
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790521920546562-17952-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790521920546562-17952-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.17.136.62:43777,127.17.136.61:43707,127.17.136.60:34161
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790521920546562-17952-0/krb5kdc/kudu_127.17.136.60.keytab
--principal=kudu/127.17.136.60
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.136.60:34161
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790521920546562-17952-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.17.136.60
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7861
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790521920546562-17952-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 27 Sep 2026 14:27:13 UTC on ccycloud.quasar-psqrth.root.comops.site
build id 4676138
I20260927 15:16:26.365890 7861 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260927 15:16:26.367035 7861 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260927 15:16:26.369824 7854 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.17.136.60" port: 34161 } attempt: 2
I20260927 15:16:26.370702 7857 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:16:26.370369 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.60:34161 (local address 127.0.0.1:43882)
0927 15:16:26.370552 (+ 183us) negotiation.cc:107] Waiting for socket to connect
0927 15:16:26.370615 (+ 63us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.136.60:34161: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":84}
I20260927 15:16:26.371552 7857 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:16:26.371221 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.60:34161 (local address 127.0.0.1:43884)
0927 15:16:26.371424 (+ 203us) negotiation.cc:107] Waiting for socket to connect
0927 15:16:26.371477 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.136.60:34161: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":135}
W20260927 15:16:26.371704 7854 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.17.136.60:34161: Network error: Client connection negotiation failed: client connection to 127.17.136.60:34161: connect: Connection refused (error 111)
I20260927 15:16:26.375669 7861 server_base.cc:1034] running on GCE node
W20260927 15:16:26.375627 7867 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260927 15:16:26.375627 7870 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260927 15:16:26.375631 7868 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260927 15:16:26.376415 7861 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260927 15:16:26.377564 7861 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260927 15:16:26.378723 7861 hybrid_clock.cc:648] HybridClock initialized: now 1790522186378705 us; error 39 us; skew 500 ppm
Sep 27 15:16:26 dist-test-slave-5s2t krb5kdc[7698](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790522186, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.136.60@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260927 15:16:26.381368 7861 init.cc:377] Logged in from keytab as kudu/127.17.136.60@KRBTEST.COM (short username kudu)
I20260927 15:16:26.382236 7861 webserver.cc:460] Webserver started at http://127.17.136.60:44793/ using document root <none> and password file <none>
I20260927 15:16:26.382805 7861 fs_manager.cc:359] Metadata directory not provided
I20260927 15:16:26.382872 7861 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260927 15:16:26.383072 7861 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260927 15:16:26.385134 7861 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790521920546562-17952-0/minicluster-data/master-2/data/instance:
uuid: "a23cb8b4ecd145f69d3d7350808df63b"
format_stamp: "Formatted at 2026-09-27 15:16:26 on dist-test-slave-5s2t"
server_key: "b06cfa58f2065f375fdbdfa35773d987"
server_key_iv: "b8ec35a2e7e51fdbed45ee558660ca34"
server_key_version: "encryptionkey@0"
I20260927 15:16:26.385689 7861 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790521920546562-17952-0/minicluster-data/master-2/wal/instance:
uuid: "a23cb8b4ecd145f69d3d7350808df63b"
format_stamp: "Formatted at 2026-09-27 15:16:26 on dist-test-slave-5s2t"
server_key: "b06cfa58f2065f375fdbdfa35773d987"
server_key_iv: "b8ec35a2e7e51fdbed45ee558660ca34"
server_key_version: "encryptionkey@0"
I20260927 15:16:26.389345 7861 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260927 15:16:26.391736 7877 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260927 15:16:26.392972 7861 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260927 15:16:26.393081 7861 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790521920546562-17952-0/minicluster-data/master-2/data,/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790521920546562-17952-0/minicluster-data/master-2/wal
uuid: "a23cb8b4ecd145f69d3d7350808df63b"
format_stamp: "Formatted at 2026-09-27 15:16:26 on dist-test-slave-5s2t"
server_key: "b06cfa58f2065f375fdbdfa35773d987"
server_key_iv: "b8ec35a2e7e51fdbed45ee558660ca34"
server_key_version: "encryptionkey@0"
I20260927 15:16:26.393174 7861 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790521920546562-17952-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790521920546562-17952-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790521920546562-17952-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260927 15:16:26.412014 7861 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260927 15:16:26.414714 7861 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260927 15:16:26.414883 7861 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260927 15:16:26.421348 7861 rpc_server.cc:307] RPC server started. Bound to: 127.17.136.60:34161
I20260927 15:16:26.421593 7929 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.136.60:34161 every 8 connection(s)
I20260927 15:16:26.422258 7861 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790521920546562-17952-0/minicluster-data/master-2/data/info.pb
I20260927 15:16:26.423415 17952 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu as pid 7861
I20260927 15:16:26.423529 17952 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790521920546562-17952-0/minicluster-data/master-2/wal/instance
I20260927 15:16:26.423795 17952 external_mini_cluster.cc:1428] Setting key 9a46d072d82c751d75f1f5897d59f3ad
I20260927 15:16:26.425189 7930 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:16:26.429162 7930 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.17.136.62" port: 43777 } has no permanent_uuid. Determining permanent_uuid...
Sep 27 15:16:26 dist-test-slave-5s2t krb5kdc[7698](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790522185, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.136.60@KRBTEST.COM
Sep 27 15:16:26 dist-test-slave-5s2t krb5kdc[7698](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790522186, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.136.60@KRBTEST.COM for kudu/127.17.136.62@KRBTEST.COM
I20260927 15:16:26.437260 7933 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:16:26.425068 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43892 (local address 127.17.136.60:34161)
0927 15:16:26.425441 (+ 373us) server_negotiation.cc:206] Beginning negotiation
0927 15:16:26.425458 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0927 15:16:26.425492 (+ 34us) server_negotiation.cc:407] Connection header received
0927 15:16:26.426119 (+ 627us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:16:26.426135 (+ 16us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:16:26.426447 (+ 312us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:16:26.426709 (+ 262us) server_negotiation.cc:226] Negotiated authn=SASL
0927 15:16:26.427544 (+ 835us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:16:26.428499 (+ 955us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:16:26.429610 (+ 1111us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:16:26.430075 (+ 465us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:16:26.430183 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:16:26.432745 (+ 2562us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0927 15:16:26.432750 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0927 15:16:26.432758 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0927 15:16:26.432783 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0927 15:16:26.434416 (+ 1633us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:16:26.434860 (+ 444us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:16:26.434866 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:16:26.434872 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:16:26.434991 (+ 119us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:16:26.435239 (+ 248us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:16:26.435242 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:16:26.435244 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:16:26.435656 (+ 412us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0927 15:16:26.435834 (+ 178us) server_negotiation.cc:1035] Waiting for connection context
0927 15:16:26.436120 (+ 286us) server_negotiation.cc:299] Negotiation successful
0927 15:16:26.436369 (+ 249us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":242,"thread_start_us":107,"threads_started":1}
I20260927 15:16:26.439280 7934 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:16:26.430928 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.62:43777 (local address 127.0.0.1:57492)
0927 15:16:26.431310 (+ 382us) negotiation.cc:107] Waiting for socket to connect
0927 15:16:26.431357 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0927 15:16:26.431467 (+ 110us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0927 15:16:26.431731 (+ 264us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0927 15:16:26.431735 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0927 15:16:26.432035 (+ 300us) client_negotiation.cc:189] Negotiated authn=SASL
0927 15:16:26.432157 (+ 122us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:16:26.432162 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:16:26.432884 (+ 722us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:16:26.432887 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:16:26.433779 (+ 892us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:16:26.433790 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:16:26.434207 (+ 417us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:16:26.434211 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:16:26.434319 (+ 108us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:16:26.434768 (+ 449us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0927 15:16:26.434779 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0927 15:16:26.436076 (+ 1297us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0927 15:16:26.437646 (+ 1570us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0927 15:16:26.437654 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0927 15:16:26.437660 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0927 15:16:26.437896 (+ 236us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0927 15:16:26.438232 (+ 336us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0927 15:16:26.438235 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0927 15:16:26.438237 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0927 15:16:26.438319 (+ 82us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0927 15:16:26.438726 (+ 407us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0927 15:16:26.438730 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0927 15:16:26.438824 (+ 94us) client_negotiation.cc:769] Sending connection context
0927 15:16:26.438955 (+ 131us) client_negotiation.cc:240] Negotiation successful
0927 15:16:26.439116 (+ 161us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":199,"thread_start_us":126,"threads_started":1}
I20260927 15:16:26.439318 7783 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:16:26.431006 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57492 (local address 127.17.136.62:43777)
0927 15:16:26.431169 (+ 163us) server_negotiation.cc:206] Beginning negotiation
0927 15:16:26.431173 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0927 15:16:26.431426 (+ 253us) server_negotiation.cc:407] Connection header received
0927 15:16:26.431545 (+ 119us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:16:26.431548 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:16:26.431597 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:16:26.431676 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0927 15:16:26.432277 (+ 601us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:16:26.432782 (+ 505us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:16:26.433887 (+ 1105us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:16:26.434104 (+ 217us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:16:26.434183 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:16:26.436204 (+ 2021us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0927 15:16:26.436208 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0927 15:16:26.436210 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0927 15:16:26.436238 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0927 15:16:26.437553 (+ 1315us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:16:26.438019 (+ 466us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:16:26.438022 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:16:26.438024 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:16:26.438104 (+ 80us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:16:26.438400 (+ 296us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:16:26.438403 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:16:26.438405 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:16:26.438639 (+ 234us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0927 15:16:26.438731 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0927 15:16:26.439031 (+ 300us) server_negotiation.cc:299] Negotiation successful
0927 15:16:26.439146 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
I20260927 15:16:26.440371 7930 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.17.136.61" port: 43707 } has no permanent_uuid. Determining permanent_uuid...
Sep 27 15:16:26 dist-test-slave-5s2t krb5kdc[7698](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790522185, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.136.62@KRBTEST.COM
Sep 27 15:16:26 dist-test-slave-5s2t krb5kdc[7698](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790522186, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.136.60@KRBTEST.COM for kudu/127.17.136.61@KRBTEST.COM
I20260927 15:16:26.447804 7934 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:16:26.440766 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.61:43707 (local address 127.0.0.1:38584)
0927 15:16:26.440868 (+ 102us) negotiation.cc:107] Waiting for socket to connect
0927 15:16:26.440879 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0927 15:16:26.440942 (+ 63us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0927 15:16:26.441347 (+ 405us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0927 15:16:26.441350 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0927 15:16:26.441513 (+ 163us) client_negotiation.cc:189] Negotiated authn=SASL
0927 15:16:26.441596 (+ 83us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:16:26.441601 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:16:26.442296 (+ 695us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:16:26.442299 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:16:26.442798 (+ 499us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:16:26.442806 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:16:26.443481 (+ 675us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:16:26.443484 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:16:26.443554 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:16:26.443901 (+ 347us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0927 15:16:26.443912 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0927 15:16:26.445104 (+ 1192us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0927 15:16:26.446504 (+ 1400us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0927 15:16:26.446506 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0927 15:16:26.446508 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0927 15:16:26.446678 (+ 170us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0927 15:16:26.446920 (+ 242us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0927 15:16:26.446922 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0927 15:16:26.446923 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0927 15:16:26.447003 (+ 80us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0927 15:16:26.447354 (+ 351us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0927 15:16:26.447356 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0927 15:16:26.447445 (+ 89us) client_negotiation.cc:769] Sending connection context
0927 15:16:26.447545 (+ 100us) client_negotiation.cc:240] Negotiation successful
0927 15:16:26.447651 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":41}
I20260927 15:16:26.447805 7783 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:16:26.439853 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57504 (local address 127.17.136.62:43777)
0927 15:16:26.439949 (+ 96us) server_negotiation.cc:206] Beginning negotiation
0927 15:16:26.439952 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0927 15:16:26.439961 (+ 9us) server_negotiation.cc:407] Connection header received
0927 15:16:26.439988 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:16:26.439990 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:16:26.440019 (+ 29us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:16:26.440098 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0927 15:16:26.440890 (+ 792us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:16:26.441380 (+ 490us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:16:26.442262 (+ 882us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:16:26.442475 (+ 213us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:16:26.442558 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:16:26.444925 (+ 2367us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0927 15:16:26.444929 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0927 15:16:26.444932 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0927 15:16:26.444955 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0927 15:16:26.446312 (+ 1357us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:16:26.446698 (+ 386us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:16:26.446701 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:16:26.446703 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:16:26.446779 (+ 76us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:16:26.447023 (+ 244us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:16:26.447026 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:16:26.447027 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:16:26.447201 (+ 174us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0927 15:16:26.447434 (+ 233us) server_negotiation.cc:1035] Waiting for connection context
0927 15:16:26.447538 (+ 104us) server_negotiation.cc:299] Negotiation successful
0927 15:16:26.447649 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260927 15:16:26.447856 7860 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:16:26.440868 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38584 (local address 127.17.136.61:43707)
0927 15:16:26.440991 (+ 123us) server_negotiation.cc:206] Beginning negotiation
0927 15:16:26.440995 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0927 15:16:26.441008 (+ 13us) server_negotiation.cc:407] Connection header received
0927 15:16:26.441046 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:16:26.441149 (+ 103us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:16:26.441208 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:16:26.441307 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0927 15:16:26.441704 (+ 397us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:16:26.442200 (+ 496us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:16:26.442901 (+ 701us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:16:26.443372 (+ 471us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:16:26.443483 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:16:26.445231 (+ 1748us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0927 15:16:26.445238 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0927 15:16:26.445240 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0927 15:16:26.445262 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0927 15:16:26.446406 (+ 1144us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:16:26.446759 (+ 353us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:16:26.446762 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:16:26.446763 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:16:26.446837 (+ 74us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:16:26.447084 (+ 247us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:16:26.447087 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:16:26.447088 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:16:26.447273 (+ 185us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0927 15:16:26.447360 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0927 15:16:26.447607 (+ 247us) server_negotiation.cc:299] Negotiation successful
0927 15:16:26.447716 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260927 15:16:26.448612 7930 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.17.136.60" port: 34161 } has no permanent_uuid. Determining permanent_uuid...
Sep 27 15:16:26 dist-test-slave-5s2t krb5kdc[7698](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790522186, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.136.60@KRBTEST.COM for kudu/127.17.136.60@KRBTEST.COM
Sep 27 15:16:26 dist-test-slave-5s2t krb5kdc[7698](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790522185, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.136.61@KRBTEST.COM
I20260927 15:16:26.457086 7934 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:16:26.449037 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.60:34161 (local address 127.0.0.1:43894)
0927 15:16:26.449128 (+ 91us) negotiation.cc:107] Waiting for socket to connect
0927 15:16:26.449141 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0927 15:16:26.449197 (+ 56us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0927 15:16:26.449480 (+ 283us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0927 15:16:26.449484 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0927 15:16:26.449628 (+ 144us) client_negotiation.cc:189] Negotiated authn=SASL
0927 15:16:26.449719 (+ 91us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:16:26.449726 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:16:26.451270 (+ 1544us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:16:26.451273 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:16:26.451927 (+ 654us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:16:26.451938 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:16:26.452395 (+ 457us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:16:26.452399 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:16:26.452478 (+ 79us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:16:26.452853 (+ 375us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0927 15:16:26.452867 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0927 15:16:26.454028 (+ 1161us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0927 15:16:26.455558 (+ 1530us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0927 15:16:26.455562 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0927 15:16:26.455564 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0927 15:16:26.455728 (+ 164us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0927 15:16:26.456031 (+ 303us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0927 15:16:26.456034 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0927 15:16:26.456036 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0927 15:16:26.456131 (+ 95us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0927 15:16:26.456504 (+ 373us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0927 15:16:26.456508 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0927 15:16:26.456607 (+ 99us) client_negotiation.cc:769] Sending connection context
0927 15:16:26.456707 (+ 100us) client_negotiation.cc:240] Negotiation successful
0927 15:16:26.456849 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":29}
I20260927 15:16:26.457118 7933 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:16:26.449208 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43894 (local address 127.17.136.60:34161)
0927 15:16:26.449310 (+ 102us) server_negotiation.cc:206] Beginning negotiation
0927 15:16:26.449313 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0927 15:16:26.449322 (+ 9us) server_negotiation.cc:407] Connection header received
0927 15:16:26.449347 (+ 25us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:16:26.449349 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:16:26.449379 (+ 30us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:16:26.449439 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0927 15:16:26.449821 (+ 382us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:16:26.451147 (+ 1326us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:16:26.452037 (+ 890us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:16:26.452282 (+ 245us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:16:26.452372 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:16:26.454170 (+ 1798us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0927 15:16:26.454174 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0927 15:16:26.454177 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0927 15:16:26.454200 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0927 15:16:26.455473 (+ 1273us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:16:26.455805 (+ 332us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:16:26.455808 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:16:26.455810 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:16:26.455873 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:16:26.456244 (+ 371us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:16:26.456247 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:16:26.456248 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:16:26.456414 (+ 166us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0927 15:16:26.456483 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0927 15:16:26.456766 (+ 283us) server_negotiation.cc:299] Negotiation successful
0927 15:16:26.456909 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":36,"server-negotiator.queue_time_us":34}
I20260927 15:16:26.457490 7779 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.17.136.60" port: 34161 } attempt: 3
I20260927 15:16:26.458056 7860 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:16:26.449015 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38600 (local address 127.17.136.61:43707)
0927 15:16:26.449129 (+ 114us) server_negotiation.cc:206] Beginning negotiation
0927 15:16:26.449132 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0927 15:16:26.449144 (+ 12us) server_negotiation.cc:407] Connection header received
0927 15:16:26.449174 (+ 30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:16:26.449177 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:16:26.449211 (+ 34us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:16:26.449272 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0927 15:16:26.449968 (+ 696us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:16:26.450771 (+ 803us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:16:26.451678 (+ 907us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:16:26.451875 (+ 197us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:16:26.451955 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:16:26.454766 (+ 2811us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0927 15:16:26.454769 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0927 15:16:26.454771 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0927 15:16:26.454791 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0927 15:16:26.456090 (+ 1299us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:16:26.456559 (+ 469us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:16:26.456562 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:16:26.456563 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:16:26.456629 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:16:26.456909 (+ 280us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:16:26.456913 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:16:26.456914 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:16:26.457104 (+ 190us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0927 15:16:26.457301 (+ 197us) server_negotiation.cc:1035] Waiting for connection context
0927 15:16:26.457815 (+ 514us) server_negotiation.cc:299] Negotiation successful
0927 15:16:26.457921 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260927 15:16:26.460489 7930 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a23cb8b4ecd145f69d3d7350808df63b: Bootstrap starting.
I20260927 15:16:26.461992 17952 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
Sep 27 15:16:26 dist-test-slave-5s2t krb5kdc[7698](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790522185, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.136.62@KRBTEST.COM for kudu/127.17.136.60@KRBTEST.COM
I20260927 15:16:26.462867 7854 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.17.136.60" port: 34161 } attempt: 3
I20260927 15:16:26.463063 7930 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a23cb8b4ecd145f69d3d7350808df63b: Neither blocks nor log segments found. Creating new log.
I20260927 15:16:26.463841 7930 log.cc:824] T 00000000000000000000000000000000 P a23cb8b4ecd145f69d3d7350808df63b: Log is configured to *not* fsync() on all Append() calls
I20260927 15:16:26.463351 7753 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "00000000000000000000000000000000"
dest_uuid: "b55ca3fef6354166851d9cf8b53479b4"
from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:57504
I20260927 15:16:26.465782 7930 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a23cb8b4ecd145f69d3d7350808df63b: No bootstrap required, opened a new log
I20260927 15:16:26.466604 7933 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:16:26.458257 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43898 (local address 127.17.136.60:34161)
0927 15:16:26.458377 (+ 120us) server_negotiation.cc:206] Beginning negotiation
0927 15:16:26.458382 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0927 15:16:26.458396 (+ 14us) server_negotiation.cc:407] Connection header received
0927 15:16:26.458432 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:16:26.458435 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:16:26.458477 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:16:26.458560 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0927 15:16:26.458965 (+ 405us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:16:26.459614 (+ 649us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:16:26.460548 (+ 934us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:16:26.460828 (+ 280us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:16:26.460925 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:16:26.463050 (+ 2125us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0927 15:16:26.463054 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0927 15:16:26.463057 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0927 15:16:26.463090 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0927 15:16:26.464813 (+ 1723us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:16:26.465334 (+ 521us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:16:26.465337 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:16:26.465339 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:16:26.465424 (+ 85us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:16:26.465772 (+ 348us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:16:26.465775 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:16:26.465777 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:16:26.466000 (+ 223us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0927 15:16:26.466091 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0927 15:16:26.466352 (+ 261us) server_negotiation.cc:299] Negotiation successful
0927 15:16:26.466451 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260927 15:16:26.466604 7782 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:16:26.457917 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.60:34161 (local address 127.0.0.1:43898)
0927 15:16:26.458039 (+ 122us) negotiation.cc:107] Waiting for socket to connect
0927 15:16:26.458055 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0927 15:16:26.458139 (+ 84us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0927 15:16:26.458606 (+ 467us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0927 15:16:26.458609 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0927 15:16:26.458768 (+ 159us) client_negotiation.cc:189] Negotiated authn=SASL
0927 15:16:26.458863 (+ 95us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:16:26.458870 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:16:26.459730 (+ 860us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:16:26.459734 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:16:26.460424 (+ 690us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:16:26.460439 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:16:26.460937 (+ 498us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:16:26.460941 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:16:26.461027 (+ 86us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:16:26.461443 (+ 416us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0927 15:16:26.461458 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0927 15:16:26.462871 (+ 1413us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0927 15:16:26.464958 (+ 2087us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0927 15:16:26.464961 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0927 15:16:26.464963 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0927 15:16:26.465207 (+ 244us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0927 15:16:26.465538 (+ 331us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0927 15:16:26.465541 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0927 15:16:26.465543 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0927 15:16:26.465651 (+ 108us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0927 15:16:26.466098 (+ 447us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0927 15:16:26.466101 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0927 15:16:26.466200 (+ 99us) client_negotiation.cc:769] Sending connection context
0927 15:16:26.466293 (+ 93us) client_negotiation.cc:240] Negotiation successful
0927 15:16:26.466435 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":46}
I20260927 15:16:26.469659 7779 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b55ca3fef6354166851d9cf8b53479b4: Bootstrap starting.
I20260927 15:16:26.469789 7930 raft_consensus.cc:348] T 00000000000000000000000000000000 P a23cb8b4ecd145f69d3d7350808df63b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b55ca3fef6354166851d9cf8b53479b4" member_type: VOTER last_known_addr { host: "127.17.136.62" port: 43777 } } peers { permanent_uuid: "09ce7a71566e447594b77c1e01b69ced" member_type: VOTER last_known_addr { host: "127.17.136.61" port: 43707 } } peers { permanent_uuid: "a23cb8b4ecd145f69d3d7350808df63b" member_type: VOTER last_known_addr { host: "127.17.136.60" port: 34161 } }
I20260927 15:16:26.470031 7930 raft_consensus.cc:729] T 00000000000000000000000000000000 P a23cb8b4ecd145f69d3d7350808df63b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a23cb8b4ecd145f69d3d7350808df63b, State: Initialized, Role: FOLLOWER
I20260927 15:16:26.470361 7930 consensus_queue.cc:260] T 00000000000000000000000000000000 P a23cb8b4ecd145f69d3d7350808df63b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b55ca3fef6354166851d9cf8b53479b4" member_type: VOTER last_known_addr { host: "127.17.136.62" port: 43777 } } peers { permanent_uuid: "09ce7a71566e447594b77c1e01b69ced" member_type: VOTER last_known_addr { host: "127.17.136.61" port: 43707 } } peers { permanent_uuid: "a23cb8b4ecd145f69d3d7350808df63b" member_type: VOTER last_known_addr { host: "127.17.136.60" port: 34161 } }
Sep 27 15:16:26 dist-test-slave-5s2t krb5kdc[7698](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790522186, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.136.61@KRBTEST.COM for kudu/127.17.136.60@KRBTEST.COM
I20260927 15:16:26.471393 7937 sys_catalog.cc:455] T 00000000000000000000000000000000 P a23cb8b4ecd145f69d3d7350808df63b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b55ca3fef6354166851d9cf8b53479b4" member_type: VOTER last_known_addr { host: "127.17.136.62" port: 43777 } } peers { permanent_uuid: "09ce7a71566e447594b77c1e01b69ced" member_type: VOTER last_known_addr { host: "127.17.136.61" port: 43707 } } peers { permanent_uuid: "a23cb8b4ecd145f69d3d7350808df63b" member_type: VOTER last_known_addr { host: "127.17.136.60" port: 34161 } } }
I20260927 15:16:26.471583 7930 sys_catalog.cc:564] T 00000000000000000000000000000000 P a23cb8b4ecd145f69d3d7350808df63b [sys.catalog]: configured and running, proceeding with master startup.
I20260927 15:16:26.471652 7937 sys_catalog.cc:458] T 00000000000000000000000000000000 P a23cb8b4ecd145f69d3d7350808df63b [sys.catalog]: This master's current role is: FOLLOWER
I20260927 15:16:26.472409 7779 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b55ca3fef6354166851d9cf8b53479b4: Neither blocks nor log segments found. Creating new log.
I20260927 15:16:26.473270 7779 log.cc:824] T 00000000000000000000000000000000 P b55ca3fef6354166851d9cf8b53479b4: Log is configured to *not* fsync() on all Append() calls
I20260927 15:16:26.475147 7857 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:16:26.463192 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.60:34161 (local address 127.0.0.1:43910)
0927 15:16:26.464945 (+ 1753us) negotiation.cc:107] Waiting for socket to connect
0927 15:16:26.464961 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0927 15:16:26.465032 (+ 71us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0927 15:16:26.465803 (+ 771us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0927 15:16:26.465805 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0927 15:16:26.465962 (+ 157us) client_negotiation.cc:189] Negotiated authn=SASL
0927 15:16:26.466056 (+ 94us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:16:26.466063 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:16:26.467905 (+ 1842us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:16:26.467925 (+ 20us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:16:26.468727 (+ 802us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:16:26.468738 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:16:26.469364 (+ 626us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:16:26.469368 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:16:26.469449 (+ 81us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:16:26.469904 (+ 455us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0927 15:16:26.469918 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0927 15:16:26.471365 (+ 1447us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0927 15:16:26.473393 (+ 2028us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0927 15:16:26.473396 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0927 15:16:26.473399 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0927 15:16:26.473644 (+ 245us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0927 15:16:26.473905 (+ 261us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0927 15:16:26.473908 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0927 15:16:26.473910 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0927 15:16:26.474285 (+ 375us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0927 15:16:26.474675 (+ 390us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0927 15:16:26.474676 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0927 15:16:26.474746 (+ 70us) client_negotiation.cc:769] Sending connection context
0927 15:16:26.474823 (+ 77us) client_negotiation.cc:240] Negotiation successful
0927 15:16:26.474949 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1652}
I20260927 15:16:26.475301 7936 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:16:26.465290 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43910 (local address 127.17.136.60:34161)
0927 15:16:26.465591 (+ 301us) server_negotiation.cc:206] Beginning negotiation
0927 15:16:26.465601 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0927 15:16:26.465614 (+ 13us) server_negotiation.cc:407] Connection header received
0927 15:16:26.465648 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:16:26.465652 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:16:26.465693 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:16:26.465779 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0927 15:16:26.466768 (+ 989us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:16:26.467749 (+ 981us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:16:26.468858 (+ 1109us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:16:26.469240 (+ 382us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:16:26.469347 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:16:26.471556 (+ 2209us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0927 15:16:26.471560 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0927 15:16:26.471562 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0927 15:16:26.471586 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0927 15:16:26.473274 (+ 1688us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:16:26.473749 (+ 475us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:16:26.473753 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:16:26.473754 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:16:26.473834 (+ 80us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:16:26.474396 (+ 562us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:16:26.474400 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:16:26.474402 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:16:26.474565 (+ 163us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0927 15:16:26.474619 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0927 15:16:26.474891 (+ 272us) server_negotiation.cc:299] Negotiation successful
0927 15:16:26.474985 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":235,"thread_start_us":82,"threads_started":1}
I20260927 15:16:26.475778 7779 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b55ca3fef6354166851d9cf8b53479b4: No bootstrap required, opened a new log
W20260927 15:16:26.476712 7948 catalog_manager.cc:1558] T 00000000000000000000000000000000 P a23cb8b4ecd145f69d3d7350808df63b: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260927 15:16:26.476778 7948 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260927 15:16:26.478777 7779 raft_consensus.cc:348] T 00000000000000000000000000000000 P b55ca3fef6354166851d9cf8b53479b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b55ca3fef6354166851d9cf8b53479b4" member_type: VOTER last_known_addr { host: "127.17.136.62" port: 43777 } } peers { permanent_uuid: "09ce7a71566e447594b77c1e01b69ced" member_type: VOTER last_known_addr { host: "127.17.136.61" port: 43707 } } peers { permanent_uuid: "a23cb8b4ecd145f69d3d7350808df63b" member_type: VOTER last_known_addr { host: "127.17.136.60" port: 34161 } }
I20260927 15:16:26.479014 7779 raft_consensus.cc:729] T 00000000000000000000000000000000 P b55ca3fef6354166851d9cf8b53479b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b55ca3fef6354166851d9cf8b53479b4, State: Initialized, Role: FOLLOWER
I20260927 15:16:26.479365 7779 consensus_queue.cc:260] T 00000000000000000000000000000000 P b55ca3fef6354166851d9cf8b53479b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b55ca3fef6354166851d9cf8b53479b4" member_type: VOTER last_known_addr { host: "127.17.136.62" port: 43777 } } peers { permanent_uuid: "09ce7a71566e447594b77c1e01b69ced" member_type: VOTER last_known_addr { host: "127.17.136.61" port: 43707 } } peers { permanent_uuid: "a23cb8b4ecd145f69d3d7350808df63b" member_type: VOTER last_known_addr { host: "127.17.136.60" port: 34161 } }
I20260927 15:16:26.480197 7951 sys_catalog.cc:455] T 00000000000000000000000000000000 P b55ca3fef6354166851d9cf8b53479b4 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b55ca3fef6354166851d9cf8b53479b4" member_type: VOTER last_known_addr { host: "127.17.136.62" port: 43777 } } peers { permanent_uuid: "09ce7a71566e447594b77c1e01b69ced" member_type: VOTER last_known_addr { host: "127.17.136.61" port: 43707 } } peers { permanent_uuid: "a23cb8b4ecd145f69d3d7350808df63b" member_type: VOTER last_known_addr { host: "127.17.136.60" port: 34161 } } }
I20260927 15:16:26.480382 7951 sys_catalog.cc:458] T 00000000000000000000000000000000 P b55ca3fef6354166851d9cf8b53479b4 [sys.catalog]: This master's current role is: FOLLOWER
I20260927 15:16:26.480965 7779 sys_catalog.cc:564] T 00000000000000000000000000000000 P b55ca3fef6354166851d9cf8b53479b4 [sys.catalog]: configured and running, proceeding with master startup.
I20260927 15:16:26.481081 7753 raft_consensus.cc:482] T 00000000000000000000000000000000 P b55ca3fef6354166851d9cf8b53479b4 [term 0 FOLLOWER]: Starting forced leader election (received explicit request)
I20260927 15:16:26.481186 7753 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b55ca3fef6354166851d9cf8b53479b4 [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:16:26.482149 7854 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 09ce7a71566e447594b77c1e01b69ced: Bootstrap starting.
I20260927 15:16:26.482280 7753 raft_consensus.cc:504] T 00000000000000000000000000000000 P b55ca3fef6354166851d9cf8b53479b4 [term 1 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b55ca3fef6354166851d9cf8b53479b4" member_type: VOTER last_known_addr { host: "127.17.136.62" port: 43777 } } peers { permanent_uuid: "09ce7a71566e447594b77c1e01b69ced" member_type: VOTER last_known_addr { host: "127.17.136.61" port: 43707 } } peers { permanent_uuid: "a23cb8b4ecd145f69d3d7350808df63b" member_type: VOTER last_known_addr { host: "127.17.136.60" port: 34161 } }
I20260927 15:16:26.483132 7753 leader_election.cc:288] T 00000000000000000000000000000000 P b55ca3fef6354166851d9cf8b53479b4 [CANDIDATE]: Term 1 election: Requested vote from peers 09ce7a71566e447594b77c1e01b69ced (127.17.136.61:43707), a23cb8b4ecd145f69d3d7350808df63b (127.17.136.60:34161)
I20260927 15:16:26.483892 7904 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "b55ca3fef6354166851d9cf8b53479b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "a23cb8b4ecd145f69d3d7350808df63b"
I20260927 15:16:26.484098 7904 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a23cb8b4ecd145f69d3d7350808df63b [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:16:26.485267 7904 raft_consensus.cc:2454] T 00000000000000000000000000000000 P a23cb8b4ecd145f69d3d7350808df63b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b55ca3fef6354166851d9cf8b53479b4 in term 1.
I20260927 15:16:26.485666 7727 leader_election.cc:302] T 00000000000000000000000000000000 P b55ca3fef6354166851d9cf8b53479b4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a23cb8b4ecd145f69d3d7350808df63b, b55ca3fef6354166851d9cf8b53479b4; no voters:
I20260927 15:16:26.485934 7951 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b55ca3fef6354166851d9cf8b53479b4 [term 1 FOLLOWER]: Leader election won for term 1
I20260927 15:16:26.486250 7951 raft_consensus.cc:686] T 00000000000000000000000000000000 P b55ca3fef6354166851d9cf8b53479b4 [term 1 LEADER]: Becoming Leader. State: Replica: b55ca3fef6354166851d9cf8b53479b4, State: Running, Role: LEADER
W20260927 15:16:26.487485 7962 catalog_manager.cc:1558] T 00000000000000000000000000000000 P b55ca3fef6354166851d9cf8b53479b4: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260927 15:16:26.487568 7962 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260927 15:16:26.488405 7854 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 09ce7a71566e447594b77c1e01b69ced: Neither blocks nor log segments found. Creating new log.
I20260927 15:16:26.489313 7854 log.cc:824] T 00000000000000000000000000000000 P 09ce7a71566e447594b77c1e01b69ced: Log is configured to *not* fsync() on all Append() calls
I20260927 15:16:26.489858 7951 consensus_queue.cc:237] T 00000000000000000000000000000000 P b55ca3fef6354166851d9cf8b53479b4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b55ca3fef6354166851d9cf8b53479b4" member_type: VOTER last_known_addr { host: "127.17.136.62" port: 43777 } } peers { permanent_uuid: "09ce7a71566e447594b77c1e01b69ced" member_type: VOTER last_known_addr { host: "127.17.136.61" port: 43707 } } peers { permanent_uuid: "a23cb8b4ecd145f69d3d7350808df63b" member_type: VOTER last_known_addr { host: "127.17.136.60" port: 34161 } }
I20260927 15:16:26.486675 7861 master_runner.cc:186] Error getting master registration for 127.17.136.62:43777: OK, instance_id { permanent_uuid: "b55ca3fef6354166851d9cf8b53479b4" instance_seqno: 1790522185994790 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260927 15:16:26.490398 7861 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260927 15:16:26.491683 7732 tablet.cc:2369] T 00000000000000000000000000000000 P b55ca3fef6354166851d9cf8b53479b4: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260927 15:16:26.491825 7854 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 09ce7a71566e447594b77c1e01b69ced: No bootstrap required, opened a new log
I20260927 15:16:26.493201 7951 sys_catalog.cc:455] T 00000000000000000000000000000000 P b55ca3fef6354166851d9cf8b53479b4 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b55ca3fef6354166851d9cf8b53479b4. Latest consensus state: current_term: 1 leader_uuid: "b55ca3fef6354166851d9cf8b53479b4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b55ca3fef6354166851d9cf8b53479b4" member_type: VOTER last_known_addr { host: "127.17.136.62" port: 43777 } } peers { permanent_uuid: "09ce7a71566e447594b77c1e01b69ced" member_type: VOTER last_known_addr { host: "127.17.136.61" port: 43707 } } peers { permanent_uuid: "a23cb8b4ecd145f69d3d7350808df63b" member_type: VOTER last_known_addr { host: "127.17.136.60" port: 34161 } } }
I20260927 15:16:26.493307 7951 sys_catalog.cc:458] T 00000000000000000000000000000000 P b55ca3fef6354166851d9cf8b53479b4 [sys.catalog]: This master's current role is: LEADER
I20260927 15:16:26.495837 7854 raft_consensus.cc:348] T 00000000000000000000000000000000 P 09ce7a71566e447594b77c1e01b69ced [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b55ca3fef6354166851d9cf8b53479b4" member_type: VOTER last_known_addr { host: "127.17.136.62" port: 43777 } } peers { permanent_uuid: "09ce7a71566e447594b77c1e01b69ced" member_type: VOTER last_known_addr { host: "127.17.136.61" port: 43707 } } peers { permanent_uuid: "a23cb8b4ecd145f69d3d7350808df63b" member_type: VOTER last_known_addr { host: "127.17.136.60" port: 34161 } }
I20260927 15:16:26.496131 7854 raft_consensus.cc:729] T 00000000000000000000000000000000 P 09ce7a71566e447594b77c1e01b69ced [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 09ce7a71566e447594b77c1e01b69ced, State: Initialized, Role: FOLLOWER
I20260927 15:16:26.496490 7854 consensus_queue.cc:260] T 00000000000000000000000000000000 P 09ce7a71566e447594b77c1e01b69ced [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b55ca3fef6354166851d9cf8b53479b4" member_type: VOTER last_known_addr { host: "127.17.136.62" port: 43777 } } peers { permanent_uuid: "09ce7a71566e447594b77c1e01b69ced" member_type: VOTER last_known_addr { host: "127.17.136.61" port: 43707 } } peers { permanent_uuid: "a23cb8b4ecd145f69d3d7350808df63b" member_type: VOTER last_known_addr { host: "127.17.136.60" port: 34161 } }
I20260927 15:16:26.494601 7711 master_runner.cc:186] Error getting master registration for 127.17.136.61:43707: OK, instance_id { permanent_uuid: "09ce7a71566e447594b77c1e01b69ced" instance_seqno: 1790522186214696 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260927 15:16:26.497838 7711 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260927 15:16:26.497990 7854 sys_catalog.cc:564] T 00000000000000000000000000000000 P 09ce7a71566e447594b77c1e01b69ced [sys.catalog]: configured and running, proceeding with master startup.
I20260927 15:16:26.498521 7828 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "b55ca3fef6354166851d9cf8b53479b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "09ce7a71566e447594b77c1e01b69ced"
I20260927 15:16:26.498745 7828 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 09ce7a71566e447594b77c1e01b69ced [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:16:26.500056 7828 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 09ce7a71566e447594b77c1e01b69ced [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b55ca3fef6354166851d9cf8b53479b4 in term 1.
W20260927 15:16:26.504271 7986 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 09ce7a71566e447594b77c1e01b69ced: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260927 15:16:26.504495 7986 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260927 15:16:26.509305 7860 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:16:26.496179 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38610 (local address 127.17.136.61:43707)
0927 15:16:26.496291 (+ 112us) server_negotiation.cc:206] Beginning negotiation
0927 15:16:26.496295 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0927 15:16:26.500802 (+ 4507us) server_negotiation.cc:407] Connection header received
0927 15:16:26.500965 (+ 163us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:16:26.500969 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:16:26.501012 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:16:26.501071 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0927 15:16:26.501928 (+ 857us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:16:26.502647 (+ 719us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:16:26.503752 (+ 1105us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:16:26.504029 (+ 277us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:16:26.504114 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:16:26.505803 (+ 1689us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0927 15:16:26.505807 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0927 15:16:26.505810 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0927 15:16:26.505833 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0927 15:16:26.507446 (+ 1613us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:16:26.507943 (+ 497us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:16:26.507948 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:16:26.507949 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:16:26.508026 (+ 77us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:16:26.508342 (+ 316us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:16:26.508345 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:16:26.508347 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:16:26.508563 (+ 216us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0927 15:16:26.508662 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0927 15:16:26.509031 (+ 369us) server_negotiation.cc:299] Negotiation successful
0927 15:16:26.509155 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260927 15:16:26.509665 7974 sys_catalog.cc:455] T 00000000000000000000000000000000 P 09ce7a71566e447594b77c1e01b69ced [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b55ca3fef6354166851d9cf8b53479b4" member_type: VOTER last_known_addr { host: "127.17.136.62" port: 43777 } } peers { permanent_uuid: "09ce7a71566e447594b77c1e01b69ced" member_type: VOTER last_known_addr { host: "127.17.136.61" port: 43707 } } peers { permanent_uuid: "a23cb8b4ecd145f69d3d7350808df63b" member_type: VOTER last_known_addr { host: "127.17.136.60" port: 34161 } } }
I20260927 15:16:26.509845 7974 sys_catalog.cc:458] T 00000000000000000000000000000000 P 09ce7a71566e447594b77c1e01b69ced [sys.catalog]: This master's current role is: FOLLOWER
I20260927 15:16:26.511618 7971 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260927 15:16:26.512579 7971 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260927 15:16:26.522478 7936 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:16:26.498106 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43916 (local address 127.17.136.60:34161)
0927 15:16:26.500267 (+ 2161us) server_negotiation.cc:206] Beginning negotiation
0927 15:16:26.500273 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0927 15:16:26.509450 (+ 9177us) server_negotiation.cc:407] Connection header received
0927 15:16:26.509610 (+ 160us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:16:26.509613 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:16:26.509661 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:16:26.509712 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0927 15:16:26.511380 (+ 1668us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:16:26.512150 (+ 770us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:16:26.513236 (+ 1086us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:16:26.513625 (+ 389us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:16:26.513701 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:16:26.516636 (+ 2935us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0927 15:16:26.516640 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0927 15:16:26.516643 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0927 15:16:26.516669 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0927 15:16:26.518322 (+ 1653us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:16:26.518795 (+ 473us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:16:26.518798 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:16:26.518800 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:16:26.518882 (+ 82us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:16:26.521266 (+ 2384us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:16:26.521270 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:16:26.521272 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:16:26.521501 (+ 229us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0927 15:16:26.521624 (+ 123us) server_negotiation.cc:1035] Waiting for connection context
0927 15:16:26.522179 (+ 555us) server_negotiation.cc:299] Negotiation successful
0927 15:16:26.522303 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":149}
I20260927 15:16:26.525110 7783 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:16:26.497959 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57518 (local address 127.17.136.62:43777)
0927 15:16:26.498448 (+ 489us) server_negotiation.cc:206] Beginning negotiation
0927 15:16:26.498453 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0927 15:16:26.498622 (+ 169us) server_negotiation.cc:407] Connection header received
0927 15:16:26.499503 (+ 881us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:16:26.499506 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:16:26.499557 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:16:26.499607 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0927 15:16:26.507352 (+ 7745us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:16:26.508100 (+ 748us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:16:26.510594 (+ 2494us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:16:26.510953 (+ 359us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:16:26.511032 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:16:26.519200 (+ 8168us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0927 15:16:26.519204 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0927 15:16:26.519207 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0927 15:16:26.519235 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0927 15:16:26.520813 (+ 1578us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:16:26.521928 (+ 1115us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:16:26.521931 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:16:26.521933 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:16:26.522018 (+ 85us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:16:26.524117 (+ 2099us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:16:26.524121 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:16:26.524123 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:16:26.524345 (+ 222us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0927 15:16:26.524462 (+ 117us) server_negotiation.cc:1035] Waiting for connection context
0927 15:16:26.524836 (+ 374us) server_negotiation.cc:299] Negotiation successful
0927 15:16:26.524957 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":195}
I20260927 15:16:26.530411 7828 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 09ce7a71566e447594b77c1e01b69ced [term 1 FOLLOWER]: Refusing update from remote peer b55ca3fef6354166851d9cf8b53479b4: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260927 15:16:26.530889 7904 raft_consensus.cc:1261] T 00000000000000000000000000000000 P a23cb8b4ecd145f69d3d7350808df63b [term 1 FOLLOWER]: Refusing update from remote peer b55ca3fef6354166851d9cf8b53479b4: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260927 15:16:26.531090 7951 consensus_queue.cc:1035] T 00000000000000000000000000000000 P b55ca3fef6354166851d9cf8b53479b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "09ce7a71566e447594b77c1e01b69ced" member_type: VOTER last_known_addr { host: "127.17.136.61" port: 43707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260927 15:16:26.532874 7951 consensus_queue.cc:1035] T 00000000000000000000000000000000 P b55ca3fef6354166851d9cf8b53479b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a23cb8b4ecd145f69d3d7350808df63b" member_type: VOTER last_known_addr { host: "127.17.136.60" port: 34161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260927 15:16:26.535425 7974 sys_catalog.cc:455] T 00000000000000000000000000000000 P 09ce7a71566e447594b77c1e01b69ced [sys.catalog]: SysCatalogTable state changed. Reason: New leader b55ca3fef6354166851d9cf8b53479b4. Latest consensus state: current_term: 1 leader_uuid: "b55ca3fef6354166851d9cf8b53479b4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b55ca3fef6354166851d9cf8b53479b4" member_type: VOTER last_known_addr { host: "127.17.136.62" port: 43777 } } peers { permanent_uuid: "09ce7a71566e447594b77c1e01b69ced" member_type: VOTER last_known_addr { host: "127.17.136.61" port: 43707 } } peers { permanent_uuid: "a23cb8b4ecd145f69d3d7350808df63b" member_type: VOTER last_known_addr { host: "127.17.136.60" port: 34161 } } }
I20260927 15:16:26.535547 7974 sys_catalog.cc:458] T 00000000000000000000000000000000 P 09ce7a71566e447594b77c1e01b69ced [sys.catalog]: This master's current role is: FOLLOWER
I20260927 15:16:26.536194 7937 sys_catalog.cc:455] T 00000000000000000000000000000000 P a23cb8b4ecd145f69d3d7350808df63b [sys.catalog]: SysCatalogTable state changed. Reason: New leader b55ca3fef6354166851d9cf8b53479b4. Latest consensus state: current_term: 1 leader_uuid: "b55ca3fef6354166851d9cf8b53479b4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b55ca3fef6354166851d9cf8b53479b4" member_type: VOTER last_known_addr { host: "127.17.136.62" port: 43777 } } peers { permanent_uuid: "09ce7a71566e447594b77c1e01b69ced" member_type: VOTER last_known_addr { host: "127.17.136.61" port: 43707 } } peers { permanent_uuid: "a23cb8b4ecd145f69d3d7350808df63b" member_type: VOTER last_known_addr { host: "127.17.136.60" port: 34161 } } }
I20260927 15:16:26.536311 7937 sys_catalog.cc:458] T 00000000000000000000000000000000 P a23cb8b4ecd145f69d3d7350808df63b [sys.catalog]: This master's current role is: FOLLOWER
I20260927 15:16:26.543918 7951 sys_catalog.cc:455] T 00000000000000000000000000000000 P b55ca3fef6354166851d9cf8b53479b4 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "b55ca3fef6354166851d9cf8b53479b4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b55ca3fef6354166851d9cf8b53479b4" member_type: VOTER last_known_addr { host: "127.17.136.62" port: 43777 } } peers { permanent_uuid: "09ce7a71566e447594b77c1e01b69ced" member_type: VOTER last_known_addr { host: "127.17.136.61" port: 43707 } } peers { permanent_uuid: "a23cb8b4ecd145f69d3d7350808df63b" member_type: VOTER last_known_addr { host: "127.17.136.60" port: 34161 } } }
I20260927 15:16:26.544047 7951 sys_catalog.cc:458] T 00000000000000000000000000000000 P b55ca3fef6354166851d9cf8b53479b4 [sys.catalog]: This master's current role is: LEADER
I20260927 15:16:26.545220 7937 sys_catalog.cc:455] T 00000000000000000000000000000000 P a23cb8b4ecd145f69d3d7350808df63b [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "b55ca3fef6354166851d9cf8b53479b4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b55ca3fef6354166851d9cf8b53479b4" member_type: VOTER last_known_addr { host: "127.17.136.62" port: 43777 } } peers { permanent_uuid: "09ce7a71566e447594b77c1e01b69ced" member_type: VOTER last_known_addr { host: "127.17.136.61" port: 43707 } } peers { permanent_uuid: "a23cb8b4ecd145f69d3d7350808df63b" member_type: VOTER last_known_addr { host: "127.17.136.60" port: 34161 } } }
I20260927 15:16:26.545331 7937 sys_catalog.cc:458] T 00000000000000000000000000000000 P a23cb8b4ecd145f69d3d7350808df63b [sys.catalog]: This master's current role is: FOLLOWER
I20260927 15:16:26.545675 7988 mvcc.cc:205] Tried to move back new op lower bound from 7333978876019425280 to 7333978875867189248. Current Snapshot: MvccSnapshot[applied={T|T < 7333978876019425280}]
I20260927 15:16:26.545830 7991 mvcc.cc:205] Tried to move back new op lower bound from 7333978876019425280 to 7333978875867189248. Current Snapshot: MvccSnapshot[applied={T|T < 7333978876019425280}]
I20260927 15:16:26.550196 7964 sys_catalog.cc:455] T 00000000000000000000000000000000 P b55ca3fef6354166851d9cf8b53479b4 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "b55ca3fef6354166851d9cf8b53479b4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b55ca3fef6354166851d9cf8b53479b4" member_type: VOTER last_known_addr { host: "127.17.136.62" port: 43777 } } peers { permanent_uuid: "09ce7a71566e447594b77c1e01b69ced" member_type: VOTER last_known_addr { host: "127.17.136.61" port: 43707 } } peers { permanent_uuid: "a23cb8b4ecd145f69d3d7350808df63b" member_type: VOTER last_known_addr { host: "127.17.136.60" port: 34161 } } }
I20260927 15:16:26.550325 7964 sys_catalog.cc:458] T 00000000000000000000000000000000 P b55ca3fef6354166851d9cf8b53479b4 [sys.catalog]: This master's current role is: LEADER
I20260927 15:16:26.551182 7989 mvcc.cc:205] Tried to move back new op lower bound from 7333978876019425280 to 7333978875867189248. Current Snapshot: MvccSnapshot[applied={T|T < 7333978876019425280}]
I20260927 15:16:26.551440 7974 sys_catalog.cc:455] T 00000000000000000000000000000000 P 09ce7a71566e447594b77c1e01b69ced [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "b55ca3fef6354166851d9cf8b53479b4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b55ca3fef6354166851d9cf8b53479b4" member_type: VOTER last_known_addr { host: "127.17.136.62" port: 43777 } } peers { permanent_uuid: "09ce7a71566e447594b77c1e01b69ced" member_type: VOTER last_known_addr { host: "127.17.136.61" port: 43707 } } peers { permanent_uuid: "a23cb8b4ecd145f69d3d7350808df63b" member_type: VOTER last_known_addr { host: "127.17.136.60" port: 34161 } } }
I20260927 15:16:26.551546 7974 sys_catalog.cc:458] T 00000000000000000000000000000000 P 09ce7a71566e447594b77c1e01b69ced [sys.catalog]: This master's current role is: FOLLOWER
I20260927 15:16:26.552285 7971 catalog_manager.cc:1347] Generated new cluster ID: e164c9034f254f479b56a617fb2da436
I20260927 15:16:26.552348 7971 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260927 15:16:26.569437 7971 catalog_manager.cc:1370] Generated new certificate authority record
I20260927 15:16:26.570706 7971 catalog_manager.cc:1504] Loading token signing keys...
I20260927 15:16:26.594301 7971 catalog_manager.cc:5868] T 00000000000000000000000000000000 P b55ca3fef6354166851d9cf8b53479b4: Generated new TSK 0
I20260927 15:16:26.595155 7971 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260927 15:16:26.628135 7936 negotiation.cc:337] Failed RPC negotiation. Trace:
0927 15:16:26.625328 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43930 (local address 127.17.136.60:34161)
0927 15:16:26.625445 (+ 117us) server_negotiation.cc:206] Beginning negotiation
0927 15:16:26.625449 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0927 15:16:26.627124 (+ 1675us) server_negotiation.cc:407] Connection header received
0927 15:16:26.627324 (+ 200us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:16:26.627327 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:16:26.627373 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:16:26.627422 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0927 15:16:26.628000 (+ 578us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:43930: BlockingRecv error: recv got EOF from 127.0.0.1:43930 (error 108)
Metrics: {"server-negotiator.queue_time_us":44}
W20260927 15:16:26.629397 7860 negotiation.cc:337] Failed RPC negotiation. Trace:
0927 15:16:26.625725 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38612 (local address 127.17.136.61:43707)
0927 15:16:26.625828 (+ 103us) server_negotiation.cc:206] Beginning negotiation
0927 15:16:26.625831 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0927 15:16:26.628607 (+ 2776us) server_negotiation.cc:407] Connection header received
0927 15:16:26.628765 (+ 158us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:16:26.628768 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:16:26.628811 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:16:26.628855 (+ 44us) server_negotiation.cc:226] Negotiated authn=SASL
0927 15:16:26.629296 (+ 441us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:38612: BlockingRecv error: recv got EOF from 127.0.0.1:38612 (error 108)
Metrics: {"server-negotiator.queue_time_us":40}
W20260927 15:16:26.630617 7783 negotiation.cc:337] Failed RPC negotiation. Trace:
0927 15:16:26.626085 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57522 (local address 127.17.136.62:43777)
0927 15:16:26.626186 (+ 101us) server_negotiation.cc:206] Beginning negotiation
0927 15:16:26.626190 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0927 15:16:26.629821 (+ 3631us) server_negotiation.cc:407] Connection header received
0927 15:16:26.629981 (+ 160us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:16:26.629984 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:16:26.630027 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:16:26.630073 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0927 15:16:26.630498 (+ 425us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:57522: BlockingRecv error: recv got EOF from 127.0.0.1:57522 (error 108)
Metrics: {"server-negotiator.queue_time_us":40}
W20260927 15:16:26.634774 7860 negotiation.cc:337] Failed RPC negotiation. Trace:
0927 15:16:26.633346 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38622 (local address 127.17.136.61:43707)
0927 15:16:26.633437 (+ 91us) server_negotiation.cc:206] Beginning negotiation
0927 15:16:26.633440 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0927 15:16:26.633919 (+ 479us) server_negotiation.cc:407] Connection header received
0927 15:16:26.634110 (+ 191us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:16:26.634113 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:16:26.634178 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:16:26.634228 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0927 15:16:26.634686 (+ 458us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:38622: BlockingRecv error: recv got EOF from 127.0.0.1:38622 (error 108)
Metrics: {"server-negotiator.queue_time_us":35}
W20260927 15:16:26.639485 7860 negotiation.cc:337] Failed RPC negotiation. Trace:
0927 15:16:26.638103 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38634 (local address 127.17.136.61:43707)
0927 15:16:26.638194 (+ 91us) server_negotiation.cc:206] Beginning negotiation
0927 15:16:26.638198 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0927 15:16:26.638684 (+ 486us) server_negotiation.cc:407] Connection header received
0927 15:16:26.638849 (+ 165us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:16:26.638852 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:16:26.638896 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:16:26.638942 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0927 15:16:26.639401 (+ 459us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:38634: BlockingRecv error: recv got EOF from 127.0.0.1:38634 (error 108)
Metrics: {"server-negotiator.queue_time_us":36}
W20260927 15:16:26.644809 7860 negotiation.cc:337] Failed RPC negotiation. Trace:
0927 15:16:26.643407 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38638 (local address 127.17.136.61:43707)
0927 15:16:26.643496 (+ 89us) server_negotiation.cc:206] Beginning negotiation
0927 15:16:26.643500 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0927 15:16:26.644028 (+ 528us) server_negotiation.cc:407] Connection header received
0927 15:16:26.644193 (+ 165us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:16:26.644196 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:16:26.644238 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:16:26.644282 (+ 44us) server_negotiation.cc:226] Negotiated authn=SASL
0927 15:16:26.644721 (+ 439us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:38638: BlockingRecv error: recv got EOF from 127.0.0.1:38638 (error 108)
Metrics: {"server-negotiator.queue_time_us":34}
W20260927 15:16:26.652282 7860 negotiation.cc:337] Failed RPC negotiation. Trace:
0927 15:16:26.650745 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38648 (local address 127.17.136.61:43707)
0927 15:16:26.650867 (+ 122us) server_negotiation.cc:206] Beginning negotiation
0927 15:16:26.650871 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0927 15:16:26.651402 (+ 531us) server_negotiation.cc:407] Connection header received
0927 15:16:26.651603 (+ 201us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:16:26.651606 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:16:26.651651 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:16:26.651700 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0927 15:16:26.652156 (+ 456us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:38648: BlockingRecv error: recv got EOF from 127.0.0.1:38648 (error 108)
Metrics: {"server-negotiator.queue_time_us":67}
W20260927 15:16:26.664233 7860 negotiation.cc:337] Failed RPC negotiation. Trace:
0927 15:16:26.662548 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38652 (local address 127.17.136.61:43707)
0927 15:16:26.662655 (+ 107us) server_negotiation.cc:206] Beginning negotiation
0927 15:16:26.662659 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0927 15:16:26.663225 (+ 566us) server_negotiation.cc:407] Connection header received
0927 15:16:26.663469 (+ 244us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:16:26.663473 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:16:26.663525 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:16:26.663594 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0927 15:16:26.664120 (+ 526us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:38652: BlockingRecv error: recv got EOF from 127.0.0.1:38652 (error 108)
Metrics: {"server-negotiator.queue_time_us":42}
W20260927 15:16:26.684453 7860 negotiation.cc:337] Failed RPC negotiation. Trace:
0927 15:16:26.682798 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38666 (local address 127.17.136.61:43707)
0927 15:16:26.682910 (+ 112us) server_negotiation.cc:206] Beginning negotiation
0927 15:16:26.682915 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0927 15:16:26.683541 (+ 626us) server_negotiation.cc:407] Connection header received
0927 15:16:26.683734 (+ 193us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:16:26.683738 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:16:26.683787 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:16:26.683837 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0927 15:16:26.684341 (+ 504us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:38666: BlockingRecv error: recv got EOF from 127.0.0.1:38666 (error 108)
Metrics: {"server-negotiator.queue_time_us":44}
W20260927 15:16:26.719849 7860 negotiation.cc:337] Failed RPC negotiation. Trace:
0927 15:16:26.718736 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38674 (local address 127.17.136.61:43707)
0927 15:16:26.718869 (+ 133us) server_negotiation.cc:206] Beginning negotiation
0927 15:16:26.718874 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0927 15:16:26.719025 (+ 151us) server_negotiation.cc:407] Connection header received
0927 15:16:26.719174 (+ 149us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:16:26.719177 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:16:26.719221 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:16:26.719323 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0927 15:16:26.719740 (+ 417us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:38674: BlockingRecv error: recv got EOF from 127.0.0.1:38674 (error 108)
Metrics: {"server-negotiator.queue_time_us":49}
W20260927 15:16:26.786900 7860 negotiation.cc:337] Failed RPC negotiation. Trace:
0927 15:16:26.785857 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38676 (local address 127.17.136.61:43707)
0927 15:16:26.785994 (+ 137us) server_negotiation.cc:206] Beginning negotiation
0927 15:16:26.785999 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0927 15:16:26.786144 (+ 145us) server_negotiation.cc:407] Connection header received
0927 15:16:26.786278 (+ 134us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:16:26.786280 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:16:26.786328 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:16:26.786387 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0927 15:16:26.786784 (+ 397us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:38676: BlockingRecv error: recv got EOF from 127.0.0.1:38676 (error 108)
Metrics: {"server-negotiator.queue_time_us":48}
W20260927 15:16:26.918089 7860 negotiation.cc:337] Failed RPC negotiation. Trace:
0927 15:16:26.916979 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38692 (local address 127.17.136.61:43707)
0927 15:16:26.917129 (+ 150us) server_negotiation.cc:206] Beginning negotiation
0927 15:16:26.917134 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0927 15:16:26.917267 (+ 133us) server_negotiation.cc:407] Connection header received
0927 15:16:26.917418 (+ 151us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:16:26.917421 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:16:26.917466 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:16:26.917541 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0927 15:16:26.917985 (+ 444us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:38692: BlockingRecv error: recv got EOF from 127.0.0.1:38692 (error 108)
Metrics: {"server-negotiator.queue_time_us":57}
W20260927 15:16:27.177313 7860 negotiation.cc:337] Failed RPC negotiation. Trace:
0927 15:16:27.176241 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38706 (local address 127.17.136.61:43707)
0927 15:16:27.176374 (+ 133us) server_negotiation.cc:206] Beginning negotiation
0927 15:16:27.176379 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0927 15:16:27.176459 (+ 80us) server_negotiation.cc:407] Connection header received
0927 15:16:27.176625 (+ 166us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:16:27.176628 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:16:27.176676 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:16:27.176740 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0927 15:16:27.177212 (+ 472us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:38706: BlockingRecv error: recv got EOF from 127.0.0.1:38706 (error 108)
Metrics: {"server-negotiator.queue_time_us":54}
I20260927 15:16:27.478027 7948 catalog_manager.cc:1259] Loaded cluster ID: e164c9034f254f479b56a617fb2da436
I20260927 15:16:27.478113 7948 catalog_manager.cc:1552] T 00000000000000000000000000000000 P a23cb8b4ecd145f69d3d7350808df63b: loading cluster ID for follower catalog manager: success
I20260927 15:16:27.479897 7948 catalog_manager.cc:1574] T 00000000000000000000000000000000 P a23cb8b4ecd145f69d3d7350808df63b: acquiring CA information for follower catalog manager: success
I20260927 15:16:27.481083 7948 catalog_manager.cc:1602] T 00000000000000000000000000000000 P a23cb8b4ecd145f69d3d7350808df63b: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260927 15:16:27.505728 7986 catalog_manager.cc:1259] Loaded cluster ID: e164c9034f254f479b56a617fb2da436
I20260927 15:16:27.505806 7986 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 09ce7a71566e447594b77c1e01b69ced: loading cluster ID for follower catalog manager: success
I20260927 15:16:27.507469 7986 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 09ce7a71566e447594b77c1e01b69ced: acquiring CA information for follower catalog manager: success
I20260927 15:16:27.508554 7986 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 09ce7a71566e447594b77c1e01b69ced: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260927 15:16:27.695006 8061 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:16:27.691386 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38716 (local address 127.17.136.61:43707)
0927 15:16:27.691634 (+ 248us) server_negotiation.cc:206] Beginning negotiation
0927 15:16:27.691638 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0927 15:16:27.691654 (+ 16us) server_negotiation.cc:407] Connection header received
0927 15:16:27.691795 (+ 141us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:16:27.691798 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:16:27.691918 (+ 120us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:16:27.692013 (+ 95us) server_negotiation.cc:226] Negotiated authn=TOKEN
0927 15:16:27.692269 (+ 256us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:16:27.692781 (+ 512us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:16:27.693599 (+ 818us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:16:27.693819 (+ 220us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:16:27.693904 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:16:27.694190 (+ 286us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0927 15:16:27.694624 (+ 434us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0927 15:16:27.694736 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0927 15:16:27.694806 (+ 70us) server_negotiation.cc:299] Negotiation successful
0927 15:16:27.694859 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":171,"thread_start_us":58,"threads_started":1}
I20260927 15:16:27.701287 8067 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:16:27.697826 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43942 (local address 127.17.136.60:34161)
0927 15:16:27.698080 (+ 254us) server_negotiation.cc:206] Beginning negotiation
0927 15:16:27.698084 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0927 15:16:27.698098 (+ 14us) server_negotiation.cc:407] Connection header received
0927 15:16:27.698173 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:16:27.698175 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:16:27.698281 (+ 106us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:16:27.698377 (+ 96us) server_negotiation.cc:226] Negotiated authn=TOKEN
0927 15:16:27.698542 (+ 165us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:16:27.699142 (+ 600us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:16:27.699971 (+ 829us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:16:27.700263 (+ 292us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:16:27.700339 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:16:27.700577 (+ 238us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0927 15:16:27.700967 (+ 390us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0927 15:16:27.701073 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0927 15:16:27.701097 (+ 24us) server_negotiation.cc:299] Negotiation successful
0927 15:16:27.701141 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":177,"thread_start_us":65,"threads_started":1}
I20260927 15:16:27.707659 8061 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:16:27.703959 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38722 (local address 127.17.136.61:43707)
0927 15:16:27.704083 (+ 124us) server_negotiation.cc:206] Beginning negotiation
0927 15:16:27.704087 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0927 15:16:27.704182 (+ 95us) server_negotiation.cc:407] Connection header received
0927 15:16:27.704290 (+ 108us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:16:27.704293 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:16:27.704334 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:16:27.704394 (+ 60us) server_negotiation.cc:226] Negotiated authn=TOKEN
0927 15:16:27.704704 (+ 310us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:16:27.705463 (+ 759us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:16:27.706434 (+ 971us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:16:27.706677 (+ 243us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:16:27.706771 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:16:27.707119 (+ 348us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0927 15:16:27.707191 (+ 72us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0927 15:16:27.707287 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0927 15:16:27.707406 (+ 119us) server_negotiation.cc:299] Negotiation successful
0927 15:16:27.707456 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260927 15:16:27.707937 8067 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:16:27.704045 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43956 (local address 127.17.136.60:34161)
0927 15:16:27.704137 (+ 92us) server_negotiation.cc:206] Beginning negotiation
0927 15:16:27.704141 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0927 15:16:27.704366 (+ 225us) server_negotiation.cc:407] Connection header received
0927 15:16:27.704489 (+ 123us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:16:27.704492 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:16:27.704536 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:16:27.704605 (+ 69us) server_negotiation.cc:226] Negotiated authn=TOKEN
0927 15:16:27.704824 (+ 219us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:16:27.705539 (+ 715us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:16:27.706694 (+ 1155us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:16:27.706998 (+ 304us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:16:27.707094 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:16:27.707381 (+ 287us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0927 15:16:27.707448 (+ 67us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0927 15:16:27.707507 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0927 15:16:27.707772 (+ 265us) server_negotiation.cc:299] Negotiation successful
0927 15:16:27.707820 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30}
I20260927 15:16:27.708915 8074 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:16:27.703782 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57534 (local address 127.17.136.62:43777)
0927 15:16:27.704017 (+ 235us) server_negotiation.cc:206] Beginning negotiation
0927 15:16:27.704021 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0927 15:16:27.704476 (+ 455us) server_negotiation.cc:407] Connection header received
0927 15:16:27.704567 (+ 91us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:16:27.704569 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:16:27.704712 (+ 143us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:16:27.704822 (+ 110us) server_negotiation.cc:226] Negotiated authn=TOKEN
0927 15:16:27.705876 (+ 1054us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:16:27.706658 (+ 782us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:16:27.707550 (+ 892us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:16:27.707857 (+ 307us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:16:27.707951 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:16:27.708247 (+ 296us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0927 15:16:27.708571 (+ 324us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0927 15:16:27.708649 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0927 15:16:27.708760 (+ 111us) server_negotiation.cc:299] Negotiation successful
0927 15:16:27.708810 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":156,"thread_start_us":61,"threads_started":1}
I20260927 15:16:27.711529 17952 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu with pid 7711
I20260927 15:16:27.717224 17952 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu with pid 7786
I20260927 15:16:27.721726 17952 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu with pid 7861
2026-09-27T15:16:27Z chronyd exiting
[ OK ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/0 (2946 ms)
[ RUN ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/1
Loading random data
Initializing database '/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790521920546562-17952-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 27 15:16:27 dist-test-slave-5s2t krb5kdc[8078](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 27 15:16:27 dist-test-slave-5s2t krb5kdc[8078](info): set up 2 sockets
Sep 27 15:16:27 dist-test-slave-5s2t krb5kdc[8078](info): commencing operation
krb5kdc: starting...
W20260927 15:16:28.663225 17952 mini_kdc.cc:121] Time spent starting KDC: real 0.922s user 0.001s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790521920546562-17952-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790521920546562-17952-0/krb5kdc/test-user.keytab.
Sep 27 15:16:28 dist-test-slave-5s2t krb5kdc[8078](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790522188, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-27T15:16:28Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-27T15:16:28Z Disabled control of system clock
WARNING: no policy specified for kudu/127.17.136.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.136.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.136.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790521920546562-17952-0/krb5kdc/kudu_127.17.136.62.keytab.
Entry for principal kudu/127.17.136.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790521920546562-17952-0/krb5kdc/kudu_127.17.136.62.keytab.
I20260927 15:16:28.776259 17952 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu
/tmp/dist-test-taskiFOyeW/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790521920546562-17952-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790521920546562-17952-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790521920546562-17952-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790521920546562-17952-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.136.62:41617
--webserver_interface=127.17.136.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790521920546562-17952-0/krb5kdc/kudu_127.17.136.62.keytab
--principal=kudu/127.17.136.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.136.20:37181
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.136.62:41617,127.17.136.61:33721,127.17.136.60:38243
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790521920546562-17952-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790521920546562-17952-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790521920546562-17952-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260927 15:16:28.881573 8091 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260927 15:16:28.881867 8091 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260927 15:16:28.881902 8091 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260927 15:16:28.881976 8091 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260927 15:16:28.885964 8091 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260927 15:16:28.886022 8091 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260927 15:16:28.886049 8091 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260927 15:16:28.886070 8091 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260927 15:16:28.886090 8091 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260927 15:16:28.891371 8091 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.136.20:37181
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790521920546562-17952-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790521920546562-17952-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.17.136.62:41617,127.17.136.61:33721,127.17.136.60:38243
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790521920546562-17952-0/krb5kdc/kudu_127.17.136.62.keytab
--principal=kudu/127.17.136.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.136.62:41617
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790521920546562-17952-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.17.136.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8091
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790521920546562-17952-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 27 Sep 2026 14:27:13 UTC on ccycloud.quasar-psqrth.root.comops.site
build id 4676138
I20260927 15:16:28.892417 8091 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260927 15:16:28.893435 8091 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260927 15:16:28.901517 8096 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260927 15:16:28.901520 8097 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260927 15:16:28.901561 8099 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260927 15:16:28.901767 8091 server_base.cc:1034] running on GCE node
I20260927 15:16:28.902410 8091 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260927 15:16:28.903540 8091 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260927 15:16:28.904785 8091 hybrid_clock.cc:648] HybridClock initialized: now 1790522188904767 us; error 30 us; skew 500 ppm
Sep 27 15:16:28 dist-test-slave-5s2t krb5kdc[8078](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790522188, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.136.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260927 15:16:28.907440 8091 init.cc:377] Logged in from keytab as kudu/127.17.136.62@KRBTEST.COM (short username kudu)
I20260927 15:16:28.908298 8091 webserver.cc:460] Webserver started at http://127.17.136.62:34567/ using document root <none> and password file <none>
I20260927 15:16:28.908807 8091 fs_manager.cc:359] Metadata directory not provided
I20260927 15:16:28.908870 8091 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260927 15:16:28.909080 8091 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260927 15:16:28.911072 8091 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790521920546562-17952-0/minicluster-data/master-0/data/instance:
uuid: "7923fcae5a5b418887faab0c13e95ed3"
format_stamp: "Formatted at 2026-09-27 15:16:28 on dist-test-slave-5s2t"
server_key: "429e5f6425ca1cf079b11343d0067149"
server_key_iv: "e3bb08061799201129efbe731bb70641"
server_key_version: "encryptionkey@0"
I20260927 15:16:28.911628 8091 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790521920546562-17952-0/minicluster-data/master-0/wal/instance:
uuid: "7923fcae5a5b418887faab0c13e95ed3"
format_stamp: "Formatted at 2026-09-27 15:16:28 on dist-test-slave-5s2t"
server_key: "429e5f6425ca1cf079b11343d0067149"
server_key_iv: "e3bb08061799201129efbe731bb70641"
server_key_version: "encryptionkey@0"
I20260927 15:16:28.915055 8091 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.000s
I20260927 15:16:28.917253 8106 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260927 15:16:28.918393 8091 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260927 15:16:28.918499 8091 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790521920546562-17952-0/minicluster-data/master-0/data,/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790521920546562-17952-0/minicluster-data/master-0/wal
uuid: "7923fcae5a5b418887faab0c13e95ed3"
format_stamp: "Formatted at 2026-09-27 15:16:28 on dist-test-slave-5s2t"
server_key: "429e5f6425ca1cf079b11343d0067149"
server_key_iv: "e3bb08061799201129efbe731bb70641"
server_key_version: "encryptionkey@0"
I20260927 15:16:28.918588 8091 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790521920546562-17952-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790521920546562-17952-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790521920546562-17952-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260927 15:16:28.942310 8091 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260927 15:16:28.945006 8091 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260927 15:16:28.945201 8091 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260927 15:16:28.951727 8091 rpc_server.cc:307] RPC server started. Bound to: 127.17.136.62:41617
I20260927 15:16:28.951958 8158 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.136.62:41617 every 8 connection(s)
I20260927 15:16:28.952646 8091 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790521920546562-17952-0/minicluster-data/master-0/data/info.pb
I20260927 15:16:28.955233 8159 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:16:28.958793 8159 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.17.136.62" port: 41617 } has no permanent_uuid. Determining permanent_uuid...
I20260927 15:16:28.961618 17952 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu as pid 8091
I20260927 15:16:28.961723 17952 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790521920546562-17952-0/minicluster-data/master-0/wal/instance
I20260927 15:16:28.961983 17952 external_mini_cluster.cc:1428] Setting key 68b4754e0fe036da539b3969fa2c5b63
WARNING: no policy specified for kudu/127.17.136.61@KRBTEST.COM; defaulting to no policy
Sep 27 15:16:28 dist-test-slave-5s2t krb5kdc[8078](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790522188, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.136.62@KRBTEST.COM for kudu/127.17.136.62@KRBTEST.COM
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.136.61@KRBTEST.COM" created.
I20260927 15:16:28.973249 8161 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:16:28.961034 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60058 (local address 127.17.136.62:41617)
0927 15:16:28.961482 (+ 448us) server_negotiation.cc:206] Beginning negotiation
0927 15:16:28.961499 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0927 15:16:28.962349 (+ 850us) server_negotiation.cc:407] Connection header received
0927 15:16:28.963296 (+ 947us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:16:28.963301 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:16:28.963487 (+ 186us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:16:28.963644 (+ 157us) server_negotiation.cc:226] Negotiated authn=SASL
0927 15:16:28.964428 (+ 784us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:16:28.965278 (+ 850us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:16:28.966197 (+ 919us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:16:28.966539 (+ 342us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:16:28.966673 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:16:28.969099 (+ 2426us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0927 15:16:28.969104 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0927 15:16:28.969113 (+ 9us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0927 15:16:28.969133 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0927 15:16:28.970604 (+ 1471us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:16:28.971010 (+ 406us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:16:28.971016 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:16:28.971018 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:16:28.971160 (+ 142us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:16:28.971459 (+ 299us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:16:28.971462 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:16:28.971464 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:16:28.971815 (+ 351us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0927 15:16:28.971930 (+ 115us) server_negotiation.cc:1035] Waiting for connection context
0927 15:16:28.972331 (+ 401us) server_negotiation.cc:299] Negotiation successful
0927 15:16:28.972508 (+ 177us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":3,"server-negotiator.queue_time_us":284,"thread_start_us":131,"threads_started":1}
I20260927 15:16:28.973254 8162 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:16:28.961034 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.62:41617 (local address 127.0.0.1:60058)
0927 15:16:28.962206 (+ 1172us) negotiation.cc:107] Waiting for socket to connect
0927 15:16:28.962244 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0927 15:16:28.962989 (+ 745us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0927 15:16:28.963661 (+ 672us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0927 15:16:28.963666 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0927 15:16:28.964074 (+ 408us) client_negotiation.cc:189] Negotiated authn=SASL
0927 15:16:28.964298 (+ 224us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:16:28.964310 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:16:28.965386 (+ 1076us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:16:28.965389 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:16:28.966095 (+ 706us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:16:28.966103 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:16:28.966674 (+ 571us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:16:28.966678 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:16:28.966843 (+ 165us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:16:28.967392 (+ 549us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0927 15:16:28.967408 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0927 15:16:28.968962 (+ 1554us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0927 15:16:28.970695 (+ 1733us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0927 15:16:28.970703 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0927 15:16:28.970710 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0927 15:16:28.970911 (+ 201us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0927 15:16:28.971239 (+ 328us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0927 15:16:28.971241 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0927 15:16:28.971243 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0927 15:16:28.971373 (+ 130us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0927 15:16:28.971918 (+ 545us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0927 15:16:28.971924 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0927 15:16:28.972074 (+ 150us) client_negotiation.cc:769] Sending connection context
0927 15:16:28.972216 (+ 142us) client_negotiation.cc:240] Negotiation successful
0927 15:16:28.972591 (+ 375us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1018,"mutex_wait_us":125,"spinlock_wait_cycles":54016,"thread_start_us":139,"threads_started":1}
I20260927 15:16:28.975486 8159 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.17.136.61" port: 33721 } has no permanent_uuid. Determining permanent_uuid...
I20260927 15:16:28.976154 8162 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:16:28.975926 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.61:33721 (local address 127.0.0.1:43012)
0927 15:16:28.976036 (+ 110us) negotiation.cc:107] Waiting for socket to connect
0927 15:16:28.976101 (+ 65us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.136.61:33721: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":42}
W20260927 15:16:28.976321 8109 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.17.136.61:33721: connect: Connection refused (error 111)
I20260927 15:16:28.977064 8162 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:16:28.976880 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.61:33721 (local address 127.0.0.1:43028)
0927 15:16:28.976968 (+ 88us) negotiation.cc:107] Waiting for socket to connect
0927 15:16:28.977009 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.136.61:33721: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":33}
W20260927 15:16:28.977176 8159 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.17.136.61:33721: Network error: Client connection negotiation failed: client connection to 127.17.136.61:33721: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.136.61 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790521920546562-17952-0/krb5kdc/kudu_127.17.136.61.keytab.
Entry for principal kudu/127.17.136.61 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790521920546562-17952-0/krb5kdc/kudu_127.17.136.61.keytab.
I20260927 15:16:28.985898 17952 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu
/tmp/dist-test-taskiFOyeW/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790521920546562-17952-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790521920546562-17952-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790521920546562-17952-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790521920546562-17952-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.136.61:33721
--webserver_interface=127.17.136.61
--webserver_port=0
--keytab_file=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790521920546562-17952-0/krb5kdc/kudu_127.17.136.61.keytab
--principal=kudu/127.17.136.61
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.136.20:37181
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.136.62:41617,127.17.136.61:33721,127.17.136.60:38243
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790521920546562-17952-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790521920546562-17952-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790521920546562-17952-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260927 15:16:29.026397 8159 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.17.136.61" port: 33721 } attempt: 1
I20260927 15:16:29.027240 8162 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:16:29.026969 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.61:33721 (local address 127.0.0.1:43032)
0927 15:16:29.027097 (+ 128us) negotiation.cc:107] Waiting for socket to connect
0927 15:16:29.027154 (+ 57us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.136.61:33721: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":39}
I20260927 15:16:29.028139 8162 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:16:29.027899 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.61:33721 (local address 127.0.0.1:43038)
0927 15:16:29.028020 (+ 121us) negotiation.cc:107] Waiting for socket to connect
0927 15:16:29.028068 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.136.61:33721: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":53}
W20260927 15:16:29.028290 8159 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.17.136.61:33721: Network error: Client connection negotiation failed: client connection to 127.17.136.61:33721: connect: Connection refused (error 111)
I20260927 15:16:29.096453 8159 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.17.136.61" port: 33721 } attempt: 2
I20260927 15:16:29.097218 8162 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:16:29.096935 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.61:33721 (local address 127.0.0.1:43054)
0927 15:16:29.097078 (+ 143us) negotiation.cc:107] Waiting for socket to connect
0927 15:16:29.097141 (+ 63us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.136.61:33721: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":54}
I20260927 15:16:29.097990 8162 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:16:29.097752 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.61:33721 (local address 127.0.0.1:43056)
0927 15:16:29.097867 (+ 115us) negotiation.cc:107] Waiting for socket to connect
0927 15:16:29.097919 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.136.61:33721: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":44}
W20260927 15:16:29.098201 8159 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.17.136.61:33721: Network error: Client connection negotiation failed: client connection to 127.17.136.61:33721: connect: Connection refused (error 111)
W20260927 15:16:29.106511 8166 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260927 15:16:29.106776 8166 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260927 15:16:29.106818 8166 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260927 15:16:29.106879 8166 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260927 15:16:29.110822 8166 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260927 15:16:29.110873 8166 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260927 15:16:29.110899 8166 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260927 15:16:29.110921 8166 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260927 15:16:29.110950 8166 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260927 15:16:29.116045 8166 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.136.20:37181
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790521920546562-17952-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790521920546562-17952-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.17.136.62:41617,127.17.136.61:33721,127.17.136.60:38243
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790521920546562-17952-0/krb5kdc/kudu_127.17.136.61.keytab
--principal=kudu/127.17.136.61
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.136.61:33721
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790521920546562-17952-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.17.136.61
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8166
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790521920546562-17952-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 27 Sep 2026 14:27:13 UTC on ccycloud.quasar-psqrth.root.comops.site
build id 4676138
I20260927 15:16:29.117012 8166 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260927 15:16:29.117952 8166 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260927 15:16:29.125856 8171 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260927 15:16:29.125871 8172 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260927 15:16:29.125866 8174 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260927 15:16:29.125947 8166 server_base.cc:1034] running on GCE node
I20260927 15:16:29.126609 8166 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260927 15:16:29.127671 8166 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260927 15:16:29.128834 8166 hybrid_clock.cc:648] HybridClock initialized: now 1790522189128817 us; error 31 us; skew 500 ppm
Sep 27 15:16:29 dist-test-slave-5s2t krb5kdc[8078](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790522189, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.136.61@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260927 15:16:29.131398 8166 init.cc:377] Logged in from keytab as kudu/127.17.136.61@KRBTEST.COM (short username kudu)
I20260927 15:16:29.132238 8166 webserver.cc:460] Webserver started at http://127.17.136.61:35591/ using document root <none> and password file <none>
I20260927 15:16:29.132742 8166 fs_manager.cc:359] Metadata directory not provided
I20260927 15:16:29.132812 8166 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260927 15:16:29.133002 8166 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260927 15:16:29.134929 8166 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790521920546562-17952-0/minicluster-data/master-1/data/instance:
uuid: "160255bc44d74054823075b9fc6982e9"
format_stamp: "Formatted at 2026-09-27 15:16:29 on dist-test-slave-5s2t"
server_key: "994319e2e26c5676eae3d071eaa8528a"
server_key_iv: "73e181de060cd7a1a8f6ba144d2061b1"
server_key_version: "encryptionkey@0"
I20260927 15:16:29.135464 8166 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790521920546562-17952-0/minicluster-data/master-1/wal/instance:
uuid: "160255bc44d74054823075b9fc6982e9"
format_stamp: "Formatted at 2026-09-27 15:16:29 on dist-test-slave-5s2t"
server_key: "994319e2e26c5676eae3d071eaa8528a"
server_key_iv: "73e181de060cd7a1a8f6ba144d2061b1"
server_key_version: "encryptionkey@0"
I20260927 15:16:29.138837 8166 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.001s
I20260927 15:16:29.141058 8181 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260927 15:16:29.142189 8166 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260927 15:16:29.142293 8166 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790521920546562-17952-0/minicluster-data/master-1/data,/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790521920546562-17952-0/minicluster-data/master-1/wal
uuid: "160255bc44d74054823075b9fc6982e9"
format_stamp: "Formatted at 2026-09-27 15:16:29 on dist-test-slave-5s2t"
server_key: "994319e2e26c5676eae3d071eaa8528a"
server_key_iv: "73e181de060cd7a1a8f6ba144d2061b1"
server_key_version: "encryptionkey@0"
I20260927 15:16:29.142376 8166 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790521920546562-17952-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790521920546562-17952-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790521920546562-17952-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260927 15:16:29.158576 8166 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260927 15:16:29.161193 8166 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260927 15:16:29.161356 8166 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260927 15:16:29.167941 8166 rpc_server.cc:307] RPC server started. Bound to: 127.17.136.61:33721
I20260927 15:16:29.168187 8233 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.136.61:33721 every 8 connection(s)
I20260927 15:16:29.168869 8166 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790521920546562-17952-0/minicluster-data/master-1/data/info.pb
I20260927 15:16:29.171340 17952 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu as pid 8166
I20260927 15:16:29.171473 17952 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790521920546562-17952-0/minicluster-data/master-1/wal/instance
I20260927 15:16:29.171684 8234 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:16:29.171830 17952 external_mini_cluster.cc:1428] Setting key b36933c8c8467c5cc0c9fa5bc08278a0
I20260927 15:16:29.175681 8234 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.17.136.62" port: 41617 } has no permanent_uuid. Determining permanent_uuid...
WARNING: no policy specified for kudu/127.17.136.60@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.136.60@KRBTEST.COM" created.
Sep 27 15:16:29 dist-test-slave-5s2t krb5kdc[8078](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790522189, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.136.61@KRBTEST.COM for kudu/127.17.136.62@KRBTEST.COM
I20260927 15:16:29.189360 8159 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.17.136.61" port: 33721 } attempt: 3
I20260927 15:16:29.189625 8161 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:16:29.177460 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60068 (local address 127.17.136.62:41617)
0927 15:16:29.177625 (+ 165us) server_negotiation.cc:206] Beginning negotiation
0927 15:16:29.177630 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0927 15:16:29.178415 (+ 785us) server_negotiation.cc:407] Connection header received
0927 15:16:29.179385 (+ 970us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:16:29.179388 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:16:29.179445 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:16:29.179532 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0927 15:16:29.180686 (+ 1154us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:16:29.181397 (+ 711us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:16:29.182843 (+ 1446us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:16:29.183189 (+ 346us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:16:29.183336 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:16:29.185872 (+ 2536us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0927 15:16:29.185875 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0927 15:16:29.185877 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0927 15:16:29.185902 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0927 15:16:29.187778 (+ 1876us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:16:29.188283 (+ 505us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:16:29.188285 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:16:29.188287 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:16:29.188353 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:16:29.188601 (+ 248us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:16:29.188603 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:16:29.188604 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:16:29.188790 (+ 186us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0927 15:16:29.188863 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0927 15:16:29.189343 (+ 480us) server_negotiation.cc:299] Negotiation successful
0927 15:16:29.189455 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260927 15:16:29.190671 8237 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:16:29.177791 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.62:41617 (local address 127.0.0.1:60068)
0927 15:16:29.178242 (+ 451us) negotiation.cc:107] Waiting for socket to connect
0927 15:16:29.178292 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0927 15:16:29.179152 (+ 860us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0927 15:16:29.179702 (+ 550us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0927 15:16:29.179709 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0927 15:16:29.180074 (+ 365us) client_negotiation.cc:189] Negotiated authn=SASL
0927 15:16:29.180571 (+ 497us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:16:29.180585 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:16:29.181517 (+ 932us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:16:29.181520 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:16:29.182728 (+ 1208us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:16:29.182738 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:16:29.183371 (+ 633us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:16:29.183374 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:16:29.183507 (+ 133us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:16:29.184031 (+ 524us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0927 15:16:29.184048 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0927 15:16:29.185700 (+ 1652us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0927 15:16:29.187891 (+ 2191us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0927 15:16:29.187897 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0927 15:16:29.187913 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0927 15:16:29.188207 (+ 294us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0927 15:16:29.188415 (+ 208us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0927 15:16:29.188417 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0927 15:16:29.188418 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0927 15:16:29.188537 (+ 119us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0927 15:16:29.188867 (+ 330us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0927 15:16:29.188872 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0927 15:16:29.189124 (+ 252us) client_negotiation.cc:769] Sending connection context
0927 15:16:29.189276 (+ 152us) client_negotiation.cc:240] Negotiation successful
0927 15:16:29.189634 (+ 358us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":254,"thread_start_us":109,"threads_started":1}
I20260927 15:16:29.192071 8234 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.17.136.61" port: 33721 } has no permanent_uuid. Determining permanent_uuid...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.136.60 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790521920546562-17952-0/krb5kdc/kudu_127.17.136.60.keytab.
Entry for principal kudu/127.17.136.60 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790521920546562-17952-0/krb5kdc/kudu_127.17.136.60.keytab.
Sep 27 15:16:29 dist-test-slave-5s2t krb5kdc[8078](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790522188, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.136.62@KRBTEST.COM for kudu/127.17.136.61@KRBTEST.COM
I20260927 15:16:29.195969 17952 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu
/tmp/dist-test-taskiFOyeW/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790521920546562-17952-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790521920546562-17952-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790521920546562-17952-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790521920546562-17952-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.136.60:38243
--webserver_interface=127.17.136.60
--webserver_port=0
--keytab_file=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790521920546562-17952-0/krb5kdc/kudu_127.17.136.60.keytab
--principal=kudu/127.17.136.60
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.136.20:37181
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.136.62:41617,127.17.136.61:33721,127.17.136.60:38243
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790521920546562-17952-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790521920546562-17952-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790521920546562-17952-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Sep 27 15:16:29 dist-test-slave-5s2t krb5kdc[8078](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790522189, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.136.61@KRBTEST.COM for kudu/127.17.136.61@KRBTEST.COM
I20260927 15:16:29.200321 8162 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:16:29.189799 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.61:33721 (local address 127.0.0.1:43058)
0927 15:16:29.189919 (+ 120us) negotiation.cc:107] Waiting for socket to connect
0927 15:16:29.189933 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0927 15:16:29.190005 (+ 72us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0927 15:16:29.190783 (+ 778us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0927 15:16:29.190785 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0927 15:16:29.190951 (+ 166us) client_negotiation.cc:189] Negotiated authn=SASL
0927 15:16:29.191043 (+ 92us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:16:29.191050 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:16:29.192276 (+ 1226us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:16:29.192279 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:16:29.193081 (+ 802us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:16:29.193091 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:16:29.193781 (+ 690us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:16:29.193786 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:16:29.193968 (+ 182us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:16:29.194374 (+ 406us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0927 15:16:29.194417 (+ 43us) client_negotiation.cc:656] calling sasl_client_start()
0927 15:16:29.195890 (+ 1473us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0927 15:16:29.198413 (+ 2523us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0927 15:16:29.198417 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0927 15:16:29.198419 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0927 15:16:29.198886 (+ 467us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0927 15:16:29.199178 (+ 292us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0927 15:16:29.199181 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0927 15:16:29.199184 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0927 15:16:29.199297 (+ 113us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0927 15:16:29.199792 (+ 495us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0927 15:16:29.199795 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0927 15:16:29.199899 (+ 104us) client_negotiation.cc:769] Sending connection context
0927 15:16:29.200008 (+ 109us) client_negotiation.cc:240] Negotiation successful
0927 15:16:29.200145 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":31}
I20260927 15:16:29.200850 8237 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:16:29.192485 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.61:33721 (local address 127.0.0.1:43066)
0927 15:16:29.192601 (+ 116us) negotiation.cc:107] Waiting for socket to connect
0927 15:16:29.192614 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0927 15:16:29.192680 (+ 66us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0927 15:16:29.193038 (+ 358us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0927 15:16:29.193041 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0927 15:16:29.193200 (+ 159us) client_negotiation.cc:189] Negotiated authn=SASL
0927 15:16:29.193291 (+ 91us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:16:29.193297 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:16:29.194178 (+ 881us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:16:29.194182 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:16:29.194933 (+ 751us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:16:29.194944 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:16:29.195505 (+ 561us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:16:29.195509 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:16:29.195604 (+ 95us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:16:29.196030 (+ 426us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0927 15:16:29.196044 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0927 15:16:29.197238 (+ 1194us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0927 15:16:29.199405 (+ 2167us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0927 15:16:29.199408 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0927 15:16:29.199410 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0927 15:16:29.199623 (+ 213us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0927 15:16:29.199870 (+ 247us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0927 15:16:29.199872 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0927 15:16:29.199874 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0927 15:16:29.199934 (+ 60us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0927 15:16:29.200229 (+ 295us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0927 15:16:29.200232 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0927 15:16:29.200308 (+ 76us) client_negotiation.cc:769] Sending connection context
0927 15:16:29.200522 (+ 214us) client_negotiation.cc:240] Negotiation successful
0927 15:16:29.200712 (+ 190us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":40,"mutex_wait_us":68}
I20260927 15:16:29.200865 8240 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:16:29.192600 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43066 (local address 127.17.136.61:33721)
0927 15:16:29.192845 (+ 245us) server_negotiation.cc:206] Beginning negotiation
0927 15:16:29.192855 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0927 15:16:29.192865 (+ 10us) server_negotiation.cc:407] Connection header received
0927 15:16:29.192894 (+ 29us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:16:29.192896 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:16:29.192935 (+ 39us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:16:29.193033 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0927 15:16:29.193417 (+ 384us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:16:29.194078 (+ 661us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:16:29.195055 (+ 977us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:16:29.195373 (+ 318us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:16:29.195486 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:16:29.197374 (+ 1888us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0927 15:16:29.197377 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0927 15:16:29.197378 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0927 15:16:29.197396 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0927 15:16:29.199317 (+ 1921us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:16:29.199717 (+ 400us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:16:29.199719 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:16:29.199721 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:16:29.199792 (+ 71us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:16:29.200004 (+ 212us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:16:29.200007 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:16:29.200009 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:16:29.200151 (+ 142us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0927 15:16:29.200225 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0927 15:16:29.200488 (+ 263us) server_negotiation.cc:299] Negotiation successful
0927 15:16:29.200665 (+ 177us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":18,"server-negotiator.queue_time_us":196,"thread_start_us":84,"threads_started":1}
I20260927 15:16:29.201387 8239 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:16:29.190110 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43058 (local address 127.17.136.61:33721)
0927 15:16:29.190404 (+ 294us) server_negotiation.cc:206] Beginning negotiation
0927 15:16:29.190415 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0927 15:16:29.190434 (+ 19us) server_negotiation.cc:407] Connection header received
0927 15:16:29.190465 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:16:29.190469 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:16:29.190663 (+ 194us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:16:29.190785 (+ 122us) server_negotiation.cc:226] Negotiated authn=SASL
0927 15:16:29.191153 (+ 368us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:16:29.192180 (+ 1027us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:16:29.193182 (+ 1002us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:16:29.193624 (+ 442us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:16:29.193726 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:16:29.196028 (+ 2302us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0927 15:16:29.196038 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0927 15:16:29.196052 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0927 15:16:29.196071 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0927 15:16:29.198307 (+ 2236us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:16:29.198994 (+ 687us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:16:29.199001 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:16:29.199002 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:16:29.199088 (+ 86us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:16:29.199384 (+ 296us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:16:29.199387 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:16:29.199389 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:16:29.199693 (+ 304us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0927 15:16:29.199811 (+ 118us) server_negotiation.cc:1035] Waiting for connection context
0927 15:16:29.200730 (+ 919us) server_negotiation.cc:299] Negotiation successful
0927 15:16:29.200849 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":206,"thread_start_us":114,"threads_started":1}
I20260927 15:16:29.202767 8159 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.17.136.60" port: 38243 } has no permanent_uuid. Determining permanent_uuid...
I20260927 15:16:29.202767 8234 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.17.136.60" port: 38243 } has no permanent_uuid. Determining permanent_uuid...
I20260927 15:16:29.203421 8162 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:16:29.203181 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.60:38243 (local address 127.0.0.1:42180)
0927 15:16:29.203307 (+ 126us) negotiation.cc:107] Waiting for socket to connect
0927 15:16:29.203356 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.136.60:38243: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":42}
I20260927 15:16:29.203469 8237 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:16:29.203201 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.60:38243 (local address 127.0.0.1:42186)
0927 15:16:29.203351 (+ 150us) negotiation.cc:107] Waiting for socket to connect
0927 15:16:29.203416 (+ 65us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.136.60:38243: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":91}
W20260927 15:16:29.203742 8184 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.17.136.60:38243: connect: Connection refused (error 111)
I20260927 15:16:29.204396 8162 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:16:29.204160 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.60:38243 (local address 127.0.0.1:42190)
0927 15:16:29.204292 (+ 132us) negotiation.cc:107] Waiting for socket to connect
0927 15:16:29.204336 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.136.60:38243: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":73}
W20260927 15:16:29.204523 8159 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.17.136.60:38243: Network error: Client connection negotiation failed: client connection to 127.17.136.60:38243: connect: Connection refused (error 111)
I20260927 15:16:29.204691 8237 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:16:29.204297 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.60:38243 (local address 127.0.0.1:42204)
0927 15:16:29.204415 (+ 118us) negotiation.cc:107] Waiting for socket to connect
0927 15:16:29.204627 (+ 212us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.136.60:38243: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":71,"thread_start_us":76,"threads_started":1}
W20260927 15:16:29.204811 8234 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.17.136.60:38243: Network error: Client connection negotiation failed: client connection to 127.17.136.60:38243: connect: Connection refused (error 111)
I20260927 15:16:29.235661 8159 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.17.136.60" port: 38243 } attempt: 1
I20260927 15:16:29.236493 8162 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:16:29.236131 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.60:38243 (local address 127.0.0.1:42214)
0927 15:16:29.236303 (+ 172us) negotiation.cc:107] Waiting for socket to connect
0927 15:16:29.236378 (+ 75us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.136.60:38243: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":60}
I20260927 15:16:29.237246 8162 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:16:29.237014 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.60:38243 (local address 127.0.0.1:42226)
0927 15:16:29.237118 (+ 104us) negotiation.cc:107] Waiting for socket to connect
0927 15:16:29.237174 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.136.60:38243: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":36}
W20260927 15:16:29.237411 8159 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.17.136.60:38243: Network error: Client connection negotiation failed: client connection to 127.17.136.60:38243: connect: Connection refused (error 111)
I20260927 15:16:29.254051 8234 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.17.136.60" port: 38243 } attempt: 1
I20260927 15:16:29.254784 8237 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:16:29.254526 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.60:38243 (local address 127.0.0.1:42230)
0927 15:16:29.254659 (+ 133us) negotiation.cc:107] Waiting for socket to connect
0927 15:16:29.254716 (+ 57us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.136.60:38243: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":52}
I20260927 15:16:29.255442 8237 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:16:29.255243 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.60:38243 (local address 127.0.0.1:42232)
0927 15:16:29.255346 (+ 103us) negotiation.cc:107] Waiting for socket to connect
0927 15:16:29.255388 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.136.60:38243: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":23}
W20260927 15:16:29.255558 8234 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.17.136.60:38243: Network error: Client connection negotiation failed: client connection to 127.17.136.60:38243: connect: Connection refused (error 111)
W20260927 15:16:29.302879 8241 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260927 15:16:29.303208 8241 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260927 15:16:29.303258 8241 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260927 15:16:29.303314 8241 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260927 15:16:29.307117 8241 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260927 15:16:29.307164 8241 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260927 15:16:29.307181 8241 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260927 15:16:29.307195 8241 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260927 15:16:29.307214 8241 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260927 15:16:29.312249 8241 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.136.20:37181
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790521920546562-17952-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790521920546562-17952-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.17.136.62:41617,127.17.136.61:33721,127.17.136.60:38243
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790521920546562-17952-0/krb5kdc/kudu_127.17.136.60.keytab
--principal=kudu/127.17.136.60
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.136.60:38243
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790521920546562-17952-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.17.136.60
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8241
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790521920546562-17952-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 27 Sep 2026 14:27:13 UTC on ccycloud.quasar-psqrth.root.comops.site
build id 4676138
I20260927 15:16:29.312549 8159 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.17.136.60" port: 38243 } attempt: 2
I20260927 15:16:29.313246 8241 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260927 15:16:29.313308 8162 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:16:29.312990 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.60:38243 (local address 127.0.0.1:42246)
0927 15:16:29.313146 (+ 156us) negotiation.cc:107] Waiting for socket to connect
0927 15:16:29.313217 (+ 71us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.136.60:38243: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":53}
I20260927 15:16:29.313941 8162 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:16:29.313732 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.60:38243 (local address 127.0.0.1:42248)
0927 15:16:29.313825 (+ 93us) negotiation.cc:107] Waiting for socket to connect
0927 15:16:29.313875 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.136.60:38243: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":33}
W20260927 15:16:29.314098 8159 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.17.136.60:38243: Network error: Client connection negotiation failed: client connection to 127.17.136.60:38243: connect: Connection refused (error 111)
I20260927 15:16:29.314389 8241 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260927 15:16:29.322218 8248 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260927 15:16:29.322240 8249 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260927 15:16:29.322391 8241 server_base.cc:1034] running on GCE node
W20260927 15:16:29.322723 8251 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260927 15:16:29.323191 8241 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260927 15:16:29.323679 8234 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.17.136.60" port: 38243 } attempt: 2
I20260927 15:16:29.324285 8237 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:16:29.324065 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.60:38243 (local address 127.0.0.1:42262)
0927 15:16:29.324175 (+ 110us) negotiation.cc:107] Waiting for socket to connect
0927 15:16:29.324221 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.136.60:38243: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":41}
I20260927 15:16:29.324308 8241 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260927 15:16:29.324942 8237 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:16:29.324768 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.60:38243 (local address 127.0.0.1:42276)
0927 15:16:29.324845 (+ 77us) negotiation.cc:107] Waiting for socket to connect
0927 15:16:29.324886 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.136.60:38243: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":24}
W20260927 15:16:29.325060 8234 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.17.136.60:38243: Network error: Client connection negotiation failed: client connection to 127.17.136.60:38243: connect: Connection refused (error 111)
I20260927 15:16:29.325462 8241 hybrid_clock.cc:648] HybridClock initialized: now 1790522189325440 us; error 36 us; skew 500 ppm
Sep 27 15:16:29 dist-test-slave-5s2t krb5kdc[8078](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790522189, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.136.60@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260927 15:16:29.327937 8241 init.cc:377] Logged in from keytab as kudu/127.17.136.60@KRBTEST.COM (short username kudu)
I20260927 15:16:29.328724 8241 webserver.cc:460] Webserver started at http://127.17.136.60:33289/ using document root <none> and password file <none>
I20260927 15:16:29.329216 8241 fs_manager.cc:359] Metadata directory not provided
I20260927 15:16:29.329276 8241 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260927 15:16:29.329443 8241 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260927 15:16:29.331423 8241 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790521920546562-17952-0/minicluster-data/master-2/data/instance:
uuid: "4c17fcce7d9c4b5eac90178dc2681091"
format_stamp: "Formatted at 2026-09-27 15:16:29 on dist-test-slave-5s2t"
server_key: "aaf6df69a4eecdafeb4e9e33357083a9"
server_key_iv: "32ec8aecc6b7893ca36c22925d052725"
server_key_version: "encryptionkey@0"
I20260927 15:16:29.331938 8241 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790521920546562-17952-0/minicluster-data/master-2/wal/instance:
uuid: "4c17fcce7d9c4b5eac90178dc2681091"
format_stamp: "Formatted at 2026-09-27 15:16:29 on dist-test-slave-5s2t"
server_key: "aaf6df69a4eecdafeb4e9e33357083a9"
server_key_iv: "32ec8aecc6b7893ca36c22925d052725"
server_key_version: "encryptionkey@0"
I20260927 15:16:29.335243 8241 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.001s
I20260927 15:16:29.337462 8258 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260927 15:16:29.338582 8241 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260927 15:16:29.338686 8241 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790521920546562-17952-0/minicluster-data/master-2/data,/tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790521920546562-17952-0/minicluster-data/master-2/wal
uuid: "4c17fcce7d9c4b5eac90178dc2681091"
format_stamp: "Formatted at 2026-09-27 15:16:29 on dist-test-slave-5s2t"
server_key: "aaf6df69a4eecdafeb4e9e33357083a9"
server_key_iv: "32ec8aecc6b7893ca36c22925d052725"
server_key_version: "encryptionkey@0"
I20260927 15:16:29.338770 8241 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790521920546562-17952-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790521920546562-17952-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790521920546562-17952-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260927 15:16:29.352911 8241 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260927 15:16:29.355815 8241 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260927 15:16:29.355978 8241 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260927 15:16:29.362309 8241 rpc_server.cc:307] RPC server started. Bound to: 127.17.136.60:38243
I20260927 15:16:29.362560 8310 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.136.60:38243 every 8 connection(s)
I20260927 15:16:29.363209 8241 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790521920546562-17952-0/minicluster-data/master-2/data/info.pb
I20260927 15:16:29.365826 8311 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:16:29.369601 8311 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.17.136.62" port: 41617 } has no permanent_uuid. Determining permanent_uuid...
I20260927 15:16:29.372025 17952 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu as pid 8241
I20260927 15:16:29.372188 17952 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskiFOyeW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790521920546562-17952-0/minicluster-data/master-2/wal/instance
I20260927 15:16:29.372501 17952 external_mini_cluster.cc:1428] Setting key 80dcf5438ec4e785c164b4191f5aa983
Sep 27 15:16:29 dist-test-slave-5s2t krb5kdc[8078](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790522189, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.136.60@KRBTEST.COM for kudu/127.17.136.62@KRBTEST.COM
Sep 27 15:16:29 dist-test-slave-5s2t krb5kdc[8078](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790522188, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.136.60@KRBTEST.COM
I20260927 15:16:29.383551 8161 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:16:29.371472 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60076 (local address 127.17.136.62:41617)
0927 15:16:29.371612 (+ 140us) server_negotiation.cc:206] Beginning negotiation
0927 15:16:29.371616 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0927 15:16:29.372525 (+ 909us) server_negotiation.cc:407] Connection header received
0927 15:16:29.373589 (+ 1064us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:16:29.373593 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:16:29.373650 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:16:29.373732 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0927 15:16:29.374764 (+ 1032us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:16:29.375575 (+ 811us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:16:29.376799 (+ 1224us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:16:29.377060 (+ 261us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:16:29.377154 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:16:29.379738 (+ 2584us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0927 15:16:29.379742 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0927 15:16:29.379745 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0927 15:16:29.379775 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0927 15:16:29.381290 (+ 1515us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:16:29.381905 (+ 615us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:16:29.381909 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:16:29.381911 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:16:29.381993 (+ 82us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:16:29.382349 (+ 356us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:16:29.382351 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:16:29.382353 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:16:29.382584 (+ 231us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0927 15:16:29.382652 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0927 15:16:29.383232 (+ 580us) server_negotiation.cc:299] Negotiation successful
0927 15:16:29.383386 (+ 154us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260927 15:16:29.384408 8315 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:16:29.373164 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42282 (local address 127.17.136.60:38243)
0927 15:16:29.373461 (+ 297us) server_negotiation.cc:206] Beginning negotiation
0927 15:16:29.373470 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0927 15:16:29.373504 (+ 34us) server_negotiation.cc:407] Connection header received
0927 15:16:29.373655 (+ 151us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:16:29.373660 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:16:29.373878 (+ 218us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:16:29.374012 (+ 134us) server_negotiation.cc:226] Negotiated authn=SASL
0927 15:16:29.374840 (+ 828us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:16:29.375972 (+ 1132us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:16:29.376978 (+ 1006us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:16:29.377482 (+ 504us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:16:29.377565 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:16:29.380170 (+ 2605us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0927 15:16:29.380176 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0927 15:16:29.380190 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0927 15:16:29.380214 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0927 15:16:29.381818 (+ 1604us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:16:29.382345 (+ 527us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:16:29.382351 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:16:29.382352 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:16:29.382441 (+ 89us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:16:29.382697 (+ 256us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:16:29.382699 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:16:29.382700 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:16:29.382978 (+ 278us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0927 15:16:29.383135 (+ 157us) server_negotiation.cc:1035] Waiting for connection context
0927 15:16:29.383407 (+ 272us) server_negotiation.cc:299] Negotiation successful
0927 15:16:29.383769 (+ 362us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":126,"server-negotiator.queue_time_us":209,"spinlock_wait_cycles":3328,"thread_start_us":141,"threads_started":1}
I20260927 15:16:29.384419 8313 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:16:29.371860 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.62:41617 (local address 127.0.0.1:60076)
0927 15:16:29.372374 (+ 514us) negotiation.cc:107] Waiting for socket to connect
0927 15:16:29.372417 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0927 15:16:29.373362 (+ 945us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0927 15:16:29.373808 (+ 446us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0927 15:16:29.373815 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0927 15:16:29.374242 (+ 427us) client_negotiation.cc:189] Negotiated authn=SASL
0927 15:16:29.374613 (+ 371us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:16:29.374633 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:16:29.375676 (+ 1043us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:16:29.375679 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:16:29.376679 (+ 1000us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:16:29.376690 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:16:29.377195 (+ 505us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:16:29.377198 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:16:29.377367 (+ 169us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:16:29.377918 (+ 551us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0927 15:16:29.377940 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0927 15:16:29.379580 (+ 1640us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0927 15:16:29.381428 (+ 1848us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0927 15:16:29.381436 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0927 15:16:29.381444 (+ 8us) client_negotiation.cc:760] calling sasl_client_step()
0927 15:16:29.381804 (+ 360us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0927 15:16:29.382081 (+ 277us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0927 15:16:29.382085 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0927 15:16:29.382086 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0927 15:16:29.382268 (+ 182us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0927 15:16:29.382681 (+ 413us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0927 15:16:29.382688 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0927 15:16:29.382988 (+ 300us) client_negotiation.cc:769] Sending connection context
0927 15:16:29.383170 (+ 182us) client_negotiation.cc:240] Negotiation successful
0927 15:16:29.383546 (+ 376us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":312,"mutex_wait_us":5,"spinlock_wait_cycles":2304,"thread_start_us":146,"threads_started":1}
I20260927 15:16:29.385671 8311 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.17.136.61" port: 33721 } has no permanent_uuid. Determining permanent_uuid...
Sep 27 15:16:29 dist-test-slave-5s2t krb5kdc[8078](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790522189, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.136.60@KRBTEST.COM for kudu/127.17.136.61@KRBTEST.COM
Sep 27 15:16:29 dist-test-slave-5s2t krb5kdc[8078](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790522188, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.136.62@KRBTEST.COM
I20260927 15:16:29.394330 8313 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:16:29.386164 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.61:33721 (local address 127.0.0.1:43078)
0927 15:16:29.386319 (+ 155us) negotiation.cc:107] Waiting for socket to connect
0927 15:16:29.386335 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0927 15:16:29.386423 (+ 88us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0927 15:16:29.386819 (+ 396us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0927 15:16:29.386822 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0927 15:16:29.386976 (+ 154us) client_negotiation.cc:189] Negotiated authn=SASL
0927 15:16:29.387080 (+ 104us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:16:29.387087 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:16:29.387959 (+ 872us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:16:29.387962 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:16:29.388589 (+ 627us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:16:29.388599 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:16:29.389068 (+ 469us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:16:29.389072 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:16:29.389158 (+ 86us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:16:29.389601 (+ 443us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0927 15:16:29.389613 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0927 15:16:29.391004 (+ 1391us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0927 15:16:29.392930 (+ 1926us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0927 15:16:29.392932 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0927 15:16:29.392934 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0927 15:16:29.393124 (+ 190us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0927 15:16:29.393383 (+ 259us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0927 15:16:29.393385 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0927 15:16:29.393387 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0927 15:16:29.393470 (+ 83us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0927 15:16:29.393850 (+ 380us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0927 15:16:29.393853 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0927 15:16:29.393940 (+ 87us) client_negotiation.cc:769] Sending connection context
0927 15:16:29.394023 (+ 83us) client_negotiation.cc:240] Negotiation successful
0927 15:16:29.394158 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":93}
I20260927 15:16:29.394392 8239 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:16:29.386398 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43078 (local address 127.17.136.61:33721)
0927 15:16:29.386516 (+ 118us) server_negotiation.cc:206] Beginning negotiation
0927 15:16:29.386519 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0927 15:16:29.386531 (+ 12us) server_negotiation.cc:407] Connection header received
0927 15:16:29.386575 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:16:29.386577 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:16:29.386626 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:16:29.386701 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0927 15:16:29.387192 (+ 491us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:16:29.387854 (+ 662us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:16:29.388705 (+ 851us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:16:29.388961 (+ 256us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:16:29.389061 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:16:29.391143 (+ 2082us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0927 15:16:29.391147 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0927 15:16:29.391149 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0927 15:16:29.391174 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0927 15:16:29.392823 (+ 1649us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:16:29.393211 (+ 388us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:16:29.393214 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:16:29.393216 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:16:29.393303 (+ 87us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:16:29.393545 (+ 242us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:16:29.393548 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:16:29.393549 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:16:29.393759 (+ 210us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0927 15:16:29.393836 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0927 15:16:29.394101 (+ 265us) server_negotiation.cc:299] Negotiation successful
0927 15:16:29.394238 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260927 15:16:29.395072 8161 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:16:29.386713 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60082 (local address 127.17.136.62:41617)
0927 15:16:29.386824 (+ 111us) server_negotiation.cc:206] Beginning negotiation
0927 15:16:29.386827 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0927 15:16:29.386840 (+ 13us) server_negotiation.cc:407] Connection header received
0927 15:16:29.386914 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:16:29.386916 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:16:29.386951 (+ 35us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:16:29.387015 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0927 15:16:29.387643 (+ 628us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:16:29.388244 (+ 601us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:16:29.389090 (+ 846us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:16:29.389339 (+ 249us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:16:29.389425 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:16:29.391715 (+ 2290us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0927 15:16:29.391719 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0927 15:16:29.391722 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0927 15:16:29.391747 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0927 15:16:29.393142 (+ 1395us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:16:29.393523 (+ 381us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:16:29.393526 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:16:29.393528 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:16:29.393610 (+ 82us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:16:29.393844 (+ 234us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:16:29.393847 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:16:29.393849 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:16:29.394048 (+ 199us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0927 15:16:29.394280 (+ 232us) server_negotiation.cc:1035] Waiting for connection context
0927 15:16:29.394811 (+ 531us) server_negotiation.cc:299] Negotiation successful
0927 15:16:29.394926 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260927 15:16:29.395171 8311 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.17.136.60" port: 38243 } has no permanent_uuid. Determining permanent_uuid...
Sep 27 15:16:29 dist-test-slave-5s2t krb5kdc[8078](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790522189, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.136.60@KRBTEST.COM for kudu/127.17.136.60@KRBTEST.COM
Sep 27 15:16:29 dist-test-slave-5s2t krb5kdc[8078](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790522188, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.136.61@KRBTEST.COM
I20260927 15:16:29.402486 8315 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:16:29.395689 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42290 (local address 127.17.136.60:38243)
0927 15:16:29.395792 (+ 103us) server_negotiation.cc:206] Beginning negotiation
0927 15:16:29.395796 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0927 15:16:29.395809 (+ 13us) server_negotiation.cc:407] Connection header received
0927 15:16:29.395882 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:16:29.395885 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:16:29.395926 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:16:29.395988 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0927 15:16:29.396361 (+ 373us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:16:29.397111 (+ 750us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:16:29.397815 (+ 704us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:16:29.398038 (+ 223us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:16:29.398105 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:16:29.399852 (+ 1747us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0927 15:16:29.399856 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0927 15:16:29.399858 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0927 15:16:29.399877 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0927 15:16:29.401132 (+ 1255us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:16:29.401492 (+ 360us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:16:29.401494 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:16:29.401495 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:16:29.401584 (+ 89us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:16:29.401812 (+ 228us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:16:29.401815 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:16:29.401817 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:16:29.402002 (+ 185us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0927 15:16:29.402098 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0927 15:16:29.402275 (+ 177us) server_negotiation.cc:299] Negotiation successful
0927 15:16:29.402376 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260927 15:16:29.402490 8313 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:16:29.395638 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.60:38243 (local address 127.0.0.1:42290)
0927 15:16:29.395734 (+ 96us) negotiation.cc:107] Waiting for socket to connect
0927 15:16:29.395748 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0927 15:16:29.395822 (+ 74us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0927 15:16:29.396024 (+ 202us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0927 15:16:29.396026 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0927 15:16:29.396171 (+ 145us) client_negotiation.cc:189] Negotiated authn=SASL
0927 15:16:29.396240 (+ 69us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:16:29.396244 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:16:29.397225 (+ 981us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:16:29.397228 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:16:29.397727 (+ 499us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:16:29.397735 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:16:29.398126 (+ 391us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:16:29.398130 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:16:29.398210 (+ 80us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:16:29.398625 (+ 415us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0927 15:16:29.398638 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0927 15:16:29.399743 (+ 1105us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0927 15:16:29.401233 (+ 1490us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0927 15:16:29.401235 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0927 15:16:29.401237 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0927 15:16:29.401399 (+ 162us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0927 15:16:29.401665 (+ 266us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0927 15:16:29.401667 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0927 15:16:29.401668 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0927 15:16:29.401736 (+ 68us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0927 15:16:29.402080 (+ 344us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0927 15:16:29.402081 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0927 15:16:29.402147 (+ 66us) client_negotiation.cc:769] Sending connection context
0927 15:16:29.402214 (+ 67us) client_negotiation.cc:240] Negotiation successful
0927 15:16:29.402309 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":29}
I20260927 15:16:29.403831 8239 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:16:29.396308 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43082 (local address 127.17.136.61:33721)
0927 15:16:29.396402 (+ 94us) server_negotiation.cc:206] Beginning negotiation
0927 15:16:29.396406 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0927 15:16:29.396428 (+ 22us) server_negotiation.cc:407] Connection header received
0927 15:16:29.396528 (+ 100us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:16:29.396531 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:16:29.396563 (+ 32us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:16:29.396619 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0927 15:16:29.397226 (+ 607us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:16:29.397681 (+ 455us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:16:29.398498 (+ 817us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:16:29.398720 (+ 222us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:16:29.398798 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:16:29.400836 (+ 2038us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0927 15:16:29.400840 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0927 15:16:29.400842 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0927 15:16:29.400865 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0927 15:16:29.402239 (+ 1374us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:16:29.402675 (+ 436us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:16:29.402678 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:16:29.402680 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:16:29.402760 (+ 80us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:16:29.403034 (+ 274us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:16:29.403038 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:16:29.403040 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:16:29.403271 (+ 231us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0927 15:16:29.403473 (+ 202us) server_negotiation.cc:1035] Waiting for connection context
0927 15:16:29.403585 (+ 112us) server_negotiation.cc:299] Negotiation successful
0927 15:16:29.403696 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260927 15:16:29.405882 8311 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4c17fcce7d9c4b5eac90178dc2681091: Bootstrap starting.
I20260927 15:16:29.406932 17952 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260927 15:16:29.408432 8311 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 4c17fcce7d9c4b5eac90178dc2681091: Neither blocks nor log segments found. Creating new log.
I20260927 15:16:29.409313 8311 log.cc:824] T 00000000000000000000000000000000 P 4c17fcce7d9c4b5eac90178dc2681091: Log is configured to *not* fsync() on all Append() calls
I20260927 15:16:29.408062 8133 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "00000000000000000000000000000000"
dest_uuid: "7923fcae5a5b418887faab0c13e95ed3"
from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:60082
I20260927 15:16:29.411505 8311 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4c17fcce7d9c4b5eac90178dc2681091: No bootstrap required, opened a new log
I20260927 15:16:29.413245 8159 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.17.136.60" port: 38243 } attempt: 3
I20260927 15:16:29.415374 8311 raft_consensus.cc:348] T 00000000000000000000000000000000 P 4c17fcce7d9c4b5eac90178dc2681091 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7923fcae5a5b418887faab0c13e95ed3" member_type: VOTER last_known_addr { host: "127.17.136.62" port: 41617 } } peers { permanent_uuid: "160255bc44d74054823075b9fc6982e9" member_type: VOTER last_known_addr { host: "127.17.136.61" port: 33721 } } peers { permanent_uuid: "4c17fcce7d9c4b5eac90178dc2681091" member_type: VOTER last_known_addr { host: "127.17.136.60" port: 38243 } }
I20260927 15:16:29.415622 8311 raft_consensus.cc:729] T 00000000000000000000000000000000 P 4c17fcce7d9c4b5eac90178dc2681091 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c17fcce7d9c4b5eac90178dc2681091, State: Initialized, Role: FOLLOWER
I20260927 15:16:29.415951 8311 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4c17fcce7d9c4b5eac90178dc2681091 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7923fcae5a5b418887faab0c13e95ed3" member_type: VOTER last_known_addr { host: "127.17.136.62" port: 41617 } } peers { permanent_uuid: "160255bc44d74054823075b9fc6982e9" member_type: VOTER last_known_addr { host: "127.17.136.61" port: 33721 } } peers { permanent_uuid: "4c17fcce7d9c4b5eac90178dc2681091" member_type: VOTER last_known_addr { host: "127.17.136.60" port: 38243 } }
I20260927 15:16:29.416196 8234 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.17.136.60" port: 38243 } attempt: 3
I20260927 15:16:29.417229 8317 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4c17fcce7d9c4b5eac90178dc2681091 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7923fcae5a5b418887faab0c13e95ed3" member_type: VOTER last_known_addr { host: "127.17.136.62" port: 41617 } } peers { permanent_uuid: "160255bc44d74054823075b9fc6982e9" member_type: VOTER last_known_addr { host: "127.17.136.61" port: 33721 } } peers { permanent_uuid: "4c17fcce7d9c4b5eac90178dc2681091" member_type: VOTER last_known_addr { host: "127.17.136.60" port: 38243 } } }
I20260927 15:16:29.417372 8317 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4c17fcce7d9c4b5eac90178dc2681091 [sys.catalog]: This master's current role is: FOLLOWER
I20260927 15:16:29.417639 8311 sys_catalog.cc:564] T 00000000000000000000000000000000 P 4c17fcce7d9c4b5eac90178dc2681091 [sys.catalog]: configured and running, proceeding with master startup.
Sep 27 15:16:29 dist-test-slave-5s2t krb5kdc[8078](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790522188, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.136.62@KRBTEST.COM for kudu/127.17.136.60@KRBTEST.COM
I20260927 15:16:29.421902 8162 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:16:29.413616 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.60:38243 (local address 127.0.0.1:42294)
0927 15:16:29.413794 (+ 178us) negotiation.cc:107] Waiting for socket to connect
0927 15:16:29.413808 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0927 15:16:29.413898 (+ 90us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0927 15:16:29.414107 (+ 209us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0927 15:16:29.414110 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0927 15:16:29.414278 (+ 168us) client_negotiation.cc:189] Negotiated authn=SASL
0927 15:16:29.414358 (+ 80us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:16:29.414363 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:16:29.415056 (+ 693us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:16:29.415059 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:16:29.415641 (+ 582us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:16:29.415651 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:16:29.416081 (+ 430us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:16:29.416085 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:16:29.416177 (+ 92us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:16:29.416641 (+ 464us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0927 15:16:29.416655 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0927 15:16:29.418131 (+ 1476us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0927 15:16:29.420308 (+ 2177us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0927 15:16:29.420311 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0927 15:16:29.420313 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0927 15:16:29.420551 (+ 238us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0927 15:16:29.420875 (+ 324us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0927 15:16:29.420878 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0927 15:16:29.420880 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0927 15:16:29.420965 (+ 85us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0927 15:16:29.421389 (+ 424us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0927 15:16:29.421392 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0927 15:16:29.421488 (+ 96us) client_negotiation.cc:769] Sending connection context
0927 15:16:29.421569 (+ 81us) client_negotiation.cc:240] Negotiation successful
0927 15:16:29.421718 (+ 149us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":105}
Sep 27 15:16:29 dist-test-slave-5s2t krb5kdc[8078](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790522189, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.136.61@KRBTEST.COM for kudu/127.17.136.60@KRBTEST.COM
I20260927 15:16:29.422758 8315 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:16:29.413712 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42294 (local address 127.17.136.60:38243)
0927 15:16:29.413818 (+ 106us) server_negotiation.cc:206] Beginning negotiation
0927 15:16:29.413822 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0927 15:16:29.413852 (+ 30us) server_negotiation.cc:407] Connection header received
0927 15:16:29.413978 (+ 126us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:16:29.413981 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:16:29.414018 (+ 37us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:16:29.414080 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0927 15:16:29.414454 (+ 374us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:16:29.414934 (+ 480us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:16:29.415763 (+ 829us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:16:29.415966 (+ 203us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:16:29.416045 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:16:29.418283 (+ 2238us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0927 15:16:29.418287 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0927 15:16:29.418290 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0927 15:16:29.418314 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0927 15:16:29.420192 (+ 1878us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:16:29.420671 (+ 479us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:16:29.420674 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:16:29.420676 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:16:29.420752 (+ 76us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:16:29.421048 (+ 296us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:16:29.421051 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:16:29.421053 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:16:29.421276 (+ 223us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0927 15:16:29.422382 (+ 1106us) server_negotiation.cc:1035] Waiting for connection context
0927 15:16:29.422452 (+ 70us) server_negotiation.cc:299] Negotiation successful
0927 15:16:29.422552 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
W20260927 15:16:29.422588 8329 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 4c17fcce7d9c4b5eac90178dc2681091: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260927 15:16:29.423403 8329 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260927 15:16:29.421465 8241 master_runner.cc:186] Error getting master registration for 127.17.136.62:41617: OK, instance_id { permanent_uuid: "7923fcae5a5b418887faab0c13e95ed3" instance_seqno: 1790522188949911 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260927 15:16:29.425567 8159 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7923fcae5a5b418887faab0c13e95ed3: Bootstrap starting.
I20260927 15:16:29.425673 8241 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260927 15:16:29.425807 8237 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:16:29.416577 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.136.60:38243 (local address 127.0.0.1:42310)
0927 15:16:29.416693 (+ 116us) negotiation.cc:107] Waiting for socket to connect
0927 15:16:29.416707 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0927 15:16:29.416786 (+ 79us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0927 15:16:29.417285 (+ 499us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0927 15:16:29.417288 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0927 15:16:29.417454 (+ 166us) client_negotiation.cc:189] Negotiated authn=SASL
0927 15:16:29.417572 (+ 118us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:16:29.417580 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:16:29.418682 (+ 1102us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:16:29.418685 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:16:29.419471 (+ 786us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0927 15:16:29.419483 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0927 15:16:29.420411 (+ 928us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0927 15:16:29.420415 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0927 15:16:29.420501 (+ 86us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:16:29.421095 (+ 594us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0927 15:16:29.421109 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0927 15:16:29.422452 (+ 1343us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0927 15:16:29.424288 (+ 1836us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0927 15:16:29.424292 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0927 15:16:29.424294 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0927 15:16:29.424528 (+ 234us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0927 15:16:29.424837 (+ 309us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0927 15:16:29.424840 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0927 15:16:29.424842 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0927 15:16:29.424932 (+ 90us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0927 15:16:29.425304 (+ 372us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0927 15:16:29.425307 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0927 15:16:29.425419 (+ 112us) client_negotiation.cc:769] Sending connection context
0927 15:16:29.425517 (+ 98us) client_negotiation.cc:240] Negotiation successful
0927 15:16:29.425655 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":35}
I20260927 15:16:29.426142 8318 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:16:29.416810 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42310 (local address 127.17.136.60:38243)
0927 15:16:29.417053 (+ 243us) server_negotiation.cc:206] Beginning negotiation
0927 15:16:29.417061 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0927 15:16:29.417074 (+ 13us) server_negotiation.cc:407] Connection header received
0927 15:16:29.417106 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:16:29.417109 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:16:29.417146 (+ 37us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:16:29.417679 (+ 533us) server_negotiation.cc:226] Negotiated authn=SASL
0927 15:16:29.417800 (+ 121us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:16:29.418565 (+ 765us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:16:29.419615 (+ 1050us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:16:29.420298 (+ 683us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:16:29.420698 (+ 400us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:16:29.422613 (+ 1915us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0927 15:16:29.422617 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0927 15:16:29.422620 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0927 15:16:29.422642 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0927 15:16:29.424184 (+ 1542us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:16:29.424640 (+ 456us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:16:29.424643 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:16:29.424644 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:16:29.424740 (+ 96us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:16:29.425019 (+ 279us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:16:29.425022 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:16:29.425024 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:16:29.425213 (+ 189us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0927 15:16:29.425301 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0927 15:16:29.425642 (+ 341us) server_negotiation.cc:299] Negotiation successful
0927 15:16:29.425817 (+ 175us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":181,"spinlock_wait_cycles":9472,"thread_start_us":80,"threads_started":1}
I20260927 15:16:29.428411 8159 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 7923fcae5a5b418887faab0c13e95ed3: Neither blocks nor log segments found. Creating new log.
I20260927 15:16:29.428857 8234 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 160255bc44d74054823075b9fc6982e9: Bootstrap starting.
I20260927 15:16:29.429276 8159 log.cc:824] T 00000000000000000000000000000000 P 7923fcae5a5b418887faab0c13e95ed3: Log is configured to *not* fsync() on all Append() calls
I20260927 15:16:29.431265 8159 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7923fcae5a5b418887faab0c13e95ed3: No bootstrap required, opened a new log
I20260927 15:16:29.431313 8234 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 160255bc44d74054823075b9fc6982e9: Neither blocks nor log segments found. Creating new log.
I20260927 15:16:29.432132 8234 log.cc:824] T 00000000000000000000000000000000 P 160255bc44d74054823075b9fc6982e9: Log is configured to *not* fsync() on all Append() calls
I20260927 15:16:29.434119 8159 raft_consensus.cc:348] T 00000000000000000000000000000000 P 7923fcae5a5b418887faab0c13e95ed3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7923fcae5a5b418887faab0c13e95ed3" member_type: VOTER last_known_addr { host: "127.17.136.62" port: 41617 } } peers { permanent_uuid: "160255bc44d74054823075b9fc6982e9" member_type: VOTER last_known_addr { host: "127.17.136.61" port: 33721 } } peers { permanent_uuid: "4c17fcce7d9c4b5eac90178dc2681091" member_type: VOTER last_known_addr { host: "127.17.136.60" port: 38243 } }
I20260927 15:16:29.434324 8159 raft_consensus.cc:729] T 00000000000000000000000000000000 P 7923fcae5a5b418887faab0c13e95ed3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7923fcae5a5b418887faab0c13e95ed3, State: Initialized, Role: FOLLOWER
I20260927 15:16:29.434644 8159 consensus_queue.cc:260] T 00000000000000000000000000000000 P 7923fcae5a5b418887faab0c13e95ed3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7923fcae5a5b418887faab0c13e95ed3" member_type: VOTER last_known_addr { host: "127.17.136.62" port: 41617 } } peers { permanent_uuid: "160255bc44d74054823075b9fc6982e9" member_type: VOTER last_known_addr { host: "127.17.136.61" port: 33721 } } peers { permanent_uuid: "4c17fcce7d9c4b5eac90178dc2681091" member_type: VOTER last_known_addr { host: "127.17.136.60" port: 38243 } }
I20260927 15:16:29.435098 8333 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7923fcae5a5b418887faab0c13e95ed3 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7923fcae5a5b418887faab0c13e95ed3" member_type: VOTER last_known_addr { host: "127.17.136.62" port: 41617 } } peers { permanent_uuid: "160255bc44d74054823075b9fc6982e9" member_type: VOTER last_known_addr { host: "127.17.136.61" port: 33721 } } peers { permanent_uuid: "4c17fcce7d9c4b5eac90178dc2681091" member_type: VOTER last_known_addr { host: "127.17.136.60" port: 38243 } } }
I20260927 15:16:29.435236 8333 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7923fcae5a5b418887faab0c13e95ed3 [sys.catalog]: This master's current role is: FOLLOWER
I20260927 15:16:29.435900 8159 sys_catalog.cc:564] T 00000000000000000000000000000000 P 7923fcae5a5b418887faab0c13e95ed3 [sys.catalog]: configured and running, proceeding with master startup.
I20260927 15:16:29.435979 8133 raft_consensus.cc:482] T 00000000000000000000000000000000 P 7923fcae5a5b418887faab0c13e95ed3 [term 0 FOLLOWER]: Starting forced leader election (received explicit request)
I20260927 15:16:29.436079 8133 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 7923fcae5a5b418887faab0c13e95ed3 [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:16:29.437234 8133 raft_consensus.cc:504] T 00000000000000000000000000000000 P 7923fcae5a5b418887faab0c13e95ed3 [term 1 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7923fcae5a5b418887faab0c13e95ed3" member_type: VOTER last_known_addr { host: "127.17.136.62" port: 41617 } } peers { permanent_uuid: "160255bc44d74054823075b9fc6982e9" member_type: VOTER last_known_addr { host: "127.17.136.61" port: 33721 } } peers { permanent_uuid: "4c17fcce7d9c4b5eac90178dc2681091" member_type: VOTER last_known_addr { host: "127.17.136.60" port: 38243 } }
I20260927 15:16:29.439312 8285 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "7923fcae5a5b418887faab0c13e95ed3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "4c17fcce7d9c4b5eac90178dc2681091"
I20260927 15:16:29.439548 8285 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 4c17fcce7d9c4b5eac90178dc2681091 [term 0 FOLLOWER]: Advancing to term 1
W20260927 15:16:29.440780 8344 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 7923fcae5a5b418887faab0c13e95ed3: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
I20260927 15:16:29.440837 8285 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 4c17fcce7d9c4b5eac90178dc2681091 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7923fcae5a5b418887faab0c13e95ed3 in term 1.
W20260927 15:16:29.440965 8344 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260927 15:16:29.441248 8109 leader_election.cc:302] T 00000000000000000000000000000000 P 7923fcae5a5b418887faab0c13e95ed3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4c17fcce7d9c4b5eac90178dc2681091, 7923fcae5a5b418887faab0c13e95ed3; no voters:
I20260927 15:16:29.441509 8333 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 7923fcae5a5b418887faab0c13e95ed3 [term 1 FOLLOWER]: Leader election won for term 1
I20260927 15:16:29.441701 8333 raft_consensus.cc:686] T 00000000000000000000000000000000 P 7923fcae5a5b418887faab0c13e95ed3 [term 1 LEADER]: Becoming Leader. State: Replica: 7923fcae5a5b418887faab0c13e95ed3, State: Running, Role: LEADER
I20260927 15:16:29.442001 8333 consensus_queue.cc:237] T 00000000000000000000000000000000 P 7923fcae5a5b418887faab0c13e95ed3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7923fcae5a5b418887faab0c13e95ed3" member_type: VOTER last_known_addr { host: "127.17.136.62" port: 41617 } } peers { permanent_uuid: "160255bc44d74054823075b9fc6982e9" member_type: VOTER last_known_addr { host: "127.17.136.61" port: 33721 } } peers { permanent_uuid: "4c17fcce7d9c4b5eac90178dc2681091" member_type: VOTER last_known_addr { host: "127.17.136.60" port: 38243 } }
I20260927 15:16:29.440667 8091 master_runner.cc:186] Error getting master registration for 127.17.136.61:33721: OK, instance_id { permanent_uuid: "160255bc44d74054823075b9fc6982e9" instance_seqno: 1790522189166063 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260927 15:16:29.443709 8091 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260927 15:16:29.443665 8333 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7923fcae5a5b418887faab0c13e95ed3 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7923fcae5a5b418887faab0c13e95ed3. Latest consensus state: current_term: 1 leader_uuid: "7923fcae5a5b418887faab0c13e95ed3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7923fcae5a5b418887faab0c13e95ed3" member_type: VOTER last_known_addr { host: "127.17.136.62" port: 41617 } } peers { permanent_uuid: "160255bc44d74054823075b9fc6982e9" member_type: VOTER last_known_addr { host: "127.17.136.61" port: 33721 } } peers { permanent_uuid: "4c17fcce7d9c4b5eac90178dc2681091" member_type: VOTER last_known_addr { host: "127.17.136.60" port: 38243 } } }
I20260927 15:16:29.443756 8234 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 160255bc44d74054823075b9fc6982e9: No bootstrap required, opened a new log
I20260927 15:16:29.443769 8333 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7923fcae5a5b418887faab0c13e95ed3 [sys.catalog]: This master's current role is: LEADER
I20260927 15:16:29.444024 8133 leader_election.cc:288] T 00000000000000000000000000000000 P 7923fcae5a5b418887faab0c13e95ed3 [CANDIDATE]: Term 1 election: Requested vote from peers 160255bc44d74054823075b9fc6982e9 (127.17.136.61:33721), 4c17fcce7d9c4b5eac90178dc2681091 (127.17.136.60:38243)
I20260927 15:16:29.444358 8348 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260927 15:16:29.445201 8348 catalog_manager.cc:1484] Initializing Kudu cluster ID...
W20260927 15:16:29.446633 8112 tablet.cc:2369] T 00000000000000000000000000000000 P 7923fcae5a5b418887faab0c13e95ed3: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260927 15:16:29.447703 8234 raft_consensus.cc:348] T 00000000000000000000000000000000 P 160255bc44d74054823075b9fc6982e9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7923fcae5a5b418887faab0c13e95ed3" member_type: VOTER last_known_addr { host: "127.17.136.62" port: 41617 } } peers { permanent_uuid: "160255bc44d74054823075b9fc6982e9" member_type: VOTER last_known_addr { host: "127.17.136.61" port: 33721 } } peers { permanent_uuid: "4c17fcce7d9c4b5eac90178dc2681091" member_type: VOTER last_known_addr { host: "127.17.136.60" port: 38243 } }
I20260927 15:16:29.447978 8234 raft_consensus.cc:729] T 00000000000000000000000000000000 P 160255bc44d74054823075b9fc6982e9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 160255bc44d74054823075b9fc6982e9, State: Initialized, Role: FOLLOWER
I20260927 15:16:29.448320 8234 consensus_queue.cc:260] T 00000000000000000000000000000000 P 160255bc44d74054823075b9fc6982e9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7923fcae5a5b418887faab0c13e95ed3" member_type: VOTER last_known_addr { host: "127.17.136.62" port: 41617 } } peers { permanent_uuid: "160255bc44d74054823075b9fc6982e9" member_type: VOTER last_known_addr { host: "127.17.136.61" port: 33721 } } peers { permanent_uuid: "4c17fcce7d9c4b5eac90178dc2681091" member_type: VOTER last_known_addr { host: "127.17.136.60" port: 38243 } }
I20260927 15:16:29.448880 8354 sys_catalog.cc:455] T 00000000000000000000000000000000 P 160255bc44d74054823075b9fc6982e9 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7923fcae5a5b418887faab0c13e95ed3" member_type: VOTER last_known_addr { host: "127.17.136.62" port: 41617 } } peers { permanent_uuid: "160255bc44d74054823075b9fc6982e9" member_type: VOTER last_known_addr { host: "127.17.136.61" port: 33721 } } peers { permanent_uuid: "4c17fcce7d9c4b5eac90178dc2681091" member_type: VOTER last_known_addr { host: "127.17.136.60" port: 38243 } } }
I20260927 15:16:29.449087 8354 sys_catalog.cc:458] T 00000000000000000000000000000000 P 160255bc44d74054823075b9fc6982e9 [sys.catalog]: This master's current role is: FOLLOWER
I20260927 15:16:29.450090 8234 sys_catalog.cc:564] T 00000000000000000000000000000000 P 160255bc44d74054823075b9fc6982e9 [sys.catalog]: configured and running, proceeding with master startup.
I20260927 15:16:29.450141 8208 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "7923fcae5a5b418887faab0c13e95ed3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "160255bc44d74054823075b9fc6982e9"
I20260927 15:16:29.450353 8208 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 160255bc44d74054823075b9fc6982e9 [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:16:29.451453 8208 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 160255bc44d74054823075b9fc6982e9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7923fcae5a5b418887faab0c13e95ed3 in term 1.
I20260927 15:16:29.452116 8285 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 4c17fcce7d9c4b5eac90178dc2681091 [term 1 FOLLOWER]: Refusing update from remote peer 7923fcae5a5b418887faab0c13e95ed3: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260927 15:16:29.452684 8207 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 160255bc44d74054823075b9fc6982e9 [term 1 FOLLOWER]: Refusing update from remote peer 7923fcae5a5b418887faab0c13e95ed3: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260927 15:16:29.453804 8333 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 7923fcae5a5b418887faab0c13e95ed3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "160255bc44d74054823075b9fc6982e9" member_type: VOTER last_known_addr { host: "127.17.136.61" port: 33721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260927 15:16:29.454211 8333 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 7923fcae5a5b418887faab0c13e95ed3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4c17fcce7d9c4b5eac90178dc2681091" member_type: VOTER last_known_addr { host: "127.17.136.60" port: 38243 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260927 15:16:29.455435 8365 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 160255bc44d74054823075b9fc6982e9: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260927 15:16:29.455543 8365 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260927 15:16:29.458662 8317 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4c17fcce7d9c4b5eac90178dc2681091 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7923fcae5a5b418887faab0c13e95ed3. Latest consensus state: current_term: 1 leader_uuid: "7923fcae5a5b418887faab0c13e95ed3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7923fcae5a5b418887faab0c13e95ed3" member_type: VOTER last_known_addr { host: "127.17.136.62" port: 41617 } } peers { permanent_uuid: "160255bc44d74054823075b9fc6982e9" member_type: VOTER last_known_addr { host: "127.17.136.61" port: 33721 } } peers { permanent_uuid: "4c17fcce7d9c4b5eac90178dc2681091" member_type: VOTER last_known_addr { host: "127.17.136.60" port: 38243 } } }
I20260927 15:16:29.458758 8317 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4c17fcce7d9c4b5eac90178dc2681091 [sys.catalog]: This master's current role is: FOLLOWER
I20260927 15:16:29.461933 8354 sys_catalog.cc:455] T 00000000000000000000000000000000 P 160255bc44d74054823075b9fc6982e9 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7923fcae5a5b418887faab0c13e95ed3. Latest consensus state: current_term: 1 leader_uuid: "7923fcae5a5b418887faab0c13e95ed3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7923fcae5a5b418887faab0c13e95ed3" member_type: VOTER last_known_addr { host: "127.17.136.62" port: 41617 } } peers { permanent_uuid: "160255bc44d74054823075b9fc6982e9" member_type: VOTER last_known_addr { host: "127.17.136.61" port: 33721 } } peers { permanent_uuid: "4c17fcce7d9c4b5eac90178dc2681091" member_type: VOTER last_known_addr { host: "127.17.136.60" port: 38243 } } }
I20260927 15:16:29.462030 8354 sys_catalog.cc:458] T 00000000000000000000000000000000 P 160255bc44d74054823075b9fc6982e9 [sys.catalog]: This master's current role is: FOLLOWER
I20260927 15:16:29.467782 8346 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7923fcae5a5b418887faab0c13e95ed3 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "7923fcae5a5b418887faab0c13e95ed3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7923fcae5a5b418887faab0c13e95ed3" member_type: VOTER last_known_addr { host: "127.17.136.62" port: 41617 } } peers { permanent_uuid: "160255bc44d74054823075b9fc6982e9" member_type: VOTER last_known_addr { host: "127.17.136.61" port: 33721 } } peers { permanent_uuid: "4c17fcce7d9c4b5eac90178dc2681091" member_type: VOTER last_known_addr { host: "127.17.136.60" port: 38243 } } }
I20260927 15:16:29.467893 8346 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7923fcae5a5b418887faab0c13e95ed3 [sys.catalog]: This master's current role is: LEADER
I20260927 15:16:29.468014 8353 mvcc.cc:205] Tried to move back new op lower bound from 7333978887982874624 to 7333978887957622784. Current Snapshot: MvccSnapshot[applied={T|T < 7333978887982874624}]
I20260927 15:16:29.469300 8239 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:16:29.460035 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43086 (local address 127.17.136.61:33721)
0927 15:16:29.460130 (+ 95us) server_negotiation.cc:206] Beginning negotiation
0927 15:16:29.460134 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0927 15:16:29.460680 (+ 546us) server_negotiation.cc:407] Connection header received
0927 15:16:29.460868 (+ 188us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:16:29.460871 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:16:29.460915 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:16:29.460963 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0927 15:16:29.461923 (+ 960us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:16:29.462637 (+ 714us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:16:29.463823 (+ 1186us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:16:29.464128 (+ 305us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:16:29.464198 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:16:29.465873 (+ 1675us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0927 15:16:29.465876 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0927 15:16:29.465879 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0927 15:16:29.465902 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0927 15:16:29.467443 (+ 1541us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:16:29.467899 (+ 456us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:16:29.467903 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:16:29.467905 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:16:29.468003 (+ 98us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:16:29.468384 (+ 381us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:16:29.468387 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:16:29.468389 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:16:29.468605 (+ 216us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0927 15:16:29.468703 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0927 15:16:29.469052 (+ 349us) server_negotiation.cc:299] Negotiation successful
0927 15:16:29.469160 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260927 15:16:29.469384 8354 sys_catalog.cc:455] T 00000000000000000000000000000000 P 160255bc44d74054823075b9fc6982e9 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "7923fcae5a5b418887faab0c13e95ed3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7923fcae5a5b418887faab0c13e95ed3" member_type: VOTER last_known_addr { host: "127.17.136.62" port: 41617 } } peers { permanent_uuid: "160255bc44d74054823075b9fc6982e9" member_type: VOTER last_known_addr { host: "127.17.136.61" port: 33721 } } peers { permanent_uuid: "4c17fcce7d9c4b5eac90178dc2681091" member_type: VOTER last_known_addr { host: "127.17.136.60" port: 38243 } } }
I20260927 15:16:29.469496 8354 sys_catalog.cc:458] T 00000000000000000000000000000000 P 160255bc44d74054823075b9fc6982e9 [sys.catalog]: This master's current role is: FOLLOWER
I20260927 15:16:29.469784 8370 mvcc.cc:205] Tried to move back new op lower bound from 7333978887982874624 to 7333978887957622784. Current Snapshot: MvccSnapshot[applied={T|T < 7333978887982874624}]
I20260927 15:16:29.470424 8333 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7923fcae5a5b418887faab0c13e95ed3 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "7923fcae5a5b418887faab0c13e95ed3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7923fcae5a5b418887faab0c13e95ed3" member_type: VOTER last_known_addr { host: "127.17.136.62" port: 41617 } } peers { permanent_uuid: "160255bc44d74054823075b9fc6982e9" member_type: VOTER last_known_addr { host: "127.17.136.61" port: 33721 } } peers { permanent_uuid: "4c17fcce7d9c4b5eac90178dc2681091" member_type: VOTER last_known_addr { host: "127.17.136.60" port: 38243 } } }
I20260927 15:16:29.470520 8333 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7923fcae5a5b418887faab0c13e95ed3 [sys.catalog]: This master's current role is: LEADER
I20260927 15:16:29.471601 8317 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4c17fcce7d9c4b5eac90178dc2681091 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "7923fcae5a5b418887faab0c13e95ed3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7923fcae5a5b418887faab0c13e95ed3" member_type: VOTER last_known_addr { host: "127.17.136.62" port: 41617 } } peers { permanent_uuid: "160255bc44d74054823075b9fc6982e9" member_type: VOTER last_known_addr { host: "127.17.136.61" port: 33721 } } peers { permanent_uuid: "4c17fcce7d9c4b5eac90178dc2681091" member_type: VOTER last_known_addr { host: "127.17.136.60" port: 38243 } } }
I20260927 15:16:29.471717 8317 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4c17fcce7d9c4b5eac90178dc2681091 [sys.catalog]: This master's current role is: FOLLOWER
I20260927 15:16:29.475448 8348 catalog_manager.cc:1347] Generated new cluster ID: 03fe0c891ff946e5ad4b0bb9ea148284
I20260927 15:16:29.475508 8348 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260927 15:16:29.487300 8318 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:16:29.460712 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42322 (local address 127.17.136.60:38243)
0927 15:16:29.460808 (+ 96us) server_negotiation.cc:206] Beginning negotiation
0927 15:16:29.460812 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0927 15:16:29.471156 (+ 10344us) server_negotiation.cc:407] Connection header received
0927 15:16:29.471342 (+ 186us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:16:29.471344 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:16:29.471394 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:16:29.471455 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0927 15:16:29.472309 (+ 854us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:16:29.473057 (+ 748us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:16:29.474105 (+ 1048us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:16:29.474437 (+ 332us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:16:29.474510 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:16:29.480487 (+ 5977us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0927 15:16:29.480491 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0927 15:16:29.480494 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0927 15:16:29.480522 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0927 15:16:29.482135 (+ 1613us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:16:29.482619 (+ 484us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:16:29.482623 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:16:29.482625 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:16:29.482709 (+ 84us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:16:29.485116 (+ 2407us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:16:29.485120 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:16:29.485122 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:16:29.485331 (+ 209us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0927 15:16:29.485457 (+ 126us) server_negotiation.cc:1035] Waiting for connection context
0927 15:16:29.486991 (+ 1534us) server_negotiation.cc:299] Negotiation successful
0927 15:16:29.487114 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260927 15:16:29.490255 8161 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:16:29.459621 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60088 (local address 127.17.136.62:41617)
0927 15:16:29.459725 (+ 104us) server_negotiation.cc:206] Beginning negotiation
0927 15:16:29.459729 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0927 15:16:29.467489 (+ 7760us) server_negotiation.cc:407] Connection header received
0927 15:16:29.475526 (+ 8037us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:16:29.475529 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:16:29.475577 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:16:29.475623 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0927 15:16:29.476603 (+ 980us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:16:29.477331 (+ 728us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:16:29.478362 (+ 1031us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:16:29.478679 (+ 317us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:16:29.478739 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:16:29.483016 (+ 4277us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0927 15:16:29.483020 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0927 15:16:29.483022 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0927 15:16:29.483048 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0927 15:16:29.484647 (+ 1599us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:16:29.488900 (+ 4253us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:16:29.488904 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:16:29.488906 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:16:29.488996 (+ 90us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0927 15:16:29.489353 (+ 357us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0927 15:16:29.489357 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0927 15:16:29.489359 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0927 15:16:29.489569 (+ 210us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0927 15:16:29.489668 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0927 15:16:29.489978 (+ 310us) server_negotiation.cc:299] Negotiation successful
0927 15:16:29.490097 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260927 15:16:29.499346 8348 catalog_manager.cc:1370] Generated new certificate authority record
I20260927 15:16:29.500715 8348 catalog_manager.cc:1504] Loading token signing keys...
I20260927 15:16:29.510502 8348 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 7923fcae5a5b418887faab0c13e95ed3: Generated new TSK 0
I20260927 15:16:29.512553 8348 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260927 15:16:29.543912 8239 negotiation.cc:337] Failed RPC negotiation. Trace:
0927 15:16:29.540681 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43098 (local address 127.17.136.61:33721)
0927 15:16:29.540809 (+ 128us) server_negotiation.cc:206] Beginning negotiation
0927 15:16:29.540813 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0927 15:16:29.542038 (+ 1225us) server_negotiation.cc:407] Connection header received
0927 15:16:29.542864 (+ 826us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:16:29.542868 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:16:29.542921 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:16:29.542973 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0927 15:16:29.543779 (+ 806us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:43098: BlockingRecv error: recv got EOF from 127.0.0.1:43098 (error 108)
Metrics: {"server-negotiator.queue_time_us":50}
W20260927 15:16:29.545265 8318 negotiation.cc:337] Failed RPC negotiation. Trace:
0927 15:16:29.541378 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42326 (local address 127.17.136.60:38243)
0927 15:16:29.541498 (+ 120us) server_negotiation.cc:206] Beginning negotiation
0927 15:16:29.541502 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0927 15:16:29.544265 (+ 2763us) server_negotiation.cc:407] Connection header received
0927 15:16:29.544568 (+ 303us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:16:29.544571 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:16:29.544618 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:16:29.544665 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0927 15:16:29.545153 (+ 488us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:42326: BlockingRecv error: recv got EOF from 127.0.0.1:42326 (error 108)
Metrics: {"server-negotiator.queue_time_us":44}
W20260927 15:16:29.546391 8161 negotiation.cc:337] Failed RPC negotiation. Trace:
0927 15:16:29.542321 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60094 (local address 127.17.136.62:41617)
0927 15:16:29.542428 (+ 107us) server_negotiation.cc:206] Beginning negotiation
0927 15:16:29.542443 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0927 15:16:29.545594 (+ 3151us) server_negotiation.cc:407] Connection header received
0927 15:16:29.545740 (+ 146us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:16:29.545743 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:16:29.545789 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:16:29.545833 (+ 44us) server_negotiation.cc:226] Negotiated authn=SASL
0927 15:16:29.546267 (+ 434us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:60094: BlockingRecv error: recv got EOF from 127.0.0.1:60094 (error 108)
Metrics: {"server-negotiator.queue_time_us":42}
W20260927 15:16:29.550621 8239 negotiation.cc:337] Failed RPC negotiation. Trace:
0927 15:16:29.549187 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43106 (local address 127.17.136.61:33721)
0927 15:16:29.549278 (+ 91us) server_negotiation.cc:206] Beginning negotiation
0927 15:16:29.549282 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0927 15:16:29.549728 (+ 446us) server_negotiation.cc:407] Connection header received
0927 15:16:29.549921 (+ 193us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:16:29.549924 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:16:29.550000 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:16:29.550048 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0927 15:16:29.550527 (+ 479us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:43106: BlockingRecv error: recv got EOF from 127.0.0.1:43106 (error 108)
Metrics: {"server-negotiator.queue_time_us":34}
W20260927 15:16:29.555327 8239 negotiation.cc:337] Failed RPC negotiation. Trace:
0927 15:16:29.553963 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43112 (local address 127.17.136.61:33721)
0927 15:16:29.554056 (+ 93us) server_negotiation.cc:206] Beginning negotiation
0927 15:16:29.554060 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0927 15:16:29.554545 (+ 485us) server_negotiation.cc:407] Connection header received
0927 15:16:29.554700 (+ 155us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:16:29.554703 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:16:29.554747 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:16:29.554791 (+ 44us) server_negotiation.cc:226] Negotiated authn=SASL
0927 15:16:29.555210 (+ 419us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:43112: BlockingRecv error: recv got EOF from 127.0.0.1:43112 (error 108)
Metrics: {"server-negotiator.queue_time_us":38}
W20260927 15:16:29.560452 8239 negotiation.cc:337] Failed RPC negotiation. Trace:
0927 15:16:29.559036 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43126 (local address 127.17.136.61:33721)
0927 15:16:29.559121 (+ 85us) server_negotiation.cc:206] Beginning negotiation
0927 15:16:29.559124 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0927 15:16:29.559674 (+ 550us) server_negotiation.cc:407] Connection header received
0927 15:16:29.559837 (+ 163us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:16:29.559840 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:16:29.559884 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:16:29.559929 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0927 15:16:29.560359 (+ 430us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:43126: BlockingRecv error: recv got EOF from 127.0.0.1:43126 (error 108)
Metrics: {"server-negotiator.queue_time_us":32}
W20260927 15:16:29.567673 8239 negotiation.cc:337] Failed RPC negotiation. Trace:
0927 15:16:29.566229 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43132 (local address 127.17.136.61:33721)
0927 15:16:29.566365 (+ 136us) server_negotiation.cc:206] Beginning negotiation
0927 15:16:29.566369 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0927 15:16:29.566847 (+ 478us) server_negotiation.cc:407] Connection header received
0927 15:16:29.567009 (+ 162us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:16:29.567012 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:16:29.567057 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:16:29.567102 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0927 15:16:29.567584 (+ 482us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:43132: BlockingRecv error: recv got EOF from 127.0.0.1:43132 (error 108)
Metrics: {"server-negotiator.queue_time_us":75}
W20260927 15:16:29.579340 8239 negotiation.cc:337] Failed RPC negotiation. Trace:
0927 15:16:29.577652 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43134 (local address 127.17.136.61:33721)
0927 15:16:29.577771 (+ 119us) server_negotiation.cc:206] Beginning negotiation
0927 15:16:29.577776 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0927 15:16:29.578331 (+ 555us) server_negotiation.cc:407] Connection header received
0927 15:16:29.578552 (+ 221us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:16:29.578556 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:16:29.578610 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:16:29.578670 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0927 15:16:29.579198 (+ 528us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:43134: BlockingRecv error: recv got EOF from 127.0.0.1:43134 (error 108)
Metrics: {"server-negotiator.queue_time_us":52}
W20260927 15:16:29.599328 8239 negotiation.cc:337] Failed RPC negotiation. Trace:
0927 15:16:29.597636 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43140 (local address 127.17.136.61:33721)
0927 15:16:29.597752 (+ 116us) server_negotiation.cc:206] Beginning negotiation
0927 15:16:29.597757 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0927 15:16:29.598334 (+ 577us) server_negotiation.cc:407] Connection header received
0927 15:16:29.598550 (+ 216us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:16:29.598554 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:16:29.598611 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:16:29.598662 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0927 15:16:29.599169 (+ 507us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:43140: BlockingRecv error: recv got EOF from 127.0.0.1:43140 (error 108)
Metrics: {"server-negotiator.queue_time_us":45}
W20260927 15:16:29.634711 8239 negotiation.cc:337] Failed RPC negotiation. Trace:
0927 15:16:29.633465 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43156 (local address 127.17.136.61:33721)
0927 15:16:29.633599 (+ 134us) server_negotiation.cc:206] Beginning negotiation
0927 15:16:29.633604 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0927 15:16:29.633871 (+ 267us) server_negotiation.cc:407] Connection header received
0927 15:16:29.634002 (+ 131us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:16:29.634005 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:16:29.634078 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:16:29.634145 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0927 15:16:29.634592 (+ 447us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:43156: BlockingRecv error: recv got EOF from 127.0.0.1:43156 (error 108)
Metrics: {"server-negotiator.queue_time_us":46}
W20260927 15:16:29.701980 8239 negotiation.cc:337] Failed RPC negotiation. Trace:
0927 15:16:29.700822 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43164 (local address 127.17.136.61:33721)
0927 15:16:29.700959 (+ 137us) server_negotiation.cc:206] Beginning negotiation
0927 15:16:29.700964 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0927 15:16:29.701158 (+ 194us) server_negotiation.cc:407] Connection header received
0927 15:16:29.701301 (+ 143us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:16:29.701303 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:16:29.701350 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:16:29.701431 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0927 15:16:29.701861 (+ 430us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:43164: BlockingRecv error: recv got EOF from 127.0.0.1:43164 (error 108)
Metrics: {"server-negotiator.queue_time_us":50}
W20260927 15:16:29.833005 8239 negotiation.cc:337] Failed RPC negotiation. Trace:
0927 15:16:29.831887 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54494 (local address 127.17.136.61:33721)
0927 15:16:29.832049 (+ 162us) server_negotiation.cc:206] Beginning negotiation
0927 15:16:29.832054 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0927 15:16:29.832159 (+ 105us) server_negotiation.cc:407] Connection header received
0927 15:16:29.832305 (+ 146us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:16:29.832308 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:16:29.832355 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:16:29.832423 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0927 15:16:29.832884 (+ 461us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:54494: BlockingRecv error: recv got EOF from 127.0.0.1:54494 (error 108)
Metrics: {"server-negotiator.queue_time_us":45}
W20260927 15:16:30.091922 8239 negotiation.cc:337] Failed RPC negotiation. Trace:
0927 15:16:30.090940 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54502 (local address 127.17.136.61:33721)
0927 15:16:30.091085 (+ 145us) server_negotiation.cc:206] Beginning negotiation
0927 15:16:30.091089 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0927 15:16:30.091154 (+ 65us) server_negotiation.cc:407] Connection header received
0927 15:16:30.091291 (+ 137us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:16:30.091294 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:16:30.091343 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:16:30.091423 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0927 15:16:30.091803 (+ 380us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:54502: BlockingRecv error: recv got EOF from 127.0.0.1:54502 (error 108)
Metrics: {"server-negotiator.queue_time_us":45}
I20260927 15:16:30.424640 8329 catalog_manager.cc:1259] Loaded cluster ID: 03fe0c891ff946e5ad4b0bb9ea148284
I20260927 15:16:30.424718 8329 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 4c17fcce7d9c4b5eac90178dc2681091: loading cluster ID for follower catalog manager: success
I20260927 15:16:30.426338 8329 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 4c17fcce7d9c4b5eac90178dc2681091: acquiring CA information for follower catalog manager: success
I20260927 15:16:30.427464 8329 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 4c17fcce7d9c4b5eac90178dc2681091: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260927 15:16:30.456754 8365 catalog_manager.cc:1259] Loaded cluster ID: 03fe0c891ff946e5ad4b0bb9ea148284
I20260927 15:16:30.456835 8365 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 160255bc44d74054823075b9fc6982e9: loading cluster ID for follower catalog manager: success
I20260927 15:16:30.458431 8365 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 160255bc44d74054823075b9fc6982e9: acquiring CA information for follower catalog manager: success
I20260927 15:16:30.459601 8365 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 160255bc44d74054823075b9fc6982e9: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260927 15:16:30.609432 8442 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:16:30.605869 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54512 (local address 127.17.136.61:33721)
0927 15:16:30.606118 (+ 249us) server_negotiation.cc:206] Beginning negotiation
0927 15:16:30.606122 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0927 15:16:30.606144 (+ 22us) server_negotiation.cc:407] Connection header received
0927 15:16:30.606294 (+ 150us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:16:30.606297 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:16:30.606416 (+ 119us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:16:30.606517 (+ 101us) server_negotiation.cc:226] Negotiated authn=TOKEN
0927 15:16:30.606722 (+ 205us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:16:30.607241 (+ 519us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:16:30.608029 (+ 788us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:16:30.608253 (+ 224us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:16:30.608320 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:16:30.608574 (+ 254us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0927 15:16:30.608985 (+ 411us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0927 15:16:30.609122 (+ 137us) server_negotiation.cc:1035] Waiting for connection context
0927 15:16:30.609224 (+ 102us) server_negotiation.cc:299] Negotiation successful
0927 15:16:30.609282 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":150,"thread_start_us":59,"threads_started":1}
I20260927 15:16:30.615209 8448 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:16:30.612087 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48750 (local address 127.17.136.60:38243)
0927 15:16:30.612336 (+ 249us) server_negotiation.cc:206] Beginning negotiation
0927 15:16:30.612340 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0927 15:16:30.612352 (+ 12us) server_negotiation.cc:407] Connection header received
0927 15:16:30.612423 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:16:30.612425 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:16:30.612531 (+ 106us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:16:30.612622 (+ 91us) server_negotiation.cc:226] Negotiated authn=TOKEN
0927 15:16:30.612788 (+ 166us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:16:30.613291 (+ 503us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:16:30.614030 (+ 739us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:16:30.614236 (+ 206us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:16:30.614301 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:16:30.614497 (+ 196us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0927 15:16:30.614886 (+ 389us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0927 15:16:30.614969 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0927 15:16:30.614996 (+ 27us) server_negotiation.cc:299] Negotiation successful
0927 15:16:30.615062 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":178,"thread_start_us":94,"threads_started":1}
I20260927 15:16:30.621598 8448 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:16:30.618115 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48752 (local address 127.17.136.60:38243)
0927 15:16:30.618204 (+ 89us) server_negotiation.cc:206] Beginning negotiation
0927 15:16:30.618208 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0927 15:16:30.618420 (+ 212us) server_negotiation.cc:407] Connection header received
0927 15:16:30.618516 (+ 96us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:16:30.618519 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:16:30.618572 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:16:30.618634 (+ 62us) server_negotiation.cc:226] Negotiated authn=TOKEN
0927 15:16:30.618844 (+ 210us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:16:30.619511 (+ 667us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:16:30.620529 (+ 1018us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:16:30.620839 (+ 310us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:16:30.620926 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:16:30.621129 (+ 203us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0927 15:16:30.621197 (+ 68us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0927 15:16:30.621253 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0927 15:16:30.621413 (+ 160us) server_negotiation.cc:299] Negotiation successful
0927 15:16:30.621465 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260927 15:16:30.621999 8442 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:16:30.617715 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54526 (local address 127.17.136.61:33721)
0927 15:16:30.617817 (+ 102us) server_negotiation.cc:206] Beginning negotiation
0927 15:16:30.617820 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0927 15:16:30.618241 (+ 421us) server_negotiation.cc:407] Connection header received
0927 15:16:30.618376 (+ 135us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:16:30.618379 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:16:30.618447 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:16:30.618525 (+ 78us) server_negotiation.cc:226] Negotiated authn=TOKEN
0927 15:16:30.619116 (+ 591us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:16:30.619891 (+ 775us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:16:30.620830 (+ 939us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:16:30.621143 (+ 313us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:16:30.621229 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:16:30.621463 (+ 234us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0927 15:16:30.621536 (+ 73us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0927 15:16:30.621578 (+ 42us) server_negotiation.cc:1035] Waiting for connection context
0927 15:16:30.621831 (+ 253us) server_negotiation.cc:299] Negotiation successful
0927 15:16:30.621883 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260927 15:16:30.622327 8454 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0927 15:16:30.617749 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36952 (local address 127.17.136.62:41617)
0927 15:16:30.618017 (+ 268us) server_negotiation.cc:206] Beginning negotiation
0927 15:16:30.618022 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0927 15:16:30.618273 (+ 251us) server_negotiation.cc:407] Connection header received
0927 15:16:30.618538 (+ 265us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0927 15:16:30.618541 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0927 15:16:30.618700 (+ 159us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0927 15:16:30.618789 (+ 89us) server_negotiation.cc:226] Negotiated authn=TOKEN
0927 15:16:30.618998 (+ 209us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:16:30.619845 (+ 847us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:16:30.620864 (+ 1019us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0927 15:16:30.621174 (+ 310us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0927 15:16:30.621269 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0927 15:16:30.621640 (+ 371us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0927 15:16:30.621965 (+ 325us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0927 15:16:30.622063 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0927 15:16:30.622131 (+ 68us) server_negotiation.cc:299] Negotiation successful
0927 15:16:30.622189 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":156,"thread_start_us":65,"threads_started":1}
I20260927 15:16:30.628479 17952 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu with pid 8091
I20260927 15:16:30.633740 17952 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu with pid 8166
I20260927 15:16:30.638336 17952 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskiFOyeW/build/debug/bin/kudu with pid 8241
2026-09-27T15:16:30Z chronyd exiting
[ OK ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/1 (2917 ms)
[----------] 2 tests from ConnectToFollowerMasterTest (5863 ms total)
[----------] Global test environment tear-down
[==========] 56 tests from 4 test suites ran. (270085 ms total)
[ PASSED ] 55 tests.
[ FAILED ] 1 test, listed below:
[ FAILED ] SecurityITest.TestJwtMiniCluster
1 FAILED TEST